loadbalancers (metallb) unreachable from host

[jeusdi]

I've created a k3d cluster using this configuration file:

apiVersion: k3d.io/v1alpha4
kind: Simple
metadata:
  name: kafka-streams
servers: 1
agents: 2
network: kafka-streams
ports:
  - port: 8000:32080
    nodeFilters:
      - server:0:direct
  - port: 8443:32443
    nodeFilters:
      - server:0:direct
  - port: 9000:32090
    nodeFilters:
      - server:0:direct
  - port: 20017:30017
    nodeFilters:
      - server:0:direct
  - port: 20018:30018
    nodeFilters:
      - server:0:direct
  - port: 9094:32094
    nodeFilters:
      - server:0:direct
registries:
  config: |
    mirrors:
      "registry.localhost:5000":
        endpoint:
          - http://host.k3d.internal:5000
options:
  k3d:
    wait: true
    timeout: "60s"
    disableLoadbalancer: true
    disableImageVolume: false
    disableRollback: true
  k3s:
    extraArgs:
      - arg: '--disable=traefik,servicelb'
        nodeFilters:
          - server:*
  kubeconfig:
    updateDefaultKubeconfig: true
    switchCurrentContext: true

After that, I installed metallb using helm chart.

$ helm install metallb metallb/metallb

Here ip address pool manifest:

apiVersion: metallb.io/v1beta1
kind: IPAddressPool
metadata:
  name: docker-k3d
spec:
  addresses:
  - 172.24.0.10-172.24.255.255

Here kafka-streams docker network:

[
    {
        "Name": "kafka-streams",
        "Id": "f337231c2216cfed61f49a6b80b4fda924cc332efdcc831c7ca613181e4ba525",
        "Created": "2023-03-01T10:18:46.912972199+01:00",
        "Scope": "local",
        "Driver": "bridge",
        "EnableIPv6": false,
        "IPAM": {
            "Driver": "default",
            "Options": null,
            "Config": [
                {
                    "Subnet": "172.24.0.0/16",
                    "Gateway": "172.24.0.1"
                }
            ]
        },
        "Internal": false,
        "Attachable": false,
        "Ingress": false,
        "ConfigFrom": {
            "Network": ""
        },
        "ConfigOnly": false,
        "Containers": {
            "c88ef42481a55353d9d67f74d304c43a8c48c01d1a2349c8b0bf2e4d785b8a44": {
                "Name": "k3d-kafka-streams-server-0",
                "EndpointID": "ce60b693664b38c8dd3cb649d22a14abef32315a7fe9cf7088898045051dcf57",
                "MacAddress": "02:42:ac:18:00:03",
                "IPv4Address": "172.24.0.3/16",
                "IPv6Address": ""
            },
            "ce4baf249f3559d3702b82770df7a088082c4d4bb69b2a9333132ef49416b0ff": {
                "Name": "k3d-kafka-streams-agent-1",
                "EndpointID": "c5b0a2653c1707286035b08922a92986a5b655ce39c344695309d7e14841adec",
                "MacAddress": "02:42:ac:18:00:02",
                "IPv4Address": "172.24.0.2/16",
                "IPv6Address": ""
            },
            "d8836b2aae35eca015b7fddc87ea39838f97f43c3e7a2693d185a71fd7a11c10": {
                "Name": "k3d-kafka-streams-agent-0",
                "EndpointID": "54cc8f1e052473fdf847017a70e5ed1826da1fddab22f52370344c5abb8bb625",
                "MacAddress": "02:42:ac:18:00:04",
                "IPv4Address": "172.24.0.4/16",
                "IPv6Address": ""
            }
        },
        "Options": {
            "com.docker.network.bridge.enable_ip_masquerade": "true"
        },
        "Labels": {
            "app": "k3d"
        }
    }
]

I'm able to reach 172.24.0.[2-4] ips from my host:

ping 172.24.0.2 
PING 172.24.0.2 (172.24.0.2) 56(84) bytes of data.
64 bytes from 172.24.0.2: icmp_seq=1 ttl=64 time=0.068 ms
64 bytes from 172.24.0.2: icmp_seq=2 ttl=64 time=0.056 ms

Here you can see my LoadBalancer service:

$ kubectl get svc -l "app.kubernetes.io/name=kafka,app.kubernetes.io/instance=kafka,app.kubernetes.io/component=kafka,pod" -w 
NAME               TYPE           CLUSTER-IP      EXTERNAL-IP   PORT(S)          AGE
kafka-0-external   LoadBalancer   10.43.101.121   172.24.0.10   9094:32094/TCP   30h

As you can see, 172.24.0.10 is assigned.

Nevertheless, I'm not able to reach it from my host:

ping 172.24.0.10                                                                                                                                 
PING 172.24.0.10 (172.24.0.10) 56(84) bytes of data.
From 172.24.0.1 icmp_seq=1 Destination Host Unreachable
From 172.24.0.1 icmp_seq=2 Destination Host Unreachable
From 172.24.0.1 icmp_seq=3 Destination Host Unreachable

I've realized that it's trying to reach 172.24.0.10 from 172.24.0.1.

Any ideas?