Kubernetes Worker

  • By Canonical Kubernetes
Channel Revision Published Runs on
latest/stable 218 17 Apr 2024
Ubuntu 22.04 Ubuntu 20.04
latest/candidate 218 15 Apr 2024
Ubuntu 22.04 Ubuntu 20.04
latest/beta 221 20 Apr 2024
Ubuntu 22.04 Ubuntu 20.04
latest/edge 215 09 Mar 2024
Ubuntu 22.04 Ubuntu 20.04
1.30/beta 221 20 Apr 2024
Ubuntu 22.04 Ubuntu 20.04
1.30/edge 215 13 Mar 2024
Ubuntu 22.04 Ubuntu 20.04
1.29/stable 218 17 Apr 2024
Ubuntu 22.04 Ubuntu 20.04
1.29/candidate 218 15 Apr 2024
Ubuntu 22.04 Ubuntu 20.04
1.29/beta 215 17 Apr 2024
Ubuntu 22.04 Ubuntu 20.04
1.29/edge 206 05 Mar 2024
Ubuntu 22.04 Ubuntu 20.04
1.28/stable 134 07 Nov 2023
Ubuntu 22.04 Ubuntu 20.04
1.28/candidate 134 01 Nov 2023
Ubuntu 22.04 Ubuntu 20.04
1.28/beta 123 18 Aug 2023
Ubuntu 22.04 Ubuntu 20.04
1.28/edge 125 21 Aug 2023
Ubuntu 22.04 Ubuntu 20.04
1.27/stable 112 12 Jun 2023
Ubuntu 22.04 Ubuntu 20.04
1.27/candidate 112 12 Jun 2023
Ubuntu 22.04 Ubuntu 20.04
1.27/beta 106 10 Apr 2023
Ubuntu 22.04 Ubuntu 20.04
1.27/edge 107 10 Apr 2023
Ubuntu 22.04 Ubuntu 20.04
1.26/stable 92 27 Feb 2023
Ubuntu 22.04 Ubuntu 20.04
1.26/candidate 92 25 Feb 2023
Ubuntu 22.04 Ubuntu 20.04
1.26/beta 76 09 Apr 2023
Ubuntu 22.04 Ubuntu 20.04
1.26/edge 76 22 Nov 2022
Ubuntu 22.04 Ubuntu 20.04
1.25/stable 77 01 Dec 2022
Ubuntu 22.04 Ubuntu 20.04 Ubuntu 18.04
1.25/candidate 77 30 Nov 2022
Ubuntu 22.04 Ubuntu 20.04 Ubuntu 18.04
1.25/beta 78 01 Dec 2022
Ubuntu 22.04 Ubuntu 20.04
1.25/edge 57 09 Sep 2022
Ubuntu 22.04 Ubuntu 20.04 Ubuntu 18.04
1.24/stable 44 04 Aug 2022
Ubuntu 22.04 Ubuntu 20.04 Ubuntu 18.04
1.24/candidate 44 02 Aug 2022
Ubuntu 22.04 Ubuntu 20.04 Ubuntu 18.04
1.24/beta 27 03 May 2022
Ubuntu 20.04 Ubuntu 18.04 Ubuntu 16.04
1.24/edge 42 28 Jul 2022
Ubuntu 22.04 Ubuntu 20.04 Ubuntu 18.04
1.23/beta 11 22 Mar 2022
Ubuntu 20.04 Ubuntu 18.04 Ubuntu 16.04
1.23/edge 7 24 Feb 2022
Ubuntu 20.04 Ubuntu 18.04 Ubuntu 16.04
juju deploy kubernetes-worker
Show information

Platform:

Ubuntu
22.04 20.04

This charm deploys a container runtime and the Kubernetes worker applications: kubelet, and kube-proxy.

In order for this charm to be useful, it should be deployed with its companion charm kubernetes-control-plane and linked with an SDN-Plugin and a container runtime such as containerd.

This charm is part of the Charmed Kubernetes bundle bundle which can be deployed with a single command::

juju deploy charmed-kubernetes

For more information about Charmed Kubernetes see the overview documentation

Scale out

To add additional compute capacity to your Kubernetes workers, you may juju add-unit kubernetes-worker to scale the cluster. The new units will automatically join any related kubernetes-master, and enlist themselves as ready once the deployment is complete.

Snap Configuration

The Kubernetes resources used by this charm are snap packages. When not specified during deployment, these resources come from the public store. By default, the snapd daemon will refresh all snaps installed from the store four (4) times per day. A charm configuration option is provided for operators to control this refresh frequency.

Examples:

refresh kubernetes-worker snaps every tuesday
juju config kubernetes-worker snapd_refresh="tue"
refresh snaps at 11pm on the last (5th) friday of the month
juju config kubernetes-worker snapd_refresh="fri5,23:00"
delay the refresh as long as possible
juju config kubernetes-worker snapd_refresh="max"
use the system default refresh timer
juju config kubernetes-worker snapd_refresh=""

Configuration

This charm supports some configuration options to set up a Kubernetes cluster that works in your environment.

For some specific Kubernetes service configuration tasks, please also see the section on configuring K8s services. Please also see the [kubernetes-master charm configuration][charm-kubernetes-master] for other settings relating to Kubernetes services.

Configuring K8s services

IPVS (IP Virtual Server)

This requires configuration of both the kubernetes-control-plane and kubernetes-worker charms. Please see the configuration section on the kubernetes-control-plane page.

Configuring kubelet

Each worker runs the node agent, kubelet with a set of arguments and configuration set by this charm. In some cases it may be desirable to add options or arguments, for which the charm provides two mechanisms

kubelet-extra-args for command line options. kubelet-extra-config for configuration.

The definitive reference for kubelet is the upstream documentation.

HugePages

HugePages are a standard memory management feature of the Linux kernel to decrease overhead for processes which consume large amounts of memory.

Kubernetes includes support for using HugePages with pods (see the upstream documentation).

To use HugePages in your pods with Charmed Kubernetes, it is necessary to update the configuration for the workers:

  1. Fetch the current ‘sysctl’ configuration from the worker:

    juju config kubernetes-worker sysctl
    

    This should return a string of config options, e.g.:

    { net.ipv4.conf.all.forwarding : 1, net.ipv4.neigh.default.gc_thresh1 : 128, net.ipv4.neigh.default.gc_thresh2 : 28672, net.ipv4.neigh.default.gc_thresh3 : 32768, net.ipv6.neigh.default.gc_thresh1 : 128, net.ipv6.neigh.default.gc_thresh2 : 28672, net.ipv6.neigh.default.gc_thresh3 : 32768, fs.inotify.max_user_instances : 8192, fs.inotify.max_user_watches: 1048576 }
    
  2. The config option for HugePages is vm.nr_hugepages. To add this configuration, you should append it to the string and set the whole configuration. For example, for 100 2Mi pages:

    juju config kubernetes-worker sysctl="{ net.ipv4.conf.all.forwarding : 1, net.ipv4.neigh.default.gc_thresh1 : 128, net.ipv4.neigh.default.gc_thresh2 : 28672, net.ipv4.neigh.default.gc_thresh3 : 32768, net.ipv6.neigh.default.gc_thresh1 : 128, net.ipv6.neigh.default.gc_thresh2 : 28672, net.ipv6.neigh.default.gc_thresh3 : 32768, fs.inotify.max_user_instances : 8192, fs.inotify.max_user_watches: 1048576, vm.nr_hugepages: 100}"
    
  3. HugePages can now be consumed via container level resource requirements using the resource name hugepages-<size>.

    For example:

    apiVersion: v1
    kind: Pod
    metadata:
      name: hugepages-test
    spec:
      containers:
      - image: ubuntu:latest
        command:
        - sleep
        - inf
        name: example
        volumeMounts:
        - mountPath: /hugepages
          name: hugepage
        resources:
          limits:
            hugepages-2Mi: 100Mi
            memory: 100Mi
          requests:
            memory: 100Mi
      volumes:
      - name: hugepage
        emptyDir:
          medium: HugePages
    

    Huge page usage in a namespace can be managed with ResourceQuota, similar to other compute resources.

  4. To verify, you can exec into the pod and check the /proc/meminfo.

    kubectl exec hugepage-test cat /proc/meminfo | grep HugePages_