Версия

-   kubernetes1.27-1.27.7-alt1

Дистрибутивы

-   ALT Server 10.1, обновлённый до Sisyphus.

Шаги воспроизведения

Выполнить следующие действия:

    # apt-get install -y kubernetes1.27-kubeadm kubernetes1.27-kubelet kubernetes1.27-crio cri-tools1.27
    # cp /etc/cni/net.d/100-crio-bridge.conflist.sample /etc/cni/net.d/100-crio-bridge.conflist
    # sed -i '/swap/d' /etc/fstab && reboot

После перезагрузки выполнить на каждой машине:

    # systemctl enable --now crio kubelet && sleep 5; systemctl status crio kubelet --no-pager -l

Ожидаемый результат: сервисы запущены успешно.

Фактический результат: сервис kubelet выходит со статусом FAILURE:

    ● kubelet.service - Kubernetes Kubelet Server
         Loaded: loaded (/lib/systemd/system/kubelet.service; enabled; preset: disabled)
        Drop-In: /etc/systemd/system/kubelet.service.d
                 └─kubeadm.conf
         Active: activating (auto-restart) (Result: exit-code) since Sun 2023-11-05 17:12:35 MSK; 4s ago
           Docs: https://kubernetes.io/docs/concepts/overview/components/#kubelet
                 https://kubernetes.io/docs/reference/generated/kubelet/
        Process: 3432 ExecStart=/usr/bin/kubelet $KUBELET_KUBECONFIG_ARGS $KUBELET_SYSTEM_PODS_ARGS $KUBELET_NETWORK_ARGS $KUBELET_DNS_ARGS $KUBELET_AUTHZ_ARGS $KUBELET_EXTRA_ARGS $KUBELET_CRI_ARGS (code=exited, status=1/FAILURE)
       Main PID: 3432 (code=exited, status=1/FAILURE)
            CPU: 406ms

    ноя 05 17:12:35 server-10-1-x86-64-20231105.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'.

В логах характерная ошибка
("command failed" err="failed to parse kubelet flag: unknown flag: --container-runtime")
{{collapse

    ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
    ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
    ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
    ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
    ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
    ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
    ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: E1105 17:12:56.569962    3457 run.go:74] "command failed" err="failed to parse kubelet flag: unknown flag: --container-runtime"
    ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE
    ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'.

Related:

-   https://github.com/kubernetes/minikube/issues/16117
-   https://github.com/kubernetes/minikube/issues/16112