48340 2023-11-05 17:28:05 +0300 failed to parse kubelet flag: unknown flag: --container-runtime при старте kubelet 2024-03-15 13:49:18 +0300 1 1 4 Development Sisyphus kubernetes1.27 unstable x86_64 Linux NEW P5 normal --- 1 alimektor shaba shaba varaksaaa qa-sisyphus oldest_to_newest 236456 0 alimektor 2023-11-05 17:28:05 +0300 Версия - kubernetes1.27-1.27.7-alt1 Дистрибутивы - ALT Server 10.1, обновлённый до Sisyphus. Шаги воспроизведения Выполнить следующие действия: # apt-get install -y kubernetes1.27-kubeadm kubernetes1.27-kubelet kubernetes1.27-crio cri-tools1.27 # cp /etc/cni/net.d/100-crio-bridge.conflist.sample /etc/cni/net.d/100-crio-bridge.conflist # sed -i '/swap/d' /etc/fstab && reboot После перезагрузки выполнить на каждой машине: # systemctl enable --now crio kubelet && sleep 5; systemctl status crio kubelet --no-pager -l Ожидаемый результат: сервисы запущены успешно. Фактический результат: сервис kubelet выходит со статусом FAILURE: ● kubelet.service - Kubernetes Kubelet Server Loaded: loaded (/lib/systemd/system/kubelet.service; enabled; preset: disabled) Drop-In: /etc/systemd/system/kubelet.service.d └─kubeadm.conf Active: activating (auto-restart) (Result: exit-code) since Sun 2023-11-05 17:12:35 MSK; 4s ago Docs: https://kubernetes.io/docs/concepts/overview/components/#kubelet https://kubernetes.io/docs/reference/generated/kubelet/ Process: 3432 ExecStart=/usr/bin/kubelet $KUBELET_KUBECONFIG_ARGS $KUBELET_SYSTEM_PODS_ARGS $KUBELET_NETWORK_ARGS $KUBELET_DNS_ARGS $KUBELET_AUTHZ_ARGS $KUBELET_EXTRA_ARGS $KUBELET_CRI_ARGS (code=exited, status=1/FAILURE) Main PID: 3432 (code=exited, status=1/FAILURE) CPU: 406ms ноя 05 17:12:35 server-10-1-x86-64-20231105.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. В логах характерная ошибка ("command failed" err="failed to parse kubelet flag: unknown flag: --container-runtime") {{collapse ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --pod-manifest-path has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --cluster-dns has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --cluster-domain has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --authorization-mode has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --client-ca-file has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: Flag --cgroup-driver has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain kubelet[3457]: E1105 17:12:56.569962 3457 run.go:74] "command failed" err="failed to parse kubelet flag: unknown flag: --container-runtime" ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain systemd[1]: kubelet.service: Main process exited, code=exited, status=1/FAILURE ноя 05 17:12:56 server-10-1-x86-64-20231105.localdomain systemd[1]: kubelet.service: Failed with result 'exit-code'. Related: - https://github.com/kubernetes/minikube/issues/16117 - https://github.com/kubernetes/minikube/issues/16112 243043 1 varaksaaa 2024-03-15 13:49:18 +0300 Воспроизводится и с 1.28. [sisyphus] ALT Server 10.1 kubernetes1.28-kubelet-1.28.7-alt1.1.x86_64