Docker、Containerd、RunC...:你应该知道的所有

Docker 1.11开始,Docker容器运行已经不是简单的通过Docker daemon来启动,而是集成了containerd、runC等多个组件。Docker服务启动之后,我们也可以看见系统上启动了dockerd、docker-containerd等进程,本文主要介绍新版Docker(1.11以后)每个部分的功能和作用。

Docker Daemon

作为Docker容器管理的守护进程,Docker Daemon从最初集成在docker命令中(1.11版本前),到后来的独立成单独二进制程序(1.11版本开始),其功能正在逐渐拆分细化,被分配到各个单独的模块中去。从Docker服务的启动脚本,也能看见守护进程的逐渐剥离:

在Docker 1.8之前,Docker守护进程启动的命令为:

docker -d

这个阶段,守护进程看上去只是Docker client的一个选项。

Docker 1.8开始,启动命令变成了:

docker daemon

这个阶段,守护进程看上去是docker命令的一个模块。

Docker 1.11开始,守护进程启动命令变成了:

dockerd

此时已经和Docker client分离,独立成一个二进制程序了。

当然,守护进程模块不停的在重构,其基本功能和定位没有变化。和一般的CS架构系统一样,守护进程负责和Docker client交互,并管理Docker镜像、容器。

下面就来介绍下独立分拆出来的其他几个模块。

Containerd

containerd是容器技术标准化之后的产物,为了能够兼容OCI标准,将容器运行时及其管理功能从Docker Daemon剥离。理论上,即使不运行dockerd,也能够直接通过containerd来管理容器。(当然,containerd本身也只是一个守护进程,容器的实际运行时由后面介绍的runC控制。)

最近,Docker刚刚宣布开源containerd。从其项目介绍页面可以看出,containerd主要职责是镜像管理(镜像、元信息等)、容器执行(调用最终运行时组件执行)。

containerd向上为Docker Daemon提供了gRPC接口,使得Docker Daemon屏蔽下面的结构变化,确保原有接口向下兼容。向下通过containerd-shim结合runC,使得引擎可以独立升级,避免之前Docker Daemon升级会导致所有容器不可用的问题。

Docker、containerd和containerd-shim之间的关系,可以通过启动一个Docker容器,观察进程之间的关联。首先启动一个容器,

docker run -d busybox sleep 1000

然后通过pstree命令查看进程之间的父子关系(其中20708是dockerd的PID):

pstree -l -a -A 20708

输出结果如下:

dockerd -H fd:// --storage-driver=overlay2
  |-docker-containe -l unix:///var/run/docker/libcontainerd/docker-containerd.sock --metrics-interval=0 --start-timeout 2m --state-dir /var/run/docker/libcontainerd/containerd --shim docker-containerd-shim --runtime docker-runc
  |   |-docker-containe b9a04a582b66206492d29444b5b7bc6ec9cf1eb83eff580fe43a039ad556e223 /var/run/docker/libcontainerd/b9a04a582b66206492d29444b5b7bc6ec9cf1eb83eff580fe43a039ad556e223 docker-runc
  |   |   |-sleep 1000

虽然pstree命令截断了命令,但我们还是能够看出,当Docker daemon启动之后,dockerd和docker-containerd进程一直存在。当启动容器之后,docker-containerd进程(也是这里介绍的containerd组件)会创建docker-containerd-shim进程,其中的参数b9a04a582b66206492d29444b5b7bc6ec9cf1eb83eff580fe43a039ad556e223就是要启动容器的id。最后docker-containerd-shim子进程,已经是实际在容器中运行的进程(既sleep 1000)。

docker-containerd-shim另一个参数,是一个和容器相关的目录/var/run/docker/libcontainerd/b9a04a582b66206492d29444b5b7bc6ec9cf1eb83eff580fe43a039ad556e223,里面的内容有:

.
├── config.json
├── init-stderr
├── init-stdin
└── init-stdout

其中包括了容器配置和标准输入、标准输出、标准错误三个管道文件。

RunC

OCI定义了容器运行时标准,runC是Docker按照开放容器格式标准(OCF, Open Container Format)制定的一种具体实现。

runC是从Docker的libcontainer中迁移而来的,实现了容器启停、资源隔离等功能。Docker默认提供了docker-runc实现,事实上,通过containerd的封装,可以在Docker Daemon启动的时候指定runc的实现。

我们可以通过启动Docker Daemon时增加--add-runtime参数来选择其他的runC现。例如:

docker daemon --add-runtime "custom=/usr/local/bin/my-runc-replacement"

下面就让我们看下这几个模块如何工作。

举个例子

这里通过Docker一些命令,实现不使用Docker Daemon直接启动一个镜像,以便了解Docker Daemon每个模块的作用。

首先,需要创建容器标准包,这部分实际上由containerd的bundle模块实现,将Docker镜像转换成容器标准包。

mkdir my_container
cd my_container
mkdir rootfs
docker export $(docker create busybox) | tar -C rootfs -xvf -

上述命令将busybox镜像解压缩到指定的rootfs目录中。如果本地不存在busybox镜像,containerd还会通过distribution模块去远程仓库拉取。

现在整个my_container目录结构如下:

$ tree -d my_container/
my_container/
└── rootfs
    ├── bin
    ├── dev
    │   ├── pts
    │   └── shm
    ├── etc
    ├── home
    ├── proc
    ├── root
    ├── sys
    ├── tmp
    ├── usr
    │   └── sbin
    └── var
        ├── spool
        │   └── mail
        └── www
17 directories

此时,标准包所需的容器数据已经准备完毕,接下来我们需要创建配置文件:

docker-runc spec

此时会生成一个名为config.json的配置文件,该文件和Docker容器的配置文件类似,主要包含容器挂载信息、平台信息、进程信息等容器启动依赖的所有数据。

最后,可以通过runc命令来启动容器:

runc run busybox

注意,runc必须使用root权限启动。

执行之后,我们可以看见容器已经启动:

localhost my_container # runc run busybox
/ # ps aux
PID   USER     TIME   COMMAND
    1 root       0:00 sh
    9 root       0:00 ps aux

此时,事实上已经可以不依赖Docker本身,如果系统上安装了runc包,即可运行容器。对于Gentoo系统来说,安装app-emulation/runc包即可。

当然,也可以使用docker-runc命令来启动容器:

localhost my_container # docker-runc run busybox
/ # ps aux
PID   USER     TIME   COMMAND
    1 root       0:00 sh
    7 root       0:00 ps aux

从这里可以看到标准化的重要性。

总结

从Docker 1.11之后,Docker Daemon被分成了多个模块以适应OCI标准。拆分之后,结构分成了以下几个部分。

其中,containerd独立负责容器运行时和生命周期(如创建、启动、停止、中止、信号处理、删除等),其他一些如镜像构建、卷管理、日志等由Docker Daemon的其他模块处理。

Docker的模块块拥抱了开放标准,希望通过OCI的标准化,容器技术能够有很快的发展。

Jul 18 16:31:42 localhost dockerd: time="2025-07-18T16:31:42+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.version"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:42 localhost dockerd: time="2025-07-18T16:31:42+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.introspection"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:42 localhost dockerd: time="2025-07-18T16:31:42+08:00" level=info msg=serving... address="/var/run/docker/containerd/docker-containerd-debug.sock" module="containerd/debug" Jul 18 16:31:42 localhost dockerd: time="2025-07-18T16:31:42+08:00" level=info msg=serving... address="/var/run/docker/containerd/docker-containerd.sock" module="containerd/grpc" Jul 18 16:31:42 localhost dockerd: time="2025-07-18T16:31:42+08:00" level=info msg="containerd successfully booted in 0.005146s" module=containerd Jul 18 16:31:42 localhost dockerd: time="2025-07-18T16:31:42.789469957+08:00" level=info msg="[graphdriver] using prior storage driver: overlay2" Jul 18 16:31:42 localhost dockerd: time="2025-07-18T16:31:42.793801120+08:00" level=info msg="Graph migration to content-addressability took 0.00 seconds" Jul 18 16:31:42 localhost dockerd: time="2025-07-18T16:31:42.795538282+08:00" level=info msg="Loading containers: start." Jul 18 16:31:42 localhost dockerd: Error starting daemon: Error initializing network controller: error obtaining controller instance: failed to create NAT chain DOCKER: COMMAND_FAILED: INVALID_IPV: 'ipv4' is not a valid backend or is unavailable Jul 18 16:31:42 localhost systemd: docker.service: main process exited, code=exited, status=1/FAILURE Jul 18 16:31:42 localhost systemd: Failed to start Docker Application Container Engine. Jul 18 16:31:42 localhost systemd: Unit docker.service entered failed state. Jul 18 16:31:42 localhost systemd: docker.service failed. Jul 18 16:31:43 localhost systemd: docker.service holdoff time over, scheduling restart. Jul 18 16:31:43 localhost systemd: Stopped Docker Application Container Engine. Jul 18 16:31:43 localhost systemd: Starting Docker Application Container Engine... Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43.247862190+08:00" level=warning msg="could not change group /var/run/docker.sock to docker: group docker not found" Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43.250571124+08:00" level=info msg="libcontainerd: started new docker-containerd process" pid=261353 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="starting containerd" module=containerd revision=773c489c9c1b21a6d78b5c538cd395416ec50f88 version=v1.0.3 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.content.v1.content"..." module=containerd type=io.containerd.content.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.snapshotter.v1.btrfs"..." module=containerd type=io.containerd.snapshotter.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=warning msg="failed to load plugin io.containerd.snapshotter.v1.btrfs" error="path /icooper/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter" module=containerd Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.snapshotter.v1.overlayfs"..." module=containerd type=io.containerd.snapshotter.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.metadata.v1.bolt"..." module=containerd type=io.containerd.metadata.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=warning msg="could not use snapshotter btrfs in metadata plugin" error="path /icooper/docker/containerd/daemon/io.containerd.snapshotter.v1.btrfs must be a btrfs filesystem to be used with the btrfs snapshotter" module="containerd/io.containerd.metadata.v1.bolt" Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.differ.v1.walking"..." module=containerd type=io.containerd.differ.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.gc.v1.scheduler"..." module=containerd type=io.containerd.gc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.containers"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.content"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.diff"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.events"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.healthcheck"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.images"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.leases"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.namespaces"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.snapshots"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.monitor.v1.cgroups"..." module=containerd type=io.containerd.monitor.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.runtime.v1.linux"..." module=containerd type=io.containerd.runtime.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.tasks"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.version"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="loading plugin "io.containerd.grpc.v1.introspection"..." module=containerd type=io.containerd.grpc.v1 Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg=serving... address="/var/run/docker/containerd/docker-containerd-debug.sock" module="containerd/debug" Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg=serving... address="/var/run/docker/containerd/docker-containerd.sock" module="containerd/grpc" Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43+08:00" level=info msg="containerd successfully booted in 0.005631s" module=containerd Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43.292626579+08:00" level=info msg="[graphdriver] using prior storage driver: overlay2" Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43.298251173+08:00" level=info msg="Graph migration to content-addressability took 0.00 seconds" Jul 18 16:31:43 localhost dockerd: time="2025-07-18T16:31:43.299760264+08:00" level=info msg="Loading containers: start." Jul 18 16:31:43 localhost dockerd: Error starting daemon: Error initializing network controller: error obtaining controller instance: failed to create NAT chain DOCKER: COMMAND_FAILED: INVALID_IPV: 'ipv4' is not a valid backend or is unavailable Jul 18 16:31:43 localhost systemd: docker.service: main process exited, code=exited, status=1/FAILURE Jul 18 16:31:43 localhost systemd: Failed to start Docker Application Container Engine. Jul 18 16:31:43 localhost systemd: Unit docker.service entered failed state. Jul 18 16:31:43 localhost systemd: docker.service failed. Jul 18 16:31:43 localhost systemd: docker.service holdoff time over, scheduling restart. Jul 18 16:31:43 localhost systemd: Stopped Docker Application Container Engine. Jul 18 16:31:43 localhost systemd: start request repeated too quickly for docker.service Jul 18 16:31:43 localhost systemd: Failed to start Docker Application Container Engine. Jul 18 16:31:43 localhost systemd: Unit docker.service entered failed state. Jul 18 16:31:43 localhost systemd: docker.service failed.
07-19
86800+08:00" level=info msg="starting containerd" revision=1a43cb6a1035441f9aca8f5666a9b3ef9e70ab20 version=v2.0.4 01099+08:00" level=info msg="loading plugin" id=io.containerd.image-verifier.v1.bindir type=io.containerd.image-verifier.v1 29284+08:00" level=info msg="loading plugin" id=io.containerd.internal.v1.opt type=io.containerd.internal.v1 39686+08:00" level=info msg="loading plugin" id=io.containerd.warning.v1.deprecations type=io.containerd.warning.v1 85903+08:00" level=info msg="loading plugin" id=io.containerd.content.v1.content type=io.containerd.content.v1 13056+08:00" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.blockfile type=io.containerd.snapshotter.v1 80715+08:00" level=info msg="skip loading plugin" error="no scratch file generator: skip plugin" id=io.containerd.snapshotter.v1.blockfile ty>46750+08:00" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.btrfs type=io.containerd.snapshotter.v1 44053+08:00" level=info msg="skip loading plugin" error="path /var/lib/containerd/io.containerd.snapshotter.v1.btrfs (ext4) must be a btrfs f>62551+08:00" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.devmapper type=io.containerd.snapshotter.v1 72004+08:00" level=info msg="skip loading plugin" error="devmapper not configured: skip plugin" id=io.containerd.snapshotter.v1.devmapper typ>79686+08:00" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.native type=io.containerd.snapshotter.v1 29311+08:00" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.overlayfs type=io.containerd.snapshotter.v1 01397+08:00" level=info msg="loading plugin" id=io.containerd.snapshotter.v1.zfs type=io.containerd.snapshotter.v1 89046+08:00" level=info msg="skip loading plugin" error="lstat /var/lib/containerd/io.containerd.snapshotter.v1.zfs: no such file or director>04550+08:00" level=info msg="loading plugin" id=io.containerd.event.v1.exchange type=io.containerd.event.v1 65958+08:00" level=info msg="loading plugin" id=io.containerd.monitor.task.v1.cgroups type=io.containerd.monitor.task.v1 93616+08:00" level=info msg="loading plugin" id=io.containerd.metadata.v1.bolt type=io.containerd.metadata.v1 69697+08:00" level=info msg="metadata content store policy set" policy=shared 22389+08:00" level=info msg="loading plugin" id=io.containerd.gc.v1.scheduler type=io.containerd.gc.v1 65806+08:00" level=info msg="loading plugin" id=io.containerd.differ.v1.walking type=io.containerd.differ.v1 79801+08:00" level=info msg="loading plugin" id=io.containerd.lease.v1.manager type=io.containerd.lease.v1 90300+08:00" level=info msg="loading plugin" id=io.containerd.service.v1.containers-service type=io.containerd.service.v1 16783+08:00" level=info msg="loading plugin" id=io.containerd.service.v1.content-service type=io.containerd.service.v1 26073+08:00" level=info msg="loading plugin" id=io.containerd.service.v1.diff-service type=io.containerd.service.v1 41660+08:00" level=info msg="loading plugin" id=io.containerd.service.v1.images-service type=io.containerd.service.v1 66638+08:00" level=info msg="loading plugin" id=io.containerd.service.v1.introspection-service type=io.containerd.service.v1 90737+08:00" level=info msg="loading plugin" id=io.containerd.service.v1.namespaces-service type=io.containerd.service.v1 00102+08:00" level=info msg="loading plugin" id=io.containerd.service.v1.snapshots-service type=io.containerd.service.v1 11006+08:00" level=info msg="loading plugin" id=io.containerd.shim.v1.manager type=io.containerd.shim.v1 25992+08:00" level=info msg="loading plugin" id=io.containerd.runtime.v2.task type=io.containerd.runtime.v2 82676+08:00" level=info msg="loading plugin" id=io.containerd.service.v1.tasks-service type=io.containerd.service.v1 00677+08:00" level=info msg="loading plugin" id=io.containerd.grpc.v1.containers type=io.containerd.grpc.v1 11153+08:00" level=info msg="loading plugin" id=io.containerd.grpc.v1.content type=io.containerd.grpc.v1 22568+08:00" level=info msg="loading plugin" id=io.containerd.grpc.v1.diff type=io.containerd.grpc.v1 63662+08:00" level=info msg="loading plugin" id=io.containerd.grpc.v1.events type=io.containerd.grpc.v1 75537+08:00" level=info msg="loading plugin" id=io.containerd.grpc.v1.images type=io.containerd.grpc.v1 84716+08:00" level=info msg="loading plugin" id=io.containerd.grpc.v1.introspection type=io.containerd.grpc.v1
最新发布
10-05
评论 1
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值