基于docker push原理进行tar镜像上传至harbor仓库（未分片）

原创于 2025-10-15 16:26:07 发布 · 296 阅读

2 ·

CC 4.0 BY-SA版权

文章标签：

#docker #harbor #k8s #java #spring cloud

深入解析Harbor镜像推送全流程实现

本文将基于开源Harbor镜像仓库，详细解析如何通过Java代码实现完整的Docker镜像推送流程。通过分析核心代码，揭示镜像推送背后的技术细节。

核心架构设计

HarborPushAllInOne类封装了完整的镜像推送功能：

使用Apache HttpClient处理HTTP请求
通过TarArchiveInputStream解析Docker镜像tar包
采用分步上传策略（Config/Layers/Manifest）

初始化参数说明：

public HarborPushAllInOne(String registry, String user, String pwd, String project, String repo) {
    this.registry = registry.trim().replaceAll("/$", "");
    this.project = project;
    this.repo = repo;
    this.basic = "Basic " + Base64.getEncoder().encodeToString((user + ":" + pwd).getBytes());
}

镜像上传三步曲

tar包解析与文件提取

private Map<String, byte[]> extractTar(String path) throws Exception {
    Map<String, byte[]> map = new HashMap<>();
    try (TarArchiveInputStream tis = new TarArchiveInputStream(Files.newInputStream(Paths.get(path)))) {
        TarArchiveEntry e;
        while ((e = tis.getNextTarEntry()) != null) {
            if (!e.isDirectory()) {
                byte[] buf = new byte[(int)e.getSize()];
                int read = 0, total = 0;
                while (total < buf.length && (read = tis.read(buf, total, buf.length - total)) >= 0) {
                    total += read;
                }
                map.put(e.getName(), buf);
                fileSizes.put(e.getName(), total);
            }
        }
    }
    return map;
}

分层上传策略

配置文件上传
镜像层文件上传
合并生成manifest

public void uploadTarImage(String tarPath, String repo, String tag) throws Exception {
    Map<String, byte[]> files = extractTar(tarPath);
    JSONObject mf = new JSONArray(new String(files.get("manifest.json"))).getJSONObject(0);
    
    // Config文件处理
    String configName = mf.getString("Config");
    String configDigest = pushBlob(files.get(configName));
    
    // Layers处理
    List<String> layerDigests = new ArrayList<>();
    List<Integer> layerSizes = new ArrayList<>();
    for (Object o : mf.getJSONArray("Layers")) {
        String layerName = (String)o;
        String digest = pushBlob(files.get(layerName));
        layerDigests.add(digest);
        layerSizes.add(fileSizes.get(layerName));
    }
    
    // 最终manifest生成
    pushManifest(configDigest, files.get(configName).length, layerDigests, layerSizes, repo, tag);
}

关键技术实现

Blob上传优化
采用检查-上传两步策略避免重复上传：

private String pushBlob(byte[] blob) throws Exception {
    String digest = "sha256:" + sha256(blob);
    String check = registry + "/v2/" + project + "/" + repo + "/blobs/" + digest;
    if (exists(check)) {
        System.out.println("Blob 已存在 " + digest);
        return digest;
    }
    // 分段上传逻辑...
}

安全认证处理
使用Basic认证并自动生成Header：

private final String basic = "Basic " + Base64.getEncoder().encodeToString((user + ":" + pwd).getBytes());

// 在请求中设置
post.setHeader(HttpHeaders.AUTHORIZATION, basic);

实际应用示例

完整的上传调用示例：

public static void main(String[] args) throws Exception {
    HarborPushAllInOne pusher = new HarborPushAllInOne(
        "https://your-harbor.com",
        "admin",
        "password",
        "your-project",
        "demo-repo"
    );
    pusher.uploadTarImage("/path/to/image.tar", "demo-repo", "v1.0");
}