Kafka2.1.1编译

Kafka2.1.1编译

一、下载

1.kafka源码
http://mirrors.tuna.tsinghua.edu.cn/apache/kafka/2.1.1/kafka-2.1.1-src.tgz

2.解压下载的kafka源码，比如解压后的目录为/root/kafka/kafka-2.1.1-src

3.下载scala2.11.11和gradle-4.10.2并配置环境变量

二、修改build.gradle

修改/root/kafka/kafka-2.1.1-src目录下的build.gradle文件

import org.ajoberstar.grgit.Grgit

ScalaCompileOptions.metaClass.daemonServer = true//增加
ScalaCompileOptions.metaClass.fork = true//增加
ScalaCompileOptions.metaClass.useAnt = false//增加
ScalaCompileOptions.metaClass.useCompileDaemon = false//增加

buildscript {
   
   
  repositories {
   
   
    mavenLocal()//修改
    maven {
   
   
      url "仓库1"//修改
    }
    maven {
   
   
      url "仓库2"//修改
    }
    maven {
   
   
      url "https://maven.aliyun.com/repository/gradle-plugin"//修改
    }
    //jcenter() 注释
  }
  apply from: file('gradle/buildscript.gradle'), to: buildscript

  dependencies {
   
   
    // For Apache Rat plugin to ignore non-Git files
    classpath "org.ajoberstar:grgit:1.9.3"
    classpath 'com.github.ben-manes:gradle-versions-plugin:0.20.0'
    classpath 'org.scoverage:gradle-scoverage:2.5.0'
    classpath 'com.github.jengelman.gradle.plugins:shadow:4.0.2'
    classpath 'org.owasp:dependency-check-gradle:3.3.4'
    classpath "com.diffplug.spotless:spotless-plugin-gradle:3.16.0"
    classpath "com.github.spotbugs:spotbugs-gradle-plugin:1.6.5"//修改
  }
...
apply from: "$rootDir/gradle/dependencies.gradle"

allprojects {
   
   

  repositories {
   
   
    mavenLocal()//修改
    maven {
   
   
      url "仓库1"//修改
    }
    maven {
   
   
      url "仓库2"//修改
    }
  }

三、编译

1. 进入/root/kafka/kafka-2.1.1-src目录
2. 执行 gradle命令，上述修改了spotbugs-gradle-plugin路径是由于在jcenter里下载不到，所以改成到https://maven.aliyun.com/repository/gradle-plugin中下载，并修改插件路径
3. 第二步执行成功后会在当前目录生成gradlew
4. 执行 ./gradlew clean
5. 执行 ./gradlew -PscalaVersion=2.11 releaseTarGz

当执行gradlew时会去下载gradle-4.10.3-bin.zip，我在执行的时候报了unable to find valid certification path to requested target的错误，有两个解决办法：

1. 手动下载gradle-4.10.3-bin.zip放到/root/.gradle/wrapper/dists/gradle-4.10.3-bin/31t79e2qsceia4mkbojplrgx，这里的目录根据需要的gradle版本来确定。我这里是4.10.3。

2. 利用如下代码生成证书：

import java.io.*;
import java.net.URL;

import java.security.*;
import java.security.cert.*;

import javax.net.ssl.*;

public class InstallCert {
   
   

    // 我们要访问的HTTPS服务，如访问 https://www.shanhy.com
    public static final String hostName = "services.gradle.org";

    public static void main(String[] args) throws Exception {
   
   
        args = new String[]{
   
   hostName};
        String host;
        int port;
        char[] passphrase;
        if ((args.length == 1) || (args.length == 2))