hadoop自定义类型异常java.lang.RuntimeException: java.lang.NoSuchMethodException: twicesort.TwoKey.<init>()

java.lang.RuntimeException: java.lang.NoSuchMethodException: twicesort.TwoKey.<init>()
    at org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:131)
    at org.apache.hadoop.io.WritableComparator.newKey(WritableComparator.java:144)
    at org.apache.hadoop.io.WritableComparator.<init>(WritableComparator.java:130)
    at org.apache.hadoop.io.WritableComparator.get(WritableComparator.java:65)
    at org.apache.hadoop.mapred.JobConf.getOutputKeyComparator(JobConf.java:887)
    at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.init(MapTask.java:1001)
    at org.apache.hadoop.mapred.MapTask.createSortingCollector(MapTask.java:401)
    at org.apache.hadoop.mapred.MapTask.access$100(MapTask.java:81)
    at org.apache.hadoop.mapred.MapTask$NewOutputCollector.<init>(MapTask.java:695)
    at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:767)

重点在这里,java.lang.NoSuchMethodException: twicesort.TwoKey,他说没有这个方法,这个方法是TwoKey的无参构造方法
这个细节在hadoop权威指南上也有提到,就在序列化或者自定义类型那章,具体不记得了,我的理解是首先他反序列化的时候先要拿到一个无参的构造对象,然后再进行对象内值的填充。

让我们再来看看hadoop给我提供的类型是不是都有无参的构造方法

public class IntWritable implements WritableComparable<IntWritable> {
  private int value;

  public IntWritable() {}

  public IntWritable(int value) { set(value); }
  }
public class LongWritable implements WritableComparable<LongWritable> {
  private long value;

  public LongWritable() {}

  public LongWritable(long value) { set(value); }
  }
public class Text extends BinaryComparable
    implements WritableComparable<BinaryComparable> {
    public Text() {
    bytes = EMPTY_BYTES;
  }

  /** Construct from a string. 
   */
  public Text(String string) {
    set(string);
  }

  /** Construct from another text. */
  public Text(Text utf8) {
    set(utf8);
  }

  /** Construct from a byte array.
   */
  public Text(byte[] utf8)  {
    set(utf8);
  }
  }
public class BooleanWritable implements WritableComparable<BooleanWritable> {
  private boolean value;

  /** 
   */
  public BooleanWritable() {};
  }
public class ByteWritable implements WritableComparable<ByteWritable> {
  private byte value;

  public ByteWritable() {}

  public ByteWritable(byte value) { set(value); }
  }
public class ShortWritable implements WritableComparable<ShortWritable> {
  private short value;

  public ShortWritable() {
  }

  public ShortWritable(short value) {
    set(value);
  }
}
评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值