
Hadoop
Hadoop
sunywz
这个作者很懒,什么都没留下…
展开
-
Hadoop-小文件解决方案之SequenceFile
package com.imooc.mr;import org.apache.commons.io.FileUtils;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.FileSystem;import org.apache.hadoop.fs.Path;import org.apache.hadoop.io.SequenceFile;import org.apache.hadoop.io.Text原创 2021-01-19 16:07:53 · 349 阅读 · 0 评论 -
Hadoop学习笔记-MapReduce之WordCount实战
package com.imooc.mr;import org.apache.hadoop.conf.Configuration;import org.apache.hadoop.fs.Path;import org.apache.hadoop.io.LongWritable;import org.apache.hadoop.io.Text;import org.apache.hadoop.mapreduce.Job;import org.apache.hadoop.mapreduce.Map原创 2021-01-14 14:16:44 · 208 阅读 · 0 评论 -
Hadoop-InputFormat之getSplits源码剖析
/** * Generate the list of files and make them into FileSplits. * @param job the job context * @throws IOException */ public List<InputSplit> getSplits(JobContext job) throws IOException { StopWatch sw = new StopWatch().start(); .原创 2021-01-14 08:52:29 · 236 阅读 · 0 评论 -
hadoop伪分布集群参数配置
core-site.xml<configuration> <property> <name>fs.defaultFS</name> <value>hdfs://bigdata01:9000</value> </property> <property> <name>hadoop.tmp.dir</name>原创 2021-01-11 10:09:54 · 153 阅读 · 0 评论 -
hadoop分布式集群参数配置
core-site.xml<configuration> <property> <name>fs.defaultFS</name> <value>hdfs://bigdata01:9000</value> </property> <property> <name>hadoop.tmp.dir</name>原创 2021-01-11 10:08:50 · 156 阅读 · 0 评论 -
Struts-java.lang.UnsupportedClassVersionError错误
出错代码如下,在网上找了下解决办法,还是没看明白。 说什么编译版本不对。 我的解决就是,直接把原来tomcat6换成7就完事了。2016-7-19 14:31:31 org.apache.catalina.core.AprLifecycleListener init信息: The Apache Tomcat Native library which allows optimal perform原创 2016-07-19 14:34:57 · 695 阅读 · 0 评论