技术笔记本

数据可视化 https://github.com/showcases/data-visualization

For early Hbase developers, it is often a nightmare to understand how the different modules speak among themselves and what. This comes in handy to understand what each sub-system is responsible for

In this tutorial I will describe how to write a simpleMapReduce program for Hadoop in thePython programming language. Motivation Even though the Hadoop framework is written in Java, programs for H

HDFS 2 architecture YARN architecture

近些年来Hadoop生态系统发展迅猛，它本身包含的软件越来越多，同时带动了周边系统的繁荣发展。尤其是在分布式计算这一领域，系统繁多纷杂，时不时冒出一个系统，号称自己比MapReduce或者Hive高效几十倍，几百倍。有一些无知的人，总是跟着瞎起哄，说Impala将取代Hive，Spark将取代Hadoop MapReduce等。本文则从问题域触发，解释说明Hadoop中每个系统独特的作用/魅力以及

HBase architecture follows the traditional master slave model where you have a master which takes decisions and one or more slaves which does the real task. In HBase, the master is called HMaster  and

HBase is an open-source implementation of the Google BigTable architecture. That part is fairly easy to understand and grasp. What I personally feel is a bit more difficult is to understand how muc

# ./sbin/start-all.sh                     This script is Deprecated. Instead use start-dfs.sh and start-yarn.sh 13/09/09 16:50:21 WARN util.NativeCodeLoader: Unable to load native-hadoop library for

... Starting namenodes on [] localhost: Error: JAVA_HOME is not set and could not be found. localhost: Error: JAVA_HOME is not set and could not be found. ... starting yarn daemons starting re

#bin/hadoop namenode -format DEPRECATED: Use of this script to execute hdfs command is deprecated. Instead use the hdfs command for it. 13/09/04 13:24:48 INFO namenode.NameNode: STARTUP_MSG: /*