Hadoop是Apache提出的一个软件框架（即：开放源码并行运算编程工具和分布式文件系统，与MapReduce和Google档案系统的概念类似）...-优快云博客

Hadoop是一个支持数据密集型分布式应用的开源软件框架，允许使用简单的编程模型处理大型数据集。它能够从单一服务器扩展到成千上万台机器，每台机器提供本地计算和存储。Hadoop的设计能够检测和处理应用程序级别的故障，从而在由可能故障的计算机组成的集群上提供高可用性服务。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Apache Hadoopis asoftware frameworkthat supports data-intensivedistributed applicationsunder afree license.^[1]It enables applications to work with thousands of nodes and petabytes of data. Hadoop was inspired byGoogle'sMapReduceandGoogle File System(GFS) papers.

Hadoop is a top-levelApacheproject being built and used by a global community of contributors,^[2]using theJavaprogramming language.Yahoo!has been the largest contributor^[3]to the project, and uses Hadoop extensively across its businesses.^[4]

Hadoop was created byDoug Cutting,^[5]who named it after his son's toy elephant.^[6]It was originally developed to support distribution for theNutchsearch engine project.^[7]

http://hadoop.apache.org/

What Is Apache Hadoop?

The Apache™ Hadoop™ project develops open-source software for reliable, scalable, distributed computing.

The Apache Hadoop software library is a framework that allows for the distributed processing of large data sets across clusters of computers using a simple programming model. It is designed to scale up from single servers to thousands of machines, each offering local computation and storage. Rather than rely on hardware to deliver high-avaiability, the library itself is designed to detect and handle failures at the application layer, so delivering a highly-availabile service on top of a cluster of computers, each of which may be prone to failures.

The project includes these subprojects:

Hadoop Common: The common utilities that support the other Hadoop subprojects.
Hadoop Distributed File System (HDFS™): A distributed file system that provides high-throughput access to application data.
Hadoop MapReduce: A software framework for distributed processing of large data sets on compute clusters.

Other Hadoop-related projects at Apache include:

Avro™: A data serialization system.
Cassandra™: A scalable multi-master database with no single points of failure.
Chukwa™: A data collection system for managing large distributed systems.
HBase™: A scalable, distributed database that supports structured data storage for large tables.
Hive™: A data warehouse infrastructure that provides data summarization and ad hoc querying.
Mahout™: A Scalable machine learning and data mining library.
Pig™: A high-level data-flow language and execution framework for parallel computation.
ZooKeeper™: A high-performance coordination service for distributed applications.

Who Uses Hadoop?

A wide variety of companies and organizations use Hadoop for both research and production. Users are encouraged to add themselves to the HadoopPoweredBywiki page.