The Hadoop FileSystem API Definition

最新推荐文章于 2021-12-01 09:45:01 发布

星空探索

最新推荐文章于 2021-12-01 09:45:01 发布

阅读量480

点赞数

分类专栏： Hadoop系统研究

Hadoop系统研究专栏收录该内容

18 篇文章

订阅专栏

本文档详细介绍了Hadoop文件系统的API定义，该API将文件系统的内容建模为一系列路径，包括目录、符号链接和文件等。此外还讨论了如何通过这些API实现不同文件系统的一致性模型，并概述了HDFS行为对于并发操作的具体表现。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

The Hadoop FileSystem API Definition

This is a specification of the Hadoop FileSystem APIs, which models the contents of a filesystem as a set of paths that are either directories, symbolic links, or files.

There is surprisingly little prior art in this area. There are multiple specifications of Unix filesystems as a tree of inodes, but nothing public which defines the notion of “Unix filesystem as a conceptual model for data storage access”.

This specification attempts to do that; to define the Hadoop FileSystem model and APIs so that multiple filesystems can implement the APIs and present a consistent model of their data to applications. It does not attempt to formally specify any of the concurrency behaviors of the filesystems, other than to document the behaviours exhibited by HDFS as these are commonly expected by Hadoop client applications.