Spark 1.2.0 released

最新推荐文章于 2020-12-24 01:33:46 发布

原创最新推荐文章于 2020-12-24 01:33:46 发布 · 965 阅读

0 ·

CC 4.0 BY-SA版权

大数据专栏收录该内容

236 篇文章

订阅专栏

Spark 1.2.0 已发布，这是 Spark API 兼容 1.x 系列的第三次更新，拥有超过 1,000 项提交及 172 位贡献者。此次发布在 Spark Core 中引入了新的网络传输子系统以改善大规模 shuffle 的性能，并在 Spark SQL 中增加了外部数据源 API 和 Hive 13 支持等新特性。MLlib 引入了一个新的流水线导向包 spark.ml，用于组合多种算法；Spark Streaming 增加了 Python API 和写入前日志以提高容错能力。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

Spark 1.2.0 released

We are happy to announce the availability of Spark 1.2.0! Spark 1.2.0 is the third release on the API-compatible 1.X line. It is Spark’s largest release ever, with contributions from 172 developers and more than 1,000 commits!This release brings operational and performance improvements in Spark core including a new network transport subsytem designed for very large shuffles. Spark SQL introduces an API for external data sources along with Hive 13 support, dynamic partitioning, and the fixed-precision decimal type. MLlib adds a new pipeline-oriented package (spark.ml) for composing multiple algorithms. Spark Streaming adds a Python API and a write ahead log for fault tolerance. Finally, GraphX has graduated from alpha and introduces a stable API.Visit the release notes to read about the new features, or download the release today.

http://spark.apache.org/news/spark-1-2-0-released.html