Apache DolphinScheduler由对数据科学家和开发者使用代码创建数据工作流程的挫败感中诞生。项目在一夜之间管理超过30,000个作业，经常因网络抖动或服务器负载导致问题，迫使团队在夜间解决问题。尝试多种数据工作流项目但未找到解决方案后，他们创建了DolphinScheduler。该项目现已成为Apache顶级项目，旨在解决复杂的数据工作流管理问题。
Apache DolphinScheduler 毕业的消息被北美科技媒体 TheNewStack 关注并邀请Apache DolphinScheduler PMC chair 代立冬 进行相关采访。
节选内容：
Like many IT projects, a new Apache Software Foundation top-level project, DolphinScheduler, grew out of frustration.
“We found it is very hard for data scientists and data developers to create a data-workflow job by using code. We had more than 30,000 jobs running in the multi data center in one night, and one master architect. Often something went wrong due to network jitter or server workload, [and] we had to wake up at night to solve the problem,” wrote Lidong Dai and William Guo of the Apache DolphinScheduler Project Management Committee, in an email. “We tried many data workflow projects, but none of them could solve our problem.”
………………………………
原文地址：
https://thenewstack.io/dolphinscheduler-tames-complex-data-workflows/
TheNewStack 是谁：
TheNewStack 北美科技媒体，创立于2014年，主要为技术人员及管理人提供领域专业知识、行业报告的综合媒体。
扫一扫
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
