Storm integrate with kafka and hdfs

最新推荐文章于 2025-12-27 14:16:20 发布
原创 最新推荐文章于 2025-12-27 14:16:20 发布 · 129 阅读 · 0 ·
CC 4.0 BY-SA版权
版权声明：本文为博主原创文章，遵循 CC 4.0 BY-SA 版权协议，转载请附上原文出处链接和本声明。
文章标签：

#大数据

本文宣布了 Apache Storm 0.9.3 版本的发布，并提供了指向该版本中 Kafka 和 HDFS 外部组件文档的链接。

https://storm.apache.org/2014/11/25/storm093-released.html

 

https://github.com/apache/storm/blob/v0.9.3/external/storm-kafka/README.md

https://github.com/apache/storm/tree/v0.9.3/external/storm-hdfs

Count-Min sketch
术业有专攻
01-26 1144
  “Sketching” data structures store a summary of a data set in situations where the whole data would be prohibitively costly to store (at least in a fast-access place like the memory as opposed to ...
Implementing Real-Time Trending Topics With a Distributed Rolling Count Algorith
术业有专攻
01-04 663
http://www.michael-noll.com/blog/2013/01/18/implementing-real-time-trending-topics-in-storm/   A common pattern in real-time data workflows is performing rolling counts of incoming data points, al...
Streaming algorithm
术业有专攻
01-26 647
http://en.wikipedia.org/wiki/Streaming_algorithm
Storm: related high qulity posts
术业有专攻
01-04 239
http://www.drdobbs.com/go-parallel/article/print?articleId=240143874&siteSectionName=
Big Data Counting: How to count a billion distinct objects using only 1.5KB of
术业有专攻
01-27 213
http://highscalability.com/blog/2012/4/5/big-data-counting-how-to-count-a-billion-distinct-objects-us.html   This is a guest post by Matt Abrams (@abramsm), from Clearspring, discussing how they a...
Content based and collaborative filtering based recommendation and personalizati
术业有专攻
01-21 210
                    References https://github.com/pranab/sifarish
Trident Tutorial
术业有专攻
01-12 208
Trident is a high-level abstraction for doing realtime computing on top of Storm. It allows you to seamlessly intermix high throughput (millions of messages per second), stateful stream processing wi...
Storm: DRPC
术业有专攻
03-17 206
                       https://storm.apache.org/documentation/Distributed-RPC.html https://github.com/mithunsatheesh/php-drpc http://php.sabscape.com/blog/?p=482
Storm: compile storm source code and run storm-starter
术业有专攻
12-01 200
https://github.com/apache/storm/tree/master/examples/storm-starter   1 down load the source codes # git clone git://github.com/apache/storm.git 2 Build and install Storm jars locally #  mvn cle...
storm: storm-kafka spout
术业有专攻
01-09 193
      package inok.storm.kafka.sample; import java.io.FileInputStream; import java.io.IOException; import java.util.Arrays; import java.util.HashMap; import java.util.Iterator; import jav...
Guaranteeing Message Processing
术业有专攻
01-16 173
Storm guarantees that each message coming off a spout will be fully processed. This page describes how Storm accomplishes this guarantee and what you have to do as a user to benefit from Storm's reli...
Strom: Trident-ML realtime ML
术业有专攻
05-26 163
https://github.com/pmerienne/trident-ml
Setting up a Storm Cluster
术业有专攻
01-22 157
https://storm.apache.org/documentation/Setting-up-a-Storm-cluster.html This page outlines the steps for getting a Storm cluster up and running. If you're on AWS, you should check out the storm-deplo...
Storm: books
术业有专攻
12-09 155
  Big Data Analytics Beyond Hadoop: Real-Time Applications with Storm, Spark, and More Hadoop Alternatives Storm Applied: Strategies for Real-time Event Processing  Storm源码分析  Storm Real-T...
concepts of Storm
术业有专攻
12-01 154
https://storm.apache.org/documentation/Concepts.html   This page lists the main concepts of Storm and links to resources where you can find more information. The concepts discussed are: Topologie...
北京兰亭妙微：深耕UI/UX全流程，以大数据可视化与3D场景设计驱动数字体验升级
最新发布
lanlanwork11的博客
12-27 161
北京兰亭妙微 UI 设计公司，深耕 UI/UX 全流程设计领域，专注大数据可视化、3D 场景化界面、多端适配设计等核心服务，拥有成熟的行业解决方案与实战案例。以下拆解国际国内的优秀设计案例。图 1：数据中心监控界面这是一套企业级数据中心的管理平台界面，核心是多维度数据的模块化展示：顶部清晰区分 “当前进程、完成进程、提交进程” 的数量状态，搭配 “当前规模、往期占比” 的快捷指标；核心区域用可视化进度条展示 “计算服务器、云服务器、数据存储” 的资源使用率（如计算服务器使用率 88.2%），搭配图标化的模块
Flink源码阅读：Watermark机制
K_Ohaha的博客
12-22 1016
本文分析了Flink中Watermark的源码实现，主要包含三个部分：1) Watermark的定义，它是一个带有时间戳的StreamElement；2) Watermark的生成过程，通过assignTimestampsAndWatermarks方法初始化，创建TimestampsAndWatermarksOperator并设置定时器周期性发送；3) 下游处理机制，获取上游最小Watermark并向下游广播。文章通过关键代码片段和调用链路图，详细阐述了Watermark在Flink中的实现原理和处理流程。
k8s+Flink断点续传(MySQL同步Starrocks)
weixin_42562106的博客
12-26 315
Flink 3.4版本在Kubernetes环境下的部署与优化 摘要：本文介绍了Flink 3.4版本在Kubernetes环境下的部署方案和优化措施。通过K8s原生支持实现了基础设施级容错，包括Pod故障自动重启、节点故障自动调度以及S3持久化存储等特性，确保作业的稳定运行。提供了集群启动命令和核心JAR包清单，详细说明了包含S3支持的Docker镜像构建方法，并给出了完整的FlinkDeployment YAML模板配置。配置中重点设置了Checkpoint、状态后端、高可用等关键参数，充分利用K8s和
视频汇聚平台EasyCVR筑牢智慧物流全场景可视化安全防线
EasyCVR视频融合云平台的技术博客
12-26 179
随着智慧物流的快速发展，仓储物流场景对监控系统的智能化、联动化、高效化要求日益提升。
how to install latest hadoop on ubuntu 24.04 and integrate with hive
07-14
- **Hive-on-MR 警告**：如果出现警告 `Hive-on-MR is deprecated in Hive 2 and may not be available in the future versions`，建议使用 Tez 或 Spark 作为执行引擎 [^2]。 - **无法启动 Hive**：如果提示 `...
评论
成就一亿技术人!
拼手气红包6.0元
还能输入1000个字符
 
红包 添加红包
表情包 插入表情
表情包 代码片
 条评论被折叠 查看
添加红包

请填写红包祝福语或标题

个

红包个数最小为10个

元

红包金额最低5元

当前余额3.43元 前往充值 >
需支付：10.00元
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付元
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明：

1.余额是钱包充值的虚拟货币，按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载，可以购买VIP、付费专栏及课程。

余额充值