
flink
文章平均质量分 84
codemosi
hadoop hive hbase mahout storm spark kafka flume,等连载中,做个爱分享的人。
干一件事,干好一件事!
QQ :1606588828
展开
-
flink index01
Apache Flink 是一个分布式流和批处理的开源平台。Flink’s core 是一个流数据引擎,它针对流数据,提供了数据分布,通信和容错,的分布式计算能力。Flink 包含如下几种不同API,用来创建不同的应用DataSet API for 静态数据 嵌入到 Java, Scala, and Python,DataStream API for 流数据翻译 2015-11-09 21:55:13 · 360 阅读 · 0 评论 -
兼容storm(beta版)
Flink streaming 兼容storm的api 接口,因此可以复用storm写的项目 。你可以:在flink上执行一个完整的storm topology.使用storm的spout和bolt,替换flink的source和operator。本文档展示如何在flink中,复用storm的代码.项目配置执行Storm Topologyflink st翻译 2015-11-20 16:03:27 · 996 阅读 · 0 评论 -
03 elasticsearch java api
package org.dennisit.elastic.process;import java.util.ArrayList;import java.util.List;import org.dennisit.entity.DataFactory;import org.dennisit.entity.Medicine;import org.elasticsearch.action.i转载 2015-11-23 03:01:07 · 446 阅读 · 0 评论 -
flink akka scala
/* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with this work for additional information * regardi原创 2015-11-20 18:41:08 · 424 阅读 · 0 评论 -
flink akka
/* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with this work for additional information * regardi原创 2015-11-20 18:40:01 · 635 阅读 · 0 评论 -
maven
连不上maven库,可以使用oschina提供的:http://maven.oschina.net/content/groups/public/。感觉oschina!!在setting.xml中配置地址为:[html] view plaincopymirrors> mirror> id>CNid>转载 2015-11-27 19:53:27 · 342 阅读 · 0 评论 -
maven'
Maven从中央仓库下载依赖提示Missing artifact的问题? 分享| 2011-07-22 16:25mmdp12 | 浏览 11068 次本来刚接触maven正在学习中,但在从中央仓库下载jar的时候总是提示Missing artifact 去网站找了下确实有这个jar但就是不能更新到本地仓库?哪位maven高手能指点一下啊,或者有没其它解决办法,或者怎么手动添加转载 2015-11-27 17:45:37 · 341 阅读 · 0 评论 -
maven
aven报错:maven-archetype-webapp:RELEASE from any of the configured repositories今天学习maven,在控制台下新建maven项目没有问题,但是在STS(eclipse)下创建maven项目老是报错,郁闷死了:-----------------------------------------转载 2015-11-27 17:00:52 · 327 阅读 · 0 评论 -
maven
eclipse中使用maven插件的时候,运行run as maven build的时候报错-Dmaven.multiModuleProjectDirectory system propery is not set. Check $M2_HOME environment variable and mvn script match. 可以设一个环境变量M2_HOME指向你的m转载 2015-11-30 17:23:19 · 361 阅读 · 0 评论 -
maven
在maven进行jetty的调试中出现错误:[plain] view plaincopy[ERROR] No plugin found for prefix 'jetty' in the current project and in the plu gin groups [org.apache.maven.plugins, org.codeha转载 2015-11-30 17:25:58 · 819 阅读 · 0 评论 -
11 编程指南_流数据
Flink 的流数据 API 编程指南Flink 的流数据处理程序是常规的程序 ,通过再流数据上,实现了各种转换 (比如 过滤, 更新中间状态, 定义窗口, 聚合)。流数据可以来之多种数据源 (比如, 消息队列, socket 流, 文件). 通过sink组件落地流计算的最终结果,比如可以把数据落地文件系统,标准输出流比如命令行界面, Flink 的程序可以运行在多种上下文环境 ,可以翻译 2015-11-12 23:27:11 · 1684 阅读 · 0 评论 -
流计算容错
This document describes Flink’s fault tolerance mechanism for streaming data flows.IntroductionCheckpointingBarriersStateExactly Once vs. At Least OnceRecoveryIntroductionApache Flin翻译 2015-11-20 16:56:57 · 1001 阅读 · 0 评论 -
架构和处理模型
The ProcessesComponent StackProjects and DependenciesThe ProcessesWhen the Flink system is started, it bring up the JobManager and one or more TaskManagers. The JobManager is the coordinat翻译 2015-11-20 16:55:57 · 421 阅读 · 0 评论 -
flink akka 应用
/* * Licensed to the Apache Software Foundation (ASF) under one * or more contributor license agreements. See the NOTICE file * distributed with this work for additional information * regardi原创 2015-11-20 18:41:39 · 2041 阅读 · 0 评论 -
02_flink 流处理
Streaming高性能 & 低延迟Flink的流计算实现,仅需要很低的配置,就能实现高吞吐量和低延迟的流数据处理。下面的图表显示了一个分布式流数据的计数任务,的性能和cpu核数的比值。正好一次语义状态的计算流数据应用可以在计算过程中保持自定义状态(state)。翻译 2015-11-09 22:23:50 · 1474 阅读 · 0 评论 -
08 Running Flink on YARN leveraging Tez
Running Flink on YARN leveraging TezYou can run Flink using Tez as an execution environment. Flink on Tez is currently included in flink-staging in alpha. All classes are located in theorg.apache.翻译 2015-11-11 21:50:51 · 905 阅读 · 0 评论 -
09 JobManager 高可用安装(HA)
JobManager High Availability (HA)The JobManager is the coordinator of each Flink deployment. It is responsible for both scheduling and resource management.By default, there is a single JobManager翻译 2015-11-11 21:51:31 · 851 阅读 · 0 评论 -
10 配置的详细说明
ConfigurationOverviewThe default configuration parameters allow Flink to run out-of-the-box in single node setups.This page lists the most common options that are typically needed to set up a翻译 2015-11-11 21:52:37 · 1502 阅读 · 0 评论 -
03 打包构建Flink的部署包
Build Flink你需要先下载源代码才能 build Flink, 可以直接下载个release版本或者去github上拉下来. 还有Maven 3, Flink 至少需要Java 7.我们推荐使用Java 8。运行下面这行拉源代码:git clone https://github.com/apache/flink最简单的building Fli翻译 2015-11-10 15:36:31 · 3876 阅读 · 0 评论 -
04 本地部署(单机模式)
本地部署本文档的目的是提供有关如何在一台机器运行Flink。DownloadRequirementsConfigurationStarting Flink下载去下载页面,下载运行包。如果你的应该里用到了Hadoop或者hbase,一定要确认和你下载的flink所依赖的Hadoop版本匹配。当有疑问或您计划只与本地文件系统,可以下载Hadoop 1.2的Fli翻译 2015-11-11 21:38:19 · 1369 阅读 · 0 评论 -
06 YARN Setup
YARN SetupQuickstart: Start a long-running Flink cluster on YARNQuickstart: Run a Flink job on YARNApache Flink on Hadoop YARN using a YARN SessionStart Flink SessionSubmit Job to Fl翻译 2015-11-11 21:49:17 · 576 阅读 · 0 评论 -
05 集群安装(stand alone)
Cluster SetupThis documentation is intended to provide instructions on how to run Flink in a fully distributed fashion on a static (but possibly heterogeneous) cluster.This involves two steps. Fir翻译 2015-11-11 21:43:56 · 583 阅读 · 0 评论 -
07 GCloud Setup
Google Compute Engine SetupThis documentation provides instructions on how to setup Flink fully automatically with Hadoop 1 or Hadoop 2 on top of a Google Compute Enginecluster. This is made possi翻译 2015-11-11 21:50:15 · 811 阅读 · 0 评论 -
Real-time stream processing: The next step for Apache Flink
转载自http://www.confluent.io/blog/real-time-stream-processing-the-next-step-for-apache-flink/by Neha NarkhedeMay 06, 2015This is a guest blog post written by Kostas Tzoumas and Stephan E转载 2015-10-28 14:07:27 · 1066 阅读 · 0 评论 -
最佳实践
This page contains a collection of best practices for Flink programmers on how to solve frequently encountered problems.Parsing command line arguments and passing them around in your Flink appli翻译 2015-11-20 16:36:11 · 906 阅读 · 0 评论 -
深入理解Apache Flink核心技术
作者:李呈祥 作者简介:Intel BigData Team软件工程师,主要关注大数据计算框架与SQL引擎的性能优化,Apache Hive Committer,Apache Flink Contributor。 责任编辑:仲浩(zhonghao@youkuaiyun.com) 文章来源:《程序员》2月期 版权声明:本文为《程序员》原创文章,未经允许不得转载,订阅2016年《程序员》请点击 h转载 2016-02-23 22:37:32 · 1810 阅读 · 0 评论