iteye_3911-优快云博客

原创 flumeng hbase jmx integration

flumeng agent collect log events to flumeng collectorflumeng collector sends data into hbaseflumeng property file is monitored and controlled by JMX Other MBean Example existing in FlumeOb...

2013-04-12 15:14:22 149

原创 Hbase MapReduce Integration

Delete Hbase rows example $hadoop jar ./sponge-hserver.jar com.citi.sponge.mapreduce.MRDeleteRows -Dtable="elf_log" -DstartKey="10000:1365663164575:88888:testhome" -DstopKey="10000:1365663164575...

2013-04-11 16:16:03 154

原创 Spring By example -- aop

Spring AOP essentials1. ProxyFactoryBean is used for declaring AOP2. ProxyFactory is for programming AOP3. AspectJFactoryBean is for AspectJ integration4. For interface, JDK proxy is used5...

2013-03-26 14:09:16 164

原创 Spring By example -- core

Spring IOC 容器的两种实现　　BeanFactory 和ApplicationContextDefaultListableBeanFactory作为一个功能完备的默认的IOC容器 ApplicationContext 除了基本的功能外,还支持不同的信息源,访问资源,支持应用事件,提供附加服务;比基本的BeanFactory提供了更高级的形态 IOC容器的初始化过程...

2013-03-25 15:53:26 117

原创 flume ng performance tuning

Transactions are critical concept for FlumeNG.Sources produce events into Channel based on transaction batch size.Sinks consume events from Channel based on transaction batch size.It means the ...

2013-03-25 14:22:04 127

原创 flume ng arc and configuration

Please ref flume user guide firsthttp://flume.apache.org/FlumeUserGuide.htmlAnd the Cloudera flume blogshttp://blog.cloudera.com/blog/category/flume/ How to define JAVA_HOME, java options ...

2013-03-22 16:11:09 147

原创 Hadoop best practise

http://www.infoq.com/cn/articles/hadoop-ten-best-practice http://www.infoq.com/cn/articles/MapReduce-Best-Practice-1

2013-03-21 15:56:12 95

原创 Gitub change username

http://alvinalexander.com/git/git-show-change-username-email-address

2013-03-20 21:56:19 103

原创 Log Management

http://kibana.org/ http://graylog2.org/ http://www.elasticsearch.org/ http://logstash.net/ http://lucene.apache.org/core/3_6_1/queryparsersyntax.html http://twitter.github.com/bo...

2013-01-24 11:02:11 165

原创好博客

http://www.williamlong.info/archives/919.html http://qbox.io/ http://www.searchtb.com/ http://blogread.cn/it/ http://www.cnblogs.com/heaad/ http://blog.javachen.com/ Clouder...

2013-01-17 21:07:14 93

原创 ElasticSearch (8) shard allocation

http://www.elasticsearch.org/guide/reference/index-modules/allocation.html #disk usage aware allocator pluginhttps://github.com/sonian/elasticsearch-equilibrium https://groups.google.c...

2013-01-03 10:41:50 129

原创 ElasticSearch (6) cluster setting

configuration file : $ES_HOME/conf/elasticsearch.yml cluster.name : PPPPPPpath.conf: /opt/PPPPPP/elasticsearch/confindex.number_of_replicas : 0index.number_of_shards : 5index.analysis.ana...

2012-12-26 13:54:24 425

原创 ElasticSearch (7) default index mapping

default mapping file : $ES_HOME/conf/default-mapping.json { "_default_" : { "_ttl" : { "enabled" : true, "default" : 7776000000 }, "_source" : { ...

2012-12-26 13:54:11 393

原创 VisualVM

VisualVM homehttp://visualvm.java.net/ How to start jstatd1. go to $JAVA_HOME/binvi jstatd.all.policy2. add below contentgrant codebase "file:${java.home}/../lib/tools.jar" {permission j...

2012-12-26 13:39:58 102

原创 ElasticSearch (5) Excellent Blog or Example

Data Visualization on EShttp://www.elasticsearch.org/blog/2011/05/13/data-visualization-with-elasticsearch-and-protovis.html Search Engine Indexinghttp://en.wikipedia.org/wiki/Index_(search_en...

2012-12-26 10:41:16 120

原创 Java 多线程

ThreadLocalhttp://blog.youkuaiyun.com/qjyong/article/details/2158097 http://lavasoft.blog.51cto.com/62575/51926/ http://lujh99.iteye.com/blog/103804 http://javarevisited.blogspot.hk/2012/05/...

2012-12-19 10:59:28 92

原创 Java容器类

Java 容器快速报错(fail-fast)机制如果你在迭代容器元素的过程时,有别的方法添加,删除或者修改了元素的值,这个时候就会抛出ConcurrentModificationException. 实现机制:以ArrayList为例,它调用iterator方法时候,其实是调用了AbstractList的iterator方法,返回了AbstractList的一个...

2012-12-11 16:28:54 128

原创 ElasticSearch (4) cluster -- sharding test

cluster setting shards : 5 replica : 0 There are 3 ES nodes. NODE_1 master NODE_2 NODE_3 After some indices are completed, using the segment api we can see that the...

2012-11-14 17:27:05 95

原创 ElasticSearch (3) Java API -- put mapping to index

// make sure the index existing before putting the mappingMap map = client.admin().cluster() .health(new ClusterHealthRequest(indexName)).actionGet() .getIndices(); // map is always ...

2012-11-14 16:54:42 316

原创 ElasticSearch (2) REST API -- How to Search

#get all the log events by logtype with a single value tomcatcurl -XGET 'http://ES_HOST_SERVER:9200/INDEX_NAME/153299/_search' -d '{ "query" : { "term" : { "logtype" : "tomcat" } ...

2012-11-14 16:26:13 100

原创 ElasticSearch (1) REST API -- ES server itself

http://www.elasticsearch.org/http://elasticsearch-users.115913.n3.nabble.com/https://groups.google.com/forum/?fromgroups=#!forum/elasticsearch ##### index settings ##### http://ES...

2012-11-14 16:14:58 119

原创 Clouder SCM Manager FAQ

Q1Sometimes SCM manger lose connection with agent because the agent is dead.A1You should start the agent service.$cd /etc/init.d$./cloudera-scm-agent status$./cloudera-scm-agent start ...

2012-11-05 17:50:58 101

原创 Linux File descriptor limit

1. Find out what the current open file descriptor limit is. $more /proc/sys/fs/file-max753825 or $sysctl -a | grep fs.file-maxfs.file-max = 7538252. View how many open file descriptor...

2012-11-01 13:38:53 987

原创 Jenkins installation

ENV listOS : redhat linux enterprise server 5.6 Install Jenkins1. download rpm installer from http://pkg.jenkins-ci.org/redhat/2. logon your system, scsu to root $pwd/root$lsapache-a...

2012-10-31 18:06:24 157

原创 YAML

http://www.yaml.org/ YAML: YAML Ain't Markup LanguageWhat It Is: YAML is a human friendly data serialization standard for all programming languages.YAML Resources: YAML 1.2 (3rd Ed...

2012-10-30 13:47:29 114

原创 Jenkins SVN

$pwd/root/.jenkins/jobs/projectName_wasce/workspace$ls -a. build-parser.xml .project.. build.xml solr-projectNamebuild ...

2012-10-25 16:43:46 124

原创 Java 字符串本质

Java字符串本质上是char序列组成.char是一个采用UTF-16编码表示Unicode代码点的代码单元.大多数的常用Unicode字符使用一个代码元就可以表示,而辅助字符需要一对代码元表示.具体编码规范见 http://ilnba.iteye.com/admin/blogs/1612414 length方法将返回采用UTF-16编码表示的给定字符串所需要的代码单元数量. pub...

2012-09-20 15:14:27 403

原创 Hbase Miscellaneous

FAQ1. Lease does not existhttp://www.linuxlefty.com/SysAdmin/lease-does-not-exist-error-hbase-export.htmlHbase Performance Toolhttp://wiki.apache.org/hadoop/Hbase/PerformanceEvaluation...

2012-08-29 14:37:58 125

原创 tomat multiple instance setup

http://www.shaunabram.com/multiple-tomcat-instances/http://www.coderanch.com/t/550067/Tomcat/Starting-Stopping-multiple-instances-apachehttp://kief.com/running-multiple-tomcat-instances-on-one...

2012-08-15 14:10:42 137

原创 GET VS POST

http://mzhou.me/?p=77001http://www.diffen.com/difference/Get_vs_Posthttp://stevenclark.com.au/2008/01/12/get-vs-post-for-the-beginner/http://www.cs.tut.fi/~jkorpela/forms/methods.htmlh...

2012-08-14 14:10:41 83

原创 REST

http://www.ibm.com/developerworks/webservices/library/ws-restful/http://blog.sina.com.cn/s/blog_628b45090100rnds.htmlhttp://shop.oreilly.com/product/9780596529260.do

2012-07-30 17:16:33 88

原创 java utf16 encoding

Unicode的码空间从U+0000到U+10FFFFUTF16分为17个多文种平面(multilingual plane),其中基本多文种平面的范围是0x0000-0xFFFF,其他的成为辅助文本平面.基本多文种平面的每个编码对应一个字符,或称作代码元,特殊的情况是:U+D800到U+DFFF之间的码位区段是永久保留不映射到字符，因此UTF-16利用保留下来的0xD800-0xDFF...

2012-07-30 16:41:32 146

原创 grep 实用例子

首先创建示例文件$ cat demo_fileTHIS LINE IS THE 1ST UPPER CASE LINE IN THIS FILE.this line is the 1st lower case line in this file.This Line Has All Its First Character Of The Word With Upper Case....

2012-07-13 16:00:05 116

原创 sed系列:pattern buffer和hold buffer

As its name implies, sed hold buffer is used to save all or part of the sed pattern space for subsequent retrieval. The contents of the pattern space can be copied to the hold space, then back again...

2012-06-26 15:13:48 225

原创 sed系列:文件多行操作

Sed reads line by line, removes any trailing new lines, places a line in a pattern space buffer, process as per the given commands and prints the pattern space.n case, if you want to delete all the ...

2012-06-26 12:51:13 301

原创 sed系列:多命令执行

Syntax:#sed -e 'command' -e 'command' filenameNote: -e option is optional for sed with single command. sed will execute the each set of command while processing input from the pattern buffer.让我们...

2012-06-22 17:01:01 747

原创 sed系列:行或者模式匹配删除特定行

“p” command prints the buffer (remember to use -n option with “p”)“d” command is just opposite, its for deletion. ‘d’ will delete the pattern space buffer and immediately starts the next cycle.S...

2012-06-21 15:52:41 948

原创 sed系列:用地址或者模式匹配输出文件行

Unix Sed Introduction sed is a “non-interactive” stream-oriented editor. Since its an “non-interactive” it can be used to automate editing if desired. The name sed is an abbreviation for stream ed...

2012-06-21 15:02:06 143

原创 sed 系列: 分支操作

无条件分支语法$ sed ':label command(s) b label':label - specification of label.commands - Any sed command(s)label - Any Name for the labelb label – jumps to the label with out checking any conditio...

2012-06-21 11:47:06 397

原创 sed 系列: 用正则表达式查找和替换

The `s’ command is probably the most important in `sed’ and has a lot of different options.The `s’ command attempts to match the pattern space against the supplied REGEXP; if the match is successf...

2012-06-19 20:55:11 3073

空空如也

空空如也