iteye_3911-优快云博客

原创 flumeng hbase jmx integration

flumeng agent collect log events to flumeng collector flumeng collector sends data into hbase flumeng property file is monitored and controlled by JMX Other MBean Example existing in Flume Ob...

2013-04-12 15:14:22 156

原创 Hbase MapReduce Integration

Delete Hbase rows example $hadoop jar ./sponge-hserver.jar com.citi.sponge.mapreduce.MRDeleteRows -Dtable="elf_log" -DstartKey="10000:1365663164575:88888:testhome" -DstopKey="10000:1365663164575...

2013-04-11 16:16:03 162

原创 Spring By example -- aop

Spring AOP essentials 1. ProxyFactoryBean is used for declaring AOP 2. ProxyFactory is for programming AOP 3. AspectJFactoryBean is for AspectJ integration 4. For interface, JDK proxy is used 5...

2013-03-26 14:09:16 173

原创 Spring By example -- core

Spring IOC 容器的两种实现　　BeanFactory 和ApplicationContext DefaultListableBeanFactory作为一个功能完备的默认的IOC容器 ApplicationContext 除了基本的功能外,还支持不同的信息源,访问资源,支持应用事件,提供附加服务;比基本的BeanFactory提供了更高级的形态 IOC容器的初始化过程...

2013-03-25 15:53:26 127

原创 flume ng performance tuning

Transactions are critical concept for FlumeNG. Sources produce events into Channel based on transaction batch size. Sinks consume events from Channel based on transaction batch size. It means the ...

2013-03-25 14:22:04 133

原创 flume ng arc and configuration

Please ref flume user guide first http://flume.apache.org/FlumeUserGuide.html And the Cloudera flume blogs http://blog.cloudera.com/blog/category/flume/ How to define JAVA_HOME, java options ...

2013-03-22 16:11:09 151

原创 Hadoop best practise

http://www.infoq.com/cn/articles/hadoop-ten-best-practice http://www.infoq.com/cn/articles/MapReduce-Best-Practice-1

2013-03-21 15:56:12 99

原创 Gitub change username

http://alvinalexander.com/git/git-show-change-username-email-address

2013-03-20 21:56:19 111

原创 Log Management

http://kibana.org/ http://graylog2.org/ http://www.elasticsearch.org/ http://logstash.net/ http://lucene.apache.org/core/3_6_1/queryparsersyntax.html http://twitter.github.com/bo...

2013-01-24 11:02:11 171

原创好博客

http://www.williamlong.info/archives/919.html http://qbox.io/ http://www.searchtb.com/ http://blogread.cn/it/ http://www.cnblogs.com/heaad/ http://blog.javachen.com/ Clouder...

2013-01-17 21:07:14 98

原创 ElasticSearch (8) shard allocation

http://www.elasticsearch.org/guide/reference/index-modules/allocation.html #disk usage aware allocator plugin https://github.com/sonian/elasticsearch-equilibrium https://groups.google.c...

2013-01-03 10:41:50 139

原创 ElasticSearch (6) cluster setting

configuration file : $ES_HOME/conf/elasticsearch.yml cluster.name : PPPPPP path.conf: /opt/PPPPPP/elasticsearch/conf index.number_of_replicas : 0 index.number_of_shards : 5 index.analysis.ana...

2012-12-26 13:54:24 436

原创 ElasticSearch (7) default index mapping

default mapping file : $ES_HOME/conf/default-mapping.json { "_default_" : { "_ttl" : { "enabled" : true, "default" : 7776000000 }, "_source" : { ...

2012-12-26 13:54:11 401

原创 VisualVM

VisualVM home http://visualvm.java.net/ How to start jstatd 1. go to $JAVA_HOME/bin vi jstatd.all.policy 2. add below content grant codebase "file:${java.home}/../lib/tools.jar" {permission j...

2012-12-26 13:39:58 108

原创 ElasticSearch (5) Excellent Blog or Example

Data Visualization on ES http://www.elasticsearch.org/blog/2011/05/13/data-visualization-with-elasticsearch-and-protovis.html Search Engine Indexing http://en.wikipedia.org/wiki/Index_(search_en...

2012-12-26 10:41:16 126

原创 Java 多线程

ThreadLocal http://blog.youkuaiyun.com/qjyong/article/details/2158097 http://lavasoft.blog.51cto.com/62575/51926/ http://lujh99.iteye.com/blog/103804 http://javarevisited.blogspot.hk/2012/05/...

2012-12-19 10:59:28 98

原创 Java容器类

Java 容器快速报错(fail-fast)机制如果你在迭代容器元素的过程时,有别的方法添加,删除或者修改了元素的值,这个时候就会抛出ConcurrentModificationException. 实现机制:以ArrayList为例,它调用iterator方法时候,其实是调用了AbstractList的iterator方法,返回了AbstractList的一个...

2012-12-11 16:28:54 130

原创 ElasticSearch (4) cluster -- sharding test

cluster setting shards : 5 replica : 0 There are 3 ES nodes. NODE_1 master NODE_2 NODE_3 After some indices are completed, using the segment api we can see that the...

2012-11-14 17:27:05 99

原创 ElasticSearch (3) Java API -- put mapping to index

// make sure the index existing before putting the mapping Map map = client.admin().cluster() .health(new ClusterHealthRequest(indexName)).actionGet() .getIndices(); // map is always ...

2012-11-14 16:54:42 322

原创 ElasticSearch (2) REST API -- How to Search

#get all the log events by logtype with a single value tomcat curl -XGET 'http://ES_HOST_SERVER:9200/INDEX_NAME/153299/_search' -d '{ "query" : { "term" : { "logtype" : "tomcat" } ...

2012-11-14 16:26:13 104

原创 ElasticSearch (1) REST API -- ES server itself

http://www.elasticsearch.org/ http://elasticsearch-users.115913.n3.nabble.com/ https://groups.google.com/forum/?fromgroups=#!forum/elasticsearch ##### index settings ##### http://ES...

2012-11-14 16:14:58 130

原创 Clouder SCM Manager FAQ

Q1 Sometimes SCM manger lose connection with agent because the agent is dead. A1 You should start the agent service. $cd /etc/init.d $./cloudera-scm-agent status $./cloudera-scm-agent start ...

2012-11-05 17:50:58 107

原创 Linux File descriptor limit

1. Find out what the current open file descriptor limit is. $more /proc/sys/fs/file-max 753825 or $sysctl -a | grep fs.file-max fs.file-max = 753825 2. View how many open file descriptor...

2012-11-01 13:38:53 1001

原创 Jenkins installation

ENV list OS : redhat linux enterprise server 5.6 Install Jenkins 1. download rpm installer from http://pkg.jenkins-ci.org/redhat/ 2. logon your system, scsu to root $pwd /root $ls apache-a...

2012-10-31 18:06:24 163

原创 YAML

http://www.yaml.org/ YAML: YAML Ain't Markup Language What It Is: YAML is a human friendly data serialization standard for all programming languages. YAML Resources: YAML 1.2 (3rd Ed...

2012-10-30 13:47:29 120

原创 Jenkins SVN

$pwd /root/.jenkins/jobs/projectName_wasce/workspace $ls -a . build-parser.xml .project .. build.xml solr-projectName build ...

2012-10-25 16:43:46 132

原创 Java 字符串本质

Java字符串本质上是char序列组成.char是一个采用UTF-16编码表示Unicode代码点的代码单元.大多数的常用Unicode字符使用一个代码元就可以表示,而辅助字符需要一对代码元表示.具体编码规范见 http://ilnba.iteye.com/admin/blogs/1612414 length方法将返回采用UTF-16编码表示的给定字符串所需要的代码单元数量. pub...

2012-09-20 15:14:27 410

原创 Hbase Miscellaneous

FAQ 1. Lease does not exist http://www.linuxlefty.com/SysAdmin/lease-does-not-exist-error-hbase-export.html Hbase Performance Tool http://wiki.apache.org/hadoop/Hbase/PerformanceEvaluation...

2012-08-29 14:37:58 134

原创 tomat multiple instance setup

http://www.shaunabram.com/multiple-tomcat-instances/ http://www.coderanch.com/t/550067/Tomcat/Starting-Stopping-multiple-instances-apache http://kief.com/running-multiple-tomcat-instances-on-one...

2012-08-15 14:10:42 152

原创 GET VS POST

http://mzhou.me/?p=77001 http://www.diffen.com/difference/Get_vs_Post http://stevenclark.com.au/2008/01/12/get-vs-post-for-the-beginner/ http://www.cs.tut.fi/~jkorpela/forms/methods.html h...

2012-08-14 14:10:41 89

原创 REST

http://www.ibm.com/developerworks/webservices/library/ws-restful/ http://blog.sina.com.cn/s/blog_628b45090100rnds.html http://shop.oreilly.com/product/9780596529260.do

2012-07-30 17:16:33 97

Unicode的码空间从U+0000到U+10FFFF UTF16分为17个多文种平面(multilingual plane),其中基本多文种平面的范围是0x0000-0xFFFF,其他的成为辅助文本平面. 基本多文种平面的每个编码对应一个字符,或称作代码元,特殊的情况是: U+D800到U+DFFF之间的码位区段是永久保留不映射到字符，因此UTF-16利用保留下来的0xD800-0xDFF...

2012-07-30 16:41:32 152

原创 grep 实用例子

首先创建示例文件 $ cat demo_file THIS LINE IS THE 1ST UPPER CASE LINE IN THIS FILE. this line is the 1st lower case line in this file. This Line Has All Its First Character Of The Word With Upper Case. ...

2012-07-13 16:00:05 124

原创 sed系列:pattern buffer和hold buffer

As its name implies, sed hold buffer is used to save all or part of the sed pattern space for subsequent retrieval. The contents of the pattern space can be copied to the hold space, then back again...

2012-06-26 15:13:48 235

原创 sed系列:文件多行操作

Sed reads line by line, removes any trailing new lines, places a line in a pattern space buffer, process as per the given commands and prints the pattern space. n case, if you want to delete all the ...

2012-06-26 12:51:13 310

原创 sed系列:多命令执行

Syntax: #sed -e 'command' -e 'command' filename Note: -e option is optional for sed with single command. sed will execute the each set of command while processing input from the pattern buffer. 让我们...

2012-06-22 17:01:01 760

原创 sed系列:行或者模式匹配删除特定行

“p” command prints the buffer (remember to use -n option with “p”) “d” command is just opposite, its for deletion. ‘d’ will delete the pattern space buffer and immediately starts the next cycle. S...

2012-06-21 15:52:41 958

原创 sed系列:用地址或者模式匹配输出文件行

Unix Sed Introduction sed is a “non-interactive” stream-oriented editor. Since its an “non-interactive” it can be used to automate editing if desired. The name sed is an abbreviation for stream ed...

2012-06-21 15:02:06 153

原创 sed 系列: 分支操作

无条件分支语法 $ sed ':label command(s) b label' :label - specification of label. commands - Any sed command(s) label - Any Name for the label b label – jumps to the label with out checking any conditio...

2012-06-21 11:47:06 407

原创 sed 系列: 用正则表达式查找和替换

The `s’ command is probably the most important in `sed’ and has a lot of different options. The `s’ command attempts to match the pattern space against the supplied REGEXP; if the match is successf...

2012-06-19 20:55:11 3084

空空如也

空空如也