术业有专攻

User-based: Who is similar to the boy, and what do they like?Item-based:  What is similar to what the boy likes? The algorithm The difference between User-based and Item-based :Slope-one...

IntroductionTo find these topics in a particular set of documents,We’d modify our clustering code to work with word vectors instead of the document vectors we’ve been using so far. A word vector i...

Online news clusteringCluster one million articles, as showed below, and save the cluster centroids for all clusters. Periodically, for each new article, use canopy clustering to assign it t...

jcseghttp://www.oschina.net/p/jcseghttp://technology.chtsai.org/mmseg/   scwshttp://www.ftphp.com/scws/demo/v48.phphttp://www.ftphp.com/scws/docs.php#instscwshttp://www.350351.com/...

Google global sites urlhttps://github.com/justjavac/Google-IPs JCSEGhttp://www.oschina.net/p/jcsegMMSEGhttp://technology.chtsai.org/mmseg/ //convert maven project to eclipse project...

When run cvb, there is a errororg.apache.hadoop.io.Text cannot be cast to org.apache.hadoop.io.IntWritableSolution:the new LDA requires SequenceFile<IntWritable, VectorWritable> as input...

Install tomcat7#sudo apt-get update#sudo apt-get install tomcat7#sudo apt-get install  tomcat7-adminhttp://localhost:8080/#sudo vi /etc/tomcat7/tomcat-users.xml<tomcat-users> ...

Supervised learningis tasked with learning a function from labeled training data in order to predict the value of any valid input. Common examples of supervised learning include classifying e-mail...

collaborative filteringproducing recommendations based on, and only based on, knowledge of users’ rela-tionships to items. These techniques require no knowledge of the properties of the items thems...

1.# svn co http://svn.apache.org/repos/asf/mahout/trunkor download mahout-distribution-0.9-src.tar.gz 2.mvn -DskipTests clean install package 3.create a common java project which using mahou...

recommending items to some user, denoted by u, as seen below It would be terribly slow to examine every item. In reality, a neighborhood of most similar users is computed first, and only items k...

Dirichlet clustering starts with a data set of points and a ModelDistribution. Think of ModelDistribution as a class that generates different models. You create an empty model and try to assign point...

As the name says, the fuzzy k-means clustering algorithm does a fuzzy form of k-means clustering. Instead of the exclusive clustering in k-means, fuzzy k-means tries to generate overlapping clusters ...

Different kinds of clustering problemsEXCLUSIVE CLUSTERING In exclusive clustering, an item belongs exclusively to one cluster, not several.OVERLAPPING CLUSTERING What if we wanted to do non-e...

Singular value decomposition–based recommenders  SVDRecommender  Linear interpolation item–based recommendation KnnItemBasedRecommender Cluster-based recommendation TreeCluster...

co-occurrence matrixInstead of computing the similarity between every pair of items, it’ll compute the number of times each pair of items occurs together in some user’s list of preferences, ...

generating user vectorsInput formatuserID: itemID1 itemID2 itemID3 ....Output format a Vector from all item IDs for the user, and outputs the user ID mapped to the user’s preference ve...

Running recommendations with HadoopThe glue that binds together the various Mapper and Reducer components is org.apache.mahout.cf.taste.hadoop.item.RecommenderJob. It configures and invokes the se...

mvn clean package -Dhadoop2.version=2.3.0 -DskipTestsmvn clean package -Dhadoop.version=2.3.0 -DskipTestsmvn clean package -Dhadoop.profile=200  -DskipTestsThe above commands will not work...

Clustering a collection involves three things:An algorithmA notion of both similarity and dissimilarityA stopping condition Measuring the similarity of items The most important issue...

 http://blog.youkuaiyun.com/zwan0518/article/details/9100329https://www.ibm.com/developerworks/library/j-mahout-scaling/http://mail-archives.apache.org/mod_mbox/mahout-user/201202.mbox/%3C1328197877...

1.configure parameters  by Run -> Run Configurations->Java Applications --> Arguments--input hdfs://192.168.122.1:2014/user/zhaohj/mahout/item.txt --output hdfs://192.168.122.1:2014/user/...

Transforming data into vectorsIn Mahout, vectors are implemented as three different classesDenseVector can be thought of as an array of doubles, whose size is the numberof features in the data....

K-means AlgorithmThe k-means algorithm will start with an initial set of k centroid points. The algorithm does multiple rounds of processing and refines the centroid locations until the iteration ...

Sample Data1,101,5.01,102,3.01,103,2.52,101,2.02,102,2.52,103,5.02,104,2.03,101,2.53,104,4.03,105,4.53,107,5.04,101,5.04,103,3.04,104,4.54,106,4.05,101,4.05,102,3.0...