Build and deploy workbench

最新推荐文章于 2023-05-30 01:56:46 发布

原创最新推荐文章于 2023-05-30 01:56:46 发布 · 338 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#开发工具 #人工智能 #大数据

Carrot 专栏收录该内容

3 篇文章

订阅专栏

本文介绍如何从源代码构建Carrot2文档聚类工作台，并针对中文分词器集成过程中遇到的问题提供解决方案。

To build Carrot² Document Clustering Workbench from source code:

Download Eclipse Target Platform from http://download.carrot2.org/eclipse and extract to some local folder.
Copy local.properties.example from Carrot² checkout folder tolocal.properties in the same folder. In local.properties edit thetarget.platform property to point to the Eclipse Target Platform you have downloaded.

Important

The folder pointed to by target.platform must have the eclipse/ folder inside.

You may also change the configs property to match the platform you want to build Carrot² Document Clustering Workbench for or rely on auto-detection.
Run:
```
ant workbench
```
to build Carrot² Document Clustering Workbench binaries.
Go to the tmp/ workbench/ tmp/ carrot2-workbench folder in the Carrot² checkout dir and run Carrot² Document Clustering Workbench.

we can run ant jar successfully. but if we want to run ant workbench, we should modify

workbench/org.carrot2.workbench.core.feature/feature.xml

to add our custom chinese tokenizer related jcseg jars

   <plugin
         id="org.lionsoul.jcseg"
         download-size="0"
         install-size="0"
         version="0.0.0"
         unpack="false"/>

workbench/org.carrot2.workbench.feature/carrot2.Workbench.launch

<stringAttribute key="selected_workspace_plugins" value="org.lionsoul.jcseg@default:default,com.carrotsearch.hppc@default:default,

#ant eclipse

etc/maven/poms/pom.xml

<org.lionsoul.jcseg.version>1.9.6</org.lionsoul.jcseg.version>


    <dependency>
      <groupId>org.lionsoul.jcseg</groupId>
      <artifactId>jcseg-core</artifactId>
      <version>${org.lionsoul.jcseg.version}</version>
    </dependency>

core/carrot2-util-text/META-INF/MANIFEST.MF

Bundle-SymbolicName: org.carrot2.text
Bundle-Version: 0.0.0.QUALIFIER
Require-Bundle:
 org.carrot2.core;bundle-version="0.0.0";visibility:=reexport,
 org.carrot2.util.matrix;bundle-version="0.0.0";visibility:=reexport,
 org.apache.lucene.v2;bundle-version="2.9.0";visibility:=reexport,
 org.lionsoul;bundle-version="1.9.6";visibility:=reexport,
 morfologik;bundle-version="1.1.2";resolution:=optional;visibility:=reexport,
 com.carrotsearch.hppc;bundle-version="0.3.0";visibility:=reexport

lib/org.lionsoul.jcseg/META-INF/MANIFEST.MF

Manifest-Version: 1.0
Bundle-ManifestVersion: 2
Bundle-Name: Jcseg Tokenizer
Bundle-SymbolicName: org.lionsoul.jcseg
Bundle-Version: 1.9.6
Bundle-ClassPath: jcseg-core-1.9.6.jar
Bundle-Vendor: jcseg Inc.
Bundle-RequiredExecutionEnvironment: JavaSE-1.7

#ant workbench

Successfully!

#cd tmp/workbench/build/tmp/carrot2-workbench-3.11.0-SNAPSHOT

#./carrot2-workbench

Error:

org.eclipse.swt.SWTError: No more handles [Unknown Mozilla path (MOZILLA_FIVE_HOME not set)

solution: sudo apt-get install libwebkitgtk-1.0-0

-----

But the custom tokenizer can't work.

#jar tf carrot2/tmp/workbench/build/tmp/carrot2-workbench-3.11.0-SNAPSHOT/plugins/org.lionsoul.jcseg_1.9.6.jar

Reason: there is a whitespace after

jcseg.LICENSE,\

solution: lib/org.lionsoul.jcseg/build.properties

bin.includes = META-INF/,\
               jcseg.LICENSE,\
               jcseg-core-1.9.6.jar

META-INF/
META-INF/MANIFEST.MF
jcseg.LICEN

there is no jcseg-core-1.9.6.jar in this plugin

#ant workbench

an error occurs

[java] [java] BUILD FAILED [java] /home/zhaohj/soft/eclipse/plugins/org.eclipse.pde.build_3.8.100.v20130514-1028/ scripts/productBuild/productBuild.xml:35: The following error occurred while executing this line: [java] /home/zhaohj/soft/eclipse/plugins/ org.eclipse.pde.build_3.8.100.v20130514-1028/scripts/productBuild/ productBuild.xml:69: org.eclipse.core.runtime.CoreException: x86_64 is not a valid configuration. [java] BUILD FAILED [java] /home/zhaohj/soft/eclipse/plugins/org.eclipse.pde.build_3.8.100.v20130514-1028/scripts/productBuild/productBuild.xml:35: The following error occurred while executing this line: [java] /home/zhaohj/soft/eclipse/plugins/org.eclipse.pde.build_3.8.100. v20130514-1028/scripts/productBuild/productBuild.xml:69: Unable to find element : /home/zhaohj/hadoop/src/carrot2/tmp/workbench/build/features/org.carrot2.workbench.feature/Workbench.product.

[eclipse.generateFeature] Incorrect directory entry: /home/zhaohj/hadoop/src/carrot2/.tools/rcp/3.7.1/eclipse.

----

cd carrot2/workbench/org.carrot2.workbench.target

README

Target platform definition. Download matching target's binary bundle from:

http://download.carrot2.org/eclipse

and unpack it to this folder.

org.carrot2.workbench.eclipse-3.6.2.target

<?xml version="1.0" encoding="UTF-8" standalone="no"?>
<?pde version="3.5"?>

<target name="org.carrot2.workbench.eclipse-3.6.2">
<locations>
<location path="${workspace_loc:org.carrot2.workbench.target}/3.6.2/eclipse" type="Directory"/>
</locations>
</target>

http://download.carrot2.org/eclipse/

lexicon put in dir :

/carrot2/tmp/workbench/build/tmp/carrot2-workbench-3.10.0-SNAPSHOT/configuration/org.eclipse.osgi/bundles/85/1/.cp

References

http://issues.carrot2.org/browse/CARROT-272

http://doc.carrot2.org/#section.workbench