luyee2010的专栏

ActionsThe following table lists some of the common actions supported by Spark. Refer to the RDD API doc (Scala, Java, Python) and pair RDD functions doc (Scala, Java) for details.Ac

TransformationsThe following table lists some of the common transformations supported by Spark. Refer to the RDD API doc (Scala, Java, Python) and pair RDD functions doc (Scala, Java) for deta

Spark Programming GuideOverviewLinking with SparkInitializing SparkUsing the ShellResilient Distributed Datasets (RDDs)Parallelized CollectionsExternal DatasetsRDD OperationsBasicsPa

Quick StartInteractive Analysis with the Spark ShellBasicsMore on RDD OperationsCachingStandalone ApplicationsWhere to Go from HereThis tutorial provides a quick introduction to using Sp

Spark Streaming Programming GuideOverviewA Quick ExampleBasic ConceptsLinkingInitializing StreamingContextDiscretized Streams (DStreams)Input DStreamsTransformations on DStreamsOutput Operatio

Spark SQL Programming GuideOverviewGetting StartedData SourcesRDDsInferring the Schema Using ReflectionProgrammatically Specifying the SchemaParquet FilesLoading Data Programmaticall

mac Os  10.12  +hadoop2.7.2+spark1.6.1 ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn --deploy-mode cluster --driver-memory 4g --executor-memory 2g

spark1.6.3elasticsearch 5.4bulk api ```(Netty4Utils:117)-NoSuchMethodError io.netty.buffer.CompositeByteBuf.addComponents(ZLjava/lang/Iterable;)Lio/netty/buffer/CompositeByteBuf;at o

spark 1.6  scala2.10  替换jackson相关的包依赖 com.fasterxml.jackson.module jackson-module-scala_2.10 2.7.4 com.fasterxml.jackson.modu