文章探讨了在Spark编程中使用静态变量可能导致的问题，并提供了解决方案。
[url]https://issues.apache.org/jira/browse/SPARK-5594[/url]
Do you write sth like:
object XXX {
val sc = new SparkContext()
def main {
rdd.map
{ someFunc() }
}
def someFunc{}
}
Our user meet the same exception because make the sparkContext as static variable instead of a local variable.
Do you write sth like:
object XXX {
val sc = new SparkContext()
def main {
rdd.map
{ someFunc() }
}
def someFunc{}
}
Our user meet the same exception because make the sparkContext as static variable instead of a local variable.
扫一扫
1131
被折叠的 条评论
为什么被折叠?
到【灌水乐园】发言
