Error:scalac: missing or invalid dependency detected while loading class file ‘RDDOperationScope.cla

九师兄

于 2019-07-02 15:17:25 发布

阅读量2.3k

点赞数

CC 4.0 BY-SA版权

分类专栏：大数据-spark 文章标签： scala 开发语言后端

本文为博主九师兄（QQ:541711153 欢迎来探讨技术）原创文章，未经允许博主不允许转载。

本文链接：https://blog.youkuaiyun.com/qq_21383435/article/details/94445466

大数据-spark 专栏收录该内容

204 篇文章 ¥49.90 ¥99.00

订阅专栏

在执行Spark任务时遇到错误，提示'missing or invalid dependency detected while loading class file 'RDDOperationScope.class'。文章详细描述了在场景1和场景2中出现的错误再现，并提供了相关解决方案，包括检查依赖和引入缺失的包。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

在这里插入图片描述

1.场景1

执行spark任务报错

Error:scalac: missing or invalid dependency detected while loading class file 'RDDOperationScope.class'.
Could not access term annotation in package com.fasterxml.jackson,
because it (or its dependencies) are missing. Check your build definition for
missing or conflicting dependencies. (Re-run with `-Ylog-classpath` to see the problematic classpath.)
A full rebuild may help if 'RDDOperationScope.class' was compiled against an incompatible version of com.fasterxml.jackson.

缺少包

了解本专栏