ImportError: cannot import name xx (scrapy爬虫之xx_spider.py和xxItem.py文件中import出错的问题)

最新推荐文章于 2025-06-11 18:07:49 发布

原创最新推荐文章于 2025-06-11 18:07:49 发布 · 4.3k 阅读

0 ·

CC 4.0 BY-SA版权

文章标签：

#scrapy #爬虫 #ImportError

Scrapy 专栏收录该内容

5 篇文章

订阅专栏

在使用Scrapy爬虫时遇到ImportError：'cannot import name jianshuItem'的问题。解决方法是在xx_spider.py中正确导入items模块，格式为：from 项目名.items import 类名+Item，例如项目名为jianshu，类名为Jianshu，则导入语句应为：from jianshu.items import JianshuItem。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

问题描述：

ImportError：“ImportError: cannot import name jianshuItem”

[root@Uu jianshu]# scrapy crawl jianshu
Traceback (most recent call last):
  File "/usr/bin/scrapy", line 11, in <module>
    sys.exit(execute())
  File "/usr/lib64/python2.7/site-packages/scrapy/cmdline.py", line 149, in execute
    cmd.crawler_process = CrawlerProcess(settings)
  File "/usr/lib64/python2.7/site-packages/scrapy/crawler.py", line 249, in __init__
    super(CrawlerProcess, self).__init__(settings)
  File "/usr/lib64/python2.7/site-packages/scrapy/crawler.py", line 137, in __init__
    self.spider_loader = _get_spider_loader(settings)
  File "/usr/lib64/python2.7/site-packages/scrapy/crawler.py", line 336, in _get_spider_loader
    return loader_cls.from_settings(settings.frozencopy())
  File "/usr/lib64/python2.7/site-packages/scrapy/spiderloader.py", line 61, in from_settings
    return cls(settings)
  File "/usr/lib64/python2.7/site-packages/scrapy/spiderloader.py", line 25, in __init__
    self._load_all_spiders()
  File "/usr/lib64/python2.7/site-packages/scrapy/spiderloader.py", line 47, in _load_all_spiders
    for module in walk_modules(name):
  File "/usr/lib64/python2.7/site-packages/scrapy/utils/misc.py", line 71, in walk_modules
    submod = import_module(fullpath)
  File "/usr/lib64/python2.7/importlib/__init__.py", line 37, in import_module
    __import__(name)
  File "/home/BS/scrapy/jianshu/jianshu/spiders/jianshu_Spider.py", line 2, in <module>
    from jianshu.items import jianshuItem
ImportError: cannot import name jianshuItem

解决问题，过程如下：

[root@Uu jianshu]# cat items.py
# -*- coding: utf-8 -*-

# Define here the models for your scraped items
#
# See documentation in:
# https://doc.scrapy.org/en/latest/topics/items.html

import scrapy


class JianshuItem(scrapy.Item):
    # define the fields for your item here like:
    title = scrapy.Field()
    url = scrapy.Field()
    author = scrapy.Field()
    readNum = scrapy.Field()
    commentNum = scrapy.Field()
    likeNum = scrapy.Field()
~
~	
"items.py" 18L, 420C written
[root@Uu spiders]# vi jianshu_Spider.py
import scrapy
from jianshu.items import JianshuItem

class jianshu_spider(scrapy.Spider):
        name = 'jianshu'
        allowed_domains = ['www.jianshu.com']
        start_urls = ['http://www.jianshu.com/top/monthly']

        def parse(self , response):
                item = JianshuItem()
                selector = Selector(response)
                selector.xpath('//ul[@class="article-list thumbnails"]/li')
                for article in articles:
                        title = article.xpath('//div/h4/a/text()').extract()
                        url = article.xpath('//div/h4/a/@href').extract()
                        author = article.xpath('//div/p/a/text()').extract()
                item['title'] = title
                item['url'] = url
                item['author'] = author
                yield item

~
~
~
~
~
"jianshu_Spider.py" 21L, 625C written

解决思路：

解决xx_spider.py中的 from 项目名.items import item.py中class的名字+Item
如项目名为jianshu，item.py中class名字为Jianshu，则，此处为：from jianshu.items import JianshuItem ,否则将会报出如上错误。