今天在验证scrapy官网tutorial的例子时遇到了这个报错,例子的链接如下:
https://docs.scrapy.org/en/latest/intro/tutorial.html
example代码如下,去掉图中箭头处的‘,’(逗号), 该问题得到解决,不知道是官网例子的代码有问题,还是我的编译环境和官网使用的不同导致
执行命令:
scrapy crawl quotes
错误日志:
2017-09-09 22:55:17 [scrapy.utils.log] INFO: Scrapy 1.4.0 started (bot: tutorial)
2017-09-09 22:55:17 [scrapy.utils.log] INFO: Overridden settings: {'BOT_NAME': 't
utorial', 'SPIDER_MODULES': ['tutorial.spiders'], 'NEWSPIDER_MODULE': 'tutorial.s
piders', 'ROBOTSTXT_OBEY': True}
2017-09-09 22:55:17 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.logstats.LogStats']
2017-09-09 22:55:17 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.robotstxt.RobotsTxtMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2017-09-09 22:55:18 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.offsite.OffsiteMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2017-09-09 22:55:18 [scrapy.middleware] INFO: Enabled item pipelines:
[]
Unhandled error in Deferred:
2017-09-09 22:55:18 [twisted] CRITICAL: Unhandled error in Deferred:
2017-09-09 22:55:18 [twisted] CRITICAL:
Traceback (most recent call last):
File "e:\develop\python\lib\site-packages\twisted\internet\defer.py", line 1386
, in _inlineCallbacks
result = g.send(result)
File "e:\develop\python\lib\site-packages\scrapy\crawler.py", line 78, in crawl
start_requests = iter(self.spider.start_requests())
TypeError: 'NoneType' object is not iterable