(scrapy_env) C:\Users\Lenovo\nepu_qa_project>scrapy crawl nepu_info
2025-07-06 23:05:58 [scrapy.utils.log] INFO: Scrapy 2.8.0 started (bot: nepu_spider)
2025-07-06 23:05:58 [scrapy.utils.log] INFO: Versions: lxml 4.9.3.0, libxml2 2.10.4, cssselect 1.1.0, parsel 1.6.0, w3lib 1.21.0, Twisted 22.10.0, Python 3.11.5 | packaged by Anaconda, Inc. | (main, Sep 11 2023, 13:26:23) [MSC v.1916 64 bit (AMD64)], pyOpenSSL 23.2.0 (OpenSSL 3.0.10 1 Aug 2023), cryptography 41.0.3, Platform Windows-10-10.0.26100-SP0
2025-07-06 23:05:58 [scrapy.crawler] INFO: Overridden settings:
{'AUTOTHROTTLE_ENABLED': True,
'AUTOTHROTTLE_MAX_DELAY': 10.0,
'AUTOTHROTTLE_START_DELAY': 1.0,
'AUTOTHROTTLE_TARGET_CONCURRENCY': 8.0,
'BOT_NAME': 'nepu_spider',
'CONCURRENT_REQUESTS': 8,
'COOKIES_ENABLED': False,
'DEPTH_LIMIT': 3,
'DEPTH_PRIORITY': 1,
'DOWNLOAD_DELAY': 0.5,
'DOWNLOAD_TIMEOUT': 15,
'HTTPCACHE_ENABLED': True,
'HTTPCACHE_EXPIRATION_SECS': 86400,
'HTTPCACHE_IGNORE_HTTP_CODES': [301, 302, 404],
'LOG_LEVEL': 'INFO',
'NEWSPIDER_MODULE': 'nepu_spider.spiders',
'RETRY_HTTP_CODES': [500, 502, 503, 504, 408, 429],
'RETRY_TIMES': 3,
'ROBOTSTXT_OBEY': True,
'SPIDER_MODULES': ['nepu_spider.spiders'],
'USER_AGENT': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 '
'(KHTML, like Gecko) Chrome/91.0.4472.124 Safari/537.36'}
2025-07-06 23:05:58 [py.warnings] WARNING: D:\annaCONDA\Lib\site-packages\scrapy\utils\request.py:232: ScrapyDeprecationWarning: '2.6' is a deprecated value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting.
It is also the default value. In other words, it is normal to get this warning if you have not defined a value for the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting. This is so for backward compatibility reasons, but it will change in a future version of Scrapy.
See the documentation of the 'REQUEST_FINGERPRINTER_IMPLEMENTATION' setting for information on how to handle this deprecation.
return cls(crawler)
2025-07-06 23:05:58 [scrapy.extensions.telnet] INFO: Telnet Password: b6620448c3adbe39
2025-07-06 23:05:58 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.throttle.AutoThrottle']
Unhandled error in Deferred:
2025-07-06 23:05:58 [twisted] CRITICAL: Unhandled error in Deferred:
Traceback (most recent call last):
File "D:\annaCONDA\Lib\site-packages\scrapy\crawler.py", line 233, in crawl
return self._crawl(crawler, *args, **kwargs)
File "D:\annaCONDA\Lib\site-packages\scrapy\crawler.py", line 237, in _crawl
d = crawler.crawl(*args, **kwargs)
File "D:\annaCONDA\Lib\site-packages\twisted\internet\defer.py", line 1947, in unwindGenerator
return _cancellableInlineCallbacks(gen)
File "D:\annaCONDA\Lib\site-packages\twisted\internet\defer.py", line 1857, in _cancellableInlineCallbacks
_inlineCallbacks(None, gen, status, _copy_context())
--- <exception caught here> ---
File "D:\annaCONDA\Lib\site-packages\twisted\internet\defer.py", line 1697, in _inlineCallbacks
result = context.run(gen.send, result)
File "D:\annaCONDA\Lib\site-packages\scrapy\crawler.py", line 122, in crawl
self.engine = self._create_engine()
File "D:\annaCONDA\Lib\site-packages\scrapy\crawler.py", line 136, in _create_engine
return ExecutionEngine(self, lambda _: self.stop())
File "D:\annaCONDA\Lib\site-packages\scrapy\core\engine.py", line 78, in __init__
self.downloader = downloader_cls(crawler)
File "D:\annaCONDA\Lib\site-packages\scrapy\core\downloader\__init__.py", line 85, in __init__
self.middleware = DownloaderMiddlewareManager.from_crawler(crawler)
File "D:\annaCONDA\Lib\site-packages\scrapy\middleware.py", line 68, in from_crawler
return cls.from_settings(crawler.settings, crawler)
File "D:\annaCONDA\Lib\site-packages\scrapy\middleware.py", line 43, in from_settings
mwcls = load_object(clspath)
File "D:\annaCONDA\Lib\site-packages\scrapy\utils\misc.py", line 60, in load_object
mod = import_module(module)
File "D:\annaCONDA\Lib\importlib\__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
File "<frozen importlib._bootstrap>", line 1126, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
File "<frozen importlib._bootstrap>", line 1140, in _find_and_load_unlocked
builtins.ModuleNotFoundError: No module named 'your_project'
2025-07-06 23:05:58 [twisted] CRITICAL:
Traceback (most recent call last):
File "D:\annaCONDA\Lib\site-packages\twisted\internet\defer.py", line 1697, in _inlineCallbacks
result = context.run(gen.send, result)
File "D:\annaCONDA\Lib\site-packages\scrapy\crawler.py", line 122, in crawl
self.engine = self._create_engine()
File "D:\annaCONDA\Lib\site-packages\scrapy\crawler.py", line 136, in _create_engine
return ExecutionEngine(self, lambda _: self.stop())
File "D:\annaCONDA\Lib\site-packages\scrapy\core\engine.py", line 78, in __init__
self.downloader = downloader_cls(crawler)
File "D:\annaCONDA\Lib\site-packages\scrapy\core\downloader\__init__.py", line 85, in __init__
self.middleware = DownloaderMiddlewareManager.from_crawler(crawler)
File "D:\annaCONDA\Lib\site-packages\scrapy\middleware.py", line 68, in from_crawler
return cls.from_settings(crawler.settings, crawler)
File "D:\annaCONDA\Lib\site-packages\scrapy\middleware.py", line 43, in from_settings
mwcls = load_object(clspath)
File "D:\annaCONDA\Lib\site-packages\scrapy\utils\misc.py", line 60, in load_object
mod = import_module(module)
File "D:\annaCONDA\Lib\importlib\__init__.py", line 126, in import_module
return _bootstrap._gcd_import(name[level:], package, level)
File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
File "<frozen importlib._bootstrap>", line 1126, in _find_and_load_unlocked
File "<frozen importlib._bootstrap>", line 241, in _call_with_frames_removed
File "<frozen importlib._bootstrap>", line 1204, in _gcd_import
File "<frozen importlib._bootstrap>", line 1176, in _find_and_load
File "<frozen importlib._bootstrap>", line 1140, in _find_and_load_unlocked
ModuleNotFoundError: No module named 'your_project'