linux ubuntu平台下安装Scrapy

最新推荐文章于 2025-09-12 15:58:40 发布

吃素的小动物

最新推荐文章于 2025-09-12 15:58:40 发布

阅读量65

点赞数

CC 4.0 BY-SA版权

文章标签： python 操作系统 shell

原文链接：http://www.cnblogs.com/hee0624/p/5254055.html

本文详细介绍如何在Linux环境下安装Python及Scrapy爬虫框架。包括使用sudo apt获取Python 2.7及相关开发工具、通过get-pip.py安装pip、利用pip安装lxml和Scrapy等依赖库的具体步骤。

1.安装Python

　　sudo apt-get install python2.7 python2.7-dev

2.安装pip

　　下载get-pip.py

　　选中该文件所在路径，执行下面的命令

　　sudo python get-pip.py

3.安装Scrapy

　　安装lxml：sudo pip install lxml

　　验证openssl 直接输入openssl

　　sudo pip install Scrapy

安装完毕之后，输入scrapy来验证是否成功

Scrapy 1.0.5 - no active project

Usage:
  scrapy <command> [options] [args]

Available commands:
  bench         Run quick benchmark test
  commands      
  fetch         Fetch a URL using the Scrapy downloader
  runspider     Run a self-contained spider (without creating a project)
  settings      Get settings values
  shell         Interactive scraping console
  startproject  Create new project
  version       Print Scrapy version
  view          Open URL in browser, as seen by Scrapy

  [ more ]      More commands available when run from project directory

Use "scrapy <command> -h" to see more info about a command