qq_51474032的博客

原创 2021-06-24

原创 2021-06-17

** demo1 ** from sklearn.cluster import KMeans import numpy as np np.random.randint(666) def keansdemo(): # 读取文件 file=open(“city.txt”,encoding=“utf-8”) cityName=[] # 保存省份名称 cityData=[] # 保存省份数据 for line in file: items=line.split(",") cityName.append(items

原创 python中常见的问题解决3

class Sanguospider(scrapy.Spider): name = “threespider” allowed_domains=[“book.douban.com”] start_urls=[“https://book.douban.com/subject/1019568/comments/”] def parse(self, response, **kwargs): data=response.css(“div.comment span.short::text”).extract() da

原创 Python中常见问题2

spiders文件夹下创建python文件 ganspider.py import scrapy from demo6.items import HouseItem class GanJiSpider(scrapy.Spider): name=“gan_spider” allowed_domains=[“xiangyang.ganji.com”] start_urls=[“http://xiangyang.ganji.com/zufang/”] 解析数据 def parse(self, response,

原创 python常见问题1

实训考题：根据豆瓣读书top250,根据出版社对书籍数量分类，绘制饼图 一、爬虫–scrapy 1.搭建环境 2.加载scrapy框架 3. setting配置 4.spider编写 测试 5. 获取数据（书名+出版社) import scrapy import numpy as np import pandas as pd import matplotlib.pyplot as plt terminal 终端实现 cd … # 跳转到上一层目录 scrapy startproject booktop #