14.分布式爬虫 Redis基础

Redis基础

1. docker attach 3ba4
2. apt-get install redis-server
3. 启动： /etc/init.d/redis-server restart
4. 退出：exit
5. 查看是否能ping通： redis-cli -h 127.0.0.1 -o 6379

Redis命令

1. redis-cli -h 127.0.0.1 p 6379
2. set hello 123456789 #以key-value 方式存储
3. get hello
4. strlen hello
5. 批量设置: mset a 199 b450 c hello
6. 批量获取: mget a c
7. 哈希存储法： key-filed-value
8. hset title name hello
9. hget title name
10. hset title sex boy
11. hget title sex
12. 批量设置： hmset title name abc id 890 sex boy
13. key:title filed:name id sex value:abc 890 boy
14. hget title id
15. hgetall title
16. hset url 123.com 1
17. hget url 123.com #判断是否为1还是0

import redis
import pymysql

rconn = redis.Redis("172.17.0.8", "6379")
# key-filed-value
# url - str(i) - value    value=1/0
for i in range(100):
	rconn.hget('url', str(i))
	rconn.hset('url'. str(i), '1')
	url = "http://www.baidu"+str(i)+".com"