【Python小白学习】文本词频统计

博客主要进行了英文《Hamlet》的词频统计以及中文《三国演义》的人物出场统计,并尝试将词频和人物相关联,以面向特定问题展开分析。

摘要生成于 C知道 ,由 DeepSeek-R1 满血版支持, 前往体验 >

英文_Hamlet英文词频统计

#CalHamlet.py

def getText():
    txt = open("hamlet.txt", "r").read()
    txt = txt.lower()
    for ch in '!"#$%&()*+,-./:;<=>?@[\\]^_‘{|}~':
        txt = txt.replace(ch, " ")
    return txt

hamletText = getText()
words = hamletTxt.spilt()       #words是一个列表类型
counts = {}                     #counts是一个字典类型
for word in words:
    counts[word] = counts.get(word, 0)

items = list(counts.items())
items.sort(key = lambda x :x[1], reverse = True)    #reverse = True:从大到小排序

for i in range(10):
    word, count = items[i]
    print("{0:<10}{1:>5}".format(word, count))

中文_《三国演义》人物出场统计

       将词频和人物相关联,面向问题

#CalThreeKingdoms.py

import jieba

txt = open("threekingdoms.txt", "r", encoding = "utf-8").read()
excludes = {"将军", "却说", "荆州", "二人", "不可", "不能", "如此", "商议", "主公"}
words = jieba.lcut(txt)
counts = {}                     #counts是一个字典类型
for word in words:
    if len(word) == 1:
        continue
    elif word == "诸葛亮" or word == "孔明曰":
        rword == "孔明"
    elif word == "关公" or word == "云长":
        rword = "关羽"
    elif word == "玄德" or word == "玄德曰":
        rword = "刘备"
    elif word == "孟德" or word == "丞相":
        rword = "曹操"
    else:
        rword = word
    counts[rword] = counts.get(rword, 0) + 1
for word in excludes:
    del counts[word]
items = list(counts.items())
items.sort(key = lambda x :x[1], reverse = True)    #reverse = True:从大到小排序

for i in range(10):
    word, count = items[i]
    print("{0:<10}{1:>5}".format(word, count))

 

评论
添加红包

请填写红包祝福语或标题

红包个数最小为10个

红包金额最低5元

当前余额3.43前往充值 >
需支付:10.00
成就一亿技术人!
领取后你会自动成为博主和红包主的粉丝 规则
hope_wisdom
发出的红包
实付
使用余额支付
点击重新获取
扫码支付
钱包余额 0

抵扣说明:

1.余额是钱包充值的虚拟货币,按照1:1的比例进行支付金额的抵扣。
2.余额无法直接购买下载,可以购买VIP、付费专栏及课程。

余额充值