词频统计

最新推荐文章于 2023-02-13 14:38:44 发布

转载最新推荐文章于 2023-02-13 14:38:44 发布 · 99 阅读

0 ·

CC 4.0 BY-SA版权

原文链接：http://www.cnblogs.com/childish/p/9167859.html

本文介绍了一个简单的Python程序，用于读取文件内容，并进行文本清理、单词分割、统计单词出现频率等操作。通过去除标点符号并按空格分割，实现了对文本中单词的基本统计。

#1.
jianFile = open('jian.txt',mode='r',encoding='utf-8')
jianText = jianFile.read()
jianFile.close()
print(jianText)

#2.
replaceList = [',',"'",'-','\n']
for c in replaceList:
    jianText = jianText.replace(c,' ')
print(jianText)

#3.
print(jianText.split(' '))
jianList = jianText.split(' ')

#4.
jianSet = set(jianList)
print(jianSet)

jianDict = {}
for word in jianSet:
    jianDict[word] = jianList.count(word)

print(jianDict)
for d in jianDict:
    print(d,jianDict[d])

#5.
wordCountList = list(jianDict.items())
print(wordCountList)
wordCountList.sort(key=lambda x:x[1],reverse=True)
print(wordCountList)

#6.
for i in range(20):
    print(wordCountList[i])

#7.
jianCountFile = open('jianCount.txt',mode='a',encoding='utf-8')
for i in range(len(wordCountList)):
    jianCountFile.write(str(wordCountList[i][1])+' '+wordCountList[i][0]+'\n')
jianCountFile.close()