词频统计

最新推荐文章于 2023-02-13 14:38:44 发布

weixin_30580943

最新推荐文章于 2023-02-13 14:38:44 发布

阅读量91

点赞数

CC 4.0 BY-SA版权

文章标签： python

原文链接：http://www.cnblogs.com/linbolinbo/p/8649841.html

本文介绍了一种通过去除标点符号、转换为小写并统计单词出现频率的方法来处理和分析文本数据的过程。该方法首先清理原始文本数据，接着将文本分割成单词列表，并最终统计每个单词的出现次数。

摘要生成于 C知道，由 DeepSeek-R1 满血版支持，前往体验 >

1
#-*- coding:UTF-8 -*-
# -*- author:Duym -*-



wordList=news.lower().split()
for w in wordList:
    print(w)


the
area
of
green
was
reducing
in
the
last
decades

2
 




sep=''',."?!:'''
for c in sep:
  news=news.replace(c,'')

wordList=news.lower().split()
wordDict={}
wordSet=set(wordList)
for w in wordSet:
    wordDict[w]=wordList.count(w)
for w in wordSet:
    print(w)


C:\Users\Administrator\PycharmProjects\bd\venv\Scripts\python.exe C:/Users/Administrator/PycharmProjects/bd/gzcc.py
giant
part
then
government
return
lost
protect
down


3

sep=''',."?!:'''
for c in sep:
  news=news.replace(c,'')

wordList=news.lower().split()
wordDict={}

wordSet=set(wordList)
for w in wordSet:
    wordDict[w]=wordList.count(w)

for w in wordSet:


    print(w,wordDict[w])

day 2
main 1
conservation 1
last 1
only 1
such 1
a 1
lost 2