首页 > 其他 > 详细

文件方式实现完整的英文词频统计实例

时间:2017-09-26 09:58:38      阅读:248      评论:0      收藏:0      [点我收藏+]

 

 

1.读入待分析的字符串

代码如下:

fo=open(text.txt,w)
fo.write(‘‘‘Well I wonder could it be When I was dreaming about you baby You were dreaming of me Call me crazy Call me blind To still be suffering is stupid after all of this time Did I lose my love to someone better And does she love you like I do I do, you know I really really do Well hey So much I need to say Been lonely since the day The day you went away So sad but true For me there‘s only you Been crying since the day I remember date and time September twenty second Sunday twenty five after nine In the doorway with your case No longer shouting at each other There were tears on our faces And we were letting go of something special Something we‘ll never have again I know, I guess I really really know Why do we never know what we‘ve got till it‘s gone How could I carry on Cause I‘ve been missing you so much I have to say‘‘‘
)
fo=open(text.txt,r)
day=fo.read()

结果:

技术分享

 

2.分解提取单词 

代码如下:

day=day.lower()


for i in ,.\"?:
    day=day.replace(i, )

words=day.split( )
#print(words)

运行结果:

技术分享

 

3.计数字典

代码如下:

dict={}
keys=set(words)
print(keys)
for i in keys:
    
    dict[i]=words.count(i)
print(dict)

运行结果:

技术分享

 

4.排除语法型词汇

代码如下:

exc={i,you,to,me,the,been,of,so,and,were,‘‘,on,really}

dict={}
keys=set(words)
keys=keys-exc
print(keys)
for i in keys:
    
    dict[i]=words.count(i)
print(dict)

运行结果:

技术分享

 

5.排序

代码如下:

wc=list(dict.items())
wc.sort(key=lambda x:x[1],reverse=True)
print(wc)

运行结果:

技术分享

 

6.输出TOP(20)

 代码如下:

for i in range(20):
    print(wc[i])

 

总代码如下:


fo=open(‘text.txt‘,‘w‘)
fo.write(‘‘‘Well I wonder could it be When I was dreaming about you baby You were dreaming of me Call me crazy Call me blind To still be suffering is stupid after all of this time Did I lose my love to someone better And does she love you like I do I do, you know I really really do Well hey So much I need to say Been lonely since the day The day you went away So sad but true For me there‘s only you Been crying since the day I remember date and time September twenty second Sunday twenty five after nine In the doorway with your case No longer shouting at each other There were tears on our faces And we were letting go of something special Something we‘ll never have again I know, I guess I really really know Why do we never know what we‘ve got till it‘s gone How could I carry on Cause I‘ve been missing you so much I have to say‘‘‘
)
fo=open(‘text.txt‘,‘r‘)
day=fo.read()
day=day.lower()


for i in ‘,.\"?‘:
day=day.replace(i,‘ ‘)

words=day.split(‘ ‘)
#print(words)


exc={‘i‘,‘you‘,‘to‘,‘me‘,‘the‘,‘been‘,‘of‘,‘so‘,‘and‘,‘were‘,‘‘,‘on‘,‘really‘}

dict={}
keys=set(words)
keys=keys-exc
#print(keys)
for i in keys:

dict[i]=words.count(i)
#print(dict)

wc=list(dict.items())
wc.sort(key=lambda x:x[1],reverse=True)
print(wc)

for i in range(20):
print(wc[i])

 

运行结果:

技术分享

 

文件方式实现完整的英文词频统计实例

原文:http://www.cnblogs.com/decadeyu/p/7595174.html

(0)
(0)
   
举报
评论 一句话评论(0
关于我们 - 联系我们 - 留言反馈 - 联系我们:wmxa8@hotmail.com
© 2014 bubuko.com 版权所有
打开技术之扣,分享程序人生!