Sum up the number of words frequency using FreqDist, python

python nltk frequency-distribution
Gusto picture Gusto · Nov 17, 2010 · Viewed 8.2k times · Source

How to sum up the number of words frequency using fd.items() from FreqDist?

>>> fd = FreqDist(text) 
>>> most_freq_w = fd.keys()[:10] #gives me the most 10 frequent words in the text
>>> #here I should sum up numbers of each of these 10 freq words appear in the text

e.g. if each word in most_freq_w appear 10 times, the result should be 100

!!! I don't need that number of all words in the text, just the 10 most frequent

Answer

Steve Tjoa picture Steve Tjoa · Nov 17, 2010

I'm not familiar with nltk, but since FreqDist derives from dict, then the following should work:

v = fd.values()
v.sort()
count = sum(v[-10:])

Related questions

FreqDist using NLTK

I'm trying to get a frequency distribution of a set of documents using Python. My code isn't working for some reason and is producing this error: Traceback (most recent call last): File "C:\Documents and Settings\aschein\Desktop\freqdist", line 32, …

Read More
re.sub erroring with "Expected string or bytes-like object"

I have read multiple posts regarding this error, but I still can't figure it out. When I try to loop through my function: def fix_Plan(location): letters_only = re.sub("[^a-zA-Z]", # Search for all non-letters " ", # Replace all non-letters with …

Read More
pip issue installing almost any library

I have a difficult time using pip to install almost anything. I'm new to coding, so I thought maybe this is something I've been doing wrong and have opted out to easy_install to get most of what I needed …

Read More