Theory

Zipf's Law - a word's utterance rank is inversly proportional to its frequency

TF-IDF - a word's utterance is offset in the number of documents where the world is found. This shows the importance of the word throughout the corpus of documents