[Text Mining]TextBlob: Simplified Text Processing

1. Get Word and Noun Phrase Frequencies
   
2. There are two ways to get the frequency of a word or noun phrase in a TextBlob.
   
3. 
   
4. The first is through the word_counts dictionary.
   
5. 
   
6. >>> monty = TextBlob("We are no longer the Knights who say Ni. "
   
7. ...                     "We are now the Knights who say Ekki ekki ekki PTANG.")
   
8. >>> monty.word_counts['ekki']

复制代码

1. Translation and Language Detection
   
2. New in version 0.5.0.
   
3. 
   
4. TextBlobs can be translated between languages.
   
5. 
   
6. >>> en_blob = TextBlob(u'Simple is better than complex.')
   
7. >>> en_blob.translate(to='es')
   
8. TextBlob("Simple es mejor que complejo.")
   
9. If no source language is specified, TextBlob will attempt to detect the language. You can specify the source language explicitly, like so. Raises TranslatorError if the TextBlob cannot be translated into the requested language or NotTranslated if the translated result is the same as the input string.
   
10. 
    
11. >>> chinese_blob = TextBlob(u"美丽优于丑陋")
    
12. >>> chinese_blob.translate(from_lang="zh-CN", to='en')
    
13. TextBlob("Beauty is better than ugly")
    
14. You can also attempt to detect a TextBlob’s language using TextBlob.detect_language().
    
15. 
    
16. >>> b = TextBlob(u"بسيط هو أفضل من مجمع")
    
17. >>> b.detect_language()
    
18. 'ar'

复制代码

1. Parsing
   
2. Use the parse() method to parse the text.
   
3. 
   
4. >>> b = TextBlob("And now for something completely different.")
   
5. >>> print(b.parse())
   
6. And/CC/O/O now/RB/B-ADVP/O for/IN/B-PP/B-PNP something/NN/B-NP/I-PNP completely/RB/B-ADJP/O different/JJ/I-ADJP/O ././O/O

复制代码

1. n-grams
   
2. The TextBlob.ngrams() method returns a list of tuples of n successive words.
   
3. 
   
4. >>> blob = TextBlob("Now is better than never.")
   
5. >>> blob.ngrams(n=3)
   
6. [WordList(['Now', 'is', 'better']), WordList(['is', 'better', 'than']), WordList(['better', 'than', 'never'])]

复制代码

1. Get Start and End Indices of Sentences
   
2. Use sentence.start and sentence.end to get the indices where a sentence starts and ends within a TextBlob.
   
3. 
   
4. >>> for s in zen.sentences:
   
5. ...     print(s)
   
6. ...     print("---- Starts at index {}, Ends at index {}".format(s.start, s.end))
   
7. Beautiful is better than ugly.
   
8. ---- Starts at index 0, Ends at index 30
   
9. Explicit is better than implicit.
   
10. ---- Starts at index 31, Ends at index 64
    
11. Simple is better than complex.
    
12. ---- Starts at index 65, Ends at index 95

复制代码

谢谢分享