12. Natural Language Processing (NLP)

Objectives

  • Perform NLP tasks fundamental to many of our later case studies
  • TextBlob, NLTK, Textatistic and spaCy libraries
  • Tokenize text into words and sentences
  • Parts-of-speech tagging
  • Sentiment analysis for determining whether text is positive, negative or neutral
  • Detect the language of text and translate between languages

Objectives (cont.)

  • Word roots via stemming and lemmatization
  • Spell checking and correction
  • Word definitions, synonyms and antonyms ===CURRENTLY DELETED AND IN DUMP FILE===
  • Remove stop words from text
  • Create word cloud visualizations
  • Readability assessment
  • Named entity recognition and similarity detection

©1992–2020 by Pearson Education, Inc. All Rights Reserved. This content is based on Chapter 5 of the book Intro to Python for Computer Science and Data Science: Learning to Program with AI, Big Data and the Cloud.

DISCLAIMER: The authors and publisher of this book have used their best efforts in preparing the book. These efforts include the development, research, and testing of the theories and programs to determine their effectiveness. The authors and publisher make no warranty of any kind, expressed or implied, with regard to these programs or to the documentation contained in these books. The authors and publisher shall not be liable in any event for incidental or consequential damages in connection with, or arising out of, the furnishing, performance, or use of these programs.