Python Arabic NLP

python arabic nlp
Bassem picture Bassem · Sep 12, 2011 · Viewed 14.7k times · Source

I'm in the process of assessing the capabilities of the NLTK in processing Arabic text in a research to analyze and extract sentiments.

Question is as follows:

  1. Is the NTLK capable of handling and allows the analysis of Arabic text?
  2. Is python capable of manipulating\tokenizing Arabic text?
  3. Will I be able to parse and store Arabic text using Python?

If python and NTLK aren't the tools for this job, what tools would you recommend (if existent)?

Thank you.

EDIT

Based on research:

  1. NTLK is only capable of stemming Arabic text: Link
  2. Python is capable of handling Arabic text since it supports UTF-8 unicode: Link
  3. Parsing and Lemmatization of Arabic text can be done using: SNLPG (The Stanford Natural Language Processing Group) Statistical Parser: Link

Answer

Boris Gorelik picture Boris Gorelik · Sep 12, 2011

A simple google search lead to these links:

Arabic Natural Language Processing

Using Python with the Quranic Arabic Corpus

HOWTO: Working with Python, Unicode, and Arabic

Are any of these useful?

Related questions

CSV file with Arabic characters is displayed as symbols in Excel

I am using python to extract Arabic tweets from twitter and save it as a CSV file, but when I open the saved file in excel the Arabic language displays as symbols. However, inside python and notepad or word, it …

Read More
How do I list all files of a directory?

How can I list all files of a directory in Python and add them to a list?

Read More
Iterating over dictionaries using 'for' loops

I am a bit puzzled by the following code: d = {'x': 1, 'y': 2, 'z': 3} for key in d: print key, 'corresponds to', d[key] What I don't understand is the key portion. How does Python recognize that it needs only to …

Read More