Generating plain text from a Wikipedia database dump

python xml database shell wikipedia
Asim picture Asim · Mar 31, 2014 · Viewed 8.7k times · Source

I found a Python script (here: Wikipedia Extractor) that can generate plain text from (English) Wikipedia database dump. When I use this command (as it's stated on the script's page):

$ python enwiki-latest-pages-articles.xml WikiExtractor.py -b 500K -o extracted

I get this error:

File "enwiki-latest-pages-articles.xml", line 1 < mediawiki xmlns="http://www.mediawiki.org/xml/export-0.8/" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xsi:schemaLocation="http://www.mediawiki.org/xml/export-0.8/http://www.mediawiki.org/xml/export-0.8.xsd" version="0.8" xml:lang="en">

^
SyntaxError: invalid syntax

I'm executing the script using Python 2.7.6 & Cygwin on Windows 7.

I hope If anyone has already used this script or experience with Python can help me to solve this error.

Thanks in advance!

Answer

alecxe picture alecxe · Mar 31, 2014

The first argument to python should be the script name.

You probably need to swap xml and py file names:

$ python WikiExtractor.py enwiki-latest-pages-articles.xml -b 500K -o extracted

Related questions

How do I parse XML in Python?

I have many rows in a database that contains XML and I'm trying to write a Python script to count instances of a particular node attribute. My tree looks like: <foo> <bar> <type foobar="1"/> &…

Read More
Pretty printing XML in Python

What is the best way (or are the various ways) to pretty print XML in Python?

Read More
Creating a simple XML file using python

What are my options if I want to create a simple XML file in python? (library wise) The xml I want looks like: <root> <doc> <field1 name="blah">some value1</field1> <…

Read More