Download JSON data and convert it to CSV using Python

python json csv yahoo-pipes
c24b picture c24b · Mar 14, 2011 · Viewed 11.5k times · Source

I'm currently using Yahoo Pipes which provides me with a JSON file from an URL.

I would like to be able to fetch it and convert it into a CSV file, and I have no idea where to begin (I'm a complete beginner in Python).

How can I fetch the JSON data from the URL?
How can I transform it to CSV?

Thank you

Answer

Hugh Bothwell picture Hugh Bothwell · Mar 14, 2011 
import urllib2
import json
import csv

def getRows(data):
    # ?? this totally depends on what's in your data
    return []

url = "http://www.yahoo.com/something"
data = urllib2.urlopen(url).read()
data = json.loads(data)

fname = "mydata.csv"
with open(fname,'wb') as outf:
    outcsv = csv.writer(outf)
    outcsv.writerows(getRows(data))

Related questions

How can I convert JSON to CSV?

I have a JSON file I want to convert to a CSV file. How can I do this with Python? I tried: import json import csv f = open('data.json') data = json.load(f) f.close() f = open('data.csv') …

Read More
How to convert CSV file to multiline JSON?

Here's my code, really simple stuff... import csv import json csvfile = open('file.csv', 'r') jsonfile = open('file.json', 'w') fieldnames = ("FirstName","LastName","IDNumber","Message") reader = csv.DictReader( csvfile, fieldnames) out = json.dumps( [ row for row in reader ] ) jsonfile.write(…

Read More
Default dict keys to avoid KeyError

I'm calling some JSON and parsing relevant data as CSV. I cannot figure out how to fill in the intermediate JSON dict file with default keys, as many are unpopulated. The result is a KeyError as I attempt to parse …

Read More