Can I POST data with python requests lib with http-gzip or deflate compression?

python http gzip deflate
AME picture AME · Dec 6, 2013 · Viewed 21.3k times · Source

I use the request-module of python 2.7 to post a bigger chunk of data to a service I can't change. Since the data is mostly text, it is large but would compress quite well. The server would accept gzip- or deflate-encoding, however I do not know how to instruct requests to do a POST and encode the data correctly automatically.

Is there a minimal example available, that shows how this is possible?

Answer

KnightOrc picture KnightOrc · Aug 10, 2016 
# Works if backend supports gzip

additional_headers['content-encoding'] = 'gzip'
request_body = zlib.compress(json.dumps(post_data))
r = requests.post('http://post.example.url', data=request_body, headers=additional_headers)

Related questions

How do I download a file over HTTP using Python?

I have a small utility that I use to download an MP3 file from a website on a schedule and then builds/updates a podcast XML file which I've added to iTunes. The text processing that creates/updates the XML …

Read More
What is the quickest way to HTTP GET in Python?

What is the quickest way to HTTP GET in Python if I know the content will be a string? I am searching the documentation for a quick one-liner like: contents = url.get("http://example.com/foo/bar") But all I …

Read More
How do I send a POST request as a JSON?

data = { 'ids': [12, 3, 4, 5, 6 , ...] } urllib2.urlopen("http://abc.com/api/posts/create",urllib.urlencode(data)) I want to send a POST request, but one of the fields should be a list of numbers. How can I do that ? (JSON?)

Read More