How can I get the body of an HTTP response using LWP::UserAgent in Perl?

perl lwp lwp-useragent
Haiyuan Zhang picture Haiyuan Zhang · Dec 17, 2009 · Viewed 10.4k times · Source

I find that the return from LWP::UserAgent->request() contains both the header and body of a HTTP response. I just need the body of the response to do some parsing, so how can I do?

Answer

GJ. picture GJ. · Dec 17, 2009 
require LWP::UserAgent;

my $ua = LWP::UserAgent->new;

my $response = $ua->get('http://search.cpan.org/');

if ($response->is_success) {

    print $response->decoded_content;  # or whatever
}
else {
    die $response->status_line;
}

response->decoded_content will return the body of the response.

Related questions

HTTPS Proxy and LWP::UserAgent

I have read a number of threads on a number of sites and am still unable to make this work. I have a client machine (OSX) with OpenSSL 0.9.8r running perl 5.12.4, with LWP 6.0.4, updated Crypt::SSLeay, Net::SSL etc. I …

Read More
LWP::UserAgent HTTP Basic Authentication

I tried to run this perl5 program: #!/usr/bin/env perl use strict; use warnings; use LWP; my $ua = LWP::UserAgent->new('Mozilla'); $ua->credentials("test.server.com:39272", "realm-name", 'user_name', 'some_pass'); my $res = $ua->get(…

Read More
Why don't my LWP::UserAgent credentials work?

I'm trying to access a protected file. Server is using digest authentication - which I can see from the printed out response. Here is the sample code: use LWP; use strict; my $url = 'http://somesite.com/aa/bb/cc.html'; …

Read More