Top "Beautifulsoup" questions

Beautiful Soup is a Python package for parsing HTML/XML.

Beautiful Soup to parse url to get another urls data

I need to parse a url to get a list of urls that link to a detail page. Then from …

python html parsing beautifulsoup
BeautifulSoup: object of type 'Response' has no len()

Issue: when I try to execute the script, BeautifulSoup(html, ...) gives the error message "TypeError: object of type 'Response' has …

python html parsing web-scraping beautifulsoup
Only extracting text from this element, not its children

I want to extract only the text from the top-most element of my soup; however soup.text gives the text …

python parsing text beautifulsoup
How to write the output to html file with Python BeautifulSoup

I modified an html file by removing some of the tags using beautifulsoup. Now I want to write the results …

python html beautifulsoup
UnicodeEncodeError: 'ascii' codec can't encode character u'\u2026'

I'm learning about urllib2 and Beautiful Soup and on first tests am getting errors like: UnicodeEncodeError: 'ascii' codec can't encode …

python python-2.7 unicode beautifulsoup urllib2
Get meta tag content property with BeautifulSoup and Python

I am trying to use python and beautiful soup to extract the content part of the tags below: <meta …

python html web-scraping beautifulsoup
How to handle IncompleteRead: in python

I am trying to fetch some data from a website. However it returns me incomplete read. The data I am …

python python-2.7 web-scraping beautifulsoup mechanize
Parse the JavaScript returned from BeautifulSoup

I would like to parse the webpage http://dcsd.nutrislice.com/menu/meadow-view/lunch/ to grab today's lunch menu. (I've …

javascript python beautifulsoup html-parsing
Scraping Data from Facebook with Python

I've been trying for several day now (unsuccessfully) to scrape cities from about 500 Facebook URLs. However, Facebook handles its data …

python facebook web-scraping beautifulsoup mechanize