beautiful soup getting tag.id

klreeher picture klreeher · Jul 25, 2014 · Viewed 28.2k times · Source

I'm attempting to get a list of div ids from a page. When I print out the attributes, I get the ids listed.

for tag in soup.find_all(class_="bookmark blurb group") :
  print(tag.attrs)

results in:

{'id': 'bookmark_8199633', 'role': 'article', 'class': ['bookmark', 'blurb', 'group']}
{'id': 'bookmark_7744613', 'role': 'article', 'class': ['bookmark', 'blurb', 'group']}
{'id': 'bookmark_7338591', 'role': 'article', 'class': ['bookmark', 'blurb', 'group']}
{'id': 'bookmark_7338535', 'role': 'article', 'class': ['bookmark', 'blurb', 'group']}
{'id': 'bookmark_4530078', 'role': 'article', 'class': ['bookmark', 'blurb', 'group']}

So I know there ARE ids. However, when I print out tag.id instead, I just get a list of "None". What am I doing wrong here?

Answer

alecxe picture alecxe · Jul 25, 2014

You can access tag’s attributes by treating the tag like a dictionary (documentation):

for tag in soup.find_all(class_="bookmark blurb group") :
    print tag.get('id')

The reason tag.id didn't work is that it is equivalent to tag.find('id'), which results into None since there is no id tag found (documentation).