Extract links from a web page using Go lang

html-parsing go
Jifeng Zhang picture Jifeng Zhang · Jun 18, 2012 · Viewed 30.4k times · Source

I am learning google's Go programming language. Does anyone know the best practice to extract all URLs from a html web page?

Coming from the Java world, there are libraries to do the job, for example jsoup , htmlparser, etc. But for go lang, I guess no available similar library was made yet?

Answer

Matt picture Matt · Aug 3, 2014

If you know jQuery, you'll love GoQuery.

Honestly, it's the easiest, most powerful HTML utility I've found in Go, and it's based off of the html package in the go.net repository. (Okay, so it's higher-level than just a parser as it doesn't expose raw HTML tokens and the like, but if you want to actually get anything done with an HTML document, this package will help.)

Related questions

Use goquery to find a class whose value contains whitespace

Answered. User PuerkitoBio helped me out with his goquery package, and I'm sure I won't be the only one wondering how to do this. (I can mark this question as 'answered' in two days) When using goquery to find classes …

Read More
Parse an HTML string with JS

I searched for a solution but nothing was relevant, so here is my problem: I want to parse a string which contains HTML text. I want to do it in JavaScript. I tried this library but it seems that it …

Read More
How do you parse and process HTML/XML in PHP?

How can one parse HTML/XML and extract information from it?

Read More