colly

GoQueryby PuerkitoBio

GoQuery brings a syntax and a set of features similar to jQuery to the Go language.

github.com/PuerkitoBio/goqueryGo 1.25+ 2 dependenciesv1.13.0updated today

xurlsby mvdan

Extract urls from text.

mvdan.cc/xurls/v2Go 1.26+ 2 dependenciesv2.6.0updated today

dataflowkitby slotix

Web scraping Framework to turn websites into structured data.

github.com/slotix/dataflowkitGo 1.13+ 16 dependenciesupdated 3y ago

pagserby foolin

Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler.

github.com/foolin/pagserGo 1.21+ 4 dependenciesv0.1.6updated 3y ago

doc-scraperby Sriram-PR

Web crawler that converts documentation sites to clean Markdown and JSONL for LLM ingestion (RAG, training data).

github.com/Sriram-PR/doc-scraper/v2Go 1.26+ 15 dependenciesv2.24.1updated 2d ago

Tagifyby zoomio

Produces a set of tags from given source.

github.com/zoomio/tagifyGo 1.22+ 7 dependenciesv0.62.0updated 2y ago

go-recipeby kkyr

A package for scraping recipes from websites.

github.com/kkyr/go-recipeGo 1.20+ 4 dependenciesv0.4.0updated 3y ago

walkerby cyucelen

Seamlessly fetch paginated data from any source. Simple and high performance API scraping included.

github.com/cyucelen/walkerGo 1.18+ 4 dependenciesv0.1.0updated 3y ago