GoQuery

collyby asciimoo

Fast and Elegant Scraping Framework for Gophers.

github.com/gocolly/colly/v2Go 1.24+ 12 dependenciesv2.2.0updated 17d ago

xurlsby mvdan

Extract urls from text.

mvdan.cc/xurls/v2Go 1.26+ 2 dependenciesv2.6.0updated today

dataflowkitby slotix

Web scraping Framework to turn websites into structured data.

github.com/slotix/dataflowkitGo 1.13+ 16 dependenciesupdated 3y ago

pagserby foolin

Pagser is a simple, extensible, configurable parse and deserialize html page to struct based on goquery and struct tags for golang crawler.

github.com/foolin/pagserGo 1.21+ 4 dependenciesv0.1.6updated 3y ago

doc-scraperby Sriram-PR

Web crawler that converts documentation sites to clean Markdown and JSONL for LLM ingestion (RAG, training data).

github.com/Sriram-PR/doc-scraper/v2Go 1.26+ 15 dependenciesv2.24.1updated 2d ago

Tagifyby zoomio

Produces a set of tags from given source.

github.com/zoomio/tagifyGo 1.22+ 7 dependenciesv0.62.0updated 2y ago

go-recipeby kkyr

A package for scraping recipes from websites.

github.com/kkyr/go-recipeGo 1.20+ 4 dependenciesv0.4.0updated 3y ago

walkerby cyucelen

Seamlessly fetch paginated data from any source. Simple and high performance API scraping included.

github.com/cyucelen/walkerGo 1.18+ 4 dependenciesv0.1.0updated 3y ago