All skillsGTM Skills Directory
SourcingWeb · Research

Web Scraping

Extracts content from any URL using five APIs: Scrapegraph for NL-guided scraping, Olostep for bulk jobs, Riveter for schema-based output, Brand.dev for bran...

by GooseWorks AI·MIT-claimed (no LICENSE file)·★ 679 on GitHub·updated 2026-05-07
npx goose-skills install

Description

Extracts content from any URL using five APIs: Scrapegraph for NL-guided scraping, Olostep for bulk jobs, Riveter for schema-based output, Brand.dev for brand assets, and Notte for browser automation.

What this skill does

  1. 1Extracts structured data from any web page using natural language prompts via Scrapegraph SmartScraper.
  2. 2Handles JS-rendered SPAs, paginated pages, and bot-protected sites with stealth mode and render options.
  3. 3Supports batch and async crawling of entire sites with URL discovery, content extraction, and status polling.
  4. 4Provides schema-enforced extraction via Riveter and browser automation for multi-step interactions via Notte.
  5. 5Fetches brand logos, colors, fonts, and design systems for any domain via Brand.dev.

When to use

  • You need to pull structured data from a web page without writing custom scraping code.
  • You're crawling a competitor's site to extract pricing, features, or leadership team data.
  • You need to automate browser interactions on a page with CAPTCHAs or login flows before scraping.

Tools used

ScrapeGraph· Web Scraping

Best for

Sales Development RepGTM Engineer

Format

FrameworkWorkflowPlaybook

Frequently asked questions

What is Web Scraping?

Web Scraping is a Claude Code skill for sourcing by GooseWorks AI. Extracts content from any URL using five APIs: Scrapegraph for NL-guided scraping, Olostep for bulk jobs, Riveter for schema-based output, Brand.dev for bran...

When should I use Web Scraping?

You need to pull structured data from a web page without writing custom scraping code. You're crawling a competitor's site to extract pricing, features, or leadership team data.

How do I install Web Scraping?

Run the install command (npx goose-skills install). Once the skill is in place, Claude Code loads it automatically whenever a task matches what it does.

Is Web Scraping free to use?

The author distributes it as MIT, but the repository has no LICENSE file. The source is public on GitHub (gooseworks-ai/goose-skills).

Source repository

gooseworks-ai/goose-skills★ 679 · 132 forks
View source SKILL.md →Repo on GitHub →

More from gooseworks-ai/goose-skills

Aeo
Tracks your brand's visibility across AI search engines including ChatGPT, Perplexity, Gemini, Grok, Claude, and DeepSeek.
Ai Video Calls Tavus
Creates real-time AI video conversations using Tavus personas.
Ai Web Scraping Scrapegraph
Extracts structured data from any webpage using natural language prompts instead of CSS selectors.
Blog Feed Monitor
Scrape blog posts via RSS feeds (free, no API key) with Apify fallback for JS-heavy sites.
Brand Intel Branddev
Pulls brand assets and company metadata from any domain via Brand.dev.
Brand Voice Extractor
Analyze a company's published content to extract their brand voice, writing style, and tone guidelines.

Other skills that might interest you

Company Intel
Produces company intelligence reports by combining Brand.dev, Fiber, and Scrapegraph.
Extract Webpage Data
Extracts structured or raw data from any URL using Olostep, Scrapegraph, and Riveter.
Yc Batch Evaluator
Scrapes a YC batch, researches each company across YC pages, the company site, Apollo founder data, and Perplexity market context, then exports a ranked Goog...
Conference Speaker Scraper
Extract speaker names, titles, companies, and bios from conference websites.
Find Twitter Influencers
Identifies and scores Twitter influencers for any company or topic.
Hacker News Scraper
Search Hacker News stories and comments using the free Algolia API.