structured-scraping-riveter
Riveter lets you scrape web pages and extract data directly into a structure you define. Set up your output schema in the API request, specify what fields to extract, and retrieve results in your chosen format—supporting text, numbers, JSON, URLs, emails, dates, and more.
Riveter extracts web data into your custom-defined schema, letting you scrape pages and structure the output exactly as needed.
AI-generated summary based on this skill's SKILL.md
Decision gist · record as of 2026-07-23
Riveter extracts web data into your custom-defined schema, letting you scrape pages and structure the output exactly as needed. Riveter lets you scrape web pages and extract data directly into a structure you define. Set up your output schema in the API request, specify what fields to extract, and retrieve results in your chosen format—supporting text, numbers, JSON, URLs, emails, dates, and more.
Use it when
- Yes.
- Structured-scraping-riveter scrapes multiple web pages and retrieves results in a consistent format.
Verify before relying
Read SKILL.md below before installing (2 files). Open directory: indexed for reading, not audited.
Install
gooseworks-ai/goose-skills/structured-scraping-riveter · repository language: Python
Open directory. Skills are indexed for reading, not audited. Review a skill's body before installing it.
Frequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
What is structured-scraping-riveter and what can it do?
Structured-scraping-riveter is a web scraping tool that extracts data from websites and returns it in a structure you define. You specify your output schema in the API request, choose which fields to extract, and receive results in your chosen format—supporting text, numbers, JSON, URLs, emails, dates, and more.
Can I extract data from websites into JSON with structured-scraping-riveter?
Yes. Structured-scraping-riveter lets you extract data from websites into JSON by defining your custom schema in the API request. You specify the fields you want to capture, and the tool returns the results in JSON format along with other structured data types you need.
How does structured-scraping-riveter handle scraping multiple web pages?
Structured-scraping-riveter scrapes multiple web pages and retrieves results in a consistent format. You define your schema once, then apply it across multiple URLs. The tool ensures all results follow the same structure, making it easy to process large batches of data uniformly.
Can structured-scraping-riveter monitor competitor prices?
Yes. Structured-scraping-riveter supports monitoring and extracting product or price data from competitor websites. You define the schema for price fields, URLs, and product details, then use the tool to regularly scrape and track changes across multiple competitor sites in a structured format.
What data types does structured-scraping-riveter support in output?
Structured-scraping-riveter supports multiple output data types including text, numbers, JSON, URLs, emails, and dates. When you define your schema, you specify the type for each field, and the tool extracts and formats the data accordingly to match your requirements.
Does structured-scraping-riveter work with job listings and news articles?
Yes. Structured-scraping-riveter can parse job listings and news articles with structured metadata. Define your schema to capture job title, company, salary, publication date, author, and other fields, then the tool extracts and organizes that data consistently across multiple sources.
SKILL.md
Rendered from the published skill. Quoted content, verbatim.
Riveter - Structured Web Scraping
Setup
Read your credentials from ~/.gooseworks/credentials.json:
export GOOSEWORKS_API_KEY=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json'))['api_key'])")
export GOOSEWORKS_API_BASE=$(python3 -c "import json;print(json.load(open('$HOME/.gooseworks/credentials.json')).get('api_base','https://api.gooseworks.ai'))")
If ~/.gooseworks/credentials.json does not exist, tell the user to run: npx gooseworks login
All endpoints use Bearer auth: -H "Authorization: Bearer $GOOSEWORKS_API_KEY"
Scrape web pages and extract data into your defined structure.
Capabilities
- Scrape: Scrape a webpage and return the text content
- Run: Copy link Define the structure of your output directly in the API request
- Run data: Retrieve the processed data from a completed project run (free)
- Run status: Check the current status of a project run (free)
- Stop run: Stop a currently running project (free)
Usage
Scrape
Scrape a webpage
(truncated - see the full file via the links below)
File tree — 2 files
skills/research-tools/capabilities/structured-scraping-riveter/SKILL.md
skills/research-tools/capabilities/structured-scraping-riveter/skill.meta.json
Let your AI agent find skills like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 56,283 agent skills by what they can do, searchable in plain language.
wish › “Extract web data into a custom-defined schema or structure”
Give your agent the search over MCP, or paste the wish link into any chat. No install? Search from any chat →
Related skills
Web-scraping lets you pull structured data from any URL using plain English descriptions of what you need. Choose from AI-powered extraction with natural language prompts, high-volume batch processing, or schema-based data structuring—then combine methods for comprehensive site crawling and automation.
Extract Webpage Data uses AI to pull structured information from web pages, transforming unorganized HTML into clean, actionable data. Choose from multiple extraction methods—natural language prompts, predefined schemas, or general scraping—depending on your needs. Handles product details, contact information, team rosters, and more.
PDF Processor pulls text, tables, and structured information from PDF documents through a multi-step workflow. It fetches PDFs, extracts content with AI, isolates table data, and converts results to markdown for easy integration into your workflows.
API Tester validates endpoints and their responses against expected schemas. Extract API specs from documentation, test GET and POST requests, and document any discrepancies between live behavior and published contracts.
Image Analyzer uses AI to process images and pull out actionable insights. Extract visible text via OCR, identify objects, describe visual content, and capture structured data from receipts, screenshots, and other image sources.
web-search-linkup provides programmatic access to web search and content fetching through two core endpoints. Use /search to retrieve web results with customizable depth, date ranges, and structured output formatting, or use /fetch to extract content from individual URLs with optional JavaScript rendering and image extraction.
More skills instagram-scraper (MIT) · web-scraping-olostep (MIT) · ai-web-scraping-scrapegraph (MIT) · browser-automation-notte (MIT) · linkedin-scraper (MIT)