search-tips
Search Tips provides practical guidance for conducting thorough web research using Exa's semantic search engine, Firecrawl CLI for content extraction, and Reddit MCP tools. It covers the research cycle of searching for sources and fetching their content, query reformulation techniques for better results, domain filtering, and content-type-specific strategies. The skill includes troubleshooting for common scraping issues and operational patterns for efficient multi-source investigation.
Search Tips teaches web research strategies using Exa semantic search, Firecrawl content extraction, and Reddit tools for multi-source investigation.
AI-generated summary based on this skill's SKILL.md
Decision gist · record as of 2026-07-26
Search Tips teaches web research strategies using Exa semantic search, Firecrawl content extraction, and Reddit tools for multi-source investigation. Search Tips provides practical guidance for conducting thorough web research using Exa's semantic search engine, Firecrawl CLI for content extraction, and Reddit MCP tools. It covers the research cycle of searching for sources and fetching their content, query reformulation techniques for better results, domain filtering, and content-type-specific strategies. The skill includes troubleshooting for common scraping issues and operational patterns for efficient multi-source investigation.
Use it when
- Search Tips emphasizes that semantic search, powered by Exa.
- Search Tips outlines a multi-source research workflow: start with semantic queries to identify diverse sources.
Verify before relying
Read SKILL.md below before installing (10 files). Open directory: indexed for reading, not audited.
Install
malob/nix-config/search-tips · repository language: Python
Open directory. Skills are indexed for reading, not audited. Review a skill's body before installing it.
Frequently asked questions
AI-generated answers based on this skill's SKILL.md and metadata
What are the best practices for searching with Exa and Firecrawl?
Search Tips recommends using Exa's semantic search engine for finding relevant sources across the web, then employing Firecrawl CLI to extract and process content from those sources. The core research cycle involves formulating semantic queries (which understand meaning beyond keywords), retrieving candidate sources, and fetching full content for analysis. Combine domain filtering to target specific websites, reformulate queries iteratively based on initial results, and use content-type-specific strategies—such as Reddit MCP tools for social sentiment—to gather comprehensive information efficiently.
How can I improve my web research with semantic search vs keyword search?
Search Tips emphasizes that semantic search, powered by Exa, understands the intent and meaning behind your query rather than just matching keywords. This approach finds more relevant sources on the first attempt. Semantic search works best when you describe what you're looking for conceptually; keyword search requires exact term matching and often needs multiple reformulations. Search Tips teaches query reformulation techniques to refine your semantic queries when initial results miss the mark, helping you discover better sources faster than traditional keyword-based research methods.
What strategies should I use for researching topics online efficiently?
Search Tips outlines a multi-source research workflow: start with semantic queries to identify diverse sources, use domain filtering to focus on authoritative sites, then extract content systematically with Firecrawl. The skill covers query reformulation—adjusting your search terms based on what you learn—to dig deeper into topics. For social sentiment and community perspectives, Search Tips includes strategies for finding and analyzing Reddit discussions. This structured approach to multi-source investigation helps you conduct deep dives without wasting time on irrelevant results.
How do I extract information from websites without getting blocked?
Search Tips addresses common web scraping challenges and provides best practices for content extraction using Firecrawl CLI. The skill covers operational patterns that respect website policies and avoid triggering anti-scraping protections. It includes troubleshooting guidance for extraction failures on complex websites, helping you identify when content is behind paywalls or requires special handling. Search Tips teaches you to recognize which extraction methods work best for different site structures, ensuring reliable data collection while maintaining ethical scraping practices.
How can I find and compare information across multiple online sources?
Search Tips provides techniques for discovering diverse sources using Exa's semantic search with domain filtering, then systematically fetching and comparing their content. The skill teaches you to structure multi-source research workflows that gather perspectives from different websites, academic sources, and community discussions via Reddit MCP tools. By combining semantic search for source discovery with Firecrawl for content extraction, Search Tips helps you build comprehensive comparisons and identify consensus or divergent viewpoints across the internet efficiently.
What should I do when web scraping or content extraction fails?
Search Tips includes troubleshooting strategies for common web scraping and content extraction failures. The skill helps you diagnose issues like blocked requests, paywall-protected content, and complex website structures that resist extraction. It covers operational patterns and best practices to minimize failures, and teaches you to recognize when a source requires alternative approaches. Search Tips provides practical solutions to keep your research workflow moving when standard extraction methods encounter obstacles.
SKILL.md
Rendered from the published skill. Quoted content, verbatim.
Search Tips
Accumulated guidance for web research using Exa, Firecrawl CLI, and Reddit MCP tools. These
are starting points, not rigid rules -- think strategically about each situation and
adapt. If a different approach makes more sense for what you're trying to do, go with it.
Run npx firecrawl-cli <command> --help to check available options beyond what's documented
here. Reference files cover tool-specific deep dives -- see bottom of this file.
Setup
Before starting research, load the required MCP tools using ToolSearch:
- Exa tools --
web_search_advanced_exaand
(truncated - see the full file via the links below)
File tree — 10 files
configs/claude/skills/search-tips/SKILL.md
configs/claude/skills/search-tips/references/academic-search.md
configs/claude/skills/search-tips/references/code-github.md
configs/claude/skills/search-tips/references/exa-tips.md
configs/claude/skills/search-tips/references/firecrawl-tips.md
configs/claude/skills/search-tips/references/people-companies.md
configs/claude/skills/search-tips/references/personal-sites.md
configs/claude/skills/search-tips/references/reddit.md
configs/claude/skills/search-tips/references/scraping-issues.md
configs/claude/skills/search-tips/references/twitter.md
Let your AI agent find skills like this
Example. Real query, live index.
You found this page by searching. An agent finds it by wishing: SkillFed indexes 56,283 agent skills by what they can do, searchable in plain language.
wish › “Learn effective web research techniques using semantic search and content extraction”
Give your agent the search over MCP, or paste the wish link into any chat. No install? Search from any chat →
Related skills
Firecrawl Scrape converts web pages into clean, LLM-ready markdown—whether static or dynamically rendered with JavaScript. It handles single URLs or batch scraping with concurrent processing, and offers filtering options like main-content-only extraction and PII redaction.
Firecrawl Download combines site mapping and scraping to save complete websites as local files in markdown, screenshots, or custom formats. Organize content into nested directories with filtering options for paths and subdomains, perfect for offline documentation access or bulk content preservation.
exa-search connects to Exa's MCP endpoint for live web queries, code documentation lookup, and full-page retrieval. Use the simple search tool for basic queries or the advanced variant for filtered results by date, domain, category, or content. Fetch complete pages when search highlights aren't enough.
Deep Research pulls together information from multiple web sources to build comprehensive, cited reports. It breaks topics into focused sub-questions, searches across available tools, reads key sources in depth, and synthesizes findings into structured reports with full attribution. Ideal for competitive analysis, due diligence, market sizing, or any investigation requiring evidence-backed conclusions.
Firecrawl is a command-line tool for extracting web content at scale, supporting search, single-page scraping, site mapping, bulk crawling, and browser automation for interactive pages. It returns clean markdown formatted for LLM context windows and handles everything from static pages to JavaScript-rendered content and pagination-gated data.
Web Research provides access to neural search and web scraping through x402-protected endpoints, combining Exa's semantic capabilities with Firecrawl's extraction power. Use it for deep investigations, finding similar content, extracting clean text from blocked sites, and crawling multiple pages—each with transparent per-task pricing starting at $0.002.
More skills firecrawl (Apache-2.0) · Firecrawl Map (unlicensed) · Firecrawl Interact (unlicensed) · Firecrawl Crawl (unlicensed) · Exa Search (unlicensed) · Firecrawl Search (unlicensed) · exa-web-search-free (Apache-2.0)