Web Search Pro

Agent-first web search and retrieval for live web search, news search, docs lookup, code lookup, company research, site crawl, site map, and structured evide...

Web Search Pro 2.1 Core Profile

This ClawHub package publishes the core retrieval profile of web-search-pro. It is a code-backed Node runtime package, not an instruction-only bundle.

Use This Skill When

• the caller needs live web search or news search
• the caller needs docs lookup or code lookup
• the caller may continue from search into extract, crawl, map, or research
• the agent needs explainable routing and visible federated-search gains
• the first run needs a real no-key baseline

Quick Start

The shortest successful path is:

• Option A: No-key baseline
• Option B: Add one premium provider
• Then try docs, news, and research

Option A: No-key baseline

No API key is required for the first successful run.

node {baseDir}/scripts/doctor.mjs --json
node {baseDir}/scripts/bootstrap.mjs --json
node {baseDir}/scripts/search.mjs "OpenAI Responses API docs" --json

Option B: Add one premium provider

If you only add one premium provider, start with TAVILY_API_KEY.

export TAVILY_API_KEY=tvly-xxxxx
node {baseDir}/scripts/doctor.mjs --json
node {baseDir}/scripts/search.mjs "latest OpenAI news" --type news --json

First successful searches

node {baseDir}/scripts/search.mjs "OpenClaw web search" --json
node {baseDir}/scripts/search.mjs "OpenAI Responses API docs" --preset docs --plan --json
node {baseDir}/scripts/extract.mjs "https://platform.openai.com/docs" --json

Then try docs, news, and research

node {baseDir}/scripts/search.mjs "OpenAI Responses API docs" --preset docs --json
node {baseDir}/scripts/search.mjs "latest OpenAI news" --type news --json
node {baseDir}/scripts/research.mjs "OpenClaw search skill landscape" --plan --json

Install Model

ClawHub installs this bundle directly as a code-backed Node skill pack.

• hard runtime requirement: node
• no remote installer, curl-to-shell bootstrap, or Python helper transport in the baseline path
• optional runtime config file: config.json
• local state directory: .cache/web-search-pro

Why Federated Search Matters

Federation is not just "more providers". It exposes compact gain metrics:

• federated.value.additionalProvidersUsed
• federated.value.resultsRecoveredByFanout
• federated.value.resultsCorroboratedByFanout
• federated.value.duplicateSavings
• routingSummary.federation.value

Runtime Contract

• selectedProvider The planner's primary route.
• routingSummary Compact route explanation with confidence and federation summary.
• routing.diagnostics Full route diagnostics exposed by --explain-routing or --plan.
• federated.providersUsed The providers that actually returned results when fanout is active.
• federated.value Compact federation gain summary for added providers, recovered results, corroboration, and duplicate savings.
• cached / cache Cache hit plus TTL telemetry for agents.
• topicType, topicSignals, researchAxes Structured planning summaries for the model-facing research pack.

Commands By Task

Included commands:

• search.mjs
• extract.mjs
• crawl.mjs
• map.mjs
• research.mjs
• doctor.mjs
• bootstrap.mjs
• capabilities.mjs
• review.mjs
• cache.mjs
• health.mjs

Runtime notes:

• Node is the only hard runtime requirement.
• No API key is required for the baseline.
• Optional provider credentials or endpoints widen coverage.
• Baseline outbound requests use curl when available and fall back to built-in fetch.

Baseline:

• No API key is required for the baseline.
• ddg is best-effort no-key search.
• fetch is the no-key extract / crawl / map fallback.

Optional provider credentials or endpoints unlock stronger coverage:

TAVILY_API_KEY=tvly-xxxxx
EXA_API_KEY=exa-xxxxx
QUERIT_API_KEY=xxxxx
SERPER_API_KEY=xxxxx
BRAVE_API_KEY=xxxxx
SERPAPI_API_KEY=xxxxx
YOU_API_KEY=xxxxx
SEARXNG_INSTANCE_URL=https://searx.example.com

# Perplexity / Sonar: choose one transport path
PERPLEXITY_API_KEY=xxxxx
OPENROUTER_API_KEY=xxxxx
OPENROUTER_BASE_URL=https://openrouter.ai/api/v1  # optional override
KILOCODE_API_KEY=xxxxx

# Or use a custom OpenAI-compatible gateway
PERPLEXITY_GATEWAY_API_KEY=xxxxx
PERPLEXITY_BASE_URL=https://gateway.example.com/v1
PERPLEXITY_MODEL=perplexity/sonar-pro  # accepts sonar* or perplexity/sonar*

Review and diagnostics:

node {baseDir}/scripts/capabilities.mjs --json
node {baseDir}/scripts/doctor.mjs --json
node {baseDir}/scripts/bootstrap.mjs --json
node {baseDir}/scripts/review.mjs --json

Search keywords:

web search, news search, latest updates, current events, docs search, API docs, code search, company research, competitor analysis, site crawl, site map, multilingual search, Baidu search, answer-first search, cited answers, explainable routing, no-key baseline