ZeroGPU Router

Cut your OpenClaw agent's inference costs. Route your AI tasks (summarize, classify, redact PII, extract JSON, short chat) to open-weight and small language models instead of burning frontier-model tokens. Our APIs are OpenAI-compatible and pay-as-you-go.

#cost-optimization #model-routing #open-weight-models #small-language-models #classification #pii-redaction #summarization #openai-compatible

What it does

Your OpenClaw agent keeps doing the heavy reasoning. Routine tasks get offloaded to ZeroGPU's open-weight and small models, typically 100–1000× cheaper per call.

Our open-weight models are the most cost-effective on the market right now. You'll find models here you won't see anywhere else, and we add roughly one a day.

• 21 task-specific skills: zerogpu-summarize, classify-iab, redact-pii, extract-json, and more
• Nothing to host or register: each skill shells out to the local zerogpu CLI through the agent's exec tool
• Unaffected by CLI model updates: each skill names its own model and calls the CLI's model-agnostic chat_completions, moderations, or embeddings command
• Savings you can see: every call logs its model, usage, and a real dollar figure
• OpenAI-compatible, pay-as-you-go: no commitments, no idle GPU cost

Quickstart

Get an API key at platform.zerogpu.ai, then:

# 1. Install the CLI the skills shell out to (3.8.0 or newer)
npm install -g zerogpu-cli@latest

# 2. Log in (prompts for your API key)
zerogpu login

# 3. Install the plugin
openclaw plugins install clawhub:zerogpu-router

Every skill shells out to the zerogpu CLI, so install it globally and run a one-time zerogpu login before using the plugin. The skills need 3.8.0 or newer, the release that added the chat_completions, moderations, and embeddings commands; on an older CLI they fail with error: unknown command 'chat_completions'. In sandboxed/Docker agents, make sure zerogpu is available inside the container.

Try it

Ask your agent in plain language. It picks the right skill, shells out to the local zerogpu CLI (which sends your text to ZeroGPU's hosted API for inference, instead of using the host model), and replies with the result plus a savings line. The replies below are illustrative: the models are small, so output is concise and a little mechanical.

Your input leaves your machine. These skills transmit the text you give them to ZeroGPU's third-party service. See Data & privacy below before feeding them anything sensitive. Because the agent can pick these skills from plain-language requests, decide up front what you're comfortable routing off-box.

Summarize a meeting recap:

summarize this: Team, quick recap of today's sync. We agreed to push the mobile
checkout redesign to the March release because the payments integration slipped a
sprint. QA flagged two blocker bugs on Android that engineering will prioritize
this week. Marketing still wants the new pricing page live before the end of the
quarter, so we will revisit scope on Thursday. Please update your tickets before
standup tomorrow.

Reply:

mobile checkout redesign pushed to march release, payments integration slipped a
sprint. qa flagged two android blocker bugs, engineering to fix this week.
marketing wants pricing page live by end of quarter, scope revisited thursday.
update tickets before standup.

model: llama-3.1-8b-instruct-fast · 78 tokens in / 41 out
💰 ZeroGPU savings so far: ≈ $2 (18,730 frontier-model tokens offloaded)

Classify a support ticket against your own labels:

classify this support ticket as billing, bug, feature-request, or account:
"I was charged twice for my October subscription, and the second charge is a
different amount than my plan. Please refund the duplicate and explain the
difference."

Reply:

[
  { "label": "billing",         "score": 0.94 },
  { "label": "account",         "score": 0.29 },
  { "label": "bug",             "score": 0.07 },
  { "label": "feature-request", "score": 0.02 }
]

model: deberta-v3-small · 61 tokens in
💰 ZeroGPU savings so far: ≈ $2 (19,180 frontier-model tokens offloaded)

Redact PII from a CRM note before sharing it:

redact the PII in this CRM note before I share it with the vendor:
"Call with Daniel Okafor (daniel.okafor@brightwave.io, +1 206-555-0147) on Tue.
Send the enterprise quote to their AP team at 400 Pine St, Seattle, WA 98101.
Card on file ends 4412; do not reference it in email."

Reply:

Call with [PERSON] ([EMAIL], [PHONE_NUMBER]) on Tue. Send the enterprise quote to
their AP team at [ADDRESS]. Card on file ends 4412; do not reference it in email.

model: gliner-multi-pii-v1 · 5 spans masked
💰 ZeroGPU savings so far: ≈ $2 (19,650 frontier-model tokens offloaded)

Note the card last-four is left untouched. The PII model covers standard categories (names, emails, phones, addresses), not project-specific identifiers. Strip those yourself.

The skills you get

Classification

Extraction & PII

Generation

Moderation and embeddings

Account

Every skill returns { <task fields>, model, usage, savings }. Browse the full catalog with pricing at docs.zerogpu.ai.

Watch your savings

Live dashboard at platform.zerogpu.ai: token usage, latency, per-tool savings, broken down by agent and time range.

Data & privacy

These skills are not local processing. Every content skill (zerogpu-summarize, classify-*, extract-*, redact-pii, extract-pii, moderate, moderate-llama, embed, chat, chat-liquid, chat-thinking, chat-qwen, chat-deepseek, chat-deepseek-v4-1-flash, chat-glm) passes the text you supply to the local zerogpu CLI, which transmits it over the network to ZeroGPU's hosted models. The CLI runs locally; the inference does not.

Before using these skills:

• Do not send secrets, credentials, API keys, or regulated data (PHI, cardholder data, etc.) unless you have cleared third-party processing with ZeroGPU for that data.
• The PII skills (redact-pii, extract-pii) send the raw, un-redacted text to the service in order to detect PII; redaction happens after transmission, not before. They reduce what you forward downstream, not what reaches ZeroGPU.
• Treat inputs the way you'd treat any third-party API call: assume the request may be logged or retained per ZeroGPU's terms and retention policy. Review those at zerogpu.ai for your compliance needs.

Credentials: zerogpu login (the signin skill) writes your API key to a local config file and upserts ZEROGPU_API_KEY into your shell profile, a persistent change to your environment. Revoke keys from the dashboard.

Support

License

MIT. See LICENSE.