Percept Ambient

Continuously captures and summarizes ambient conversations to build a local knowledge graph for context-aware assistance without explicit commands.

jarvis563@jarvis563

Install

openclaw skills install @jarvis563/percept-ambient

percept-ambient

Ambient intelligence mode — continuous context awareness without explicit commands.

What it does

Runs in the background, building a knowledge graph of conversations, entities, and relationships over time. Your agent passively learns context from ambient speech — who you talk to, what projects are active, what decisions were made — without needing explicit commands.

When to use

User wants always-on context awareness
Agent needs background knowledge from daily conversations
User asks "what do you know about [person/project]?" based on overheard context

Requirements

percept-listen skill installed and running
percept-summarize skill installed (for entity extraction)

How it works

All conversations are continuously captured and summarized
Entities (people, companies, projects, topics) extracted automatically
Relationships mapped between entities (works_on, client_of, mentioned_with)
Context packets assembled on demand for any agent action
Full-text search (FTS5) + vector search (LanceDB) for retrieval

Context packets

When your agent needs context, Percept assembles a Context Packet:

json

{
  "recent_conversations": [...],
  "resolved_entities": [...],
  "relationships": [...],
  "relevant_history": [...]
}

This gives the agent rich situational awareness without loading entire conversation histories.

Vector search

Semantic search over utterances using NVIDIA NIM embeddings (primary) with all-MiniLM-L6-v2 as offline fallback. Stored in LanceDB (local, zero-infra).

bash

# Search via dashboard (port 8960) or API
curl localhost:8960/api/search?q=project+deadline&mode=hybrid

Privacy controls

All data stored locally in SQLite + LanceDB
TTL auto-purge (configurable retention periods)
No audio stored — only transcripts
Dashboard → Settings → Privacy for granular controls

Real-time dashboard

Monitor ambient intelligence at http://localhost:8960:

Live conversation feed
Entity graph visualization
Search across all conversations
Analytics and usage stats