🦞 OpenClaw MLflow Observability Plugin

MLflow integration for OpenClaw for observability, evaluation, and monitoring. This plugin automatically traces OpenClaw agent executions in MLflow, capturing LLM calls, tool invocations, and sub-agent spans in a hierarchical trace structure.

Key Benefits

• 🌐 Open Source: MLflow is 100% open source and governed by the Linux Foundation, rooted in the same philosophy as OpenClaw.
• 🛡️ You Own Your Data: MLflow is self-hosted. Trace data from OpenClaw stays on your infrastructure and never leaves it.
• 🔀 Vendor Neutral: MLflow works with any LLM provider or agent framework, with no vendor lock-in.

Setup

1. Install the Plugin

openclaw plugins install @mlflow/mlflow-openclaw

2. Start the MLflow Server

Start the MLflow server (self-hosting) following the instructions. Alternatively, use a managed MLflow service if you prefer not to self-host.

3. Configure the Plugin

openclaw mlflow configure

The plugin will prompt you for the MLflow tracking URI and experiment ID. You can create an experiment from the MLflow UI.

~$ openclaw mlflow configure

🦞 OpenClaw 2026.3.13 (61d171a) — Automation with claws: minimal fuss, maximal pinch.

┌  MLflow Tracing configuration
│
◆  MLflow Tracking URI
│  http://localhost:5000
└
◇  Experiment ID
│  2

4. Check the Status

Verify the configuration by running the following command:

openclaw mlflow status

If the configuration is successful, you should see the effective configuration in the output.

5. Talk to OpenClaw

Run or restart the OpenClaw gateway to apply the configuration.

openclaw gateway run  # or openclaw gateway restart
openclaw message send "Hello, Lobster!"

Visit the MLflow UI (e.g. http://localhost:5000) to see the trace.

Configuration

Environment Variables

Tracking URI and experiment ID can also be set through environment variables:

export MLFLOW_TRACKING_URI=http://localhost:5000
export MLFLOW_EXPERIMENT_ID=<your-experiment-id>

Plugin Allowlist

OpenClaw shows a warning when a community plugin is installed but not declared in the plugin allowlist. Add mlflow-openclaw to the plugin allowlist in your openclaw.json file to suppress the warning.

{
    "plugins": {
        "allow": ["mlflow-openclaw"]
    }
}

What Gets Traced

The plugin creates a span hierarchy for each agent session:

AGENT (openclaw_agent)              ← root span
├── LLM (llm_call)                  ← each LLM interaction
├── TOOL (tool_<name>)              ← each tool invocation
├── AGENT (subagent_<label>)        ← sub-agent executions
└── ...

Development

# Type-check
npm run typecheck

# Test
npm test

# Format
npm run format

# Lint
npm run lint

License

This project is licensed under the Apache License 2.0 - see the LICENSE file for details.