Model Watch

Security checks across malware telemetry and agentic risk

Overview

This is a simple local benchmark tool that stores score history on the user's machine, with no evidence of network access, credential use, or destructive behavior.

Before installing, consider whether your model outputs contain secrets or proprietary data. The tool appears to keep only local score history, but pasted command-line JSON may be captured by your shell history or visible briefly to local process observers.

SkillSpector

By NVIDIA
Vulnerability Patterns
  • Prompt InjectionInstruction Override, Hidden Instructions, Exfiltration Commands
  • Data ExfiltrationExternal Transmission, Env Variable Harvesting, File System Enumeration
  • Privilege EscalationExcessive Permissions, Sudo/Root Execution, Credential Access
  • Supply ChainUnpinned Dependencies, External Script Fetching, Obfuscated Code
  • Excessive AgencyUnrestricted Tool Access, Autonomous Decision Making, Scope Creep
Findings (2)

Missing User Warnings

Medium
Confidence
92% confidence
Finding
The README explicitly instructs users to submit model outputs and states those submissions are stored locally, but it does not warn that pasted outputs may include sensitive prompts, proprietary code, customer data, or secrets returned by the model. In the context of an AI benchmarking tool, users are likely to test real model responses, so omission of a privacy/data-handling warning creates a credible risk of accidental sensitive data retention on disk.

Missing User Warnings

Low
Confidence
93% confidence
Finding
The tool persists submitted benchmark outputs to a history file under the user's home directory without clearly disclosing that behavior in the module description or command help before submission. Because model outputs may contain proprietary prompts, sensitive completions, or customer data, silent persistence can create an unintended local data-retention risk even though the file is only written locally.

VirusTotal

61/61 vendors flagged this skill as clean.

View on VirusTotal