{"skill":{"slug":"macos-desktop-control","displayName":"MacOS Desktop Control (Mouse, Keyboard, Screenshots)","summary":"Automate macOS desktop by capturing screenshots and executing precise mouse movements, clicks, and keyboard inputs via cliclick.","description":"# macOS Control Skill\n\nA high-fidelity automation bridge for macOS (Darwin) that enables agents to perceive the desktop state and execute precise mouse and keyboard interactions.\n\n## 🛠 Included Scripts\nThis skill leverages specialized wrappers located in the `/scripts` directory to interface with system-level binaries:\n\n### 1. `cliclick_wrapper.sh`\nA dedicated wrapper for the `cliclick` utility to handle synthetic input events.\n- **Path**: `scripts/cliclick_wrapper.sh`\n- **Logic**: Executes `/opt/homebrew/bin/cliclick` with passed arguments.\n- **Capabilities**: Left/Right clicks, mouse movement, and keyboard emulation.\n\n### 2. `vision_wrapper.sh`\nThe visual perception engine for the skill.\n- **Path**: `scripts/vision_wrapper.sh`\n- **Logic**: Utilizes the native macOS `screencapture` utility in silent mode (`-x`).\n- **Output**: Generates a standard PNG at `/tmp/claw_view.png`.\n\n---\n\n## 🚀 Tool Specifications\n\n### `see`\nCaptures the current screen state for visual analysis.\n* **Returns**: A string confirming the filepath of the capture.\n* **Use Case**: Identifies UI elements, window positions, and application states.\n\n### `click`\nSends precise commands to the mouse and keyboard.\n* **Usage**: `click \"c:x,y\"` (Click) or `click \"m:x,y\"` (Move).\n* **Syntax**: Supports all `cliclick` standard notation including `w:` (wait) and `t:` (type).\n\n---\n\n## ⚙️ Requirements & Setup\n\n1. **Binary Dependency**:\n   ```bash\n   brew install cliclick\n   ```\n","tags":{"latest":"1.0.0"},"stats":{"comments":0,"downloads":4256,"installsAllTime":161,"installsCurrent":45,"stars":2,"versions":1},"createdAt":1771459092648,"updatedAt":1779077060926},"latestVersion":{"version":"1.0.0","createdAt":1771459092648,"changelog":"Initial release of macOS desktop control skill.\n\n- Enables taking screenshots of the macOS desktop.\n- Allows analysis of screenshots to identify coordinates.\n- Provides click automation at specified coordinates using the `click` tool.","license":null},"metadata":null,"owner":{"handle":"emptyopen","userId":"s170k2sp20j1m89z4m4nh48z0988567p","displayName":"Matt","image":"https://avatars.githubusercontent.com/u/18575100?v=4"},"moderation":{"isSuspicious":false,"isMalwareBlocked":false,"verdict":"clean","reasonCodes":["review.llm_review"],"summary":"Review: review.llm_review","engineVersion":"v2.4.24","updatedAt":1779932733954}}