Install
openclaw skills install happyhorse-video-gen-editHappyHorse Video Generation and Editting
Video Generation and Editing with HappyHorse models. Supports text2video, image2video (first-frame based), reference2video (multi-image character fusion), and video editing capabilities.
HappyHorse Video Models
HappyHorse Video Models, created by Alibaba Group, are video generation and editing models. This skill integrates with HappyHorse Model APIs on ModelStudio (Bailian-Alibaba Model Service Platform).
Model Overview
| Model | Capabilities | Resolution | Duration |
|---|---|---|---|
| happyhorse-1.0-t2v | Text to Video | 720P, 1080P | 3-15s |
| happyhorse-1.0-i2v | First-frame Image to Video | 720P, 1080P | 3-15s |
| happyhorse-1.0-r2v | Reference images to video, Multi-character fusion | 720P, 1080P | 3-15s |
| happyhorse-1.0-video-edit | Video editing, Style transfer, Reference-based edit | 720P, 1080P | 3-15s (output) |
Text to Video Generation (happyhorse-1.0-t2v)
Generate videos from text prompts.
text2video task-submit
python3 {baseDir}/scripts/happyhorse-magic.py text2video-gen --prompt "一座由硬纸板和瓶盖搭建的微型城市，在夜晚焕发出生机" --resolution "720P" --ratio "16:9" --duration 5
python3 {baseDir}/scripts/happyhorse-magic.py text2video-gen --prompt "一只可爱的小猫将军站在悬崖上，远处是壮丽的雪山" --resolution "1080P" --ratio "16:9" --duration 10
python3 {baseDir}/scripts/happyhorse-magic.py text2video-gen --prompt "海浪拍打岩石的慢镜头" --resolution "720P" --ratio "9:16" --duration 8 --no-watermark
Options
--prompt: Text prompt for video generation (required, max 5000 non-Chinese chars or 2500 Chinese chars)--resolution: Video resolution -720Por1080P(default: 1080P)--ratio: Aspect ratio -16:9,9:16,1:1,4:3,3:4(default: 16:9)--duration: Video duration in seconds, 3-15 (default: 5)--no-watermark: Disable "Happy Horse" watermark (default: enabled)--seed: Random seed for reproducibility [0, 2147483647]
text2video tasks-get (round-robin)
python3 {baseDir}/scripts/happyhorse-magic.py text2video-get --task-id "<TASK_ID_FROM_VIDEO_GEN>"
Image to Video Generation (happyhorse-1.0-i2v)
Generate video from a first-frame image. Output aspect ratio automatically follows the input image.
First-frame to Video
python3 {baseDir}/scripts/happyhorse-magic.py image2video-gen --prompt "一只猫在草地上奔跑" --first-frame "https://example.com/cat.png" --resolution "720P" --duration 5
python3 {baseDir}/scripts/happyhorse-magic.py image2video-gen --first-frame "https://example.com/landscape.jpg" --resolution "1080P" --duration 10
python3 {baseDir}/scripts/happyhorse-magic.py image2video-gen --prompt "花朵缓缓绽放" --first-frame "https://example.com/flower.png" --duration 8 --no-watermark
Options
--prompt: Text prompt for video generation (optional but recommended)--first-frame: First frame image URL (required). Format: JPEG/JPG/PNG/WEBP, min 300px per side, max 10MB.--resolution: Video resolution -720Por1080P(default: 1080P). Output ratio follows input image.--duration: Video duration in seconds, 3-15 (default: 5)--no-watermark: Disable "Happy Horse" watermark (default: enabled)--seed: Random seed for reproducibility [0, 2147483647]
Note: There is no --ratio parameter. The output video aspect ratio automatically follows the input first-frame image.
image2video tasks-get (round-robin)
python3 {baseDir}/scripts/happyhorse-magic.py image2video-get --task-id "<TASK_ID_FROM_VIDEO_GEN>"
Reference to Video Generation (happyhorse-1.0-r2v)
Generate video from reference images as character/object sources. Use "character1", "character2", etc. in the prompt to reference images by their array order.
Multi-character Reference
python3 {baseDir}/scripts/happyhorse-magic.py reference2video-gen --prompt "身着红色旗袍的女性character1，镜头以侧面中景勾勒旗袍修身剪裁" --reference-images "https://example.com/girl.jpg" --resolution "720P" --ratio "16:9" --duration 5
python3 {baseDir}/scripts/happyhorse-magic.py reference2video-gen --prompt "身着红色旗袍的女性character1，轻抬玉手展开折扇character2时流苏耳坠character3随头部转动轻盈摆动" --reference-images "https://example.com/girl.jpg" "https://example.com/fan.jpg" "https://example.com/earrings.jpg" --resolution "720P" --ratio "16:9" --duration 5
python3 {baseDir}/scripts/happyhorse-magic.py reference2video-gen --prompt "character1在海边散步，阳光洒在沙滩上" --reference-images "https://example.com/person.png" --resolution "1080P" --ratio "16:9" --duration 10
Options
--prompt: Text prompt with character references (required, max 5000 non-Chinese chars). Use "character1/character2/..." to reference images in array order.--reference-images: Reference image URLs (required, 1-9 images). The 1st image = character1, 2nd = character2, etc.--resolution: Video resolution -720Por1080P(default: 1080P)--ratio: Aspect ratio -16:9,9:16,1:1,4:3,3:4(default: 16:9)--duration: Video duration in seconds, 3-15 (default: 5)--no-watermark: Disable "Happy Horse" watermark (default: enabled)--seed: Random seed for reproducibility [0, 2147483647]
Note: Reference images should have short side >= 400px. Avoid low-resolution, blurry, or heavily compressed images.
reference2video tasks-get (round-robin)
python3 {baseDir}/scripts/happyhorse-magic.py reference2video-get --task-id "<TASK_ID_FROM_VIDEO_GEN>"
Video Editing (happyhorse-1.0-video-edit)
Edit existing videos with text instructions and optional reference images. Supports style transfer, local replacement, and other editing tasks.
Instruction-based Editing
python3 {baseDir}/scripts/happyhorse-magic.py video-edit --prompt "将场景变成夜晚，添加霓虹灯效果" --video "https://example.com/video.mp4" --resolution "720P"
python3 {baseDir}/scripts/happyhorse-magic.py video-edit --prompt "为人物换上酷闪的衣服" --video "https://example.com/original.mp4"
Reference Image-based Editing
python3 {baseDir}/scripts/happyhorse-magic.py video-edit --prompt "让视频中的角色穿上图片中的条纹毛衣" --video "https://example.com/video.mp4" --reference-images "https://example.com/clothes.webp"
python3 {baseDir}/scripts/happyhorse-magic.py video-edit --prompt "将背景替换为参考图中的场景" --video "https://example.com/video.mp4" --reference-images "https://example.com/bg.jpg" --resolution "720P"
Options
--prompt: Editing instruction (required, max 5000 non-Chinese chars)--video: Input video URL to edit (required, mp4/mov, 3-60s input, output max 15s)--reference-images: Reference image URLs for editing (optional, 0-5 images)--resolution: Output resolution -720Por1080P(default: 1080P)--audio-setting: Audio handling -auto(default) ororigin(keep original audio)--no-watermark: Disable "Happy Horse" watermark (default: enabled)--seed: Random seed for reproducibility [0, 2147483647]
Note: Output aspect ratio and duration follow the input video. No --ratio or --duration parameters. If input video > 15s, system auto-truncates to first 15s.
video-edit tasks-get (round-robin)
python3 {baseDir}/scripts/happyhorse-magic.py video-edit-get --task-id "<TASK_ID_FROM_VIDEO_EDIT>"
Key Differences from Wan 2.7
| Feature | HappyHorse | Wan 2.7 |
|---|---|---|
| Watermark default | Enabled ("Happy Horse") | Disabled ("AI Generated") |
| prompt_extend | Not supported | Supported |
| negative_prompt | Not supported | Supported |
| seed parameter | Supported (all models) | Supported (all models) |
| I2V modes | First-frame only | First-frame, First+Last-frame, Video continuation |
| R2V reference type | Images only (character1/2) | Videos + Images (视频1/图片1) |
| R2V reference count | 1-9 images | Max 3 videos + 5 images |
| Video Edit input | 3-60s, output max 15s | 2-10s |
| Video Edit prompt | Required | Optional |
Important Notes
- Task ID Validity: Task IDs are valid for 24 hours
- Video URL Validity: Generated video URLs are valid for 24 hours, download immediately
- Content Review: Both input and output are subject to content safety review
- Billing: Based on resolution (1080P > 720P) × duration (seconds)
- Watermark: Default enabled with "Happy Horse" text; use
--no-watermarkto disable