Voice Translator

说中文出外语语音——按住说中文，2-3秒内播放英/日/韩语音。支持场景模式、双向对话、常用句收藏。

Install

openclaw skills install @scikkk/voice-translator

Voice Translator / 语音翻译器

按住说中文，松手后 2-3 秒内播放目标语言语音。出国旅行、跨国沟通即开即用。

工作流程

text

[按住录音] → ASR识别中文 → LLM场景化翻译 → TTS合成外语语音 → [播放]
双向模式：[录入外语] → ASR识别 → 翻译成中文 → TTS播放中文

核心 API

第一步：语音识别（ASR）

bash

# 录制音频后上传识别（中文）
curl https://api.senseaudio.cn/v1/audio/transcriptions \
  -H "Authorization: Bearer $SENSEAUDIO_API_KEY" \
  -F file="@recording.wav" \
  -F model="sense-asr" \
  -F language="zh" \
  -F response_format="text"
# 返回：买单

双向模式识别外语（自动检测语言）：

bash

curl https://api.senseaudio.cn/v1/audio/transcriptions \
  -H "Authorization: Bearer $SENSEAUDIO_API_KEY" \
  -F file="@foreign.wav" \
  -F model="sense-asr" \
  -F response_format="text"
# 返回：Can I get the check please

第二步：场景化翻译（LLM）

翻译不是直译，而是目标语言的自然表达。通过系统提示注入场景上下文：

场景	system prompt 关键词
餐厅	restaurant, ordering food, dining
机场	airport, check-in, boarding, customs
酒店	hotel, check-in, room service, concierge
出租车	taxi, directions, destination
购物	shopping, price, discount, payment
就医	medical, symptoms, pharmacy, emergency

翻译示例（餐厅场景）：

中文"买单" → "Can I get the check, please?" ✓（非 "buy the bill" ✗）
中文"这个怎么做的" → "How is this dish prepared?" ✓
中文"不要辣" → "Could you make it not spicy, please?" ✓

第三步：语音合成（TTS）

bash

# 英语播报
curl -X POST https://api.senseaudio.cn/v1/t2a_v2 \
  -H "Authorization: Bearer $SENSEAUDIO_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "SenseAudio-TTS-1.0",
    "text": "Can I get the check, please?",
    "stream": false,
    "voice_setting": {
      "voice_id": "female_0001_a",
      "speed": 0.9
    },
    "audio_setting": {
      "format": "mp3",
      "sample_rate": 32000
    }
  }' | python3 -c "
import sys, json, subprocess
r = json.load(sys.stdin)
audio = bytes.fromhex(r['data']['audio'])
open('/tmp/translated.mp3','wb').write(audio)
subprocess.run(['play','/tmp/translated.mp3'])
"

完整 Python 实现

python

import os
import json
import requests
import subprocess
import tempfile

API_KEY = os.environ["SENSEAUDIO_API_KEY"]
ASR_URL = "https://api.senseaudio.cn/v1/audio/transcriptions"
TTS_URL = "https://api.senseaudio.cn/v1/t2a_v2"

# 场景配置
SCENES = {
    "restaurant": {
        "name": "餐厅",
        "prompt": "You are translating for a customer in a restaurant. Use natural, polite expressions a native speaker would use when ordering food, asking about dishes, or requesting service.",
    },
    "airport": {
        "name": "机场",
        "prompt": "You are translating at an airport. Use standard travel expressions for check-in, boarding, customs, and baggage.",
    },
    "hotel": {
        "name": "酒店",
        "prompt": "You are translating at a hotel. Use polite hospitality expressions for check-in, room requests, and concierge services.",
    },
    "taxi": {
        "name": "出租车",
        "prompt": "You are translating in a taxi. Use clear, direct expressions for giving directions and destinations.",
    },
    "shopping": {
        "name": "购物",
        "prompt": "You are translating while shopping. Use natural expressions for asking prices, sizes, discounts, and payment.",
    },
    "medical": {
        "name": "就医",
        "prompt": "You are translating at a medical facility. Use clear, precise expressions for describing symptoms and seeking help.",
    },
}

# 目标语言配置
LANGUAGES = {
    "en": {"name": "英语", "voice_id": "female_0001_a"},
    "ja": {"name": "日语", "voice_id": "female_0001_a"},
    "ko": {"name": "韩语", "voice_id": "female_0001_a"},
    "fr": {"name": "法语", "voice_id": "female_0001_a"},
    "de": {"name": "德语", "voice_id": "female_0001_a"},
    "es": {"name": "西班牙语", "voice_id": "female_0001_a"},
}

LANG_NAMES = {
    "en": "English", "ja": "Japanese", "ko": "Korean",
    "fr": "French", "de": "German", "es": "Spanish",
}


def asr(audio_path: str, language: str = None) -> str:
    """语音识别"""
    with open(audio_path, "rb") as f:
        data = {"model": "sense-asr", "response_format": "text"}
        if language:
            data["language"] = language
        resp = requests.post(
            ASR_URL,
            headers={"Authorization": f"Bearer {API_KEY}"},
            files={"file": f},
            data=data,
            timeout=15,
        )
    resp.raise_for_status()
    return resp.text.strip()


def translate(text: str, target_lang: str, scene: str = None) -> str:
    """场景化翻译（调用 LLM）"""
    scene_prompt = SCENES.get(scene, {}).get("prompt", "Translate naturally.")
    lang_name = LANG_NAMES.get(target_lang, target_lang)

    # 此处接入你的 LLM（如 Claude API）
    # 示例 prompt：
    system = f"{scene_prompt} Translate the Chinese text to {lang_name}. Return ONLY the translated text, no explanations."
    # user = text
    # ... call LLM API ...
    # 返回翻译结果
    raise NotImplementedError("请接入 LLM 翻译接口")


def tts(text: str, target_lang: str) -> bytes:
    """文字转语音"""
    voice_id = LANGUAGES.get(target_lang, {}).get("voice_id", "female_0001_a")
    payload = {
        "model": "SenseAudio-TTS-1.0",
        "text": text,
        "stream": False,
        "voice_setting": {"voice_id": voice_id, "speed": 0.9},
        "audio_setting": {"format": "mp3", "sample_rate": 32000},
    }
    resp = requests.post(
        TTS_URL,
        headers={"Authorization": f"Bearer {API_KEY}", "Content-Type": "application/json"},
        json=payload,
        timeout=15,
    )
    resp.raise_for_status()
    return bytes.fromhex(resp.json()["data"]["audio"])


def play_audio(audio_bytes: bytes):
    """播放音频"""
    with tempfile.NamedTemporaryFile(suffix=".mp3", delete=False) as f:
        f.write(audio_bytes)
        tmp_path = f.name
    # macOS: afplay, Linux: play (sox), Windows: start
    for cmd in [["afplay", tmp_path], ["play", tmp_path], ["mpg123", tmp_path]]:
        try:
            subprocess.run(cmd, check=True, capture_output=True)
            return
        except (FileNotFoundError, subprocess.CalledProcessError):
            continue


class VoiceTranslator:
    def __init__(self, target_lang: str = "en", scene: str = None, bidirectional: bool = False):
        self.target_lang = target_lang
        self.scene = scene
        self.bidirectional = bidirectional
        self.favorites: list[dict] = []  # 收藏的句子

    def translate_voice(self, audio_path: str) -> dict:
        """主流程：录音 → 识别 → 翻译 → 合成 → 播放"""
        # 1. ASR
        src_lang = None if self.bidirectional else "zh"
        recognized = asr(audio_path, language=src_lang)
        print(f"识别: {recognized}")

        # 2. 翻译
        tgt_lang = "zh" if self.bidirectional else self.target_lang
        translated = translate(recognized, tgt_lang, self.scene)
        print(f"翻译: {translated}")

        # 3. TTS + 播放
        audio = tts(translated, tgt_lang)
        play_audio(audio)

        result = {"original": recognized, "translated": translated, "lang": tgt_lang}
        return result

    def add_favorite(self, result: dict):
        """收藏句子"""
        entry = {**result, "scene": self.scene}
        if entry not in self.favorites:
            self.favorites.append(entry)
            print(f"已收藏: {result['original']} → {result['translated']}")

    def play_favorite(self, index: int):
        """直接播放收藏句子"""
        entry = self.favorites[index]
        audio = tts(entry["translated"], entry["lang"])
        play_audio(audio)

    def save_favorites(self, path: str = "favorites.json"):
        with open(path, "w", encoding="utf-8") as f:
            json.dump(self.favorites, f, ensure_ascii=False, indent=2)

    def load_favorites(self, path: str = "favorites.json"):
        try:
            with open(path, encoding="utf-8") as f:
                self.favorites = json.load(f)
        except FileNotFoundError:
            pass


# 使用示例
if __name__ == "__main__":
    # 餐厅场景，翻译成英语
    translator = VoiceTranslator(target_lang="en", scene="restaurant")
    translator.load_favorites()

    # 翻译一句话
    result = translator.translate_voice("recording.wav")

    # 收藏
    translator.add_favorite(result)
    translator.save_favorites()

    # 双向模式：对方说英语，翻译成中文
    reverse = VoiceTranslator(target_lang="zh", bidirectional=True)
    reverse.translate_voice("foreign_speech.wav")

场景模式速查

场景	常见中文输入	自然外语输出（英语示例）
餐厅	买单	Can I get the check, please?
餐厅	这个怎么做的	How is this dish prepared?
餐厅	不要辣	Could you make it not spicy?
机场	我的行李丢了	I'd like to report lost luggage.
机场	登机口在哪	Where is the boarding gate?
酒店	我要退房	I'd like to check out, please.
出租车	去这个地址	Please take me to this address.
购物	能便宜点吗	Is there any discount available?
就医	我头很痛	I have a severe headache.

支持语言

代码	语言	ASR 支持	TTS 支持
en	英语	✅	✅
ja	日语	✅	✅
ko	韩语	✅	✅
fr	法语	✅	✅
de	德语	✅	✅
es	西班牙语	✅	✅
th	泰语	✅	✅
vi	越南语	✅	✅

收藏功能

翻译过的句子可一键收藏，自动积累个人旅行用语库：

python

# 收藏
translator.add_favorite(result)
translator.save_favorites("my_phrases.json")

# 下次直接播放，无需重新录音
translator.load_favorites("my_phrases.json")
translator.play_favorite(0)  # 播放第一条收藏

收藏文件格式（favorites.json）：

json

[
  {
    "original": "买单",
    "translated": "Can I get the check, please?",
    "lang": "en",
    "scene": "restaurant"
  }
]

TTS 参数说明

参数	推荐值	说明
speed	0.9	略慢，外语更清晰易懂
vol	1.0	标准音量
format	mp3	通用格式
sample_rate	32000	平衡音质与速度

Voice Translator

Install

Voice Translator / 语音翻译器

工作流程

核心 API

第一步：语音识别（ASR）

第二步：场景化翻译（LLM）

第三步：语音合成（TTS）

完整 Python 实现

场景模式速查

支持语言

收藏功能

TTS 参数说明

相关资源