🎁 Get the FREE AI Skills Starter Guide β€” Subscribe β†’
BytesAgainBytesAgain
πŸ¦€ ClawHub

Aliyun Qwen Tts Realtime

by @cinience

Use when real-time speech synthesis is needed with Alibaba Cloud Model Studio Qwen TTS Realtime models. Use when low-latency interactive speech is required,...

Versionv1.0.0
Downloads460
TERMINAL
clawhub install aliyun-qwen-tts-realtime

πŸ“– About This Skill


name: aliyun-qwen-tts-realtime description: Use when real-time speech synthesis is needed with Alibaba Cloud Model Studio Qwen TTS Realtime models. Use when low-latency interactive speech is required, including instruction-controlled realtime synthesis. version: 1.0.0

Category: provider

Model Studio Qwen TTS Realtime

Use realtime TTS models for low-latency streaming speech output.

Critical model names

Use one of these exact model strings:

  • qwen3-tts-flash-realtime
  • qwen3-tts-instruct-flash-realtime
  • qwen3-tts-instruct-flash-realtime-2026-01-22
  • qwen3-tts-vd-realtime-2026-01-15
  • qwen3-tts-vc-realtime-2026-01-15
  • Prerequisites

  • Install SDK in a virtual environment:
  • python3 -m venv .venv
    . .venv/bin/activate
    python -m pip install dashscope
    
  • Set DASHSCOPE_API_KEY in your environment, or add dashscope_api_key to ~/.alibabacloud/credentials.
  • Normalized interface (tts.realtime)

    Request

  • text (string, required)
  • voice (string, required)
  • instruction (string, optional)
  • sample_rate (int, optional)
  • Response

  • audio_base64_pcm_chunks (array)
  • sample_rate (int)
  • finish_reason (string)
  • Operational guidance

  • Use websocket or streaming endpoint for realtime mode.
  • Keep each utterance short for lower latency.
  • For instruction models, keep instruction explicit and concise.
  • Some SDK/runtime combinations may reject realtime model calls over MultiModalConversation; use the probe script below to verify compatibility.
  • Local demo script

    Use the probe script to verify realtime compatibility in your current SDK/runtime, and optionally fallback to a non-realtime model for immediate output:

    .venv/bin/python skills/ai/audio/aliyun-qwen-tts-realtime/scripts/realtime_tts_demo.py \
      --text "This is a realtime speech demo." \
      --fallback \
      --output output/ai-audio-tts-realtime/audio/fallback-demo.wav
    

    Strict mode (for CI / gating):

    .venv/bin/python skills/ai/audio/aliyun-qwen-tts-realtime/scripts/realtime_tts_demo.py \
      --text "realtime health check" \
      --strict
    

    Output location

  • Default output: output/ai-audio-tts-realtime/audio/
  • Override base dir with OUTPUT_DIR.
  • Validation

    mkdir -p output/aliyun-qwen-tts-realtime
    for f in skills/ai/audio/aliyun-qwen-tts-realtime/scripts/*.py; do
      python3 -m py_compile "$f"
    done
    echo "py_compile_ok" > output/aliyun-qwen-tts-realtime/validate.txt
    

    Pass criteria: command exits 0 and output/aliyun-qwen-tts-realtime/validate.txt is generated.

    Output And Evidence

  • Save artifacts, command outputs, and API response summaries under output/aliyun-qwen-tts-realtime/.
  • Include key parameters (region/resource id/time range) in evidence files for reproducibility.
  • Workflow

    1) Confirm user intent, region, identifiers, and whether the operation is read-only or mutating. 2) Run one minimal read-only query first to verify connectivity and permissions. 3) Execute the target operation with explicit parameters and bounded scope. 4) Verify results and save output/evidence files.

    References

  • references/sources.md
  • βš™οΈ Configuration

  • Install SDK in a virtual environment:
  • python3 -m venv .venv
    . .venv/bin/activate
    python -m pip install dashscope
    
  • Set DASHSCOPE_API_KEY in your environment, or add dashscope_api_key to ~/.alibabacloud/credentials.
  • πŸ”’ Constraints

    mkdir -p output/aliyun-qwen-tts-realtime
    for f in skills/ai/audio/aliyun-qwen-tts-realtime/scripts/*.py; do
      python3 -m py_compile "$f"
    done
    echo "py_compile_ok" > output/aliyun-qwen-tts-realtime/validate.txt
    

    Pass criteria: command exits 0 and output/aliyun-qwen-tts-realtime/validate.txt is generated.