🎁 Get the FREE AI Skills Starter Guide β€” Subscribe β†’
BytesAgainBytesAgain
πŸ¦€ ClawHub

Audio PTBR

by @henrique-simoes

Premium Portuguese-Brazilian voice interface with neural TTS and Claude AI integration. Features wav2vec2-large-xlsr-53-ptBR for excellent PT-BR understandin...

Versionv2.0.1
Downloads516
TERMINAL
clawhub install audio-ptbr-aprimorado

πŸ“– About This Skill


name: audio-ptbr-autoreply version: 2.0.1 description: | Premium Portuguese-Brazilian voice interface with neural TTS and Claude AI integration. Features wav2vec2-large-xlsr-53-ptBR for excellent PT-BR understanding (slang, expressions, accents) + optional Claude API for intelligent responses. Multiple neural voices (3 masculine, 1 feminine). Silent audio-in/audio-out by default with one-command installation.

category: voice tags: - voice - audio - speech-to-text - text-to-speech - portuguese - accessibility hooks: - event: "message.audio.receive" action: "bash process.sh \"{{MediaPath}}\" \"{{Target}}\" \"{{MessageID}}\"" triggers: - command: "/voz" description: "Configurar voz ou processar Γ‘udio manualmente" action: "bash process.sh \"{{args}}\"" config: tools: media: audio: scope: default: "allow"


Audio PT Auto-Reply v2.0.1 - Premium Voice Interface

Complete voice interface with superior Brazilian Portuguese understanding and automatic setup.

🌟 Key Features

Superior PT-BR Understanding

  • Model: wav2vec2-large-xlsr-53-portuguese (jonatasgrosman)
  • Excellence in: Brazilian Portuguese with slang, expressions, accents
  • Also supports: English (multilingual)
  • Quality: State-of-the-art for PT-BR ASR
  • πŸ€– Optional Claude Integration

  • Intelligent responses using Claude API
  • Falls back to OpenClaw agent automatically
  • Optional: No API key required, still works with OpenClaw agent
  • Smart: Better understanding of context and Portuguese nuances
  • Neural Voice Options (Piper TTS)

    | Voice | Gender | Quality | Character | |-------|--------|---------|-----------| | jeff | Masculina | Medium | Clear, professional | | cadu | Masculina | Medium | Warm, natural | | faber | Masculina | Medium | Balanced | | miro | Feminina | High | Community voice |

    Voice Commands

    Change voice anytime with:

  • /voz jeff - Voice: Jeff
  • /voz cadu - Voice: Cadu
  • /voz faber - Voice: Faber
  • /voz miro - Voice: Miro (feminina)
  • /voz feminina - Automatic: miro
  • /voz masculina - Automatic: jeff
  • /voz listar - Show all voices
  • ⚑ Installation (NEW!)

    One-Command Installation

    bash install.sh
    

    The installer automatically:

  • βœ… Detects your system architecture (ARM64, x86_64)
  • βœ… Downloads Piper TTS
  • βœ… Downloads 4 Brazilian Portuguese voice models (~240MB)
  • βœ… Installs Python dependencies
  • βœ… Validates everything works
  • No manual downloads. No configuration. Just one command!

    πŸ”„ Critical Rules

    DEFAULT: AUDIO ONLY - NO TEXT

    When user sends audio:

  • ❌ NO transcription shown
  • ❌ NO "Pesquisando...", "Gerando..."
  • ❌ NO confirmations or explanations
  • βœ… ONLY audio reply
  • TEXT MODE: Say "texto" or "responda em texto" explicitly

    πŸ“Š Workflow

    🎀 Audio Received (PT-BR/EN)
        ↓
    πŸ”€ Transcribe (wav2vec2 PT-BR - silent)
        ↓
    πŸ€– AI Response (Claude API or OpenClaw Agent - silent)
        ↓
    πŸ—£οΈ Synthesize (Piper neural - silent)
        ↓
    πŸ“€ Send Audio Reply (silent)
    

    πŸ“ Scripts

    Installation & Setup

  • install.sh - Automatic installation (run once!)
  • health_check.py - Validate the installation
  • Core Processing

  • transcribe.py - wav2vec2 PT-BR speech recognition
  • synthesize.py - Piper TTS with voice selection
  • voice_config.py - Voice preference management
  • process.sh - Full workflow orchestration
  • AI Integration

  • claude_adapter.py - Claude API bridge (intelligent responses)
  • πŸ”§ Configuration

    Optional: Enable Claude Integration

    For intelligent AI responses, set your API key:

    export ANTHROPIC_API_KEY="sk-your-api-key"
    

    Without this, the skill uses OpenClaw's agent (still great responses!).

    Voice Configuration

    Current voice is saved automatically in:

    ~/.openclaw/workspace/.audio_pt_voice_config
    

    πŸ“Š Technical Details

    ASR Model

  • Name: jonatasgrosman/wav2vec2-large-xlsr-53-portuguese
  • Training: Fine-tuned on PT-BR Common Voice + other datasets
  • Strengths: Brazilian slang, regional expressions, informal speech
  • License: Apache 2.0
  • TTS Engine

  • Engine: Piper (fast, local neural TTS)
  • Voices: 4 PT-BR options
  • Speed: Real-time on ARM64/x64
  • Format: Opus OGG (Telegram optimized)
  • License: MIT
  • AI Response (Optional)

  • Primary: Claude API (when API key provided)
  • Fallback: OpenClaw Agent (always available)
  • License: Claude API is proprietary; OpenClaw Agent is included
  • πŸš€ Getting Started

    1. Install skill from ClaWHub 2. Run: bash install.sh 3. Restart: openclaw gateway restart 4. Use: Send audio messages, use /voz commands

    πŸ“‹ Requirements

  • OpenClaw 2026.4.10+
  • Python 3.8+
  • 300MB free disk space (for voice models)
  • Internet connection (for initial downloads)
  • Optional: ANTHROPIC_API_KEY for Claude integration
  • πŸ”’ Privacy & Security

  • βœ… Audio transcription happens locally (wav2vec2 runs on your machine)
  • βœ… Voice synthesis happens locally (Piper runs on your machine)
  • ⚠️ AI responses:
  • - Without API key: Processed by OpenClaw Agent (check OpenClaw privacy) - With API key: Sent to Anthropic (Claude respects prompt privacy per TOS)

    πŸ“œ License

    MIT - Free to use, modify, and redistribute

    πŸ™ Credits

  • ASR: jonatasgrosman/wav2vec2-large-xlsr-53-portuguese
  • TTS: Piper by Rhasspy
  • AI: Claude API by Anthropic (optional)
  • Voices: Piper Voices repository + TarcisoAmorim community contribution