mmMusicExpert

---

name: mm-music-expert description: Create music with MiniMax music models (music-2.5+, music-2.5). Use when generating songs, instrumental tracks, or chanting from lyrics and style prompts via MiniMax Music Generation API. Guides music novices through an interactive workflow to produce professional-quality music.

---

MiniMax Music Expert

Generate music using MiniMax Music Generation API. Default model: music-2.5+ (recommended). This skill is designed to help music novices create professional-quality music through guided interaction.

Environment Setup

export MINIMAX_MUSIC_API_KEY="your_api_key"

---

Agent Workflow (MUST FOLLOW)

When a user requests music creation, always follow this 4-step interactive workflow. Do NOT skip steps or jump directly to generation.

Step 1: Understand & Clarify Requirements

Analyze the user's input and identify which dimensions are already covered vs. missing. Then ask targeted follow-up questions to fill the gaps.

Dimension checklist — check which are provided, ask about the rest. Each question MUST provide lettered options (A/B/C/...) for the user to choose from:

| Dimension | Question with options | |-----------|---------------------| | Type | "这首歌的类型？ A. 有人声演唱的歌曲 B. 纯音乐/背景音乐(无人声) C. 哼唱/吟唱(旋律人声无歌词)" | | Genre/Style | "你喜欢什么音乐风格？ A. 流行 B. 摇滚 C. 民谣 D. 电子/EDM E. 嘻哈/说唱 F. 爵士 G. 古风/中国风 H. R&B I. 其他(请描述)" | | Mood/Emotion | "希望传达什么情绪？ A. 欢快活泼 B. 温柔抒情 C. 忧伤感怀 D. 激昂热血 E. 治愈放松 F. 大气磅礴/史诗感 G. 浪漫甜蜜 H. 其他(请描述)" | | Scene/Use case | "这首歌打算用在什么场景？ A. 短视频/Vlog BGM B. 个人收藏/送人 C. 游戏/动画 D. 咖啡馆/餐厅 E. 婚礼/庆典 F. 运动/健身 G. 其他(请描述)" | | Tempo/Rhythm | "节奏方面的偏好？ A. 慢速抒情(60-80 BPM) B. 中速舒缓(80-110 BPM) C. 中快轻快(110-130 BPM) D. 快速动感(130-160 BPM) E. 不确定，交给你来定" | | Instruments | "有没有想要的乐器？ A. 钢琴为主 B. 吉他(民谣/电吉他) C. 中国民乐(笛子/琵琶/古筝/二胡) D. 弦乐(小提琴/大提琴) E. 电子合成器 F. 管乐(萨克斯/小号) G. 不确定，根据风格搭配 H. 其他(请描述)" | | Vocal | "人声方面？(纯音乐跳过) A. 温柔女声 B. 有力女声 C. 温柔男声 D. 有力男声 E. 烟嗓/沙哑 F. 不确定，交给你来定" | | Lyrics | "歌词方面？(纯音乐跳过) A. 我已有歌词 B. 我给主题/关键词，你来写 C. 全部交给AI自动生成" | | Dynamic Arc | "歌曲的情绪走向？ A. 由浅入深，慢慢推向高潮 B. 开头就炸裂，全程高能 C. 先抑后扬(安静开头→爆发副歌) D. 起伏交替(安静→爆发→安静→更大爆发) E. 全程平稳舒缓 F. 不确定，交给你来编排" | | Reference | "有没有喜欢的参考？(optional) A. 有，类似某个歌手/歌曲(请说明) B. 没有特别参考" |

Rules:

不要一次抛出所有问题。根据用户已提供的信息，只问缺失的关键维度（通常 2-4 个问题）

每个问题必须带字母选项(A/B/C/...)，降低用户决策成本

选项末尾提供"其他"或"交给你来定"的兜底选项，避免用户被选项限制

如果用户的需求已经很明确（覆盖了 Type + Genre + Mood + 至少一个其他维度），可以直接进入 Step 2

示例交互： > 用户: "帮我做一首关于杭州的歌" > Agent: "好的！关于这首杭州之歌，我还想确认几个方面，你可以直接回复选项字母： > > 1. 🎵 风格：A. 中国风民谣 B. 流行 C. 古风 D. R&B E. 其他 > 2. 🎤 情绪：A. 温柔抒情 B. 大气磅礴 C. 欢快明朗 D. 忧伤怀旧 > 3. 🎶 人声：A. 温柔女声 B. 有力女声 C. 温柔男声 D. 有力男声 > 4. 🎭 情绪走向：A. 由浅入深慢慢推向高潮 B. 先抑后扬 C. 全程舒缓 D. 起伏交替 > 5. ✍️ 歌词：A. 我已有歌词 B. 我给主题你来写 C. AI自动生成 > > 直接回复如 1A 2B 3A 4A 5B 即可！"

Step 2: Design Song Blueprint & Present Draft

This is the most important step. Do NOT write a flat prompt. First design a Song Blueprint (段落蓝图) that plans each section's musical characteristics, then derive the prompt and lyrics from it.

#### Step 2a: Create Song Blueprint

Based on gathered requirements, plan the section-by-section musical journey. Each section should have distinct characteristics.

Blueprint format:

🎼 歌曲蓝图
| 段落 | 情绪/能量 | 乐器/编曲 | 人声表现 | 制作特点 |
|------|-----------|-----------|----------|----------|
| [Intro] | ... | ... | ... | ... |
| [Verse 1] | ... | ... | ... | ... |
| [Pre Chorus] | ... | ... | ... | ... |
| [Chorus] | ... | ... | ... | ... |
| ... | ... | ... | ... | ... |

Blueprint example (用户需求: "一首关于杭州的中国风民谣，温柔开头，副歌大气"):

🎼 歌曲蓝图
| 段落 | 情绪/能量 | 乐器/编曲 | 人声表现 | 制作特点 |
|------|-----------|-----------|----------|----------|
| [Intro] | 宁静悠远 ⚡① | 古筝独奏琶音 | — | 空间感大，远处水声质感 |
| [Verse 1] | 细腻叙述 ⚡② | +笛子旋律，轻拨琵琶 | 温柔低吟，呼吸感 | 亲密感，少混响 |
| [Verse 2] | 情感渐浓 ⚡③ | +二胡加入，节奏轻启 | 声线渐开，带感情 | 开始加宽声场 |
| [Pre Chorus] | 蓄势待发 ⚡⑤ | 弦乐铺底渐强，鼓点加入 | 力度上升，情绪推动 | 渐强(crescendo) |
| [Chorus] | 大气磅礴 ⚡⑧ | 全编制爆发：弦乐+鼓+笛+琵琶 | 高亢嘹亮，饱满和声 | "音墙"，宽广声场 |
| [Bridge] | 回归内省 ⚡③ | 仅钢琴+古筝 | 轻声吟唱 | 突然安静，对比反差 |
| [Chorus] | 最终爆发 ⚡⑨ | 全编制+合唱层叠 | 全力释放，高音 | 最高能量 |
| [Outro] | 渐归平静 ⚡② | 古筝回归独奏 | — | 渐弱收尾 |

⚡① ~ ⚡⑩ = energy level, 用于可视化段落间的能量变化曲线。

Blueprint design principles:

段落间必须有对比：相邻段落的能量/乐器/人声至少有一项明显不同

能量曲线要有起伏：避免全程同一能量级。典型曲线：低→中→高→低→最高→低

Chorus 必须是能量峰值：确保副歌和主歌之间有显著的编曲差异

Bridge 通常是"呼吸空间"：在两次 Chorus 之间提供反差

#### Step 2b: Derive Prompt from Blueprint

将蓝图中的信息转化为 prompt。好的 prompt 需要同时描述整体基调和段落间的动态变化。

Prompt construction formula:

[整体风格/BPM] + [人声描述 + 段落间变化] + [核心乐器] + [动态弧线描述] + [声场/制作特点]

Example (based on the 杭州 blueprint above):

A poetic and cinematic Chinese folk pop at 78 BPM, featuring a tender female vocal that transitions from intimate whispering in the verses to powerful soaring belting in the choruses with layered harmonies. The arrangement builds from a solo guzheng intro, gradually adding dizi (bamboo flute), pipa, and erhu through the verses, swelling to a full orchestral "wall of sound" with strings and percussion in the choruses, before retreating to a quiet guzheng outro. The production shifts from a dry, intimate space in the verses to a wide, reverberant arena soundscape in the choruses.

Key: The prompt explicitly describes what changes between sections — not just a flat list of attributes.

#### Step 2c: Write Lyrics with Section Directions

Write lyrics using annotated structure tags and parenthetical directions to reinforce the blueprint:

[Intro]
（古筝琶音，空灵悠远）
[Verse 1: 温柔低吟]
西湖 烟雨 朦胧了 谁的眼
断桥 残雪 化作 心头的暖
[Verse 2: 情感渐浓]
（笛声加入，轻柔的鼓点）
三潭 映月 点亮了 千年夜
灵隐 钟声 唤醒 梦中的蝶
[Pre Chorus: 情绪递进]
（弦乐渐强 / Rising strings）
这片土地 承载了 多少故事
每一寸 都是 我的根
[Chorus: 大气爆发]
（Full band kicks in / 全编制爆发）
杭州 我的杭州
你是 我心中 永远的歌
...
[Bridge: 回归平静]
（Music drops to piano and guzheng only / 仅剩钢琴与古筝）
闭上眼 你还在那里
...
[Chorus: 最终高潮]
（Maximum energy / 最高能量，加入合唱层）
杭州 我的杭州
...
[Outro: 渐弱收尾]
（古筝独奏，渐弱 / Guzheng solo, fading out）

#### Step 2d: Present Complete Draft

Combine all above into the final presentation:

📋 生成方案
模式：Standard Song
🎼 歌曲蓝图：
[the blueprint table]
Prompt：
[the full prompt — with dynamic arc description]
歌词：
[the full lyrics — with annotated tags and parenthetical directions]
说明：[1-2 sentences on creative choices]

请确认是否满意，或告诉我需要调整的地方（如某段落的情绪、乐器、歌词等）。

Rules:

Always create the blueprint first, then derive prompt and lyrics from it

Prompt must describe section transitions, not just a flat style

Lyrics must use annotated structure tags (e.g., [Chorus: 大气爆发]) and parenthetical directions (e.g., （Full band kicks in）) to control each section's sound

Show the complete blueprint, prompt, and lyrics — never hide details

Wait for explicit user confirmation before proceeding to Step 3

Step 3: Generate Music

After user confirms (or after applying their revisions and getting re-confirmation):

1. Determine the output file name from context (e.g., ./audio/杭州之歌.mp3) 2. Run the generation command:

python scripts/generate_music.py \
  --lyrics "" \
  --prompt "" \
  --output ./audio/.mp3

For instrumental mode, add --is-instrumental true and omit --lyrics. For auto-lyrics mode, add --lyrics-optimizer true and omit --lyrics.

3. Inform user that generation is in progress (API call may take 30-120 seconds)

Step 4: Post-Generation Feedback

After the audio file is generated:

1. Tell the user the file location and invite them to listen 2. Ask for feedback:

🎵 音乐已生成！文件保存在：./audio/.mp3
请试听后告诉我你的感受：
✅ 满意，完成
🔄 需要调整（请告诉我具体想改什么，比如节奏太快、想换个风格、歌词某处要改等）

3. If user requests changes: - Analyze what needs modification (prompt, lyrics, or both) - Return to Step 2 with the revised draft - Repeat until user is satisfied

Common revision patterns:

| User feedback | Action | |---------------|--------| | "节奏太快/太慢" | Adjust BPM in prompt | | "风格不对" | Revise genre/style keywords in prompt | | "人声不喜欢" | Adjust vocal description in prompt | | "歌词某段要改" | Modify specific lyrics section | | "想加点 rap" | Add [Verse: Rap] section in lyrics, update prompt | | "乐器不对" | Revise instrument list in prompt | | "感觉太单调" | Add dynamic arc description, enrich structure tags with annotations | | "想要更有层次感" | Add parenthetical production directions in lyrics, describe section transitions in prompt |

---

Model & Mode Reference

Model Differences

| Feature | music-2.5 | music-2.5+ (recommended) | |---------|-----------|--------------------------| | Standard song (with lyrics) | ✅ lyrics required | ✅ lyrics required | | Pure music (is_instrumental) | ❌ not supported | ✅ prompt required, lyrics optional | | Auto-generate lyrics (lyrics_optimizer) | ✅ | ✅ | | prompt field | Optional [0, 2000] chars | Optional for songs; Required [1, 2000] for instrumental | | lyrics field | Required [1, 3500] chars | Required for songs; optional for instrumental |

Generation Modes

| Mode | When to use | Key Args | |------|-------------|----------| | Standard Song | User has/wants lyrics + singing | --lyrics + --prompt | | Pure Music | "纯音乐" / "instrumental" / "背景音乐" / "无人声" | --is-instrumental true + --prompt | | Chanting | "哼唱" / "吟唱" / "humming" | --lyrics (syllables) + --prompt | | Auto Lyrics | User wants AI to write lyrics | --lyrics-optimizer true + --prompt |

---

Prompt Crafting (Best Practices)

Prompt 控制音乐的整体风格、情绪和制作方向。好的 prompt 不是扁平的属性罗列，而是描述音乐如何在段落间变化。

核心维度（必须覆盖）

| 维度 | 说明 | 示例 | |------|------|------| | Genre + Era/Region | 具体风格 + 时代或地域 | 1980s J-Rock, Chinese folk R&B, 昭和年代Disco | | BPM | 明确的节拍速度 | 92 BPM, 136 BPM, 140 BPM | | Vocal + Transition | 性别、音色 + 段落间如何变化 | soft airy female vocal that transitions from intimate whispering in verses to powerful soaring belting in choruses | | Instruments + Layering | 核心乐器 + 各段落如何叠加/退出 | builds from solo guzheng, adding dizi and pipa through verses, swelling to full orchestral in choruses | | Mood | 2-3 个情绪描述词 | passionate, nostalgic, hopeful | | Dynamic Arc | 段落间的能量演进曲线 | from intimate dry verse into wide reverberant chorus, retreating to quiet bridge before final explosive chorus |

进阶维度（提升精度）

| 维度 | 说明 | 示例 | |------|------|------| | Production/Mix | 混音风格、段落间空间变化 | dry intimate space in verses, wide reverberant arena soundscape in choruses | | Sound Design | 特定风格的声学特征 | rock saturation, 80s Minneapolis sound, modern electronic wide transients | | Scene/Use case | 使用场景 | anime theme, club/party, coffee shop BGM | | Avoid | 排除元素 | no autotune, avoid heavy reverb, no trap hi-hats |

Prompt 构建公式（推荐）

[整体风格 + BPM] + [人声描述 + 段落间变化] + [乐器编排 + 段落间叠加/退出] + [动态弧线] + [声场/制作变化]

English template (highest precision):

A [mood] [BPM] [genre] track featuring a [vocal] that [transitions from X in verses to Y in choruses], with arrangement building from [sparse intro instruments] through [verse additions] to [full chorus instrumentation], [bridge contrast], before [final chorus climax]. Production shifts from [verse sound] to [chorus sound].

Example:

A poetic and cinematic Chinese folk pop at 78 BPM, featuring a tender female vocal that transitions from intimate whispering in the verses to powerful soaring belting in the choruses with layered harmonies. The arrangement builds from a solo guzheng intro, gradually adding dizi, pipa, and erhu through the verses, swelling to a full orchestral "wall of sound" with strings and percussion in the choruses, retreating to quiet guzheng in the bridge, before a final explosive chorus with choir layers. Production shifts from dry intimate space in verses to wide reverberant arena soundscape in choruses.

Chinese description template:

78 BPM 的诗意中国风民谣，温柔女声演唱。主歌低吟浅唱、气息感十足，到副歌转为高亢嘹亮的全力释放。编曲从古筝独奏开头，主歌逐渐加入笛子、琵琶，到副歌时弦乐、鼓点全编制爆发形成"音墙"，Bridge回归古筝独奏的宁静，尾声再次爆发后古筝收尾渐弱。

Simple tag template (for straightforward requests):

[风格], [情绪], [BPM], [乐器], [人声类型]

示例: Pop,中国风R&B / Afro House,Tropical House / 流行，女生，舒缓

常见用户需求 → Prompt 转换

| 用户需求 | Prompt 方向 | |----------|------------| | "主旋律大气磅礴" | prompt 描述动态弧线: arrangement builds from gentle opening to massive orchestral chorus with powerful brass, strings and timpani, creating an epic arena soundscape | | "副歌加一段 rap" | prompt: with melodic rap in verses transitioning to anthemic singing in choruses; 歌词: [Verse 1: Rap] + [Chorus: Singing] | | "歌颂我的家乡·杭州" | 主题在歌词；prompt 描述风格+动态: Chinese folk pop, building from intimate solo guzheng verse to full ensemble chorus | | "使用笛子、琵琶等民乐" | prompt 描述乐器如何分布: featuring dizi (bamboo flute) as verse melody, pipa as rhythmic texture, erhu joining in bridge, full silk-bamboo ensemble in chorus | | "复古迪斯科" | 复古迪斯科风格，主歌以放克吉他切分律动为主，副歌管弦与合成器全面加入，庆典般的能量爆发 | | "治愈系轻音乐" | healing ambient, starting with solo piano, gradually layering soft strings and gentle pads, building warmth + --is-instrumental true | | "开头要炸裂" | explosive intro with heavy bass and drum impact, settling into groove for verses, building back to maximum energy chorus | | "想要有层次感" | prompt 显式描述每段的乐器增减: verse: acoustic guitar + light drums → pre-chorus: add synth pads + bass → chorus: full band with layered vocals → bridge: strip to piano only |

---

Lyrics Writing (Best Practices)

结构标签

官方支持的 14 种标签：

[Intro] [Verse] [Pre Chorus] [Chorus] [Post Chorus]
[Bridge] [Interlude] [Outro] [Transition] [Break]
[Hook] [Build Up] [Inst] [Solo]

结构标签高级用法

编号区分：用编号区分不同段落，使每段有不同表现：

[Verse 1]
街边红灯 摇曳 破了 暮色
[Verse 2]
玉米 粒粒 颗颗 都是 地道

注释标签：在标签后用冒号加注释，指导该段落的演绎方式：

[Intro Hook: Heavy Hanmai Style & 808 Drop]
[Verse 1: Aggressive Rap]
[Pre-Chorus: Build Up]
[Chorus: Maximum Energy]
[Bridge: Comical Trombone Solo]
[Outro: Speed Up]
[Drop / Chorus]

段落对比编排（关键：避免歌曲单调）

核心原则：每个段落的歌词中应通过注释标签 + 括号指令明确告诉模型这一段的音乐特征，确保相邻段落之间产生对比。

完整示例（注意每个段落的括号指令如何控制乐器和能量的变化）：

[Intro]
（古筝独奏琶音，空旷悠远）
[Verse 1: 温柔叙述]
（轻柔的笛子旋律加入，亲密的混音空间）
西湖 烟雨 朦胧了 谁的眼
断桥 残雪 化作 心头的暖
[Pre Chorus: 情绪递进]
（弦乐渐强，鼓点轻启 / Strings building, drums entering）
这片土地 承载了 多少故事
[Chorus: 全力爆发]
（Full band kicks in / 全编制爆发，宽广音场）
杭州 我的杭州
你是我心中 永远的歌
[Bridge: 突然安静]
（Music drops to piano only / 仅剩钢琴，安静的呼吸空间）
闭上眼 你还在那里
[Chorus: 最终高潮]
（Maximum energy, choir layers added / 最高能量，加入合唱）
杭州 我的杭州

对比维度清单（至少变化 1-2 项）： | 维度 | Verse (低能量) | Chorus (高能量) | |------|---------------|----------------| | 乐器数量 | 1-2 件 | 全编制 | | 音场宽度 | 亲密/干 | 宽广/混响 | | 人声力度 | 低吟/轻唱 | 高亢/嘹亮 | | 节奏密度 | 稀疏/无鼓 | 密集/强劲鼓点 | | 动态层次 | 轻 (p/mp) | 强 (f/ff) |

括号指令（关键技巧）

在歌词中使用 () 或 （） 插入演奏/音效/人声指令，模型会尝试执行：

乐器控制：

[Intro]
（琵琶琶音）
[Outro]
（二胡拉出一个帅气的尾音）
（鼓声重击收尾）

音效/声音设计：

(Sound of glass breaking / 玻璃破碎声)
(Phone ringing sound / 电话铃声)
(Sudden change to 8-bit game sound / 突然变成红白机音效)
(Abrupt silence / 突然安静)
(Sound of a chicken / 一声鸡叫): 咯咯哒？

人声技巧：

(Robotic Voice / 机械音)
(Super fast flow / 极快语速)
(Pitch rising higher and higher / 音调越来越高)
(Deep Voice / 深沉男声)
(Gang Vocals, Everyone shouting)
(Manic laughter)

编曲/动态：

(Heavy Bass kicks in / 重低音爆发)
(Rising synth / 情绪递进)
(Music stops briefly, only Trombone playing funny melody)
(BPM increases significantly to Happy Hardcore speed)
(Fading out with beat / 渐弱)
(Maximum Volume / 最大音量)
(Beat returns - Manyao Style)

拟声词/象声词

在歌词中直接写拟声词可产生特殊音效效果：

Boom Boom Boom!
A-Ba A-Ba A-Ba A-Ba!
Bi-bu Bi-bu Bi-bu Bi-bu (救护车音效)
Womp Womp Womp
嗡——啪!

中文空格分词（节奏控制）

中文歌词中加空格控制字词的演唱节奏和断句：

街边红灯 摇曳 破了 暮色          ← 空格控制断句节奏
半城 烟火 尽是 诱人 醇香

对比无空格版本：

街边红灯摇曳破了暮色              ← 模型自行断句，节奏不可控

双语歌词

中英混合歌词可产生跨文化效果：

霓虹灯在闪烁 (Flash, Flash)
别管现在几点钟 (Tik, Tok)
Zuo! You! Shang! Xia! (左! 右! 上! 下!)

典型歌曲结构模板

标准流行曲：

[Intro]
[Verse 1]
[Pre Chorus]
[Chorus]
[Verse 2]
[Bridge]
[Chorus]
[Outro]

EDM/舞曲：

[Intro]
[Verse 1]
[Pre-Chorus: Build Up]
[Drop / Chorus]
[Verse 2]
[Build Up]
[Drop / Chorus: Maximum Energy]
[Outro]

带 Rap 的歌曲：

[Intro]
[Verse 1: Rap]
[Pre Chorus]
[Chorus]
[Verse 2: Melodic Rap]
[Bridge]
[Chorus]
[Outro]

---

Script Reference

| File | Purpose | |------|---------| | scripts/generate_music.py | Main CLI: lyrics + prompt → audio file | | scripts/utils_audio.py | Hex decoding, file saving, URL download |

Key CLI Arguments

| Arg | Default | Description | |-----|---------|-------------| | --lyrics | — | Song lyrics (required unless instrumental or lyrics-optimizer) | | --prompt | — | Style/scene description (required for instrumental) | | --model | music-2.5+ | Model name | | --is-instrumental | false | Pure music mode (music-2.5+ only) | | --lyrics-optimizer | false | Auto-generate lyrics from prompt | | --output | — | Output file path (required) | | --output-format | url | Response format: hex or url | | --format | — | Audio codec: mp3, wav, pcm | | --sample-rate | — | 16000 / 24000 / 32000 / 44100 | | --bitrate | — | 32000 / 64000 / 128000 / 256000 | | --stream | false | Streaming mode (hex only) | | --aigc-watermark | false | Append watermark (non-stream only) | | --download | false | Download when output-format=url |

API Payload Quick Reference

Standard Song:

{
  "model": "music-2.5+",
  "prompt": "indie folk, melancholic",
  "lyrics": "[Verse]\n街灯微亮晚风轻抚\n影子拉长独自漫步\n[Chorus]\n推开木门香气弥漫",
  "audio_setting": { "sample_rate": 44100, "bitrate": 256000, "format": "mp3" }
}

Pure Music (music-2.5+ only):

{
  "model": "music-2.5+",
  "prompt": "coffee shop, ambient, relaxing, piano",
  "is_instrumental": true
}

Auto Lyrics:

{
  "model": "music-2.5+",
  "prompt": "upbeat pop, summer vibes",
  "lyrics_optimizer": true
}

For full API details, see references/minimax_music_api.md.