Produce a track in Ableton Live by talking
Ever wanted to control Ableton with just your voice? Task: Ever wanted to control Ableton with just your voice? Me too! I made this MCP server so I could just ask Codex to do anything in Ableton Live for me, while I was nap-trapped by my baby. Unlike other Ableton MCPs I tried, this one can do pretty much anything that is possible via Ableton's Object model; the agent can just eval arbitrary python that runs inside Ableton. It also has some tools defined for common tasks so those work faster and more reliably. I had Codex CLI optimize this for hours with the new /goal command to prioritize low end-to-end latency, high reliability, low token usage, while maintaining full flexibility. Things you can use it for: create MIDI clips, insert audio files, general Ableton questions (with this, your agent can see your whole live set), add tracks with different devices and effects, analyze harmony, analyze audio signals at any point in the signal chain, generate spectrograms, clip automation, setting up mastering or vocal processing chains, insert MIDI the agent finds from the web... it's very general purpose, I'm not sure what the limits are. How to setup Just tell your AI agent (Codex, Claude Code, Cursor, Copilot, Gemini, etc.) to: Set up the https://github.com/bschoepke/ableton-live-mcp MCP server for me It should work on Mac and Windows with recent Ableton versions, but I have only tested it on Ableton Live Suite 12.3.8 on macOS Tahoe. Back up your Live Set before using this. The MCP can edit your set directly and could corrupt it. How to update git pull this repo or ask your agent to: Update the https://github.com/bschoepke/ableton-live-mcp MCP server for me Demos Here are a couple examples of live sets made from scratch with Codex in just a few minutes, along with their prompts. After it makes something, you can ask for follow up changes. https://www.youtube.com/watch?v=8dRRrIY7NI0 The chat messages I sent to Codex to make this: in ableton, make a self reflective song, with audio vocals (via macos say) and chip tunes and 80's drum machines. should be a real edm banger Follow up prompts: i want midi for everything but vocals please, with ableton devices. not prerendered audio for instruments needs some fills and should hit way harder after "3-2-1 i become the sound" the vocals are squished too much (read too quickly), give them a little more length add some dynamics, the song is basically one volume. and some pumping side chain improve dynamics of the clap, seems a bit flat and indistinguished, want it harder after the 3-2-1 drop introduce a new element on a new track after the 3-2-1 drop, that comes in but then recedes before the final exit doesn't seem like the new thing has any notes the element is a bit muddy/indistinct. perhaps it needs simplification and more space, different instrument choice, i dunno https://youtu.be/cLCHEV1jWQo Prompt used to make this: In Ableton, make a piano duet that tells the story of people debating the positive and negative merits of AI. The composition should be both beautiful and dynamic but surprising and fresh. Use Keyscape devices. Built in Agent Audio Tap Max for Live device The MCP includes an "Agent Audio Tap" Max for Live device that enables the agent to capture audio signals at any part of the signal processing chain. This gives the agent a full feedback loop for mixing and mastering tasks: it can capture audio signals for further processing with custom python, then tweak your Ableton devices, and then repeat. Example usage where I asked Codex to generate a spectrogram of two piano tracks I had: Ideas Control your external synthesizers and other hardware with the MCP Ask it questions like "why does my mix sound muddy?" or "how do I sidechain my bass track?" Ask it to do things like "add a chord track that fits with my melody" or "give me a basic backing track for me to noodle on my guitar with" You can tell it use third party plugins (VSTs, audio units) like Serum and Keyscape Tell your agent to incorporate your existing vocal samples, including asking it to trim silence and transcribe your audio samples before creatively incorporating them into your live set Ask your agent to set up crazy user controlled DJ effects Experiment with VJ plugins like Videosync to make music videos driven by your live set; tools: Codex. Human role: The original post does not say how a person stayed involved.; limitations: Prerequisites include Ableton Live Suite 12.3.8 (tested on macOS Tahoe) and the ableton-live-mcp server. Critical constraint: The MCP can directly edit and potentially corrupt the Live Set, so backups are mandatory. Source reliability is secondary; the author notes uncertainty about the full limits of the tool's capabilities..
Tools
Published on Agent Work Atlas:
Overview
Ever wanted to control Ableton with just your voice?
Workflow
Ever wanted to control Ableton with just your voice? Me too! I made this MCP server so I could just ask Codex to do anything in Ableton Live for me, while I was nap-trapped by my baby. Unlike other Ableton MCPs I tried, this one can do pretty much anything that is possible via Ableton's Object model; the agent can just eval arbitrary python that runs inside Ableton. It also has some tools defined for common tasks so those work faster and more reliably. I had Codex CLI optimize this for hours with the new /goal command to prioritize low end-to-end latency, high reliability, low token usage, while maintaining full flexibility. Things you can use it for: create MIDI clips, insert audio files, general Ableton questions (with this, your agent can see your whole live set), add tracks with different devices and effects, analyze harmony, analyze audio signals at any point in the signal chain, generate spectrograms, clip automation, setting up mastering or vocal processing chains, insert MIDI the agent finds from the web... it's very general purpose, I'm not sure what the limits are. How to setup Just tell your AI agent (Codex, Claude Code, Cursor, Copilot, Gemini, etc.) to: Set up the https://github.com/bschoepke/ableton-live-mcp MCP server for me It should work on Mac and Windows with recent Ableton versions, but I have only tested it on Ableton Live Suite 12.3.8 on macOS Tahoe. Back up your Live Set before using this. The MCP can edit your set directly and could corrupt it. How to update git pull this repo or ask your agent to: Update the https://github.com/bschoepke/ableton-live-mcp MCP server for me Demos Here are a couple examples of live sets made from scratch with Codex in just a few minutes, along with their prompts. After it makes something, you can ask for follow up changes. https://www.youtube.com/watch?v=8dRRrIY7NI0 The chat messages I sent to Codex to make this: in ableton, make a self reflective song, with audio vocals (via macos say) and chip tunes and 80's drum machines. should be a real edm banger Follow up prompts: i want midi for everything but vocals please, with ableton devices. not prerendered audio for instruments needs some fills and should hit way harder after "3-2-1 i become the sound" the vocals are squished too much (read too quickly), give them a little more length add some dynamics, the song is basically one volume. and some pumping side chain improve dynamics of the clap, seems a bit flat and indistinguished, want it harder after the 3-2-1 drop introduce a new element on a new track after the 3-2-1 drop, that comes in but then recedes before the final exit doesn't seem like the new thing has any notes the element is a bit muddy/indistinct. perhaps it needs simplification and more space, different instrument choice, i dunno https://youtu.be/cLCHEV1jWQo Prompt used to make this: In Ableton, make a piano duet that tells the story of people debating the positive and negative merits of AI. The composition should be both beautiful and dynamic but surprising and fresh. Use Keyscape devices. Built in Agent Audio Tap Max for Live device The MCP includes an "Agent Audio Tap" Max for Live device that enables the agent to capture audio signals at any part of the signal processing chain. This gives the agent a full feedback loop for mixing and mastering tasks: it can capture audio signals for further processing with custom python, then tweak your Ableton devices, and then repeat. Example usage where I asked Codex to generate a spectrogram of two piano tracks I had: Ideas Control your external synthesizers and other hardware with the MCP Ask it questions like "why does my mix sound muddy?" or "how do I sidechain my bass track?" Ask it to do things like "add a chord track that fits with my melody" or "give me a basic backing track for me to noodle on my guitar with" You can tell it use third party plugins (VSTs, audio units) like Serum and Keyscape Tell your agent to incorporate your existing vocal samples, including asking it to trim silence and transcribe your audio samples before creatively incorporating them into your live set Ask your agent to set up crazy user controlled DJ effects Experiment with VJ plugins like Videosync to make music videos driven by your live set
Reported result
The source author reports creating live sets from scratch in minutes using Codex, with examples including an EDM track and a piano duet. No quantitative metrics on time savings or quality are provided. Proposed acceptance check: Verify that a simple command (e.g., 'add a new MIDI track') successfully modifies the Live Set without corruption.
Human role
The original post does not say how a person stayed involved.
Limitations
Prerequisites include Ableton Live Suite 12.3.8 (tested on macOS Tahoe) and the ableton-live-mcp server. Critical constraint: The MCP can directly edit and potentially corrupt the Live Set, so backups are mandatory. Source reliability is secondary; the author notes uncertainty about the full limits of the tool's capabilities.
Try it
I want to test the ableton-live-mcp server with Codex to control Ableton Live. First, ensure I have a backup of my current Live Set at [replaceable_backup_path]. Set up the MCP server from https://github.com/bschoepke/ableton-live-mcp. Then, ask Codex to perform a simple, non-destructive task: 'Create a new MIDI track named TestTrack and add a simple 4-bar chord progression.' After Codex executes this, I will manually verify in Ableton that the track exists and contains the expected MIDI notes. If successful, I will ask for a more complex task: 'Analyze the harmony of the current set and suggest a bassline.' I will review the suggestion before applying it. Do not proceed to complex automation or audio processing until I confirm the basic MIDI creation works. If any errors occur, stop and report them without attempting to fix the Live Set directly.
Source reports are not independently verified. Publication date is the catalog publication date, not the original article date.