Magenta RealTime

Overview

Magenta RealTime is Google's real-time music generator. You just toss it a sound clip or type “electro funk” and it starts building music. You can even do both at once. It’s light enough to run live on stage so DJs and game devs might love this.

The team behind RealTime have packed three smart pieces into it:

SpectroStream. This crunches stereo sound into small tokens.

MusicCoCa. Lines up sound and words in one space so you get better control over the vibe.

Transformer LLM. The big brain that spits out the music based on what you gave it.

It’s quick enough for live jamming or scoring scenes in games. Want a peaceful tune during calm gameplay and chaos when things explode? This can keep up.

Sure there’s stuff missing. It can’t really sing lyrics and it only remembers the last 10 seconds. But right now it’s the only AI you can run live that makes music on the spot without pausing.

You get the full tool and code under Apache 2.0 and CC-BY 4.0. No locked features.

How to use it? Type in text prompts to control the overall style of the generated music in real time. The sliders by the prompts change the influence of each text prompt on the overall output. 

Supported Languages