M4L.RhythmVAE – Train and use AI rhythm generators on Ableton Live

Variational Autoencoder(VAE)-based rhythm generation device for Ableton Live/Max for Live. This plug-in software allows artists/musicians to train and use the rhythm generation model within the music production software(DAW). 

Users of the device can drag and drop MIDI files containing rhythm track and train the model. Once trained, they can automate the transition of the latent vector of the VAE model and generate dynamically changing various rhythm patterns.

The device simplifies the otherwise complicated and cumbersome process of training and utilizing generational models and allows artists to explore the possibility of AI freely. We aimed to democratize the use of AI in the music production process.



Source Code:



Towards democratizing music production with AI-Design of Variational Autoencoder-based Rhythm Generator as a DAW plugin https://arxiv.org/abs/2004.01525

Training Process
Generation Process

Participants of MUTEK AI Music Lab Tokyo used M4L.RhythmVAE to develop their own musical ideas


Join the discussion and tell us your opinion.

Published a paper on arxiv – Nao Tokui / 徳井直生
April 8, 2020 at 4:27 pm

[…] For more detail on the project: M4L.RhythmVAE – Train and use AI rhythm generators on Ableton Live […]

log – 2020 – Nao Tokui / 徳井直生
March 18, 2021 at 1:07 pm

[…] Added a page on M4L.RhythmVAE – Max for Live plugin for training and using AI Rhythm Generation […]