Along with the new Google Bard update and the upcoming generative AI experience in search, Google also announced MusicLM, an AI music generation model, at Google I/O 2023. Luckily, we already have access to MusicLM, and we have tested and explained its potential and capabilities. Google claims it’s an experimental AI tool that can create music based on text input, but it’s limited to just 20 seconds.
MusicLM is a text-to-music generation model developed by Google as part of its AI Test Kitchen program. Create hi-fi music from simple text descriptions similar to a natural language message. MusicLM generates music at 24 kHz with a higher sample rate, which means the generated audio is of high quality. Moreover, MusicLM’s AI-based music generation is very fast, almost instantaneous.
The Google MusicLM AI model was trained on a dataset of 5,500 music tracks uniquely created by sound artists working at the Google Arts and Culture Lab. The music is captioned with rich text descriptions by human experts in the field of music. Google has released a dataset, called MusicCaps, to support future research.
Basically, you can create your own music with simple text instructions. If you have an idea about a particular type of music, but can’t define it, MusicLM can spark your imagination and bring you what you want. MusicLM currently generates two tracks for your input for a maximum of 20 seconds. But according to his research, he is able to create consistent music for up to 5 minutes.
Also, Read: Samsung Crystal 4K iSmart UHD TV 2023
How to Use Google MusicLM to Generate AI Music
That said, let’s go ahead and learn how to use Google MusicLM to generate AI soundtracks.
- Go to the Google MusicLM website and click “Get Started”.
- Now click on “Register your interest” and join the waiting list. Users are approved instantly, so there’s no more waiting.
- After that, sign in with a Google account and you will get instant access to MusicLM.
- Now go ahead and enter text descriptions to create the music of your music. For example, I started with the following message and got some nice relaxing music.
- Then I entered the following message to generate music for the workout. He did a decent job.
- You can also enter longer prompts with multiple descriptions. And the rendering was pretty good.
- Finally, you can also enter abstract prompts. This description is taken from the painting The Persistence of Memory by Salvador Dalí.
- And for those wondering how we integrate the examples above, you can easily download AI music. Click on the “three dots” icon next to the generated tracks and select the “Download” option from the context menu.
Google MusicLM Hands-On Trial: First Impressions
While exploring Google MusicLM, it became clear that MusicLM is yet another early demonstration of what AI can do in the music industry. Sometimes he surprised me with his melodious delivery and often the music generated turned out to be average. In its official video, Google demonstrated that MusicLM can create great music in different variations inspired by popular songs. However, in our tests, MusicLM failed to generate similar results.
This may be because Google has not fully released the model, as it is still part of the experimental AI Test Kitchen initiative. In the future, you may be able to upload your own audio buzz and have MusicLM add a saxophone and play the music in jazz. I also asked him to create a fusion of western rock and Indian classical music and the result was very bad.
In short, for a first demo, MusicLM is an exciting AI project for musicians, but to make it really great, it will require a higher quality data set, rich text descriptions, and additional features like the ability to download your own music samples. We look forward to the release of new models and features from Google and OpenAI for AI music generation.