Business Tech

Google Magenta’s AI feature allows users to create own melodies in virtual music room

Google Magenta’s AI feature - Appy Pie

A new Google Magenta project lets the user mix lo-fi, hip-hop music tracks to create a custom music room in browsers, without any musical ability and expertise.

The Magenta project’s latest Lo-Fi Player has been created to use Google’s machine learning systems for the creation of art and music. This feature has been created by an intern Vibert Thio.

Lo-Fi Player is the best example to build custom music. When users open the Lo-Fi Player, they will be guided to a pixelated virtual room where they will be allowed to click on different objects — a clock, a cat, or a piano, to change the different tracks, like the melody and the bass line. The Lo-Fi Player’s source code can be found on GitHub and is customizable.

Lo-Fi Player creator Vibert Thio, the summer 2020 Magenta intern, wrote in a blog post of the company, “The view outside the window relates to the background sound in the track, and you can change both the visual and the music by clicking on the window.”

He further wrote, “The team built a tutorial called “Play, Magenta!” where users can edit sounds and canvas live in their own browsers.”

The Lo-Fi player is simply a virtual room in the browser where a user can play around the music features in the room, play around with the beat, and change the music in real-time. The view outside the room window relates to the background sound in the track where the visual or the music can be changed by clicking on the window.

Every time the beat loops, the system will arbitrarily select comments from the live chat to modify the music and those comments will be highlighted with a chat bubble. Even users who don’t interact will be able to hear how it evolves as it is modified and changed by chat commands.

The customized music room can be shared with other users. The entire experience is designed to make music and art with the help of Google’s machine learning systems. Magenta is powered by Google’s open-source TensorFlow system.

The Lo-Fi Player is also enabled with an interactive YouTube stream, a “shared space”. To let people inhabit the same music together, the Lo-Fi player will be streamed on YouTube for a few weeks. This shared space will allow users to be in the same music room together. However, the interaction mode differs for each browser. However, rather than clicking on different elements in the room, players type commands into the live chat window to rearrange the tracks. The commands would change the color of the room, change the melody, switch the instruments, and so on.

Vibert Thio said, “We’re able to create something more like a music generating room than a musical instrument or composition tool. This is very much a first attempt at ML-powered interactive YouTube streaming.”

Other Magenta projects are – the Piano Genie, an AI program that lets anyone play the piano, and NSynth, a machine learning algorithm that uses a neural network to learn and create new sounds.