Pioneering producer and singer Imogen Heap has teamed up with Jen, an ethical AI music creation platform, to launch two new models inspired by her musical styles. The partnership was announced Thursday (November 14) at the Web Summit in Lisbon, Portugal.
First, Heap is launching its own StyleFilter model, Jen's patented tool that allows users to create original tracks that infuse an artist or producer's distinct musical styles into their new projects. Especially for Heap's collab, the StyleFilter model trained on her new singles 'What Have You Done To Me' and 'Last Night of an Empire'. Importantly, StyleFilter is said to do this while still “maintaining transparency, protection and compensation” for Heap. Second, Heap and Jen also announced a new AI voice model trained on Heap's different vocalizations.
Jen Co-Founder and CEO, Sarah Senderoffand Heap took the stage at Web Summit's Center Stage to demonstrate how StyleFilter works, turning prompts into compositions that blend Heap's style into a user's original works. See their explanation below:
During her decades-long career, Heap has been regarded as an innovator, pushing the boundaries of art and technology. From the early days of her career, she has popularized the use of vocoders. Later, she developed her own products, such as the Mi.Mu gloves, a wearable tool that allows her to record loops and edit vocals with small hand movements, and The Creative Passport, a service that combines all of an artist's information into one part of resume, press photos, royalties accounting, set lists and more.
Last month, in an interview with The Guardian, Heap explained her new AI assistant, called Mogen, which is trained on Heap's interviews, speeches and TK to essentially act as a living autobiography that can answer questions for her fans. Later, she hopes to expand Mogen to train her in musical improvisation and become a live concert partner.
Jen is an AI music creation platform that puts transparency at the forefront. His Jen-1 model, released in June, is a text-to-music model trained on 40 different licensed catalogs (and then verified with 150 million songs). It is also supported by the founder/CEO of APG Mike Karenwho came on board as a founding partner in the fall of 2023. As Senderoff explained in an August 2023 interview with Bulletin board“Jen is spelled JEN because she's designed to be your friend who goes into the studio with you. It's a tool.”
Jen uses blockchain technology to ensure transparency and traceability of her projects after they are created and released to the world. Each of the works created with Heap's StyleFilter will be licensed for use through Auracles — an upcoming non-profit platform, designed by Jen, that uses source data to give artists greater access, control and permission to what is made using their StyleFilter model.
While other AI companies have worked to create personalized AI music models trained on a specific list of producers or artists in the past, such as Soundful Collabs, Jen's team believes StyleFilter is different because it “can learn and apply the style of an artist training into a song, establishing a new level of creative precision and efficiency,” says a company spokesperson.
“Shara's integrity shines an extraordinary light at this pivotal moment in our human history,” says Heap. “The exponential curve of innovation in and with AI attracts opportunists focused primarily on lining their pockets in the gold rush or those racing at speed to stick their 'tech flag' in the sand to corner a market. Along with clear product innovation and new revenue streams for Jen's musicians, Shara's power of inspiration and determination to get the ethical foundation right from the ground up is inspiring. A very rare example of service, contributing to a future where people are empowered, valued and credited, in and for our collective global tools and knowledge.”
“At Jen, we're committed to creating innovative products that invite artists to participate as AI reshapes the music industry, allowing their art to take new forms as technology evolves, while ensuring respect and fair compensation,” says Senderoff. “Our StyleFilter is a testament to that vision, introducing an innovative way for users to engage with the musical essence of artists they may never have the opportunity to work with directly. Premiering this product with Imogen Heap, a pioneer at the intersection of music and technology, exemplifies our commitment to building with respect and reverence for those who paved the way. She is also an incomparable person whom I am honored to call my friend.”
from our partners at https://www.billboard.com/pro/imogen-heap-jen-ai-voice-music-models-capture-artist-stylefilter/