Purdue University Utilizes AI to Enhance Musical Performances

Artificial intelligence (AI) is set to take center stage in the world of music, as Purdue University embarks on a novel research project aimed at harnessing the potential of AI to enhance musical performances. Spearheaded by cellist and clinical associate professor of music, Yeon-Ji “Kristen” Yun, this multidisciplinary study is designed to explore the intersection of STEM (science, technology, engineering, and math) and arts through the lens of AI. The project is backed by a grant from the National Science Foundation.

The fusion of AI and music is not entirely new, with AI having already found applications in recording and composition. However, its potential in performance and education remains largely untapped. Yun, a faculty member at Purdue’s Patti and Rusty Rueff School of Design, Art, and Performance, believes that AI could offer significant benefits to musicians without compromising their creative abilities.

The project aims to develop two AI-enabled tools specifically designed for string music performers. The first tool, known as the Evaluator, will analyze audio and video recordings of a musician’s performance and compare it against digitized music scores and a database of video performances. Using an AI images generator, it will identify discrepancies in the audio and suggest posture adjustments based on the video analysis. This tool is intended to enhance individual practice and performance.

The second tool, termed the Companion, will serve as a virtual ensemble member, filling in for absent instruments. It will use audio analysis to adapt to the tempo and style of the musicians. While the initial focus is on stringed instruments, the ultimate goal is to extend its applicability to all musical instruments.

The research team comprises experts from diverse fields, including electrical and computer engineering, computer graphics technology, art and design, and business management. They aim to understand when and how AI can contribute measurably to musicians’ practice and performance, and what factors might influence musicians’ acceptance of AI in their work.

Yun emphasizes that the Companion tool goes beyond simply reproducing the music. It takes into account the creative liberties that musicians often take, such as altering the duration or tempo of a note. This requires separating the duration from frequency while still maintaining the ensemble’s tempo.

The team will conduct user studies in collaboration with Ka-Wai Yu, an associate professor in music at Utah Tech University. These studies will provide insights into how these AI tools can be integrated into real-world practice and performance settings.

As one of the top public research institutions, Purdue University continues to push the boundaries of knowledge and innovation. With over 105,000 students across various modalities and locations, Purdue is committed to delivering quality education at an affordable cost. This latest project, blending AI and music, is a testament to its dedication to exploring new frontiers and pushing the envelope in research and education.

This latest AI news showcases the potential of artificial intelligence generated images and AI text generator tools to revolutionize the field of music. As AI continues to evolve, it opens up new possibilities and opportunities for musicians, educators, and learners alike. The Purdue University project is an exciting step towards harnessing the power of AI to enhance musical performances and education.