News

AIM PhD candidate Yinghao Ma presented his work entitled “MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Response” at a recent workshop hosted by the British Machine Vision Association and the Society for Pattern Recognition in London, on April 24, 2024. MusiLingo is a system merging pre-trained music encoders with language models to enhance music-text interaction. It aims to make music more interpretable for everyone, ranging from composers to those that are hard of hearing, using a projection layer that integrates music embeddings into language models for effective text generation. More information about the workshop can be found here, and more information on MusiLingo is available on the paper and Hugging Face.

The Centre for Digital Music will be hosting the second in-person meet-up of the UK Acoustics Network special interest group on Spatial Acoustics and Immersive Audio (SIG-SAIA) on the 10th of May, 2024, at Queen Mary University of London. The meetup will be organised by Dr Aidan Hogg, Lecturer in Computer Science at C4DM and Queen Mary, who is also SIG-SAIA group co-ordinator.

The meetup will feature short talks from researchers working in the group’s remit, including AIM PhD student Chin-Yun Yu who will give a talk on “Time-of-arrival estimation and phase unwrapping of head-related transfer functions with integer linear programming”, and C4DM Post-Doctoral Research Assistant and former AIM PhD student Saurjya Sarkar who will give a talk on “Time-domain music source separation for choirs and ensembles”. The meetup will conclude with a backstage visit at the Royal Opera House.

More information on the meetup and information on how to attend can be found at: https://acoustics.ac.uk/second-in-person-sig-saia-meet-up/

On 7-11 May, AIM researchers will participate at the Twelfth International Conference on Learning Representations (ICLR 2024), taking place in Vienna, Austria. ICLR is the premier gathering of professionals dedicated to the advancement of the branch of artificial intelligence called representation learning, but generally referred to as deep learning.

AIM members will be presenting the following paper at the main track of ICLR 2024:

• MERT: acoustic music understanding model with large-scale self-supervised training, by Yizhi Li, Ruibin Yuan, Ge Zhang, Yinghao MA, Xingran Chen, Hanzhi Yin, Chenghao Xiao, Chenghua Lin, Anton Ragni, Emmanouil Benetos, Norbert Gyenge, Roger Dannenberg, Ruibo Liu, Wenhu Chen, Gus Xia, Yemin Shi, Wenhao Huang, Zili Wang, Yike Guo, Jie Fu (postprint)

AIM members will also be presenting the following paper at the ICLR 2024 workshop on LLM Agents:

• WavCraft: Audio Editing and Generation with Large Language Models, by Jinhua Liang, Huan Zhang, Haohe Liu, Yin Cao, Qiuqiang Kong, Xubo Liu, Wenwu Wang, Mark D Plumbley, Huy Phan, Emmanouil Benetos (postprint)

See you all at ICLR!