The field of Auditory, Speech, and Music focuses on general intelligence, employing research paradigms based on neuroscience and neuromorphic intelligence. It adopts an embodied learning approach through body-environment interaction, with the goal of conducting theoretical, methodological, and applied research in areas such as scene analysis of complex acoustic environments, human-computer speech interaction, and intelligent music composition. The aim is to construct and refine new frameworks for auditory perception processing models, speech knowledge representation, and cognitive development.

The main research areas include the mechanisms and modeling of auditory perception, active/passive target source detection, localization, and enhancement in complex acoustic environments for robots, speech perception, understanding, and generation, music signal source separation and analysis, as well as automatic composition, orchestration, performance, mixing, and 3D virtual sound field. The research aims to provide intelligent robots with autonomous auditory perception and cognitive abilities for environment analysis and understanding, developing general objectives, adaptive strategies, and effective methods in real-world settings.

This research has received support from various national, provincial, international, and industry-funded projects, including the National Key R&D Program, National Basic Research Program (973 Program), National High-Tech Development Program (863 Program), National Natural Science Foundation major and key projects, National Social Science Foundation major projects, Key Basic Research Projects of the Science and Technology Commission of the Central Military Commission, and the Major Projects for 2030 Science and Technology Innovation. Significant progress has been made in related research and technology fields, with over 70 research papers published in renowned domestic and international journals and top conferences, including IEEE TASLP, Hearing Research, JASA, JAES, ICASSP, Interspeech, AAAI, AES Convention, and more. Additionally, more than 50 national invention patents have been filed.