1 Audio Analysis Lab, The Technical Faculty of IT and Design, Aalborg University, VBN2 Department of Architecture, Design and Media Technology, The Technical Faculty of IT and Design, Aalborg University, VBN3 Sektion København, The Technical Faculty of IT and Design, Aalborg University, VBN4 The Faculty of Engineering and Science (TECH), Aalborg University, VBN
What Are They Really Recognizing?
We re-implement and test two state-of-the-art systems for automatic music genre classification; but unlike past works in this area, we look closer than ever before at their behavior. First, we look at specific instances where each system consistently applies the same wrong label across multiple trials of cross-validation. Second, we test the robustness of each system to spectral equalization. Finally, we test how well human subjects recognize the genres of music excerpts composed by each system to be highly genre representative. Our results suggest that neither high-performing system has a capacity to recognize music genre.
Proceedings of the Second International Acm Workshop on Music Information Retrieval With User-centered and Multimodal Strategies, 2012, p. 69-74