What are we really decoding in musical attention?
University of Trento · Supervisor: Daniel Baldauf
I reproduced a published EEG decoder of musical attention, then upgraded it with a frozen LAION-CLAP audio tower. Digging through the legacy code, I ran the test the original paper never ran: holding whole songs out. Accuracy fell to chance, and a classifier that never sees the EEG still recovered the labels. The model had learned the song, not the attention.
On a second dataset designed to rule out that shortcut, controlled experiments showed the models following the statistics of the music and of their training data instead of the listener’s attention.
schematic · similarity values are illustrative
What the metric says: the EEG points to the instrument the listener attends to.
- 01 · reproduce87.5%the published baseline, rebuilt
- 02 · upgrade94.6%with a frozen CLAP audio tower
- 03 · audit25.8%songs held out, a test the paper never ran · chance 25%
