Decoding Absolute and Relative Pitch Imagery in the Auditory Pathway

CCN Colloquium

Michael Casey - Decoding Pitch Imagery in the Auditory Pathway

Abstract: 
Our previous work (Casey, Thompson, Kang, Raizada, and Wheatley 2012) investigated decoding hemodynamic brain activity in the feed-forward pathways involved in music listening with rich stimuli. Our current work investigates top-down music processing via auditory imagery with an imagined music task. Most previous work on auditory imagery (e.g. Zatorre 2000; Zatorre, Halpern, and Bouffard 2010) used familiar tunes, such as nursery rhymes, that have associated lyrics which elicit activation of language areas in the brain. We required stimuli that were clearly pitched and musical, but without words, that would be easy to imagine. This led us to choose musical scales, which are accurately imagined by most trained musicians. Our pilot experiment compared hemodynamic brain activity to heard and imagined musical tones at two different levels of pitch hierarchy; absolute pitch and relative scale degree. We used a continuous scanner acquisition paradigm with a two-second TR. Twenty four major scales were heard and imagined in ascending and descending order. Notes were two seconds long to align with the scanner TR. A total of thirty-six distinct pitches were used in the experiment. The data was labeled in two ways, according to absolute pitch and relative scale degree, without one variable confounding the other. We applied masks for primary auditory cortex, which contains a tonotopic organization of spectro-temporal receptive fields, and secondary auditory cortex (STS/STG), which is implicated in the cognition of hierarchical pitch structures. Using the MVPA paradigm we tested both spectral clustering (unsupervised) and support vector machine (supervised) classification of high-low and pitch category discrimination for both the heard and imagined BOLD responses with absolute and relative pitch conditions. Preliminary supervised learning results for the absolute-pitch heard experiment yielded Acc=0.57 SE=0.023 (NULL Acc=0.50 SE=0.006) and absolute-pitch imagined results were ACC=0.60 SE=0.04. We will present further results of our preliminary experiments and give an overview of future directions for this work.