Musicat: a Model of Musical Expectation
Computer Science Department
Monday, Dec. 3, 2007, 4:00-5:30
Ballantine Hall 005
In the field of music cognition, melodic expectation has been a topic of much interest in the past several decades. Several theoretical and computer models have been developed by experts in the field, but I contend that these models differ in significant ways from the way humans generate expectations. For instance, Margulis’ (2005) model, a synthesis of many major prior models, represents the state of the art: given an input piece of music, it simulates the process of listening to the music, one beat at a time, computing an expectation for each beat as a probability distribution over all possible successive notes. This distribution is based primarily on the shape of the melody in the preceding few notes and the harmonic context; a small set of formulas deterministically computes the probabilities. Absent from the model is flexible perception of the input; there is no room for creativity in the generated expectations.
The new model discussed in this talk, called Musicat (after Copycat and Metacat), extends Hofstadter and Mitchell’s Copycat architecture for use in a musical domain. Whereas Copycat and related programs operated on essentially static inputs, Musicat will take into account the temporal nature of music. Musicat will model the dynamic experience of listening as music unfolds through time, where representations and expectations are formed and quickly revised as new notes are perceived and previously perceived notes fade into memory.
In this talk I will first describe a pilot study in-progress to study melodic expectation. I recruited music students and recorded their improvised, sung responses to two-note melodic fragments. I will share preliminary results from analysis of this data and discuss how these results might influence the development of Musicat. Second, I will describe the overall architecture of Musicat and share some ideas for novel elements I hope to include in the program which were not present in earlier FARG models.
The Mind and Computation Talk Series is a forum for Indiana University Computer Science and Informatics students and faculty, as well as visitors to IU, who work in the areas of artificial intelligence and cognitive science to make presentations about their research. The talks are open to the general IU public and will be announced to the mailing lists of Computer Science, Informatics, and Cognitive Science. Students in the Cognitive Science PhD Program or in the Joint PhD Program in Cognitive Science and Computer Science or Informatics may satisfy the program’s public colloquium requirement by giving a talk in this series.