SonicMuse
From Music Hack Day
Contents |
[edit] SonicMuse
SonicMuse combines the application Sonic Visualiser for viewing and analysing the content of music audio files with the online music sheet database MuseScore. The score best matching the metadata of the audio track loaded in Sonic Visualiser is retrieved from MuseScore.com and displayed in SV (in the MIDI format). SonicMuse is a first step towards enhanced performance practice analysis based on audio and symbolic information.
http://www.flickr.com/photos/matdiffusion/6788369199/in/photostream
[edit] Creator
Mathieu Barthet (Centre for Digital Music, Queen Mary University of London): @matdiffusion
Contributions from: Thomas Bonte (MuseScore) & George Fazekas (Centre for Digital Music, Queen Mary University of London)
[edit] About the hack
SonicMuse controls Sonic Visualiser via OSC. The app. retrieves the collection of MuseScore.com scores for a given audio track using the JSON format. The collection of scores is parsed in JSON and filtered to get the score whose title is the closest to the track metadata. The score is then displayed in a new Sonic Visualiser pane in the MIDI format.
[edit] Tools, APIs, or kit used
Sonic Visualiser, OSC, MuseScore.com API, JSON, Python
[edit] Ideas for future development
- Improvements of the filtering process of the scores from MuseScore.com to discard irrelevant scores - Audio to score synchronisation in Sonic Visualiser - Computation of expressive timing deviations from the score (e.g. based on QM's tempo extraction Vamp plugin ) to compare a recorded performance with a mechanic or "robotic" rendition (raw MIDI)
