Auto Score Tubing
From Music Hack Day
Contents |
[edit] Creator
- Nicolas Froment
- Thomas Bonte
- Werner Schweer
forfait sosh forfait mobile forfait b and you comparateur forfait mobile sms illimite forfait mobile blackberry
[edit] About the hack
YouTube.com is stuffed with great musical performances. Imagine these videos playing along with the musical score! While manually synchronizing a score measure per measure along with the video is possible, automatic synchronizing would be even greater. The Queen Mary wizards, Simon Dixon and Chris Cannam, came to rescue.
[edit] What APIs, tools or kit did you use?
- MuseScore.com API - http://wiki.github.com/musescore-com/api/
- MATCH Vamp plugin - http://vamp-plugins.org/download.html
- YouTube.com - http://www.youtube.com/dev
- SOX - http://sox.sourceforge.net
[edit] Images/Screenshots
http://www.youtube.com/watch?v=n1_kzPg1dLI
Log in for the private beta via http://musescore.com/user/register/code/musichackday
[edit] Anything left to do
Hack was made at the Music Hack Day, so it needs further optimizations to reduce the processing time. Also, it needs to be build for Linux, while it was initially hacked up on Windows. This hack will finally end up on http://musescore.com
[edit] Source code and links
rem %1 youtube.com video id
rem %2 musescore.com score id
rem %3 musescore.com score secret
python youtube-dl.py http://www.youtube.com/watch?v=%1
ffmpeg -i %1.mp4 -acodec libmp3lame -ac 2 -ab 128k -vn -y %1.mp3
wget http://static.musescore.com/%2/%3/score.mp3
ffmpeg -i score.mp3 score.wav
ffmpeg -i %1.mp3 %1.wav
sox score.wav tmp.wav mixer 1
sox tmp.wav tmp2.wav swap
sox tmp2.wav tmp-l.wav rate 44100
sox %1.wav tmp-r.wav mixer 1
sox -m tmp-r.wav tmp-l.wav out.wav
vamp-simple-host.exe match-vamp-plugin:match:b_a out.wav -o text3.txt
