- Deep Learning for Music Analysis and Generation, NTU
COMME5070, 2023 Fall
- Official
course website at NTU (access limited): https://cool.ntu.edu.tw/courses/27790
- Slides: https://github.com/affige/DeepMIR/
- Syllabus
- W1.
Introduction to the course
- W2.
Fundamentals & Music representation
- W3.
Analysis I (timbre): Automatic music classification and representation
learning
- W4.
Generation I: Source separation
- W5.
Generation II: GAN & Vocoders
- W6.
Generation III: Synthesis of notes and loops
- W7.
Analysis II (pitch): Music transcription, Melody extraction, and Chord
Recognition
- W8.
Generation IV: Symbolic MIDI generation
- W9.
Generation V: Symbolic MIDI generation: Advanced Topics
- W10.
Generation VI: Singing voice generation
- W11.
Generation VII: Text-to-music generation
- W12.
Project pitch
- W13.
Generation VIII: Differentiable DSP models and automatic mixing
- W14.
Miscellaneous Topics
- W15.
Break
- W16.
Final project presentation
- List of final projects presented
by the class students
- Positive Grid guitar effect removal
– extensions of this project has been published at DAFx’24: “Distortion
Recovery: A Two-Stage Method for Guitar Effect Removal”
- Personalization on music
generation
– extensions of this project has been accepted for publication
at ISMIR’24: “Audio
Prompt Adapter: Unleashing music editing abilities for text-to-music with
lightweight finetuning”
- Music2fail: transfer music to
fail recorder style
– extensions of this project has been accepted for publication
at APSIPA ASC’24:
“Music2Fail: Transfer Music to Failed Recorder Style”
- Music generation from image
and text
– extensions still ongoing
- Neural screaming voice conversion
– extensions still ongoing
- Acapella accompaniment
generation
– extensions still ongoing
- Toward cross-lingual singing
voice conversion
- Personalized singing voice
beautifier
- Multimodal music emotion
recognition
- Music emotion recognition
using contrastive language audio pretraining
- Evaluation toolkit for
controllable text-to-music models
- Muse2bach
- GuitarPedal simulation
- OSU! Taiko auto mapper
- AI Nice Chord progression
- Timbre transfer by diffusion
models