|
Music
and AI Lab, NTU
GICE (臺灣大學
音樂與人工智慧實驗室)
We
use knowledge in music to build deep learning models that analyze and/or
create music.
Exemplar
topics for music analysis include
automatic music transcription, melody extraction, structural analysis, and
source separation.
Exemplar
topics for music creation include
symbolic-domain MIDI generation, audio-domain singing voice synthesis,
text-to-music, loop generation, tone creation, and automatic music mixing
(see here for a
curated list of models for music creation).
We
place a bit more focus on music creation in the past few years, building
models such as the Pop
Music Transformer
and Compound Word
Transformer
for MIDI generation, and KaraSinger for musical audio
generation.
In
partnership with the Taiwan AI Labs and the famous singer Sandee Chan, we
also built the first deep learning-based singing voice synthesis model (AI Sandee; AI陳珊妮) with human-level performance in Taiwan (ref).
The
lab used to be affiliated with the Research Center for IT Innovation at
Academia Sinica, from Sept. 2011 to Jan. 2023. See here for the good old memories.
|