Nonnegative matrix factorization with the Itakura-Saito divergence.

With application to music analysis.




1) Analysis of a short piano excerpt

Data

K = 4


EUC-NMF
K=4-EUC
pitch =   60.8   65.0   68.0  108.4
Component 1
Component 2
Component 3
Component 4

KL-NMF
K=4-KL
pitch =   60.8   65.0   68.2  108.4
Component 1
Component 2
Component 3
Component 4

IS-NMF/MU
K=4-IS
pitch =   60.8   65.0   68.0  108.4
Component 1
Component 2
Component 3
Component 4

IS-NMF/EM
K=4-EM
pitch =   49.0   65.0   72.0  108.4
Component 1
Component 2
Component 3
Component 4


K = 5


EUC-NMF
K=5-EUC
pitch =     60.8   65.0   65.4   68.0  108.4
Component 1
Component 2
Component 3
Component 4
Component 5

KL-NMF
K=5-KL
pitch =     61.0   65.0   68.0   72.2  108.4
Component 1
Component 2
Component 3
Component 4
Component 5

IS-NMF/MU
K=5-IS
pitch =     49.0   65.0   72.0  108.4  108.4
Component 1
Component 2
Component 3
Component 4
Component 5

IS-NMF/EM
K=5-EM
pitch =     61.0   65.0   68.0  108.4  108.4
Component 1
Component 2
Component 3
Component 4
Component 5


K = 6


EUC-NMF
K=5-EUC
pitch =     61.0   65.0   65.4   68.0   72.0  108.4
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6

KL-NMF
K=5-KL
pitch =     61.0   65.0   68.0   72.0   81.0  108.4
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6

IS-NMF/MU
K=5-IS
pitch =     61.0   65.0   68.0   72.0  108.4  108.4
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6

IS-NMF/EM
K=5-EM
pitch =     61.0   65.0   68.0   72.0  108.4  108.4
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6




2) Analysis of early jazz music

Data


EUC-NMF

Jazz-K=10-EUC
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6
Component 7
Component 8
Component 9
Component 10

KL-NMF
Jazz-K=10-KL
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6
Component 7
Component 8
Component 9
Component 10

IS-NMF/MU

Jazz-K=10-IS
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6
Component 7
Component 8
Component 9
Component 10

IS-NMF/EM
Jazz-K=10-EM
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6
Component 7
Component 8
Component 9
Component 10

IS-NMF/IG
Jazz-K=10-IG
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6
Component 7
Component 8
Component 9
Component 10




AUDIO
RESTORATION

Original mono

Denoised mono

Denoised stereo



SOURCE
EXTRACTION

Acompaniment
(Comp. 2)

Trombone
(Comp. 7)

Trumpet & Clarinet
(contains also piano notes)
(Comp. 1, 3-6, 8, 10)

KL-NMF on magnitude spectrogram
Jazz-K=10-KL-Mag
Component 1
Component 2
Component 3
Component 4
Component 5
Component 6
Component 7
Component 8
Component 9
Component 10

Reconstruction