BandNet: Neural Network-Based Multi-Instrument Music Composition
BandNet: A Neural Network-Based, Multi-Instrument
Beatles-Style MIDI Music Composition Machine
Yichao Zhou
1,2
Wei Chu
1
Sam Young
1,3
Xin Chen
1
1
Snap Inc.
2
EECS,
University of California, Berkeley.
3
Herb
Alpert
School
of
Music,
University of California, Los Angeles
.
undefined●
G
O
A
L
:
A
u
t
o
m
a
t
i
c
a
l
l
y
g
e
n
e
r
a
t
e
m
u
s
i
c
s
c
o
r
e
s
○
G
e
n
e
r
a
t
e
m
u
s
i
c
s
f
o
r
p
h
o
t
o
a
l
b
u
m
s
○
B
u
i
l
d
r
o
y
a
l
t
y
-
f
r
e
e
s
o
u
n
d
l
i
b
r
a
r
i
e
s
○
H
a
r
m
o
n
i
z
e
v
o
c
a
l
s
i
n
g
i
n
g
Computer Music Composition
●
1
2
3
M
I
D
I
f
i
l
e
s
f
r
o
m
“
T
h
e
B
e
a
t
l
e
s
”
●
4
l
a
b
e
l
l
e
d
c
h
a
n
n
e
l
s
○
M
e
l
o
d
y
(
v
o
c
a
l
p
a
r
t
)
○
C
h
o
r
d
s
(
h
a
r
m
o
n
y
p
a
r
t
)
○
B
a
s
s
○
D
r
u
m
“The Beatles” Dataset
L
i
m
i
t
a
t
i
o
n
o
f
e
x
i
s
t
i
n
g
w
o
r
k
s
(
M
a
g
e
n
t
a
,
F
o
l
k
R
N
N
,
B
a
c
h
B
o
t
)
●
C
a
n
n
o
t
s
u
p
p
o
r
t
m
u
l
t
i
p
l
e
i
n
s
t
r
u
m
e
n
t
s
(
B
a
n
d
!
)
●
L
a
c
k
o
f
s
o
n
g
s
t
r
u
c
t
u
r
e
Challenges
●
L
S
T
M
-
R
N
N
:
H
o
w
t
o
d
e
a
l
w
i
t
h
m
u
l
t
i
p
l
e
i
n
s
t
r
u
m
e
n
t
s
?
○
R
N
N
o
n
l
y
t
a
k
e
s
a
s
e
q
u
e
n
c
e
a
s
i
n
p
u
t
Encoding the Score
NEW_NOTE
E4
NEXT_CHANNEL
NEW_NOTE
C3
NEXT_STEP
CONTINUE_NOTE
E4
NEXT_CHANNEL
NEW_NOTE
G3
NEW_NOTE
C3
NEXT_STEP
…
Melody
Bass
1.
U
s
e
r
s
p
i
c
k
a
s
e
e
d
f
o
r
t
h
e
e
a
c
h
s
e
c
t
i
o
n
;
2.
L
S
T
M
-
R
N
N
g
e
n
e
r
a
t
e
s
m
u
s
i
c
c
l
i
p
s
f
o
r
e
a
c
h
s
e
c
t
i
o
n
;
3.
U
s
e
r
s
l
i
s
t
e
n
t
o
t
h
e
c
l
i
p
s
a
n
d
c
h
o
o
s
e
t
h
e
o
n
e
t
h
e
y
l
i
k
e
;
4.
B
a
n
d
N
e
t
a
s
s
e
m
b
l
e
s
t
h
e
w
h
o
l
e
s
o
n
g
a
c
c
o
r
d
i
n
g
t
o
a
m
u
s
i
c
s
t
r
u
c
t
u
r
e
t
e
m
p
l
a
t
e
Music Assemble Pipeline
Results
(Subjective
Listening)
We asked subjects to listen to
14
testing
songs
and
answer the questions
(1-5):
1.
Does it sound similar to the music
from
the Beatles?
2.
How likely is it that this music was
professionally composed?
3.
How interesting is this music?
Style
Similarity
Profession
Interestingness
Thank you for listening!
Good afternoon, everyone, I am Yichao Zhou from UC Berkeley. I will present our work, BandNet: A Neural Network-Based, Multi-Instrument Beatles-Style MIDI Music Composition Machine.
This research project introduces BandNet, a neural network-based system for multi-instrument Beatles-style MIDI music composition. By encoding musical scores using LSTM-RNN, the system addresses limitations of existing works and supports generating music scores for various purposes. Users can engage in the music assembly pipeline, selecting music clips and structuring songs based on a provided template. Results indicate subjective listening feedback on the music's similarity to The Beatles, perceived professionalism, and overall interest.
Download Presentation
Please find below an Image/Link to download the presentation.
The content on the website is provided AS IS for your information and personal use only. It may not be sold, licensed, or shared on other websites without obtaining consent from the author. Download presentation by click this link. If you encounter any issues during the download, it is possible that the publisher has removed the file from their server.
E N D
Presentation Transcript
BandNet: A Neural Network-Based, Multi-Instrument Beatles-Style MIDI Music Composition Machine Yichao Zhou1,2 Wei Chu1Sam Young1,3 Xin Chen1 1Snap Inc. 2EECS, University of California, Berkeley. 3Herb Alpert School of Music, University of California, Los Angeles.
Computer Music Composition GOAL: Automatically generate music scores Generate musics for photo albums Build royalty-free sound libraries Harmonize vocal singing
The Beatles Dataset 123 MIDI files from The Beatles 4 labelled channels Melody (vocal part) Chords (harmony part) Bass Drum
Challenges Limitation of existing works (Magenta, FolkRNN, BachBot) Cannot support multiple instruments (Band!) Lack of song structure
Encoding the Score LSTM-RNN: How to deal with multiple instruments? RNN only takes a sequence as input NEW_NOTE E4 NEXT_CHANNEL NEW_NOTE C3 Melody NEXT_STEP CONTINUE_NOTE E4 NEXT_CHANNEL NEW_NOTE G3 NEW_NOTE C3 Bass NEXT_STEP
Music Assemble Pipeline 1. Users pick a seed for the each section; 2. LSTM-RNN generates music clips for each section; 3. Users listen to the clips and choose the one they like; 4. BandNet assembles the whole song according to a music structure template
Results (Subjective Listening) We asked subjects to listen to 14 testing songs and answer the questions (1-5): 1. Does it sound similar to the music from the Beatles? How likely is it that this music was professionally composed? How interesting is this music? 2. 3. Style Similarity Profession Interestingness
