Brian Whitman from The Echo Nest presents The Echo Nest Remix API to Dorkbot NYC, March 4 2009.

1. THE ECHO NEST REMIX API
Hello dorkbot nyc!
I am Brian Whitman a co-founder of
The Echo Nest Corporation,
a music intelligence concern based in
Somerville, MA, USA.
The Remix API is/was developed by our lovely
employees and well-wishers:
Ben Lacker, co-founders Tristan Jehan & myself,
Josh Lif-ton, Rob Ochsorn, Adam Lindsay
http://code.google.com/p/echo-nest-remix

4. THINGS WE CAN DO IN OUR COMPANY
THAT NO ONE ELSE CAN DO

5. THINGS WE CAN DO IN OUR COMPANY
THAT NO ONE ELSE CAN DO
THINGS WE
MAKE MONEY DOING

6. REMIX
THINGS WE CAN DO IN OUR COMPANY
THAT NO ONE ELSE CAN DO
THINGS WE
MAKE MONEY DOING

7. REMIX
something to do with
hall & oates
THINGS WE CAN DO IN OUR COMPANY
THAT NO ONE ELSE CAN DO
THINGS WE
MAKE MONEY DOING

9. WHAT
THE ECHO NEST REMIX API
DOES

10. 25
auditory spectrogram
20
15
auditory spectrogram
10
5
1
0 0.5 1 1.5 2 sec.
1
0.8
segmentation
0.6
segments 0.4
0.2
0
0 0.5 1 1.5 2 sec.
B
A#
A
pitch features
G#
G
pitch features
F#
F
E
D#
D
C#
C
0 0.5 1 1.5 2 sec.
25
20
timbre features
15
timbre features 10
5
1
2 4 6 8 10 12 14 16 segments
JEHAN STYLE

11. 4
x 10
2
1
0
beat markers
! -1
! -2
0 5 10 15 20 25
240
190
143
tempogram 114
96
72
60
0 5 10 15 20 25
1
0.8
0.6
tempo spectrum 0.4
0.2
0
60 72 96 114 143 190 240
JEHAN STYLE

12. ANY OL SOUND, for free, chop it up into
Sections: verse, chorus, bridge
Bars
Beats (downbeat)
Segments / syllables / notes

13. >> song.segments
[segment, segment, segment...]
>> song.segments[10].start
34.502
>> song.segments[10].timbre
[-30.2, -10.4, 4.5, 3.2...]
>> song.segments[10].pitch
[0.5, 0.13, 1.0, .... ]
>> song.segments.reverse()
>> for i in segments:
i.stretch(2)
i = i + othersong.segment[12]
>> You can mix elements, time stretch them, detect & change pitch, move them
around, repeat them on downbeats, find a closest match in another song, detect and
modify volume envelopes, read/write mp3, aiff, wav
File "<stdin>", line 1
SyntaxError: invalid syntax
ALL SONG ELEMENTS ARE ITEMS IN A LIST

14. WHAT YOU CAN DO WITH
THE ECHO NEST REMIX API

15. MAKE WEB SITES

16. MAKE WEB SITES THAT CONFUSE PEOPLE

17. MAKE PRETTY PICTURES

18. MAKE PRETTY PICTURES

19. I’ve always wanted to hear Justin
Timberlake trying to sing Billie Jean
automatically by comparing timbre,
pitch and loudness distances.
-B.L.
MAKE MUSIC

20. Let’s go on residency in Amsterdam and
get an adorably nervous Austrian
accordionist to play like a bird!
-K.D. & B.W.
MAKE MUSIC

21. James Brown... FOREVER.
- T.J.
MAKE MUSIC

22. MAKE MOVIES

23. THE NEAR FUTURE OF
THE ECHO NEST REMIX API

24. STAGE ONE:
ALL MUSIC, ALL THE TIME

26. >> from echonest import search
>> segments = search.query(“voice”, soundsLike=”bjork”, pitch=”F#”)
>> len(segments)
65706
>> new_song = random.shuffle(segments).write(“bjork2009.mp3”)

27. STAGE TWO:
GET OFF THE COMPUTER

28. HAVE YOU SEEN THIS THING IT’S CRAZY

29. STAGE THREE:
Let NORMAL PEOPLE use it

30. 100%
75%
Music goodness
50%
brian
25%
0%
nothing not much a little somewhat pretty good expert dork prime
Computers know-how

32. YES WE CAN

33. brian@echonest.com
do you wonder if
are you one of those sysex is turing
python “people” (you complete?
know what I’m saying)
would you like to
HELP US put girl talk out of
did you ever write a business?
music app in {R,
MATLAB, Excel, bash}?
we catalog every orchestra hit
1980-1992. want the password?
http://code.google.com/p/echo-nest-remix