Today's smartphones have all that's necessary to be an electronic conductors baton. You can use accelerometers and machine learning to detect music conducting gestures that affect the tempo (BPM) and dynamic range of MIDI music.
Conducting music with react native and machine learning
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
12. React native
Overview
It’s a mobile app
framework that allows
you to build a native
mobile app with
JavaScript
You can expect the
same level of
performance as a
native mobile app
Web developers can
use their existing
JavaScript skills
18. Counts the number of zero
crossings that occur in
an N dimensional signal over a
given window.
19. • Dynamic time warping (DTW)
• Supervised learning classification
algorithm
• Measures similarity between two
temporal sequences that very in
speed
• Common used for speech and
signature recognition
20.
21.
22. Links to the Code and to Learn More
justinmaurer.net
Demo Code:
https://github.com/jmdotnet/airconductor
Gesture Recognition Toolkit (GRT)
http://www.nickgillian.com/wiki/pmwiki.php/GRT/Reference
Bass Midi:
https://www.un4seen.com/
AirConductor App:
airconductor.com
https://play.google.com/store/apps/details?id=com.jmnet.air
conductor