IoT Tech Day Coding Mojo slides. Utrecht, April 2016
•
1 gostou•973 visualizações
http://www.iottechday.nl/sessions/how-i-rediscovered-my-coding-mojo-by-building-an-iotrobotics-prototype/ Includes links to video demos. "Come hear the story of how I learned new technologies and rediscovered my coding mojo by building an IoT/robotics prototype: a JavaScript powered, voice-controlled robot! Along the way you can expect to learn about HTML5 speech recognition, controlling hardware with Node.js and Johnny-Five, using WebSockets and MQTT for communication between components, and finally how you can combine the Raspberry Pi and Arduino platforms to gain ultimate power over your own projects!"
Recomendados
Mais conteúdo relacionado
Semelhante a IoT Tech Day Coding Mojo slides. Utrecht, April 2016
Semelhante a IoT Tech Day Coding Mojo slides. Utrecht, April 2016 (20)
Mais de Mark West
Mais de Mark West (16)
Último
Último (20)
IoT Tech Day Coding Mojo slides. Utrecht, April 2016
- 1. HOW I GOT BACK MY CODING MOJO! Mark West #iottechday
- 12. The Arduino Ecosystem • MicroController platform. • Many different Arduino models. • Open Source design. • MicroControllers extensible via “Shields”.
- 17. Two Servos for Camera Pan & Tilt Servos wired to Arduino Chassis Raspberry PI In Plastic Case WIFI Dongle
- 19. Actuators Sensors Nervous System Raspberry PI 2Raspberry PI Cam Arduberry Microcontroller Arduino Chassis Servo Servo Brain NodeBot Rover Hardware
- 20. Combining the Raspberry PI & Arduino Raspberry PI • Linux PC. • Supports USB peripherals. • Programming. ArduinoPlatform • MicroController. • Robust. • Native analogue support. The whole is greater than the sum of parts!
- 21. Actuators Sensors Nervous System Raspberry PI 2Raspberry PI Cam Arduberry Microcontroller Arduino Chassis Servo Servo Brain NodeBot Rover Hardware
- 23. Raspberry PI 2 Arduberry Servo Software Communication across Hardware Layers Servo Raspberry PI Chassis JavaScriptPI Binary (Compiled C / C++)
- 26. 1. Maturity 2. Community 3. DSL 4. Portability 5. Open Source 6. Node.js ecosystem 7. REPL Benefits of using Johnny-Five
- 27. Imports J5 Dependancy Adds LED instance to REPL Declares LED as connected to UNO Pin 13 Blinks LED every 500 milliseconds Code block triggered by UNO ”Ready” Event Initialises UNO Johnny-Five Code Example var five = require("johnny-five"); var myBoard = new five.Board(); myBoard.on("ready", function() { var myLed = new five.Led(13); myLed.blink(500); this.repl.inject({ replLed: myLed }); });
- 29. Arduberry Servo Bridging the gap with Firmata Servo Raspberry PI Chassis Johnny-Five (Firmata Client) Std. Firmata (Firmata Server) JavaScriptPI Binary (Compiled C / C++)
- 31. Getting Started with Johnny-Five 1. Buy an Arduino Experimenters Kit. 2. Follow the tutorials at http://node-ardx.org. 3. Visit http://johnny-five.io for more information and inspiration.
- 33. Speech Recognition Requirements Need to have • Quality and speed of speech recognition. • Free, no restrictions. • Software based. • JavaScript. Nice to have • Speech to text. • One stop service. • Battle tested.
- 40. Speech Demo See https://vimeo.com/162426456 for an example of the speech recognition in progress.
- 41. Button press and release connected to Web Speech API start and stop Control methods. Continuous dictation switched on, to avoid cutting commands short. Interim results switched on – shown in green text (final results in white). Each set of results checked for uniqueness to avoid sending duplicate commands to the Robot. Web Speech API : Robot
- 46. Johnny-Five Process Express Process Raspberry PI 2 WE Browser HTTPS NodeBot Rover Hardware Firmata
- 48. Why Add a Message Broker? • Seperation of concerns. • Isolate main components for easier testing.
- 49. MQTT – MQ Telemetry Transport • Internet of Things connectivityprotocol. • Designed to be lightweightwith a small footprint and little overhead. • Is a protocoland a Pub-Sub Message Broker. • Used by Facebook for pushing updates to mobile clients.
- 50. Adding MQTT to the NodeBot Rover Broker • Public MQTT Broker – ManyPublic Brokers exist. – One less process to run on RaspberryPI. Client • MQTT.js – Provides an MQTT client libraryfor Node.js. – Extremelysimple to use. – Integrates seamlesslywith Johnny-Five.
- 52. MQTT Over WebSockets with MQTT.js • MQTT.js is a Node.js package and is meant for use on the Server Side. • To allow MQTT.js to run from the Browser, we first needed to ”Browserify” the MQTT library. • We could then access the ”Browserified” MQTT client library from the Browser. • This solution requires that your MQTT Broker has a WebSocket endpoint.
- 53. MQTT Over WebSockets Demo Demo of the HiveMQ WebSocket Client http://www.hivemq.com/demos/websocket- client
- 55. Node.js Twitter Client • Fully fledged Twitter Client: – Asynchronous. – Supports REST API (read and write) – Supports Streaming API (eventsand tweets). • Requires developer credentials from Twitter: – Trivial to get hold of.
- 57. Video Streaming via Motion • Motion: Software Motion Detector. • Provides streaming video with possibility to create snapshots. • Good performance on the Raspberry PI. • Potential side project: get Robot to follow moving objects?
- 60. So Did I Get My Coding Mojo Back?
- 65. “please rate my talk in the offical IoT Tech Day app” @markawest