SlideShare uma empresa Scribd logo
1 de 21
CASE STUDY OF INTER-ROBOT
COMMUNICATION IN A ROBOT
ORCHESTRA
PRESENTED BY
ARUN
An invention of Sony
Qrio─ Quest for cuRIOsity
Smoother and faster humanoid robot than ever before
7.3 kg, 58 cm and 1 hour battery
A bipedal robot which could wave, hello and recognize voice
Could converse, sing, walk uphill, dance, kick and play using its fingers.
Seven microphones
Could sing in unison
Interact with humans with movements
Speech with more than 1000 words
Learn new words also
Showed emotions by flashing lights
Three CCD cameras in all, One in each eye and one at center. Two CCD
cameras in eyes recognized up to 10 different faces and objects, and
determined location of objects in view
o Four Qrios performed a complicated dance routine in 2003
o
o
o
o
o
o
o
o
o
o
o
o
o
In 2006, ten Qrios gave a dance number.
Conducted entire orchestra.
Played a unique rendition of Beethoven's 5th symphony (1808)
Orchestra had novel instruments played by robotic actuators.
Each Qrio had 38 fluid motion flexible joints controlled by separate motors for
each with ASIP in each.
o Three central system microcontrollers controlled motion, recognized speech and
visual images, respectively.
o Memory 64 MB with each microcontroller
o
o
o
o
o
o
o
o
o

A musical device communicates data to another using MIDI protocol
Most musical instruments─ MIDI compatible
MIDI IN and MIDI OUT connections
Optically isolated with the musical instrument hardware

MIDI specifications:
Define

(i) what a physical connector is,
(ii) what message format is used by connecting devices and controlling them in "real
time" and
(iii) standard for MIDI files.
MIDI Messages
o
o
o
o
o

Define an event what musical note is pressed and with what speed it was pressed.
This event is input to another MIDI receiver.
MIDI receiver plays that note back with the specified speed.
An entire ensemble of a robot orchestra can be controlled using MIDI protocol.
Also the actuators are synchronized as per the notes and speeds.

A MIDI message
o Consists of a command and corresponding data for that command.
o Data sent in byte formats and are always between 0 and 127
o Corresponding command bytes in a channel message and are always are from 128 to
255.
o Corresponding command bytes are:o Musical note, pitch-bend, control change, program change and aftertouch (polypressure) messages.
MIDI Format Specifications
o Maximum 16 channels in a system
o MIDI specifies system messages, manufacturer's system exclusive messages and
real time system exclusive messages (between 0xF0 to 0xFF)

Real time system message example
o A MIDI start from conductor is 0xFA command
o Always begins playback at very beginning of the song (called MIDI Beat 0)]
o So when a slave player receives MIDI Start (0xFA), it automatically resets its song
position = 0

Inter-Robot communication of MIDI files
o Transport of a MIDI file─ Bluetooth, high Speed Serial, USB or FireWire.
o For robot orchestra, communication protocol for MIDI files can be Bluetooth or
WLAN 802.11
Inputs and Outputs to a software module
o k sensor inputs to a module
o q outputs generate to actuators in a
sequence
o p outputs to message boxes (also called
mailboxes in certain OS or notifications in
certain OS) in a sequence

Orchestrator Software Module
o Software which sequences, synchronizes the
inputs from 1st to kth sensors and generates
the messages and outputs for the actuators,
display and message boxes at the specified
instances and time intervals.
o Message boxes store the notifications, which
initiate the tasks as per the notifications
Purpose
To communicate selected MIDI file data over Bluetooth personal area network from Robot
Conductor communication task to music playing robot tasks

Inputs

1. Orchestra_Choice
2. MIDI File

Signals, events and Notifications
Commands in the file

Outputs
o MIDI File for inter-robot communication
o Messages to actuators for movements
Functions of the system
o A user signals an Orchestra_Choice, say Beethoven's 5th symphony to start.
o The conductor C task_MIDI selects the chosen MIDI file and posts the bytes from the
files in message queue for task_Piconet_Master.
o Piconet is a network of Bluetooth devices. Bluetooth devices can form a network known
as p ic o ne t with the devices within a distance of about 10 m.
o Bluetooth piconet of network of master C, and slaves P1, P2, P3 and P4.
o task_PICONET_SlaveP1, task_PICONET_SlaveP2, task_PICONET_SlaveP3 and
task_PICONET_SlaveP4 accept the messages from task_Piconet_Master.
o task_Piconet_Master posts the MIDI messages to a task_ MIDI_Slave.
o task_ MIDI_Slave posts the messages to a task_Orchestrator, which controls the motor
movements of the slave robot actuators and musical note actuators.

Design Metrics
o
o
o
o

Power Dissipation: As required by mechanical units, music units and actuators
Performance: Human equivalent of Orchestra in music
Engineering Cost: US$ 150000 (assumed) including mechanical actuators
Manufacturing Cost: US$ 50000 (assumed)
Task_Conductor class diagram
Class Task_MIDI
Objects
task_MIDI,
task_Piconet_Master,
task_Piconet_SlaveP1,task_Piconet_SlaveP2, task_ Piconet
_SlaveP3, task_Piconet_SlaveP4, task_MIDI_SlaveP1, task_
MIDI_SlaveP2, task_MIDI_SlaveP3, task_MIDI_SlaveP4,
task_Orchestrator_SlaveP1, task_Orchestrator_SlaveP2,
task_Orchestrator_SlaveP3, task_ Orchestrator_SlaveP4

Msg Queue objects for posting and accepting Msg
MsgQMidi, MsgQBluetooth, MsgQMidiP1, MsgQBluetoothP2, SigPort4.

MsgQMIDI
o post NumMsg messages from MIDI file in one cycle to the object
task_Piconet_Master.
o MsgQBluetooth post Bluetooth stack data in one cycle to Port_Bluetooth.
o Signal object SigPort to ports initiates transfer of Bluetooth stack.
o Signal object SigPortP1, SigPortP2, SigPortP3 and SigPortP4 initiates reception
of Bluetooth stack.
Microcontroller
o A microcontroller at master and each slave to control for Orchestrator for
movements.
o An ASIP for each motor movement.
o An ASIP at master and each slave for Bluetooth piconet communication between
master and slaves.

Hardware architecture components
o
o
o
o
o
o
o

Processors
ASIPs
Memory
Ports
Devices
Mechanical and electromechanical units
Interfacing and mapping of these components
Microcontroller
Software Architecture
o OS
o ISRs for initiating action on user inputs and GUI notification, for example for
Orchestra_Choice.
o Orchestrator tasks for master and slaves.

Queue Method for system call to the OS

o task_MIDI waits for NumMsg MIDI messages from MIDI file for chosen orchestra
and posts to the NumMsg number MsgQMidi messages to task_Piconet_Master.
o task_MIDI posts the bytes in message queue for task_Piconet_Master
task_Piconet_Master
o Discovers the slaves and sets up piconet Bluetooth device network on first
initiation.
o On accepting MsgQMidi messages, it sends protocol stack outputs
through the port.
o A task_Piconet_SlaveP1 sets up network with master as the server.

task_Piconet_Slave

o Receives Bluetooth stack for the NumMsg messages of MIDI file and sets up network
with master as server.
o The MIDI messages are sorted for the messages to be directed to track P1 or P2 or P3
or P4.
o trackP1 messages post to task_MIDI_SlaveP1 from task_Piconet_SlaveP1.
o Then task_MIDI_SlaveP1 posts the messages to actuators and Orchestrator
task_OrchetratorP1.
o Step similar repeat for other slaves P2, P3 and P4 tracks in robot orchestra.
Case study of inter robot communication
Case study of inter robot communication

Mais conteúdo relacionado

Mais procurados

Bluetooth Technology -- detailed explanation
Bluetooth Technology -- detailed explanation Bluetooth Technology -- detailed explanation
Bluetooth Technology -- detailed explanation Siva Pradeep Bolisetti
 
Satellite communication Basics
Satellite communication BasicsSatellite communication Basics
Satellite communication BasicsNiranjan Poojary
 
Optical wireless communication
Optical wireless communicationOptical wireless communication
Optical wireless communicationVishak V Thampy
 
Single Sideband Suppressed Carrier (SSB-SC)
Single Sideband Suppressed Carrier (SSB-SC)Single Sideband Suppressed Carrier (SSB-SC)
Single Sideband Suppressed Carrier (SSB-SC)Ridwanul Hoque
 
Digital satellite communications
Digital satellite communicationsDigital satellite communications
Digital satellite communicationsNisreen Bashar
 
Decimation and Interpolation
Decimation and InterpolationDecimation and Interpolation
Decimation and InterpolationFernando Ojeda
 
wireless sensor network
wireless sensor networkwireless sensor network
wireless sensor networkA. Shamel
 
PSK (PHASE SHIFT KEYING )
PSK (PHASE SHIFT KEYING )PSK (PHASE SHIFT KEYING )
PSK (PHASE SHIFT KEYING )vijidhivi
 
Software defined radio
Software defined radioSoftware defined radio
Software defined radioRahul Sidhu
 
Diversity Techniques in Wireless Communication
Diversity Techniques in Wireless CommunicationDiversity Techniques in Wireless Communication
Diversity Techniques in Wireless CommunicationSahar Foroughi
 
IBOC TECHNOLOGY
IBOC TECHNOLOGYIBOC TECHNOLOGY
IBOC TECHNOLOGYDj Tibi
 
Satellite communications
Satellite communicationsSatellite communications
Satellite communicationsSARITHA REDDY
 
satellite-communication-ppt
satellite-communication-pptsatellite-communication-ppt
satellite-communication-pptjhcid
 
Information Theory and Coding - Lecture 5
Information Theory and Coding - Lecture 5Information Theory and Coding - Lecture 5
Information Theory and Coding - Lecture 5Aref35
 

Mais procurados (20)

Mobile satellite communication
Mobile satellite communicationMobile satellite communication
Mobile satellite communication
 
Bluetooth Technology -- detailed explanation
Bluetooth Technology -- detailed explanation Bluetooth Technology -- detailed explanation
Bluetooth Technology -- detailed explanation
 
Satellite communication Basics
Satellite communication BasicsSatellite communication Basics
Satellite communication Basics
 
Multiple Access
Multiple AccessMultiple Access
Multiple Access
 
Optical wireless communication
Optical wireless communicationOptical wireless communication
Optical wireless communication
 
Single Sideband Suppressed Carrier (SSB-SC)
Single Sideband Suppressed Carrier (SSB-SC)Single Sideband Suppressed Carrier (SSB-SC)
Single Sideband Suppressed Carrier (SSB-SC)
 
Adaptive equalization
Adaptive equalizationAdaptive equalization
Adaptive equalization
 
Digital satellite communications
Digital satellite communicationsDigital satellite communications
Digital satellite communications
 
Decimation and Interpolation
Decimation and InterpolationDecimation and Interpolation
Decimation and Interpolation
 
wireless sensor network
wireless sensor networkwireless sensor network
wireless sensor network
 
PSK (PHASE SHIFT KEYING )
PSK (PHASE SHIFT KEYING )PSK (PHASE SHIFT KEYING )
PSK (PHASE SHIFT KEYING )
 
Software defined radio
Software defined radioSoftware defined radio
Software defined radio
 
Earth Station Subsystem
Earth Station SubsystemEarth Station Subsystem
Earth Station Subsystem
 
Diversity Techniques in Wireless Communication
Diversity Techniques in Wireless CommunicationDiversity Techniques in Wireless Communication
Diversity Techniques in Wireless Communication
 
Satellite link design
Satellite link designSatellite link design
Satellite link design
 
IBOC TECHNOLOGY
IBOC TECHNOLOGYIBOC TECHNOLOGY
IBOC TECHNOLOGY
 
Satellite Subsystems
Satellite SubsystemsSatellite Subsystems
Satellite Subsystems
 
Satellite communications
Satellite communicationsSatellite communications
Satellite communications
 
satellite-communication-ppt
satellite-communication-pptsatellite-communication-ppt
satellite-communication-ppt
 
Information Theory and Coding - Lecture 5
Information Theory and Coding - Lecture 5Information Theory and Coding - Lecture 5
Information Theory and Coding - Lecture 5
 

Destaque

Swarm robotics for intelligent warehousing
Swarm robotics for intelligent warehousingSwarm robotics for intelligent warehousing
Swarm robotics for intelligent warehousingeSAT Journals
 
20161006 rsp2016 ohkawa-presen
20161006 rsp2016 ohkawa-presen20161006 rsp2016 ohkawa-presen
20161006 rsp2016 ohkawa-presenTakeshi Ohkawa
 
How to build Open Hardware self-navigating car robot
How to build Open Hardware self-navigating car robotHow to build Open Hardware self-navigating car robot
How to build Open Hardware self-navigating car robotTomáš Jukin
 
Swarm intelligence
Swarm intelligenceSwarm intelligence
Swarm intelligenceSophia
 
Swarm intelligence
Swarm intelligenceSwarm intelligence
Swarm intelligenceEslam Hamed
 
Wireless robot ppt
Wireless robot pptWireless robot ppt
Wireless robot pptVarun B P
 
Wireless Pick and Place Surveillance Robot
Wireless Pick and Place Surveillance RobotWireless Pick and Place Surveillance Robot
Wireless Pick and Place Surveillance RobotZeenat Saba Khan
 
Awareness motion and it's timing to induce user's action
Awareness motion and it's timing to induce user's actionAwareness motion and it's timing to induce user's action
Awareness motion and it's timing to induce user's actionAiri Y
 
Introduction to ROS (Robot Operating System)
Introduction to ROS (Robot Operating System) Introduction to ROS (Robot Operating System)
Introduction to ROS (Robot Operating System) hvcoup
 

Destaque (13)

Swarm robotics for intelligent warehousing
Swarm robotics for intelligent warehousingSwarm robotics for intelligent warehousing
Swarm robotics for intelligent warehousing
 
20161006 rsp2016 ohkawa-presen
20161006 rsp2016 ohkawa-presen20161006 rsp2016 ohkawa-presen
20161006 rsp2016 ohkawa-presen
 
How to build Open Hardware self-navigating car robot
How to build Open Hardware self-navigating car robotHow to build Open Hardware self-navigating car robot
How to build Open Hardware self-navigating car robot
 
swarm robotics
swarm roboticsswarm robotics
swarm robotics
 
Swarm intelligence
Swarm intelligenceSwarm intelligence
Swarm intelligence
 
ROS distributed architecture
ROS  distributed architectureROS  distributed architecture
ROS distributed architecture
 
Swarm intelligence
Swarm intelligenceSwarm intelligence
Swarm intelligence
 
Swarm intelligence
Swarm intelligenceSwarm intelligence
Swarm intelligence
 
Wireless robot ppt
Wireless robot pptWireless robot ppt
Wireless robot ppt
 
Wireless Pick and Place Surveillance Robot
Wireless Pick and Place Surveillance RobotWireless Pick and Place Surveillance Robot
Wireless Pick and Place Surveillance Robot
 
Awareness motion and it's timing to induce user's action
Awareness motion and it's timing to induce user's actionAwareness motion and it's timing to induce user's action
Awareness motion and it's timing to induce user's action
 
Robotics.Ppt
Robotics.PptRobotics.Ppt
Robotics.Ppt
 
Introduction to ROS (Robot Operating System)
Introduction to ROS (Robot Operating System) Introduction to ROS (Robot Operating System)
Introduction to ROS (Robot Operating System)
 

Semelhante a Case study of inter robot communication

Spherator FM VST VST3 Audio Unit: 4 Operator Frequency Modulation Synthesizer...
Spherator FM VST VST3 Audio Unit: 4 Operator Frequency Modulation Synthesizer...Spherator FM VST VST3 Audio Unit: 4 Operator Frequency Modulation Synthesizer...
Spherator FM VST VST3 Audio Unit: 4 Operator Frequency Modulation Synthesizer...Syntheway Virtual Musical Instruments
 
Distance measuring unit with zigbee protocol, Ultra sonic sensor
Distance measuring unit with zigbee protocol, Ultra sonic sensorDistance measuring unit with zigbee protocol, Ultra sonic sensor
Distance measuring unit with zigbee protocol, Ultra sonic sensorAshok Raj
 
Optical recording system
Optical recording systemOptical recording system
Optical recording systemTamilarasan N
 
The MIDI Protocol - Musical Instrument Digital Interface
The MIDI Protocol - Musical Instrument Digital InterfaceThe MIDI Protocol - Musical Instrument Digital Interface
The MIDI Protocol - Musical Instrument Digital InterfaceBhaumik Bhatt
 
Mse%204001%20 Wireless%20 Optical%20 Mouse
Mse%204001%20 Wireless%20 Optical%20 MouseMse%204001%20 Wireless%20 Optical%20 Mouse
Mse%204001%20 Wireless%20 Optical%20 Mouseadamwentworth
 
Computer Organization and Architecture ppt .pptx
Computer Organization and Architecture ppt .pptxComputer Organization and Architecture ppt .pptx
Computer Organization and Architecture ppt .pptxSURESHKUMARMURK22DS4
 
The IoT Academy IoT training Arduino Part 5 Arduino peripherals
The IoT Academy IoT training Arduino Part 5 Arduino peripheralsThe IoT Academy IoT training Arduino Part 5 Arduino peripherals
The IoT Academy IoT training Arduino Part 5 Arduino peripheralsThe IOT Academy
 
Micro-MIDI: A Real Time, Dynamic Microtonal MIDI Application
Micro-MIDI: A Real Time, Dynamic Microtonal MIDI ApplicationMicro-MIDI: A Real Time, Dynamic Microtonal MIDI Application
Micro-MIDI: A Real Time, Dynamic Microtonal MIDI Applicationinventionjournals
 
Technical Elements of the Public Switched Telephone Network
Technical Elements of the Public Switched Telephone NetworkTechnical Elements of the Public Switched Telephone Network
Technical Elements of the Public Switched Telephone Networkmkhalil26
 
robotics and embedded system ppt
robotics and embedded system pptrobotics and embedded system ppt
robotics and embedded system pptNilgiri publicity
 
Fpga implementation of mimo
Fpga implementation of mimoFpga implementation of mimo
Fpga implementation of mimohafsabanu
 
Scaling Down Instrumentation Deploying Analog Mixed Signal Technology
Scaling Down Instrumentation Deploying Analog Mixed Signal TechnologyScaling Down Instrumentation Deploying Analog Mixed Signal Technology
Scaling Down Instrumentation Deploying Analog Mixed Signal TechnologyShivaprasad Tilekar
 
LaserHarp_Presentation
LaserHarp_PresentationLaserHarp_Presentation
LaserHarp_PresentationShane Jonson
 
Synthractive VST, VST3 and Audio Unit Stereo Subtractive Synthesizer: Leads, ...
Synthractive VST, VST3 and Audio Unit Stereo Subtractive Synthesizer: Leads, ...Synthractive VST, VST3 and Audio Unit Stereo Subtractive Synthesizer: Leads, ...
Synthractive VST, VST3 and Audio Unit Stereo Subtractive Synthesizer: Leads, ...Syntheway Virtual Musical Instruments
 
The Doppler EffectWhat is the Doppler effect, and why is it impo.docx
The Doppler EffectWhat is the Doppler effect, and why is it impo.docxThe Doppler EffectWhat is the Doppler effect, and why is it impo.docx
The Doppler EffectWhat is the Doppler effect, and why is it impo.docxcherry686017
 
Music With Pharo
Music With PharoMusic With Pharo
Music With PharoESUG
 

Semelhante a Case study of inter robot communication (20)

Spherator FM VST VST3 Audio Unit: 4 Operator Frequency Modulation Synthesizer...
Spherator FM VST VST3 Audio Unit: 4 Operator Frequency Modulation Synthesizer...Spherator FM VST VST3 Audio Unit: 4 Operator Frequency Modulation Synthesizer...
Spherator FM VST VST3 Audio Unit: 4 Operator Frequency Modulation Synthesizer...
 
Distance measuring unit with zigbee protocol, Ultra sonic sensor
Distance measuring unit with zigbee protocol, Ultra sonic sensorDistance measuring unit with zigbee protocol, Ultra sonic sensor
Distance measuring unit with zigbee protocol, Ultra sonic sensor
 
Optical recording system
Optical recording systemOptical recording system
Optical recording system
 
The MIDI Protocol - Musical Instrument Digital Interface
The MIDI Protocol - Musical Instrument Digital InterfaceThe MIDI Protocol - Musical Instrument Digital Interface
The MIDI Protocol - Musical Instrument Digital Interface
 
Mse%204001%20 Wireless%20 Optical%20 Mouse
Mse%204001%20 Wireless%20 Optical%20 MouseMse%204001%20 Wireless%20 Optical%20 Mouse
Mse%204001%20 Wireless%20 Optical%20 Mouse
 
SENSOR DATA COMMUNICATION TO THNIGSPEAK IOT PLATFORM USING RASPBERRY P
SENSOR DATA COMMUNICATION TO THNIGSPEAK  IOT PLATFORM USING RASPBERRY PSENSOR DATA COMMUNICATION TO THNIGSPEAK  IOT PLATFORM USING RASPBERRY P
SENSOR DATA COMMUNICATION TO THNIGSPEAK IOT PLATFORM USING RASPBERRY P
 
Microprocessor Systems
Microprocessor Systems Microprocessor Systems
Microprocessor Systems
 
Computer Organization and Architecture ppt .pptx
Computer Organization and Architecture ppt .pptxComputer Organization and Architecture ppt .pptx
Computer Organization and Architecture ppt .pptx
 
The IoT Academy IoT training Arduino Part 5 Arduino peripherals
The IoT Academy IoT training Arduino Part 5 Arduino peripheralsThe IoT Academy IoT training Arduino Part 5 Arduino peripherals
The IoT Academy IoT training Arduino Part 5 Arduino peripherals
 
Micro-MIDI: A Real Time, Dynamic Microtonal MIDI Application
Micro-MIDI: A Real Time, Dynamic Microtonal MIDI ApplicationMicro-MIDI: A Real Time, Dynamic Microtonal MIDI Application
Micro-MIDI: A Real Time, Dynamic Microtonal MIDI Application
 
Technical Elements of the Public Switched Telephone Network
Technical Elements of the Public Switched Telephone NetworkTechnical Elements of the Public Switched Telephone Network
Technical Elements of the Public Switched Telephone Network
 
robotics and embedded system ppt
robotics and embedded system pptrobotics and embedded system ppt
robotics and embedded system ppt
 
Fpga implementation of mimo
Fpga implementation of mimoFpga implementation of mimo
Fpga implementation of mimo
 
Lecture 1.pptx
Lecture 1.pptxLecture 1.pptx
Lecture 1.pptx
 
Scaling Down Instrumentation Deploying Analog Mixed Signal Technology
Scaling Down Instrumentation Deploying Analog Mixed Signal TechnologyScaling Down Instrumentation Deploying Analog Mixed Signal Technology
Scaling Down Instrumentation Deploying Analog Mixed Signal Technology
 
LaserHarp_Presentation
LaserHarp_PresentationLaserHarp_Presentation
LaserHarp_Presentation
 
Synthractive VST, VST3 and Audio Unit Stereo Subtractive Synthesizer: Leads, ...
Synthractive VST, VST3 and Audio Unit Stereo Subtractive Synthesizer: Leads, ...Synthractive VST, VST3 and Audio Unit Stereo Subtractive Synthesizer: Leads, ...
Synthractive VST, VST3 and Audio Unit Stereo Subtractive Synthesizer: Leads, ...
 
Bluetooth mobileip
Bluetooth mobileipBluetooth mobileip
Bluetooth mobileip
 
The Doppler EffectWhat is the Doppler effect, and why is it impo.docx
The Doppler EffectWhat is the Doppler effect, and why is it impo.docxThe Doppler EffectWhat is the Doppler effect, and why is it impo.docx
The Doppler EffectWhat is the Doppler effect, and why is it impo.docx
 
Music With Pharo
Music With PharoMusic With Pharo
Music With Pharo
 

Último

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfciinovamais
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...Marc Dusseiller Dusjagr
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxNirmalaLoungPoorunde1
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Sapana Sha
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactdawncurless
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991RKavithamani
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdfQucHHunhnh
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingTechSoup
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformChameera Dedduwage
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfJayanti Pande
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docxPoojaSen20
 
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...RKavithamani
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxheathfieldcps1
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxGaneshChakor2
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introductionMaksud Ahmed
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphThiyagu K
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityGeoBlogs
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104misteraugie
 

Último (20)

Activity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdfActivity 01 - Artificial Culture (1).pdf
Activity 01 - Artificial Culture (1).pdf
 
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
“Oh GOSH! Reflecting on Hackteria's Collaborative Practices in a Global Do-It...
 
Employee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptxEmployee wellbeing at the workplace.pptx
Employee wellbeing at the workplace.pptx
 
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111Call Girls in Dwarka Mor Delhi Contact Us 9654467111
Call Girls in Dwarka Mor Delhi Contact Us 9654467111
 
Accessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impactAccessible design: Minimum effort, maximum impact
Accessible design: Minimum effort, maximum impact
 
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptxINDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
INDIA QUIZ 2024 RLAC DELHI UNIVERSITY.pptx
 
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
Industrial Policy - 1948, 1956, 1973, 1977, 1980, 1991
 
1029-Danh muc Sach Giao Khoa khoi 6.pdf
1029-Danh muc Sach Giao Khoa khoi  6.pdf1029-Danh muc Sach Giao Khoa khoi  6.pdf
1029-Danh muc Sach Giao Khoa khoi 6.pdf
 
Grant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy ConsultingGrant Readiness 101 TechSoup and Remy Consulting
Grant Readiness 101 TechSoup and Remy Consulting
 
A Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy ReformA Critique of the Proposed National Education Policy Reform
A Critique of the Proposed National Education Policy Reform
 
Web & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdfWeb & Social Media Analytics Previous Year Question Paper.pdf
Web & Social Media Analytics Previous Year Question Paper.pdf
 
mini mental status format.docx
mini    mental       status     format.docxmini    mental       status     format.docx
mini mental status format.docx
 
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
Privatization and Disinvestment - Meaning, Objectives, Advantages and Disadva...
 
The basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptxThe basics of sentences session 2pptx copy.pptx
The basics of sentences session 2pptx copy.pptx
 
CARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptxCARE OF CHILD IN INCUBATOR..........pptx
CARE OF CHILD IN INCUBATOR..........pptx
 
microwave assisted reaction. General introduction
microwave assisted reaction. General introductionmicrowave assisted reaction. General introduction
microwave assisted reaction. General introduction
 
Z Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot GraphZ Score,T Score, Percential Rank and Box Plot Graph
Z Score,T Score, Percential Rank and Box Plot Graph
 
Paris 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activityParis 2024 Olympic Geographies - an activity
Paris 2024 Olympic Geographies - an activity
 
Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1Código Creativo y Arte de Software | Unidad 1
Código Creativo y Arte de Software | Unidad 1
 
Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104Nutritional Needs Presentation - HLTH 104
Nutritional Needs Presentation - HLTH 104
 

Case study of inter robot communication

  • 1. CASE STUDY OF INTER-ROBOT COMMUNICATION IN A ROBOT ORCHESTRA PRESENTED BY ARUN
  • 2.
  • 3. An invention of Sony Qrio─ Quest for cuRIOsity Smoother and faster humanoid robot than ever before 7.3 kg, 58 cm and 1 hour battery A bipedal robot which could wave, hello and recognize voice Could converse, sing, walk uphill, dance, kick and play using its fingers. Seven microphones Could sing in unison Interact with humans with movements Speech with more than 1000 words Learn new words also Showed emotions by flashing lights Three CCD cameras in all, One in each eye and one at center. Two CCD cameras in eyes recognized up to 10 different faces and objects, and determined location of objects in view o Four Qrios performed a complicated dance routine in 2003 o o o o o o o o o o o o o
  • 4. In 2006, ten Qrios gave a dance number. Conducted entire orchestra. Played a unique rendition of Beethoven's 5th symphony (1808) Orchestra had novel instruments played by robotic actuators. Each Qrio had 38 fluid motion flexible joints controlled by separate motors for each with ASIP in each. o Three central system microcontrollers controlled motion, recognized speech and visual images, respectively. o Memory 64 MB with each microcontroller o o o o o
  • 5.
  • 6. o o o o A musical device communicates data to another using MIDI protocol Most musical instruments─ MIDI compatible MIDI IN and MIDI OUT connections Optically isolated with the musical instrument hardware MIDI specifications: Define (i) what a physical connector is, (ii) what message format is used by connecting devices and controlling them in "real time" and (iii) standard for MIDI files.
  • 7. MIDI Messages o o o o o Define an event what musical note is pressed and with what speed it was pressed. This event is input to another MIDI receiver. MIDI receiver plays that note back with the specified speed. An entire ensemble of a robot orchestra can be controlled using MIDI protocol. Also the actuators are synchronized as per the notes and speeds. A MIDI message o Consists of a command and corresponding data for that command. o Data sent in byte formats and are always between 0 and 127 o Corresponding command bytes in a channel message and are always are from 128 to 255. o Corresponding command bytes are:o Musical note, pitch-bend, control change, program change and aftertouch (polypressure) messages.
  • 8. MIDI Format Specifications o Maximum 16 channels in a system o MIDI specifies system messages, manufacturer's system exclusive messages and real time system exclusive messages (between 0xF0 to 0xFF) Real time system message example o A MIDI start from conductor is 0xFA command o Always begins playback at very beginning of the song (called MIDI Beat 0)] o So when a slave player receives MIDI Start (0xFA), it automatically resets its song position = 0 Inter-Robot communication of MIDI files o Transport of a MIDI file─ Bluetooth, high Speed Serial, USB or FireWire. o For robot orchestra, communication protocol for MIDI files can be Bluetooth or WLAN 802.11
  • 9. Inputs and Outputs to a software module o k sensor inputs to a module o q outputs generate to actuators in a sequence o p outputs to message boxes (also called mailboxes in certain OS or notifications in certain OS) in a sequence Orchestrator Software Module o Software which sequences, synchronizes the inputs from 1st to kth sensors and generates the messages and outputs for the actuators, display and message boxes at the specified instances and time intervals. o Message boxes store the notifications, which initiate the tasks as per the notifications
  • 10. Purpose To communicate selected MIDI file data over Bluetooth personal area network from Robot Conductor communication task to music playing robot tasks Inputs 1. Orchestra_Choice 2. MIDI File Signals, events and Notifications Commands in the file Outputs o MIDI File for inter-robot communication o Messages to actuators for movements
  • 11. Functions of the system o A user signals an Orchestra_Choice, say Beethoven's 5th symphony to start. o The conductor C task_MIDI selects the chosen MIDI file and posts the bytes from the files in message queue for task_Piconet_Master. o Piconet is a network of Bluetooth devices. Bluetooth devices can form a network known as p ic o ne t with the devices within a distance of about 10 m. o Bluetooth piconet of network of master C, and slaves P1, P2, P3 and P4. o task_PICONET_SlaveP1, task_PICONET_SlaveP2, task_PICONET_SlaveP3 and task_PICONET_SlaveP4 accept the messages from task_Piconet_Master. o task_Piconet_Master posts the MIDI messages to a task_ MIDI_Slave. o task_ MIDI_Slave posts the messages to a task_Orchestrator, which controls the motor movements of the slave robot actuators and musical note actuators. Design Metrics o o o o Power Dissipation: As required by mechanical units, music units and actuators Performance: Human equivalent of Orchestra in music Engineering Cost: US$ 150000 (assumed) including mechanical actuators Manufacturing Cost: US$ 50000 (assumed)
  • 14. Objects task_MIDI, task_Piconet_Master, task_Piconet_SlaveP1,task_Piconet_SlaveP2, task_ Piconet _SlaveP3, task_Piconet_SlaveP4, task_MIDI_SlaveP1, task_ MIDI_SlaveP2, task_MIDI_SlaveP3, task_MIDI_SlaveP4, task_Orchestrator_SlaveP1, task_Orchestrator_SlaveP2, task_Orchestrator_SlaveP3, task_ Orchestrator_SlaveP4 Msg Queue objects for posting and accepting Msg MsgQMidi, MsgQBluetooth, MsgQMidiP1, MsgQBluetoothP2, SigPort4. MsgQMIDI o post NumMsg messages from MIDI file in one cycle to the object task_Piconet_Master. o MsgQBluetooth post Bluetooth stack data in one cycle to Port_Bluetooth. o Signal object SigPort to ports initiates transfer of Bluetooth stack. o Signal object SigPortP1, SigPortP2, SigPortP3 and SigPortP4 initiates reception of Bluetooth stack.
  • 15.
  • 16. Microcontroller o A microcontroller at master and each slave to control for Orchestrator for movements. o An ASIP for each motor movement. o An ASIP at master and each slave for Bluetooth piconet communication between master and slaves. Hardware architecture components o o o o o o o Processors ASIPs Memory Ports Devices Mechanical and electromechanical units Interfacing and mapping of these components
  • 18. Software Architecture o OS o ISRs for initiating action on user inputs and GUI notification, for example for Orchestra_Choice. o Orchestrator tasks for master and slaves. Queue Method for system call to the OS o task_MIDI waits for NumMsg MIDI messages from MIDI file for chosen orchestra and posts to the NumMsg number MsgQMidi messages to task_Piconet_Master. o task_MIDI posts the bytes in message queue for task_Piconet_Master
  • 19. task_Piconet_Master o Discovers the slaves and sets up piconet Bluetooth device network on first initiation. o On accepting MsgQMidi messages, it sends protocol stack outputs through the port. o A task_Piconet_SlaveP1 sets up network with master as the server. task_Piconet_Slave o Receives Bluetooth stack for the NumMsg messages of MIDI file and sets up network with master as server. o The MIDI messages are sorted for the messages to be directed to track P1 or P2 or P3 or P4. o trackP1 messages post to task_MIDI_SlaveP1 from task_Piconet_SlaveP1. o Then task_MIDI_SlaveP1 posts the messages to actuators and Orchestrator task_OrchetratorP1. o Step similar repeat for other slaves P2, P3 and P4 tracks in robot orchestra.