SlideShare uma empresa Scribd logo
1 de 15
RAPTOR CODES
José Lopes (please call me Sá)
@zemanelsa
About me
• Braga
• MSc in Information Security (FCUL)
• Researcher@LaSIGE
• Motorcycles
• MSc Thesis
• RaptorQ implementation
• Breaking & Securing RQ
What you should take from this talk?
Theory:
• What are fountain codes?
• What properties they have?
• How can they be used?
You should think about:
• Where can I use them?
• How can my applications benefit from them?
• New ideas that work with this mindset
FEC - Forward Error Correction
• Used to recover from errors occurred during transmission
• Sender encodes the message in a redundant way
• using an error-correcting code (ECC)
• Redundancy allows the receiver to detect errors
• and often to correct these errors without retransmission
• Corrects errors without a reverse channel to request
retransmission of data
• but at the cost of a fixed, higher forward channel bandwidth
• Usually applied in situations where retransmissions are
costly or impossible (e.g., multicast)
• Added to mass storage devices to enable recovery of
corrupted data (e.g., RAID)
Erasure codes
• Error correcting code
• Transforms a message of k symbols into a longer
message with n symbols
• The original message can be recovered from a
subset (k’) of the n symbols
• (Code rate)  r = k/n proportion of the data-stream that is useful
• (Reception efficiency)  k’/k
Fountain codes
• Rateless erasure code
• Endless supply of encoded symbols
• Recover original data with any K encoded symbols (with
high probability)
DigitalK
Receiver
(bucket)
Fountain
Use case: point-to-multipoint
• For a large number of receivers TCP does not
scale
• every receiver requires a separate data stream
• sender needs to keep track of what arrives at each
receiver
• UDP can be used
• scales effortlessly
• best effort: loss rate ↑ ⇒ degraded experience
• Difficult to provide a scalable broadcast
service on the Internet
• it would be interesting to have reliability whilst
retaining UDP’s efficiency
S
R2
R1
R4 R3
LT code (the first fountain code!)
• Based on two random generators
• One generates how many XORs should be made
• The other generates (the IDs of) which symbols will be XORed
• 5%-10% extra symbols are usually needed
S : source symbol E : encoding symbol (+ is the XOR operation)
E0 = S2 + S4 + S5 E1 = S0 + S1 + S2 E2 = S0 + S3 E3 = S2
E4 = S0 + S5 E5 = S2 + S5 E6 = S1 + S3 + S4 + S5
S0 S5S4S3S2S1
E0 E1 E2 E3 E4 E5 E6
Raptor codes (finally!)
• Faster encoding/decoding algorithms
• Pre-code
• Steep overhead-failure probability curve
RaptorQ:
• Systematic
• Faster
• Steeper
HOW CAN WE USE THIS!?!?
Data
Partition into
Source Blocks
Source block i
RaptorQ
Decoder
Source block i
Data
Reconstruct
the data
Put in packets &
transmit through
the network
Received Symbols ( ≥ K)
Some packets are lost in the
network
RaptorQ Encoder
Source Symbols (K)
Repair
Generator
Repair Symbols (R)
Encoding Symbols
Can be used as
overhead (extra
symbols)
SENDER RECEIVER
How awesome is RaptorQ? Pretty awesome...
• Incredibly low probabilities of failure (for accidental faults)
K (number of source symbols)
0 Overhead [·10-3] 1 Overhead [·10-5] 2 Overhead [·10-7]
Loss 10 26 101 10 26 101 10 26 101
10% 0 5.4 5.7 0 0 3.8 0 0 2.5
20% 0 4.0 4.8 0 2.3 2.4 0 0 0.5
50% 0 3.9 4.9 0 1.6 2.5 0 0.9 1.2
60% 4.8 4.1 4.9 0 1.5 2.2 0 0 2.1
85% 0 12.7 4.7 0 0.8 2.4 0 0 1.3
Who’s using Raptor codes?
Where to now?
• José Lopes, “Communication with RaptorQ Erasure Codes
in Malicious Environments”, MSc thesis
• José Lopes and Nuno Neves, “Stopping a Rapid Tornado
with a Puff” (soon to be IEEE S&P)
• The OpenRQ Library (www.lasige.di.fc.ul.pt/openrq)
• Amin Shokrollahi, "Raptor codes”, IEEE Transactions on
Information Theory 52.6 (2006): 2551-2567.
• Amin Shokrollahi and Michael Luby, “Raptor Codes”
Now Publishers Inc 2011
• IETF RFC6330
RAPTOR CODES
José Lopes (please call me Sá)
@zemanelsa
Thank you! Any questions?

Mais conteúdo relacionado

Mais procurados

Doppler Spread and Coherence Time.pptx
Doppler Spread and Coherence Time.pptxDoppler Spread and Coherence Time.pptx
Doppler Spread and Coherence Time.pptxBhavanaMU012
 
Wireless Communication Notes.pdf
Wireless Communication Notes.pdfWireless Communication Notes.pdf
Wireless Communication Notes.pdfshanmugamsara
 
Pulse Code Modulation (PCM)
Pulse Code Modulation (PCM)Pulse Code Modulation (PCM)
Pulse Code Modulation (PCM)Arun c
 
Equalization (Technique on Receiver Side to remove Interferences)
Equalization (Technique on Receiver Side to remove Interferences)Equalization (Technique on Receiver Side to remove Interferences)
Equalization (Technique on Receiver Side to remove Interferences)Syed Taimoor Hussain Shah
 
Channel Capacity and transmission media
Channel Capacity and transmission mediaChannel Capacity and transmission media
Channel Capacity and transmission mediaHemant Chetwani
 
Oea000000 lte principle fundamental issue 1.01
Oea000000 lte principle fundamental issue 1.01Oea000000 lte principle fundamental issue 1.01
Oea000000 lte principle fundamental issue 1.01Ndukwe Amandi
 
Orthogonal frequency division multiplexing (ofdm)
Orthogonal frequency division multiplexing (ofdm)Orthogonal frequency division multiplexing (ofdm)
Orthogonal frequency division multiplexing (ofdm)Dilip Mathuria
 
Enhanced Data rates for Global Evolution (EDGE)
Enhanced Data rates for Global Evolution (EDGE)Enhanced Data rates for Global Evolution (EDGE)
Enhanced Data rates for Global Evolution (EDGE)Ramrao Desai
 
Digital t carriers and multiplexing power point (laurens)
Digital t carriers and multiplexing power point (laurens)Digital t carriers and multiplexing power point (laurens)
Digital t carriers and multiplexing power point (laurens)Laurens Luis Bugayong
 
SPREAD SPECTRUM MODULATION.pptx
SPREAD SPECTRUM MODULATION.pptxSPREAD SPECTRUM MODULATION.pptx
SPREAD SPECTRUM MODULATION.pptxDeepakBaghel50
 
Cellular concepts and system design fundamentals
Cellular concepts and system design fundamentalsCellular concepts and system design fundamentals
Cellular concepts and system design fundamentalsKamal Sharma
 
Unit 4 ec8702 - ad hoc and wireless sensor networks unit -4 mr.darwin nesaku...
Unit  4 ec8702 - ad hoc and wireless sensor networks unit -4 mr.darwin nesaku...Unit  4 ec8702 - ad hoc and wireless sensor networks unit -4 mr.darwin nesaku...
Unit 4 ec8702 - ad hoc and wireless sensor networks unit -4 mr.darwin nesaku...Darwin Nesakumar
 
Chirp spread spectrum communication
Chirp spread spectrum communicationChirp spread spectrum communication
Chirp spread spectrum communicationMahmudul Islam
 
simulation of turbo encoding and decoding
simulation of turbo encoding and decodingsimulation of turbo encoding and decoding
simulation of turbo encoding and decodingGulafshan Saifi
 
Pcm transmitter and receiver
Pcm transmitter and receiverPcm transmitter and receiver
Pcm transmitter and receiverBPrabhaPalani
 
Multiple access techniques
Multiple access techniquesMultiple access techniques
Multiple access techniquesBibhu Prasad
 

Mais procurados (20)

Doppler Spread and Coherence Time.pptx
Doppler Spread and Coherence Time.pptxDoppler Spread and Coherence Time.pptx
Doppler Spread and Coherence Time.pptx
 
Wireless Communication Notes.pdf
Wireless Communication Notes.pdfWireless Communication Notes.pdf
Wireless Communication Notes.pdf
 
Pulse Code Modulation (PCM)
Pulse Code Modulation (PCM)Pulse Code Modulation (PCM)
Pulse Code Modulation (PCM)
 
Equalization (Technique on Receiver Side to remove Interferences)
Equalization (Technique on Receiver Side to remove Interferences)Equalization (Technique on Receiver Side to remove Interferences)
Equalization (Technique on Receiver Side to remove Interferences)
 
Channel Capacity and transmission media
Channel Capacity and transmission mediaChannel Capacity and transmission media
Channel Capacity and transmission media
 
Oea000000 lte principle fundamental issue 1.01
Oea000000 lte principle fundamental issue 1.01Oea000000 lte principle fundamental issue 1.01
Oea000000 lte principle fundamental issue 1.01
 
Orthogonal frequency division multiplexing (ofdm)
Orthogonal frequency division multiplexing (ofdm)Orthogonal frequency division multiplexing (ofdm)
Orthogonal frequency division multiplexing (ofdm)
 
Enhanced Data rates for Global Evolution (EDGE)
Enhanced Data rates for Global Evolution (EDGE)Enhanced Data rates for Global Evolution (EDGE)
Enhanced Data rates for Global Evolution (EDGE)
 
Digital t carriers and multiplexing power point (laurens)
Digital t carriers and multiplexing power point (laurens)Digital t carriers and multiplexing power point (laurens)
Digital t carriers and multiplexing power point (laurens)
 
SPREAD SPECTRUM MODULATION.pptx
SPREAD SPECTRUM MODULATION.pptxSPREAD SPECTRUM MODULATION.pptx
SPREAD SPECTRUM MODULATION.pptx
 
Cellular concepts and system design fundamentals
Cellular concepts and system design fundamentalsCellular concepts and system design fundamentals
Cellular concepts and system design fundamentals
 
Unit 4 ec8702 - ad hoc and wireless sensor networks unit -4 mr.darwin nesaku...
Unit  4 ec8702 - ad hoc and wireless sensor networks unit -4 mr.darwin nesaku...Unit  4 ec8702 - ad hoc and wireless sensor networks unit -4 mr.darwin nesaku...
Unit 4 ec8702 - ad hoc and wireless sensor networks unit -4 mr.darwin nesaku...
 
Chirp spread spectrum communication
Chirp spread spectrum communicationChirp spread spectrum communication
Chirp spread spectrum communication
 
Amps
AmpsAmps
Amps
 
simulation of turbo encoding and decoding
simulation of turbo encoding and decodingsimulation of turbo encoding and decoding
simulation of turbo encoding and decoding
 
Unit iv wcn main
Unit iv wcn mainUnit iv wcn main
Unit iv wcn main
 
Pcm transmitter and receiver
Pcm transmitter and receiverPcm transmitter and receiver
Pcm transmitter and receiver
 
Turbo codes.ppt
Turbo codes.pptTurbo codes.ppt
Turbo codes.ppt
 
Multiple access techniques
Multiple access techniquesMultiple access techniques
Multiple access techniques
 
LTE Basic
LTE BasicLTE Basic
LTE Basic
 

Semelhante a Raptor codes

Accurate Synchronization of EtherCAT Systems Using Distributed Clocks
Accurate Synchronization of EtherCAT Systems Using Distributed ClocksAccurate Synchronization of EtherCAT Systems Using Distributed Clocks
Accurate Synchronization of EtherCAT Systems Using Distributed ClocksDesign World
 
serial_busses_i2c.pptx
serial_busses_i2c.pptxserial_busses_i2c.pptx
serial_busses_i2c.pptxSKUP1
 
Akka-demy (a.k.a. How to build stateful distributed systems) I/II
 Akka-demy (a.k.a. How to build stateful distributed systems) I/II Akka-demy (a.k.a. How to build stateful distributed systems) I/II
Akka-demy (a.k.a. How to build stateful distributed systems) I/IIPeter Csala
 
Looking out for anomalies
Looking out for anomaliesLooking out for anomalies
Looking out for anomaliesCSIRO
 
BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...
BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...
BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...Alexandre Moneger
 
dokumen.tips_linux-networking-commands.ppt
dokumen.tips_linux-networking-commands.pptdokumen.tips_linux-networking-commands.ppt
dokumen.tips_linux-networking-commands.pptThorOdinson55
 
Ntc 362 effective communication uopstudy.com
Ntc 362 effective communication   uopstudy.comNtc 362 effective communication   uopstudy.com
Ntc 362 effective communication uopstudy.comULLPTT
 
Ntc 362 forecasting and strategic planning -uopstudy.com
Ntc 362 forecasting and strategic planning -uopstudy.comNtc 362 forecasting and strategic planning -uopstudy.com
Ntc 362 forecasting and strategic planning -uopstudy.comULLPTT
 
39245203 intro-es-iv
39245203 intro-es-iv39245203 intro-es-iv
39245203 intro-es-ivEmbeddedbvp
 
QuadIron An open source library for number theoretic transform-based erasure ...
QuadIron An open source library for number theoretic transform-based erasure ...QuadIron An open source library for number theoretic transform-based erasure ...
QuadIron An open source library for number theoretic transform-based erasure ...Scality
 
ARCHITECTING INFLUXENTERPRISE FOR SUCCESS
ARCHITECTING INFLUXENTERPRISE FOR SUCCESSARCHITECTING INFLUXENTERPRISE FOR SUCCESS
ARCHITECTING INFLUXENTERPRISE FOR SUCCESSInfluxData
 
Micro control idsecconf2010
Micro control idsecconf2010Micro control idsecconf2010
Micro control idsecconf2010idsecconf
 
Network State Awareness & Troubleshooting
Network State Awareness & TroubleshootingNetwork State Awareness & Troubleshooting
Network State Awareness & TroubleshootingAPNIC
 
How to Make Norikra Perfect
How to Make Norikra PerfectHow to Make Norikra Perfect
How to Make Norikra PerfectSATOSHI TAGOMORI
 
Apache Big Data 2016: Next Gen Big Data Analytics with Apache Apex
Apache Big Data 2016: Next Gen Big Data Analytics with Apache ApexApache Big Data 2016: Next Gen Big Data Analytics with Apache Apex
Apache Big Data 2016: Next Gen Big Data Analytics with Apache ApexApache Apex
 

Semelhante a Raptor codes (20)

Polyraptor
PolyraptorPolyraptor
Polyraptor
 
Accurate Synchronization of EtherCAT Systems Using Distributed Clocks
Accurate Synchronization of EtherCAT Systems Using Distributed ClocksAccurate Synchronization of EtherCAT Systems Using Distributed Clocks
Accurate Synchronization of EtherCAT Systems Using Distributed Clocks
 
serial_busses_i2c.pptx
serial_busses_i2c.pptxserial_busses_i2c.pptx
serial_busses_i2c.pptx
 
Serial Busses.pptx
Serial Busses.pptxSerial Busses.pptx
Serial Busses.pptx
 
Akka-demy (a.k.a. How to build stateful distributed systems) I/II
 Akka-demy (a.k.a. How to build stateful distributed systems) I/II Akka-demy (a.k.a. How to build stateful distributed systems) I/II
Akka-demy (a.k.a. How to build stateful distributed systems) I/II
 
Looking out for anomalies
Looking out for anomaliesLooking out for anomalies
Looking out for anomalies
 
Polyraptor
PolyraptorPolyraptor
Polyraptor
 
BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...
BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...
BSides LV 2016 - Beyond the tip of the iceberg - fuzzing binary protocols for...
 
dokumen.tips_linux-networking-commands.ppt
dokumen.tips_linux-networking-commands.pptdokumen.tips_linux-networking-commands.ppt
dokumen.tips_linux-networking-commands.ppt
 
Ntc 362 effective communication uopstudy.com
Ntc 362 effective communication   uopstudy.comNtc 362 effective communication   uopstudy.com
Ntc 362 effective communication uopstudy.com
 
Ntc 362 forecasting and strategic planning -uopstudy.com
Ntc 362 forecasting and strategic planning -uopstudy.comNtc 362 forecasting and strategic planning -uopstudy.com
Ntc 362 forecasting and strategic planning -uopstudy.com
 
39245203 intro-es-iv
39245203 intro-es-iv39245203 intro-es-iv
39245203 intro-es-iv
 
QuadIron An open source library for number theoretic transform-based erasure ...
QuadIron An open source library for number theoretic transform-based erasure ...QuadIron An open source library for number theoretic transform-based erasure ...
QuadIron An open source library for number theoretic transform-based erasure ...
 
TCP-IP PROTOCOL
TCP-IP PROTOCOLTCP-IP PROTOCOL
TCP-IP PROTOCOL
 
ARCHITECTING INFLUXENTERPRISE FOR SUCCESS
ARCHITECTING INFLUXENTERPRISE FOR SUCCESSARCHITECTING INFLUXENTERPRISE FOR SUCCESS
ARCHITECTING INFLUXENTERPRISE FOR SUCCESS
 
Part 6 : Internet applications
Part 6 : Internet applicationsPart 6 : Internet applications
Part 6 : Internet applications
 
Micro control idsecconf2010
Micro control idsecconf2010Micro control idsecconf2010
Micro control idsecconf2010
 
Network State Awareness & Troubleshooting
Network State Awareness & TroubleshootingNetwork State Awareness & Troubleshooting
Network State Awareness & Troubleshooting
 
How to Make Norikra Perfect
How to Make Norikra PerfectHow to Make Norikra Perfect
How to Make Norikra Perfect
 
Apache Big Data 2016: Next Gen Big Data Analytics with Apache Apex
Apache Big Data 2016: Next Gen Big Data Analytics with Apache ApexApache Big Data 2016: Next Gen Big Data Analytics with Apache Apex
Apache Big Data 2016: Next Gen Big Data Analytics with Apache Apex
 

Último

Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Enterprise Knowledge
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?Igalia
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxMalak Abu Hammad
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘RTylerCroy
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024The Digital Insurer
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Servicegiselly40
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonAnna Loughnan Colquhoun
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)wesley chun
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking MenDelhi Call girls
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityPrincipled Technologies
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...Martijn de Jong
 

Último (20)

Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024Tata AIG General Insurance Company - Insurer Innovation Award 2024
Tata AIG General Insurance Company - Insurer Innovation Award 2024
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?A Year of the Servo Reboot: Where Are We Now?
A Year of the Servo Reboot: Where Are We Now?
 
The Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptxThe Codex of Business Writing Software for Real-World Solutions 2.pptx
The Codex of Business Writing Software for Real-World Solutions 2.pptx
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
Bajaj Allianz Life Insurance Company - Insurer Innovation Award 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)Powerful Google developer tools for immediate impact! (2023-24 C)
Powerful Google developer tools for immediate impact! (2023-24 C)
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 

Raptor codes

  • 1. RAPTOR CODES José Lopes (please call me Sá) @zemanelsa
  • 2. About me • Braga • MSc in Information Security (FCUL) • Researcher@LaSIGE • Motorcycles • MSc Thesis • RaptorQ implementation • Breaking & Securing RQ
  • 3. What you should take from this talk? Theory: • What are fountain codes? • What properties they have? • How can they be used? You should think about: • Where can I use them? • How can my applications benefit from them? • New ideas that work with this mindset
  • 4.
  • 5. FEC - Forward Error Correction • Used to recover from errors occurred during transmission • Sender encodes the message in a redundant way • using an error-correcting code (ECC) • Redundancy allows the receiver to detect errors • and often to correct these errors without retransmission • Corrects errors without a reverse channel to request retransmission of data • but at the cost of a fixed, higher forward channel bandwidth • Usually applied in situations where retransmissions are costly or impossible (e.g., multicast) • Added to mass storage devices to enable recovery of corrupted data (e.g., RAID)
  • 6. Erasure codes • Error correcting code • Transforms a message of k symbols into a longer message with n symbols • The original message can be recovered from a subset (k’) of the n symbols • (Code rate)  r = k/n proportion of the data-stream that is useful • (Reception efficiency)  k’/k
  • 7. Fountain codes • Rateless erasure code • Endless supply of encoded symbols • Recover original data with any K encoded symbols (with high probability) DigitalK Receiver (bucket) Fountain
  • 8. Use case: point-to-multipoint • For a large number of receivers TCP does not scale • every receiver requires a separate data stream • sender needs to keep track of what arrives at each receiver • UDP can be used • scales effortlessly • best effort: loss rate ↑ ⇒ degraded experience • Difficult to provide a scalable broadcast service on the Internet • it would be interesting to have reliability whilst retaining UDP’s efficiency S R2 R1 R4 R3
  • 9. LT code (the first fountain code!) • Based on two random generators • One generates how many XORs should be made • The other generates (the IDs of) which symbols will be XORed • 5%-10% extra symbols are usually needed S : source symbol E : encoding symbol (+ is the XOR operation) E0 = S2 + S4 + S5 E1 = S0 + S1 + S2 E2 = S0 + S3 E3 = S2 E4 = S0 + S5 E5 = S2 + S5 E6 = S1 + S3 + S4 + S5 S0 S5S4S3S2S1 E0 E1 E2 E3 E4 E5 E6
  • 10. Raptor codes (finally!) • Faster encoding/decoding algorithms • Pre-code • Steep overhead-failure probability curve RaptorQ: • Systematic • Faster • Steeper
  • 11. HOW CAN WE USE THIS!?!? Data Partition into Source Blocks Source block i RaptorQ Decoder Source block i Data Reconstruct the data Put in packets & transmit through the network Received Symbols ( ≥ K) Some packets are lost in the network RaptorQ Encoder Source Symbols (K) Repair Generator Repair Symbols (R) Encoding Symbols Can be used as overhead (extra symbols) SENDER RECEIVER
  • 12. How awesome is RaptorQ? Pretty awesome... • Incredibly low probabilities of failure (for accidental faults) K (number of source symbols) 0 Overhead [·10-3] 1 Overhead [·10-5] 2 Overhead [·10-7] Loss 10 26 101 10 26 101 10 26 101 10% 0 5.4 5.7 0 0 3.8 0 0 2.5 20% 0 4.0 4.8 0 2.3 2.4 0 0 0.5 50% 0 3.9 4.9 0 1.6 2.5 0 0.9 1.2 60% 4.8 4.1 4.9 0 1.5 2.2 0 0 2.1 85% 0 12.7 4.7 0 0.8 2.4 0 0 1.3
  • 14. Where to now? • José Lopes, “Communication with RaptorQ Erasure Codes in Malicious Environments”, MSc thesis • José Lopes and Nuno Neves, “Stopping a Rapid Tornado with a Puff” (soon to be IEEE S&P) • The OpenRQ Library (www.lasige.di.fc.ul.pt/openrq) • Amin Shokrollahi, "Raptor codes”, IEEE Transactions on Information Theory 52.6 (2006): 2551-2567. • Amin Shokrollahi and Michael Luby, “Raptor Codes” Now Publishers Inc 2011 • IETF RFC6330
  • 15. RAPTOR CODES José Lopes (please call me Sá) @zemanelsa Thank you! Any questions?