SlideShare a Scribd company logo
1 of 13
Download to read offline
DS – Decentralized Systems



               A Survey on
Large-Scale Decentralized Storage Systems
              to be used by
      Volunteer Computing Systems

    Umit Cavus Buyuksahin   ucbuyuksahin@gmail.com
    Maria Stylianou         marsty5@gmail.com
    Nicos Demetriou         nicosdem7@gmail.com
    Muhammad Adnan Khan     malikadnan78@gmail.com
Outline
●   Introduction
    ●   Large-Scale Decentralized Storage Systems
    ●   Volunteer Computing Systems


●   Main Common Characteristics

●   Most Suitable System

●   Summary                                         2
Introduction
      Storage Systems               Volunteer
      → Store data from             Computing Systems
      computations of               → Volunteers offer
      Distributed Systems           unused storage &
      → Need for more               resources
      storage!
               Researchers from SS turn to:
               → Unused storage
               → Volunteer Computing Systems             3
DS – Decentralized Systems
Main Common Characteristics
   ●   Symmetry              peers at the same level

   ●   Scalability           regarding # of nodes


   ●   Anonymity             keep identity secret


   ●   Availability          data reachable

   ●   Robustness            recovery after failures
                                                       4
DS – Decentralized Systems
Examined Decentralized Systems
   ●   FreeHaven                     ●   Riak
   ●   FreeNet                       ●   Dynamo
                             Umit                       Adnan
   ●   Ivy                           ●   MongoDB
   ●   Frangipani                    ●   BigTable
   ●   Ceph                          ●   Pastis
   ●   OceanStore                    ●   Storage@home
                             Nicos                      Maria
   ●   Antiquity                     ●   Farsite
   ●   TFS                           ●   TotalRecall
                                                                5
DS – Decentralized Systems
Symmetry
       Not Symmetric Systems
        Frangipani
         Antiquity
                                Have an administrator
         BigTable
         Farsite

        OceanStore
        MongoDB                 Have different roles
        TotalRecall
                                                        6
DS – Decentralized Systems
Scalability
       Systems with Limited Scalability

         FreeHaven
                                 Limited Scalability
         Ivy
                                 by design
         Farsite


      Best System: Ceph

                                                       7
DS – Decentralized Systems
Anonymity
       Systems with Anonymity

         FreeHaven
         FreeNet                   Addressed as
                                   a main issue
         Storage@Home




                                                  8
DS – Decentralized Systems
Availability
       Systems with Medium Level Availability

         FreeHaven
                                No replication mechanism
         FreeNet




      Best System: TotalRecall

                                                           9
DS – Decentralized Systems
Robustness
       All Systems are Robust
       FreeHaven → Buddy System
       Antiquity             → Quorum Repair
       Pastis                → Based on its Storage Layer
       FarSite               → Handle Byzantine Faults


       The rest:
       → Fault Tolerance Service, Repair Mechanisms
                                                            10
DS – Decentralized Systems
Most Suitable System:
                  Storage@home
     ●   Typical volunteer computing model
     ●   Participants
         ●   Act as volunteers
         ●   Install an agent on their machine
         ●   Compete & Gain points based on
             contribution in storage & recruitment process

     ●   DSS characteristics → Satisfied!
     ●   VCS requirements → Satisfied!
                                                             11
DS – Decentralized Systems
Summary
     ●   DSS & VCS have common characteristics
         – Symmetry          – Scalability – Anonymity
         – Availability      – Robustness

     ●   Storage@home has everything!




                                                         12
DS – Decentralized Systems
DS – Decentralized Systems



               A Survey on
Large-Scale Decentralized Storage Systems
              to be used by
      Volunteer Computing Systems

    Umit Cavus Buyuksahin   ucbuyuksahin@gmail.com
    Maria Stylianou         marsty5@gmail.com
    Nicos Demetriou         nicosdem7@gmail.com
    Muhammad Adnan Khan     malikadnan78@gmail.com

More Related Content

Viewers also liked

EEDC - Why use of REST for Web Services
EEDC - Why use of REST for Web Services EEDC - Why use of REST for Web Services
EEDC - Why use of REST for Web Services Maria Stylianou
 
A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer...
A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer...A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer...
A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer...Maria Stylianou
 
How Companies Learn Your Secrets
How Companies Learn Your SecretsHow Companies Learn Your Secrets
How Companies Learn Your SecretsMaria Stylianou
 
Automatic Energy-based Scheduling
Automatic Energy-based SchedulingAutomatic Energy-based Scheduling
Automatic Energy-based SchedulingMaria Stylianou
 
SPARJA: a Distributed Social Graph Partitioning and Replication Middleware
SPARJA: a Distributed Social Graph Partitioning and Replication MiddlewareSPARJA: a Distributed Social Graph Partitioning and Replication Middleware
SPARJA: a Distributed Social Graph Partitioning and Replication MiddlewareMaria Stylianou
 
Performance Analysis of multithreaded applications based on Hardware Simulati...
Performance Analysis of multithreaded applications based on Hardware Simulati...Performance Analysis of multithreaded applications based on Hardware Simulati...
Performance Analysis of multithreaded applications based on Hardware Simulati...Maria Stylianou
 
Data Streaming with Apache Kafka & MongoDB
Data Streaming with Apache Kafka & MongoDBData Streaming with Apache Kafka & MongoDB
Data Streaming with Apache Kafka & MongoDBconfluent
 
Apache kafka-a distributed streaming platform
Apache kafka-a distributed streaming platformApache kafka-a distributed streaming platform
Apache kafka-a distributed streaming platformconfluent
 

Viewers also liked (11)

EEDC - Why use of REST for Web Services
EEDC - Why use of REST for Web Services EEDC - Why use of REST for Web Services
EEDC - Why use of REST for Web Services
 
A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer...
A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer...A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer...
A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer...
 
How Companies Learn Your Secrets
How Companies Learn Your SecretsHow Companies Learn Your Secrets
How Companies Learn Your Secrets
 
Pregel - Paper Review
Pregel - Paper ReviewPregel - Paper Review
Pregel - Paper Review
 
Erlang in 10 minutes
Erlang in 10 minutesErlang in 10 minutes
Erlang in 10 minutes
 
Automatic Energy-based Scheduling
Automatic Energy-based SchedulingAutomatic Energy-based Scheduling
Automatic Energy-based Scheduling
 
SPARJA: a Distributed Social Graph Partitioning and Replication Middleware
SPARJA: a Distributed Social Graph Partitioning and Replication MiddlewareSPARJA: a Distributed Social Graph Partitioning and Replication Middleware
SPARJA: a Distributed Social Graph Partitioning and Replication Middleware
 
Google's Dremel
Google's DremelGoogle's Dremel
Google's Dremel
 
Performance Analysis of multithreaded applications based on Hardware Simulati...
Performance Analysis of multithreaded applications based on Hardware Simulati...Performance Analysis of multithreaded applications based on Hardware Simulati...
Performance Analysis of multithreaded applications based on Hardware Simulati...
 
Data Streaming with Apache Kafka & MongoDB
Data Streaming with Apache Kafka & MongoDBData Streaming with Apache Kafka & MongoDB
Data Streaming with Apache Kafka & MongoDB
 
Apache kafka-a distributed streaming platform
Apache kafka-a distributed streaming platformApache kafka-a distributed streaming platform
Apache kafka-a distributed streaming platform
 

Recently uploaded

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptxHampshireHUG
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationRadu Cotescu
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountPuma Security, LLC
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slidevu2urc
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024The Digital Insurer
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking MenDelhi Call girls
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024Rafal Los
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking MenDelhi Call girls
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationMichael W. Hawkins
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...Neo4j
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Igalia
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEarley Information Science
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024Results
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonetsnaman860154
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationSafe Software
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdfhans926745
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsRoshan Dwivedi
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreternaman860154
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure servicePooja Nehwal
 

Recently uploaded (20)

How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
04-2024-HHUG-Sales-and-Marketing-Alignment.pptx
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
Breaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path MountBreaking the Kubernetes Kill Chain: Host Path Mount
Breaking the Kubernetes Kill Chain: Host Path Mount
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024Finology Group – Insurtech Innovation Award 2024
Finology Group – Insurtech Innovation Award 2024
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
GenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day PresentationGenCyber Cyber Security Day Presentation
GenCyber Cyber Security Day Presentation
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptxEIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
EIS-Webinar-Prompt-Knowledge-Eng-2024-04-08.pptx
 
A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024A Call to Action for Generative AI in 2024
A Call to Action for Generative AI in 2024
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf[2024]Digital Global Overview Report 2024 Meltwater.pdf
[2024]Digital Global Overview Report 2024 Meltwater.pdf
 
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live StreamsTop 5 Benefits OF Using Muvi Live Paywall For Live Streams
Top 5 Benefits OF Using Muvi Live Paywall For Live Streams
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure serviceWhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
WhatsApp 9892124323 ✓Call Girls In Kalyan ( Mumbai ) secure service
 

Decentralized Storage Systems in Volunteer Computing Systems

  • 1. DS – Decentralized Systems A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer Computing Systems Umit Cavus Buyuksahin ucbuyuksahin@gmail.com Maria Stylianou marsty5@gmail.com Nicos Demetriou nicosdem7@gmail.com Muhammad Adnan Khan malikadnan78@gmail.com
  • 2. Outline ● Introduction ● Large-Scale Decentralized Storage Systems ● Volunteer Computing Systems ● Main Common Characteristics ● Most Suitable System ● Summary 2
  • 3. Introduction Storage Systems Volunteer → Store data from Computing Systems computations of → Volunteers offer Distributed Systems unused storage & → Need for more resources storage! Researchers from SS turn to: → Unused storage → Volunteer Computing Systems 3 DS – Decentralized Systems
  • 4. Main Common Characteristics ● Symmetry peers at the same level ● Scalability regarding # of nodes ● Anonymity keep identity secret ● Availability data reachable ● Robustness recovery after failures 4 DS – Decentralized Systems
  • 5. Examined Decentralized Systems ● FreeHaven ● Riak ● FreeNet ● Dynamo Umit Adnan ● Ivy ● MongoDB ● Frangipani ● BigTable ● Ceph ● Pastis ● OceanStore ● Storage@home Nicos Maria ● Antiquity ● Farsite ● TFS ● TotalRecall 5 DS – Decentralized Systems
  • 6. Symmetry Not Symmetric Systems Frangipani Antiquity Have an administrator BigTable Farsite OceanStore MongoDB Have different roles TotalRecall 6 DS – Decentralized Systems
  • 7. Scalability Systems with Limited Scalability FreeHaven Limited Scalability Ivy by design Farsite Best System: Ceph 7 DS – Decentralized Systems
  • 8. Anonymity Systems with Anonymity FreeHaven FreeNet Addressed as a main issue Storage@Home 8 DS – Decentralized Systems
  • 9. Availability Systems with Medium Level Availability FreeHaven No replication mechanism FreeNet Best System: TotalRecall 9 DS – Decentralized Systems
  • 10. Robustness All Systems are Robust FreeHaven → Buddy System Antiquity → Quorum Repair Pastis → Based on its Storage Layer FarSite → Handle Byzantine Faults The rest: → Fault Tolerance Service, Repair Mechanisms 10 DS – Decentralized Systems
  • 11. Most Suitable System: Storage@home ● Typical volunteer computing model ● Participants ● Act as volunteers ● Install an agent on their machine ● Compete & Gain points based on contribution in storage & recruitment process ● DSS characteristics → Satisfied! ● VCS requirements → Satisfied! 11 DS – Decentralized Systems
  • 12. Summary ● DSS & VCS have common characteristics – Symmetry – Scalability – Anonymity – Availability – Robustness ● Storage@home has everything! 12 DS – Decentralized Systems
  • 13. DS – Decentralized Systems A Survey on Large-Scale Decentralized Storage Systems to be used by Volunteer Computing Systems Umit Cavus Buyuksahin ucbuyuksahin@gmail.com Maria Stylianou marsty5@gmail.com Nicos Demetriou nicosdem7@gmail.com Muhammad Adnan Khan malikadnan78@gmail.com