SlideShare uma empresa Scribd logo
1 de 13
SIYAPATH
P2P, Gossip Based Volunteer Computing Framework
RISING DEMAND FOR
HIGH COMPUTATIONAL POWER

 Simulations
 Analysis of large data from optical telescopes
 Gene sequencers
 Gravitational wave detectors
 Edge-detection for high resolution medical
  image sequences
 Biology-inspired algorithms

2
                             National Best Quality Software Awards, Sri Lanka - 2012
HOW TO ADDRESS?
 Supercomputing
 Distributed Computing
     Cluster Computing
     Grid/Desktop-Grid Computing
     Volunteer Computing




3
                                National Best Quality Software Awards, Sri Lanka - 2012
EXISTING VOLUNTEER
COMPUTING FRAMEWORKS
 Client Server Architecture
     Server bottleneck
     Single point of failure
 Complexity of Configuring




4
                                National Best Quality Software Awards, Sri Lanka - 2012
INTRODUCING SIYAPATH
 P2P Architecture
     Absence of server bottleneck
     Absence of single point of failure
 Gossip Protocols
     Scalability
     Robustness
     Reliability
 Simplicity in Configuring

5
                                     National Best Quality Software Awards, Sri Lanka - 2012
FEATURES
 Job Submission
 Job Scheduling      User                       Job Processor



 Task Distribution
 Task Processing
 Result Validation
 Result Delivery
                                          Task           Task           Task

 Fault Tolerance                       Processor      Processor      Processor



 Security
6
                             National Best Quality Software Awards, Sri Lanka - 2012
DEMONSTRATION



7
            National Best Quality Software Awards, Sri Lanka - 2012
PERFORMANCE TESTING
Test                                                     1            2                                    3                    4             5
Users                                                    5           10                                    15                  20            25
Volunteers                                              30           30                                    30                  30            30
Avg. Response Time (s)                                 52.16        89.63                              136.29               211.02          249.25
Avg. Throughput (Tasks per                             126.76       136.45                             130.03               109.49          125.96
minute)


                               Average Response Time                                                            Average Throughput

                     300                                                                         160

                     250                                                                         140
                                                                                                 120
                                                                             Tasks per minute
    Time (seconds)




                     200
                                                                                                 100
                     150                                                                          80
                     100                                                                          60
                                                                                                  40
                     50
                                                                                                  20
                       0                                                                           0
                           1      2             3         4     5                                      1           2             3      4            5
8                                              Test
                                                                                                National Best Quality Software Awards, Sri Lanka - 2012
                                                                                                                            Test
BEST PRACTICES
 Version control system
 Build Automation
 Unit / Integrated testing
 Logging
 Continuous Integration
 User friendly Website




9
                              National Best Quality Software Awards, Sri Lanka - 2012
OPEN SOURCE COMPONENTS
  Services Framework - Apache Thrift
    Communication via a service interface
    Addresses implementation details of the network
    P2P nature using thrift client/server

  System Monitoring – SIGAR
  Apache Maven
  Apache Log4j




10
                                      National Best Quality Software Awards, Sri Lanka - 2012
DOCUMENTATION
  User manuals for the framework
  User API Docs
  Research publications
  Project Website




11
                           National Best Quality Software Awards, Sri Lanka - 2012
TEAM
  Members:
      Amila Manoj Silva
      Nadeeshani Hewage
      Mohamed Nufail
      Malith Dhanushka



  Supervisors:
      Dr. Srinath Perera
      Mrs. Vishakha Nanayakkara
12
                                   National Best Quality Software Awards, Sri Lanka - 2012
Questions?
     Thank You!



13
            National Best Quality Software Awards, Sri Lanka - 2012

Mais conteúdo relacionado

Semelhante a Siyapath - A P2P, Gossip Based Volunteer Computing Framework

Performance testslideshowrecent
Performance testslideshowrecentPerformance testslideshowrecent
Performance testslideshowrecent
Future Simmons
 
A Declarative Approach for Performance Tests Execution in Continuous Software...
A Declarative Approach for Performance Tests Execution in Continuous Software...A Declarative Approach for Performance Tests Execution in Continuous Software...
A Declarative Approach for Performance Tests Execution in Continuous Software...
Vincenzo Ferme
 
Vs2010 alm overview 22nd march
Vs2010 alm overview 22nd marchVs2010 alm overview 22nd march
Vs2010 alm overview 22nd march
Spiffy
 

Semelhante a Siyapath - A P2P, Gossip Based Volunteer Computing Framework (20)

Auto sre with keptn
Auto sre with keptnAuto sre with keptn
Auto sre with keptn
 
Performance testslideshowrecent
Performance testslideshowrecentPerformance testslideshowrecent
Performance testslideshowrecent
 
A Declarative Approach for Performance Tests Execution in Continuous Software...
A Declarative Approach for Performance Tests Execution in Continuous Software...A Declarative Approach for Performance Tests Execution in Continuous Software...
A Declarative Approach for Performance Tests Execution in Continuous Software...
 
Vs2010 alm overview 22nd march
Vs2010 alm overview 22nd marchVs2010 alm overview 22nd march
Vs2010 alm overview 22nd march
 
COLO: COarse-grain LOck-stepping Virtual Machines for Non-stop Service
COLO: COarse-grain LOck-stepping Virtual Machines for Non-stop ServiceCOLO: COarse-grain LOck-stepping Virtual Machines for Non-stop Service
COLO: COarse-grain LOck-stepping Virtual Machines for Non-stop Service
 
Introduction to Performance Testing Part 1
Introduction to Performance Testing Part 1Introduction to Performance Testing Part 1
Introduction to Performance Testing Part 1
 
Whats New In 2010 (Msdn & Visual Studio)
Whats New In 2010 (Msdn & Visual Studio)Whats New In 2010 (Msdn & Visual Studio)
Whats New In 2010 (Msdn & Visual Studio)
 
Sql server 2012 roadshow masd overview 003
Sql server 2012 roadshow masd overview 003Sql server 2012 roadshow masd overview 003
Sql server 2012 roadshow masd overview 003
 
Embracing service-level-objectives of your microservices in your Cl/CD
Embracing service-level-objectives of your microservices in your Cl/CDEmbracing service-level-objectives of your microservices in your Cl/CD
Embracing service-level-objectives of your microservices in your Cl/CD
 
(ATS3-PLAT01) Recent developments in Pipeline Pilot
(ATS3-PLAT01) Recent developments in Pipeline Pilot(ATS3-PLAT01) Recent developments in Pipeline Pilot
(ATS3-PLAT01) Recent developments in Pipeline Pilot
 
Performance Testing of eLearning Portal- A case study by Oak Systems Pvt Ltd
Performance Testing of eLearning Portal- A case study by Oak Systems Pvt LtdPerformance Testing of eLearning Portal- A case study by Oak Systems Pvt Ltd
Performance Testing of eLearning Portal- A case study by Oak Systems Pvt Ltd
 
SharePoint 2010's Virtual Reality - SPC2C
SharePoint 2010's Virtual Reality - SPC2CSharePoint 2010's Virtual Reality - SPC2C
SharePoint 2010's Virtual Reality - SPC2C
 
T3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of ExcellenceT3 Consortium's Performance Center of Excellence
T3 Consortium's Performance Center of Excellence
 
Turbocharge Your Automation Framework to Shorten Regression Execution Time
Turbocharge Your Automation Framework to Shorten Regression Execution TimeTurbocharge Your Automation Framework to Shorten Regression Execution Time
Turbocharge Your Automation Framework to Shorten Regression Execution Time
 
ALM with TFS 2010
ALM with TFS 2010ALM with TFS 2010
ALM with TFS 2010
 
SQL Anywhere Tips and Tricks
SQL Anywhere Tips and TricksSQL Anywhere Tips and Tricks
SQL Anywhere Tips and Tricks
 
Online examination system
Online examination systemOnline examination system
Online examination system
 
White Paper: xDesign Online Editor & API Performance Benchmark Summary
White Paper: xDesign Online Editor & API Performance Benchmark Summary   White Paper: xDesign Online Editor & API Performance Benchmark Summary
White Paper: xDesign Online Editor & API Performance Benchmark Summary
 
SharePoint 2010's Virtual Reality
SharePoint 2010's Virtual RealitySharePoint 2010's Virtual Reality
SharePoint 2010's Virtual Reality
 
Lap Around Visual Studio 2010 Ultimate And TFS 2010
Lap Around Visual Studio 2010 Ultimate And TFS 2010Lap Around Visual Studio 2010 Ultimate And TFS 2010
Lap Around Visual Studio 2010 Ultimate And TFS 2010
 

Último

Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
vu2urc
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 

Último (20)

ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...Workshop - Best of Both Worlds_ Combine  KG and Vector search for  enhanced R...
Workshop - Best of Both Worlds_ Combine KG and Vector search for enhanced R...
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Histor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slideHistor y of HAM Radio presentation slide
Histor y of HAM Radio presentation slide
 
Evaluating the top large language models.pdf
Evaluating the top large language models.pdfEvaluating the top large language models.pdf
Evaluating the top large language models.pdf
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024Axa Assurance Maroc - Insurer Innovation Award 2024
Axa Assurance Maroc - Insurer Innovation Award 2024
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men08448380779 Call Girls In Friends Colony Women Seeking Men
08448380779 Call Girls In Friends Colony Women Seeking Men
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
Presentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreterPresentation on how to chat with PDF using ChatGPT code interpreter
Presentation on how to chat with PDF using ChatGPT code interpreter
 
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
Apidays Singapore 2024 - Building Digital Trust in a Digital Economy by Veron...
 
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men08448380779 Call Girls In Greater Kailash - I Women Seeking Men
08448380779 Call Girls In Greater Kailash - I Women Seeking Men
 
Scaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organizationScaling API-first – The story of a global engineering organization
Scaling API-first – The story of a global engineering organization
 
CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
Handwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed textsHandwritten Text Recognition for manuscripts and early printed texts
Handwritten Text Recognition for manuscripts and early printed texts
 

Siyapath - A P2P, Gossip Based Volunteer Computing Framework

  • 1. SIYAPATH P2P, Gossip Based Volunteer Computing Framework
  • 2. RISING DEMAND FOR HIGH COMPUTATIONAL POWER  Simulations  Analysis of large data from optical telescopes  Gene sequencers  Gravitational wave detectors  Edge-detection for high resolution medical image sequences  Biology-inspired algorithms 2 National Best Quality Software Awards, Sri Lanka - 2012
  • 3. HOW TO ADDRESS?  Supercomputing  Distributed Computing  Cluster Computing  Grid/Desktop-Grid Computing  Volunteer Computing 3 National Best Quality Software Awards, Sri Lanka - 2012
  • 4. EXISTING VOLUNTEER COMPUTING FRAMEWORKS  Client Server Architecture  Server bottleneck  Single point of failure  Complexity of Configuring 4 National Best Quality Software Awards, Sri Lanka - 2012
  • 5. INTRODUCING SIYAPATH  P2P Architecture  Absence of server bottleneck  Absence of single point of failure  Gossip Protocols  Scalability  Robustness  Reliability  Simplicity in Configuring 5 National Best Quality Software Awards, Sri Lanka - 2012
  • 6. FEATURES  Job Submission  Job Scheduling User Job Processor  Task Distribution  Task Processing  Result Validation  Result Delivery Task Task Task  Fault Tolerance Processor Processor Processor  Security 6 National Best Quality Software Awards, Sri Lanka - 2012
  • 7. DEMONSTRATION 7 National Best Quality Software Awards, Sri Lanka - 2012
  • 8. PERFORMANCE TESTING Test 1 2 3 4 5 Users 5 10 15 20 25 Volunteers 30 30 30 30 30 Avg. Response Time (s) 52.16 89.63 136.29 211.02 249.25 Avg. Throughput (Tasks per 126.76 136.45 130.03 109.49 125.96 minute) Average Response Time Average Throughput 300 160 250 140 120 Tasks per minute Time (seconds) 200 100 150 80 100 60 40 50 20 0 0 1 2 3 4 5 1 2 3 4 5 8 Test National Best Quality Software Awards, Sri Lanka - 2012 Test
  • 9. BEST PRACTICES  Version control system  Build Automation  Unit / Integrated testing  Logging  Continuous Integration  User friendly Website 9 National Best Quality Software Awards, Sri Lanka - 2012
  • 10. OPEN SOURCE COMPONENTS  Services Framework - Apache Thrift  Communication via a service interface  Addresses implementation details of the network  P2P nature using thrift client/server  System Monitoring – SIGAR  Apache Maven  Apache Log4j 10 National Best Quality Software Awards, Sri Lanka - 2012
  • 11. DOCUMENTATION  User manuals for the framework  User API Docs  Research publications  Project Website 11 National Best Quality Software Awards, Sri Lanka - 2012
  • 12. TEAM  Members:  Amila Manoj Silva  Nadeeshani Hewage  Mohamed Nufail  Malith Dhanushka  Supervisors:  Dr. Srinath Perera  Mrs. Vishakha Nanayakkara 12 National Best Quality Software Awards, Sri Lanka - 2012
  • 13. Questions? Thank You! 13 National Best Quality Software Awards, Sri Lanka - 2012

Notas do Editor

  1. Computational modeling - generate accurate models of the structures of crystalline and amorphous solidsClimate simulations model the past and future global climate with input from observational data and mathematical models. Advanced computational techniques and computer capabilities allow researchers to increase the resolution and refine the grids for climate simulations that enable better regional and global predictions.Bio-inspired algorithms such as genetic and evolutionary algorithms, ant colonies, and immune systems are routinely applied to hard and large problems in a variety of areas. Some examples are optimization through genetic algorithms, new ideas for developing routing algorithms in wireless networks inspired by honey bee behaviour, resource discovery and data mining computations in Grid and P2P frameworks achieved by ant-inspired algorithms, and so on.
  2. Computational power volunteered by general publicLarge resource poolself-financing / self-maintainingVolunteer Computing FrameworksExisting frameworksBOINCBayanihanJADIF
  3. Task scheduling/distribution > interface – priority, securityTask processing > iface – any kind of task, different tasks