SlideShare uma empresa Scribd logo
1 de 14
ICS 691:
             WattDepot 2.0 and
            Project Opportunities


                       Robert Brewer
     Collaborative Software Development Laboratory
       Dept of Information and Computer Sciences
              University of Hawaii at Manoa
                 http://www.kukuicup.org/
1)
Quickie Quiz!




     What are the 3 architectural components of
     WattDepot?




2)
Quickie Quiz Answer

                         WattDepot                             WattDepot
     Devices    Meters    Sensors                               Clients

                                            WattDepot
                                             Server

                                     HTTP
                                                        HTTP




3)
WattDepot 2.0
     Paper was written in early 2010
      • 11 releases since then
      • 2 years is a long time

     Outline of talk
     • What’s new since paper
     • Exciting project opportunities!

     Credit
     • Andrea Connell made WattDepot 2.0 happen

4)
New for Developers
     Source control
      • svn -> git

     Build system
     • Ant -> Maven

     Many new library updates
     • Restlet 2.1RC5



5)
New for Client Developers
     REST API
     • Fully implemented (finally)
     • New conveniences for client developers

     Google visualization integrated into REST API
     • Now listens on just 1 port




6)
New for End Users (Server)
     New storage backends
      • BerkeleyDB (George Lee)
      • PostgreSQL (Andrea Connell)
     Ephemeral data storage
      • Cache high frequency data
      • Persist to disk at lower frequency
     Cloud-enabled
      • Can (almost) be run on Heroku
     Load tested
      • Though more can be done

7)
New for End Users (Client)
     New sensors
     • Shark 200S meter
     • eGauge meter

     Sensor improvements
      • Multithreaded sensors
      • Can “embed” sensors in server process




8)
Project Ideas




9)
WattDepot Apps 2.0
      WattDepot lacks good UI
      • Timeline & monitor viz in separate app
      • No CRUD for users & sources!
      • Poor user experience

      Create a Single Page Application
       • Serve up static HTML/JS/CSS from WD server
       • Now it’s built in
      Features
       • Timeline, monitor viz
       • Also CRUD for users, sources, sensordata
10)
WattDepot in the Cloud
      Technically works on Heroku
      Many practical issues
       • Configuring sensors
       • Port problem
      Frontend tightly coupled to backend
       • Can’t just ramp up frontend processes

      Make WattDepot cloudirific
      • Solve practical issues
      • Decouple frontend from backend
      • Maybe explore other cloud providers?
11)
Supercharge WattDepot
      Performance adequate for Kukui Cup
       • Much room for improvement
       • Many parameters & layers to tweak

      Characterize current performance
       • Different backends, paramters, local vs cloud
      Profile system
       • Where are the bottlenecks
      Supercharge!
       • Fix bottlenecks
       • Measure performance improvement
12)
Environmental Data Support
      Currently focused on energy
      • What about water use?
      • Environmental data: temp, humidity, wind

      Support additional data types
       • How to generalize REST API?
       • What value add does WD provide?
       • What does this mean for backends?



13)
PostgreSQL Improvements
      Implement properties as hstore
       • Arbitrary key-value storage in Postgres




14)

Mais conteúdo relacionado

Mais procurados

DockerCon EU 2015: Production Ready Containers from IBM and Docker
DockerCon EU 2015: Production Ready Containers from IBM and DockerDockerCon EU 2015: Production Ready Containers from IBM and Docker
DockerCon EU 2015: Production Ready Containers from IBM and Docker
Docker, Inc.
 

Mais procurados (20)

How Kubernetes make OpenStack & Ceph better
How Kubernetes make OpenStack & Ceph betterHow Kubernetes make OpenStack & Ceph better
How Kubernetes make OpenStack & Ceph better
 
SUSE CaaSP: deploy OpenFaaS and Ethereum Blockchain on Kubernetes
SUSE CaaSP: deploy OpenFaaS and Ethereum Blockchain on KubernetesSUSE CaaSP: deploy OpenFaaS and Ethereum Blockchain on Kubernetes
SUSE CaaSP: deploy OpenFaaS and Ethereum Blockchain on Kubernetes
 
Gdg izmir kubernetes
Gdg izmir kubernetesGdg izmir kubernetes
Gdg izmir kubernetes
 
Aks pimarox from zero to hero
Aks pimarox from zero to heroAks pimarox from zero to hero
Aks pimarox from zero to hero
 
Bitfusion Overview Tensorflow Meetup
Bitfusion Overview Tensorflow MeetupBitfusion Overview Tensorflow Meetup
Bitfusion Overview Tensorflow Meetup
 
AKS
AKSAKS
AKS
 
Working with kubernetes
Working with kubernetesWorking with kubernetes
Working with kubernetes
 
KEDA Overview
KEDA OverviewKEDA Overview
KEDA Overview
 
Kubernetes Presentation
Kubernetes PresentationKubernetes Presentation
Kubernetes Presentation
 
Stateful set in kubernetes implementation & usecases
Stateful set in kubernetes implementation & usecases Stateful set in kubernetes implementation & usecases
Stateful set in kubernetes implementation & usecases
 
Kafka for begginer
Kafka for begginerKafka for begginer
Kafka for begginer
 
One cluster to serve them all
One cluster to serve them allOne cluster to serve them all
One cluster to serve them all
 
Spark day 2017 - Spark on Kubernetes
Spark day 2017 - Spark on KubernetesSpark day 2017 - Spark on Kubernetes
Spark day 2017 - Spark on Kubernetes
 
Kubernates : An Small introduction for Beginners by Rajiv Vishwkarma
Kubernates : An Small introduction for Beginners by Rajiv VishwkarmaKubernates : An Small introduction for Beginners by Rajiv Vishwkarma
Kubernates : An Small introduction for Beginners by Rajiv Vishwkarma
 
A Primer on Kubernetes and Google Container Engine
A Primer on Kubernetes and Google Container EngineA Primer on Kubernetes and Google Container Engine
A Primer on Kubernetes and Google Container Engine
 
Cncf event driven autoscaling with keda
Cncf   event driven autoscaling with kedaCncf   event driven autoscaling with keda
Cncf event driven autoscaling with keda
 
K8s monitoring with elk
K8s monitoring with elkK8s monitoring with elk
K8s monitoring with elk
 
Kubernetes - A Short Ride Throught the project and its ecosystem
Kubernetes - A Short Ride Throught the project and its ecosystemKubernetes - A Short Ride Throught the project and its ecosystem
Kubernetes - A Short Ride Throught the project and its ecosystem
 
Managing add-ons across clusters
Managing add-ons across clustersManaging add-ons across clusters
Managing add-ons across clusters
 
DockerCon EU 2015: Production Ready Containers from IBM and Docker
DockerCon EU 2015: Production Ready Containers from IBM and DockerDockerCon EU 2015: Production Ready Containers from IBM and Docker
DockerCon EU 2015: Production Ready Containers from IBM and Docker
 

Destaque

Destaque (7)

WattDepot: A software ecosystem for energy data collection, storage, analysis...
WattDepot: A software ecosystem for energy data collection, storage, analysis...WattDepot: A software ecosystem for energy data collection, storage, analysis...
WattDepot: A software ecosystem for energy data collection, storage, analysis...
 
SocialSense: A System For Social Environment Awareness
SocialSense: A System For Social Environment AwarenessSocialSense: A System For Social Environment Awareness
SocialSense: A System For Social Environment Awareness
 
From Smart Grids to Smart Consumers
From Smart Grids to Smart ConsumersFrom Smart Grids to Smart Consumers
From Smart Grids to Smart Consumers
 
ICS 690 talk: Personal Environmental Trainer
ICS 690 talk: Personal Environmental TrainerICS 690 talk: Personal Environmental Trainer
ICS 690 talk: Personal Environmental Trainer
 
Smart Grid to Smart Consumers (ICS 690)
Smart Grid to Smart Consumers (ICS 690)Smart Grid to Smart Consumers (ICS 690)
Smart Grid to Smart Consumers (ICS 690)
 
Population growth and Natural resources
Population growth and Natural resourcesPopulation growth and Natural resources
Population growth and Natural resources
 
Study: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving CarsStudy: The Future of VR, AR and Self-Driving Cars
Study: The Future of VR, AR and Self-Driving Cars
 

Semelhante a WattDepot 2.0 presentation

Docker Hub: Past, Present and Future by Ken Cochrane & BC Wong
Docker Hub: Past, Present and Future by Ken Cochrane & BC WongDocker Hub: Past, Present and Future by Ken Cochrane & BC Wong
Docker Hub: Past, Present and Future by Ken Cochrane & BC Wong
Docker, Inc.
 
Scaling Hadoop at LinkedIn
Scaling Hadoop at LinkedInScaling Hadoop at LinkedIn
Scaling Hadoop at LinkedIn
DataWorks Summit
 

Semelhante a WattDepot 2.0 presentation (20)

Distributed Data Flow for the Web of Things: Distributed Node-RED
Distributed Data Flow for the Web of Things: Distributed Node-REDDistributed Data Flow for the Web of Things: Distributed Node-RED
Distributed Data Flow for the Web of Things: Distributed Node-RED
 
Asynchronous design with Spring and RTI: 1M events per second
Asynchronous design with Spring and RTI: 1M events per secondAsynchronous design with Spring and RTI: 1M events per second
Asynchronous design with Spring and RTI: 1M events per second
 
Monitoring in a fast-changing world with Prometheus
Monitoring in a fast-changing world with PrometheusMonitoring in a fast-changing world with Prometheus
Monitoring in a fast-changing world with Prometheus
 
Open shift and docker - october,2014
Open shift and docker - october,2014Open shift and docker - october,2014
Open shift and docker - october,2014
 
Iot meets Serverless
Iot meets ServerlessIot meets Serverless
Iot meets Serverless
 
Docker Hub: Past, Present and Future by Ken Cochrane & BC Wong
Docker Hub: Past, Present and Future by Ken Cochrane & BC WongDocker Hub: Past, Present and Future by Ken Cochrane & BC Wong
Docker Hub: Past, Present and Future by Ken Cochrane & BC Wong
 
Scaling Hadoop at LinkedIn
Scaling Hadoop at LinkedInScaling Hadoop at LinkedIn
Scaling Hadoop at LinkedIn
 
Introduction to SignalR
Introduction to SignalRIntroduction to SignalR
Introduction to SignalR
 
Trend Micro Big Data Platform and Apache Bigtop
Trend Micro Big Data Platform and Apache BigtopTrend Micro Big Data Platform and Apache Bigtop
Trend Micro Big Data Platform and Apache Bigtop
 
MongoDB World 2016: Get MEAN and Lean with MongoDB and Kubernetes
MongoDB World 2016: Get MEAN and Lean with MongoDB and KubernetesMongoDB World 2016: Get MEAN and Lean with MongoDB and Kubernetes
MongoDB World 2016: Get MEAN and Lean with MongoDB and Kubernetes
 
HTTP/2 Comes to Java: Servlet 4.0 and what it means for the Java/Jakarta EE e...
HTTP/2 Comes to Java: Servlet 4.0 and what it means for the Java/Jakarta EE e...HTTP/2 Comes to Java: Servlet 4.0 and what it means for the Java/Jakarta EE e...
HTTP/2 Comes to Java: Servlet 4.0 and what it means for the Java/Jakarta EE e...
 
Introduction to Virtual Kubelet
Introduction to Virtual KubeletIntroduction to Virtual Kubelet
Introduction to Virtual Kubelet
 
Containers, microservices and serverless for realists
Containers, microservices and serverless for realistsContainers, microservices and serverless for realists
Containers, microservices and serverless for realists
 
Nodeless and serverless kubernetes
Nodeless and serverless kubernetesNodeless and serverless kubernetes
Nodeless and serverless kubernetes
 
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
Unified Framework for Real Time, Near Real Time and Offline Analysis of Video...
 
Html5 web sockets - Brad Drysdale - London Web 2011-10-20
Html5 web sockets - Brad Drysdale - London Web 2011-10-20Html5 web sockets - Brad Drysdale - London Web 2011-10-20
Html5 web sockets - Brad Drysdale - London Web 2011-10-20
 
56k.cloud training
56k.cloud training56k.cloud training
56k.cloud training
 
Alex Wade, Digital Library Interoperability
Alex Wade, Digital Library InteroperabilityAlex Wade, Digital Library Interoperability
Alex Wade, Digital Library Interoperability
 
Afs manager
Afs managerAfs manager
Afs manager
 
Eric Proegler Oredev Performance Testing in New Contexts
Eric Proegler Oredev Performance Testing in New ContextsEric Proegler Oredev Performance Testing in New Contexts
Eric Proegler Oredev Performance Testing in New Contexts
 

Último

Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
KarakKing
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
ZurliaSoop
 

Último (20)

How to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POSHow to Manage Global Discount in Odoo 17 POS
How to Manage Global Discount in Odoo 17 POS
 
How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17How to Create and Manage Wizard in Odoo 17
How to Create and Manage Wizard in Odoo 17
 
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptxBasic Civil Engineering first year Notes- Chapter 4 Building.pptx
Basic Civil Engineering first year Notes- Chapter 4 Building.pptx
 
Salient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functionsSalient Features of India constitution especially power and functions
Salient Features of India constitution especially power and functions
 
This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.This PowerPoint helps students to consider the concept of infinity.
This PowerPoint helps students to consider the concept of infinity.
 
Understanding Accommodations and Modifications
Understanding  Accommodations and ModificationsUnderstanding  Accommodations and Modifications
Understanding Accommodations and Modifications
 
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
Beyond_Borders_Understanding_Anime_and_Manga_Fandom_A_Comprehensive_Audience_...
 
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
Jual Obat Aborsi Hongkong ( Asli No.1 ) 085657271886 Obat Penggugur Kandungan...
 
Application orientated numerical on hev.ppt
Application orientated numerical on hev.pptApplication orientated numerical on hev.ppt
Application orientated numerical on hev.ppt
 
Interdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptxInterdisciplinary_Insights_Data_Collection_Methods.pptx
Interdisciplinary_Insights_Data_Collection_Methods.pptx
 
Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)Jamworks pilot and AI at Jisc (20/03/2024)
Jamworks pilot and AI at Jisc (20/03/2024)
 
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
Sensory_Experience_and_Emotional_Resonance_in_Gabriel_Okaras_The_Piano_and_Th...
 
Graduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - EnglishGraduate Outcomes Presentation Slides - English
Graduate Outcomes Presentation Slides - English
 
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
80 ĐỀ THI THỬ TUYỂN SINH TIẾNG ANH VÀO 10 SỞ GD – ĐT THÀNH PHỐ HỒ CHÍ MINH NĂ...
 
FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024FSB Advising Checklist - Orientation 2024
FSB Advising Checklist - Orientation 2024
 
How to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptxHow to setup Pycharm environment for Odoo 17.pptx
How to setup Pycharm environment for Odoo 17.pptx
 
How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17How to Add New Custom Addons Path in Odoo 17
How to Add New Custom Addons Path in Odoo 17
 
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptxHMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
HMCS Vancouver Pre-Deployment Brief - May 2024 (Web Version).pptx
 
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptxExploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
Exploring_the_Narrative_Style_of_Amitav_Ghoshs_Gun_Island.pptx
 
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptxOn_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
On_Translating_a_Tamil_Poem_by_A_K_Ramanujan.pptx
 

WattDepot 2.0 presentation

  • 1. ICS 691: WattDepot 2.0 and Project Opportunities Robert Brewer Collaborative Software Development Laboratory Dept of Information and Computer Sciences University of Hawaii at Manoa http://www.kukuicup.org/ 1)
  • 2. Quickie Quiz! What are the 3 architectural components of WattDepot? 2)
  • 3. Quickie Quiz Answer WattDepot WattDepot Devices Meters Sensors Clients WattDepot Server HTTP HTTP 3)
  • 4. WattDepot 2.0 Paper was written in early 2010 • 11 releases since then • 2 years is a long time Outline of talk • What’s new since paper • Exciting project opportunities! Credit • Andrea Connell made WattDepot 2.0 happen 4)
  • 5. New for Developers Source control • svn -> git Build system • Ant -> Maven Many new library updates • Restlet 2.1RC5 5)
  • 6. New for Client Developers REST API • Fully implemented (finally) • New conveniences for client developers Google visualization integrated into REST API • Now listens on just 1 port 6)
  • 7. New for End Users (Server) New storage backends • BerkeleyDB (George Lee) • PostgreSQL (Andrea Connell) Ephemeral data storage • Cache high frequency data • Persist to disk at lower frequency Cloud-enabled • Can (almost) be run on Heroku Load tested • Though more can be done 7)
  • 8. New for End Users (Client) New sensors • Shark 200S meter • eGauge meter Sensor improvements • Multithreaded sensors • Can “embed” sensors in server process 8)
  • 10. WattDepot Apps 2.0 WattDepot lacks good UI • Timeline & monitor viz in separate app • No CRUD for users & sources! • Poor user experience Create a Single Page Application • Serve up static HTML/JS/CSS from WD server • Now it’s built in Features • Timeline, monitor viz • Also CRUD for users, sources, sensordata 10)
  • 11. WattDepot in the Cloud Technically works on Heroku Many practical issues • Configuring sensors • Port problem Frontend tightly coupled to backend • Can’t just ramp up frontend processes Make WattDepot cloudirific • Solve practical issues • Decouple frontend from backend • Maybe explore other cloud providers? 11)
  • 12. Supercharge WattDepot Performance adequate for Kukui Cup • Much room for improvement • Many parameters & layers to tweak Characterize current performance • Different backends, paramters, local vs cloud Profile system • Where are the bottlenecks Supercharge! • Fix bottlenecks • Measure performance improvement 12)
  • 13. Environmental Data Support Currently focused on energy • What about water use? • Environmental data: temp, humidity, wind Support additional data types • How to generalize REST API? • What value add does WD provide? • What does this mean for backends? 13)
  • 14. PostgreSQL Improvements Implement properties as hstore • Arbitrary key-value storage in Postgres 14)