SlideShare uma empresa Scribd logo
1 de 27
Welcome to the Webinar

Deploy Big Data Solutions Rapidly in
Cloud through Harbinger’s ABC Model
by Harbinger Systems
Panellists

Dr. Prashant Khambekar

Umesh Kanade

Vice President
Delivery

General Manager
Technology Solutions

Dr. Asheesh Choksi
Solutions Architect

2
Agenda
• Big Data Problem Space

• Harbinger ABC Model
• Case Studies
• Q&A

3
Big Data Paradigm

4
Manageable Data
Variety

Velocity

RDBMS system for data storage
Implementation of Business
logic by Application server
Business features are rendered
by Request/Response model

Volume

5
Big Data
Variety

Velocity

Volume
6
ABC Model

7
Harbinger’s ABC Learning Model

Big Data
A-B-C
Learning

Agile

Cloud
8
ABC Iteration Model

9
Case 1
Volume Space

10
Case 1 - Volume Space : Business Challenges
• Data maintained by Legacy system is not queriable
• Searching for information is becoming pain area as the data size
is growing
• Business wants to connect operational, clinical and financial
properties of each record

• App should support interoperability from multiple platforms
(mobile devices, desktop OS …)
11
Case 1 – ABC in Volume Space
Data Volume
ETL
Hadoop DFS

Search

Multiple Business
needs evolving over
time

AWS EMR

12
Case 1 - Volume Space

ETL
Flat Files, Feeds

Name Node

Secondary
Name Node

Data Nodes
Hadoop API

Map
Reduce

Results

13
Case 1 – Volume Space
Scaling

Hadoop distributed File System

• Map Reduce Jobs for each type of query

Search

Solr based indexing

• De-identification of sensitive information (HIPAA compliance)
• Relevance search

ETL

Data migration from Legacy system

• Custom ETL, Cleaning and Validation of records

14
Case 2
Velocity Space

15
Case 2 - Velocity Space: Business Challenges

Users Bet or Bid on Certain Resources

Sport Events
Live Show on TV…

Application Should Synchronize
Thousands of Users in Real-Time

Application Usage Spikes with Popular Events

16
ABC in Velocity Space
Transaction Velocity
Mongo DB
Redis

Evolving Business
Requirements

Tech POCs

AWS EC2
Real time resource
scale up/down
17
Case 2 - Velocity Space
Notifications Node JS, Socket IO
• Dynamic Synchronization
• Cross browser (HTML 5-based)

Extensibility

Grails, MVC, REST

• Efficient Development
• Support for Mobile

18
Case 3
Variety Space

19
Case 3 - Variety Space: Business Challenges

Relationships:
Structured and un-structured attributes
Recommendations:
Connections and preferences and Discovery

Data Variety: Traditional design approach could be extremely complex

20
Case 3 – Variety Space
Data Variety

Orient DB, PostgreSQL
Graph Structures and
Recommendation Engine

Weekly Builds
Synchronization with
Business

AWS EC2
Scalability, Multi-tenancy
Auto-Scaling, Separate
Schema for accounts
21
Case 3 – Variety Space
Multi-tenancy Cloud + PostgreSQL
• Supports Schemas for Multi-tenancy

Productivity

RoR, Phusion Passenger Server

• Developer Productivity
• Resources exposed with REST APIs

Responsive

D3, SVG, VivaGraph

• Renders scalable vector images in modern browsers

22
Summary

23
Solution Space
Variety
Key Value Store
(NoSQL)
Document based or
Graph database

Velocity
In memory Database
Push (WebSocket)

Volume
Map Reduce
(Hadoop)
24
A-B-C Model Review
Structured,
Unstructured Data
Volume, Velocity,
Variety Analytics

Frequent Builds
Validations/POCs
Re-alignment with business

App Complexity
Resource Scale-up/down
Platform Services
(Security, Backup, Metering)
25
Q&A

26
Thank You!
Visit us at: www.harbinger-systems.com
Write to us at: hsplinfo@harbingergroup.com

Blog: blog.harbinger-systems.com
Twitter: twitter.com/HarbingerSys (@HarbingerSys)
Slideshare: slideshare.net/hsplmkting
Facebook: facebook.com/harbingersys
LinkedIn: linkedin.com/company/382306
27

Mais conteúdo relacionado

Destaque

Engage for Success: Improve Workforce Engagement with Open Communication and ...
Engage for Success: Improve Workforce Engagement with Open Communication and ...Engage for Success: Improve Workforce Engagement with Open Communication and ...
Engage for Success: Improve Workforce Engagement with Open Communication and ...
Harbinger Systems - HRTech Builder of Choice
 
Elements
ElementsElements
Elements
kaa kaa
 
Webinar: How to choose your outsourcing partner for building mobile apps?
Webinar: How to choose your outsourcing partner for building mobile apps?Webinar: How to choose your outsourcing partner for building mobile apps?
Webinar: How to choose your outsourcing partner for building mobile apps?
Harbinger Systems - HRTech Builder of Choice
 
Webinar: Mobile UX: Doing It The Right Way
Webinar: Mobile UX: Doing It The Right WayWebinar: Mobile UX: Doing It The Right Way
Webinar: Mobile UX: Doing It The Right Way
Harbinger Systems - HRTech Builder of Choice
 

Destaque (12)

Create scalable and configurable multi tenancy application
Create scalable and configurable multi tenancy applicationCreate scalable and configurable multi tenancy application
Create scalable and configurable multi tenancy application
 
Webinar: UI/UX best practices in cms based web design
Webinar: UI/UX best practices in cms based web designWebinar: UI/UX best practices in cms based web design
Webinar: UI/UX best practices in cms based web design
 
Engage for Success: Improve Workforce Engagement with Open Communication and ...
Engage for Success: Improve Workforce Engagement with Open Communication and ...Engage for Success: Improve Workforce Engagement with Open Communication and ...
Engage for Success: Improve Workforce Engagement with Open Communication and ...
 
Harbinger Tech Session in cloud Expo 2015- Harnessing the power of linked ope...
Harbinger Tech Session in cloud Expo 2015- Harnessing the power of linked ope...Harbinger Tech Session in cloud Expo 2015- Harnessing the power of linked ope...
Harbinger Tech Session in cloud Expo 2015- Harnessing the power of linked ope...
 
Elements
ElementsElements
Elements
 
Hardware Lab. Andrew Kokhanovskyi. Kaa introduction
Hardware Lab. Andrew Kokhanovskyi. Kaa introductionHardware Lab. Andrew Kokhanovskyi. Kaa introduction
Hardware Lab. Andrew Kokhanovskyi. Kaa introduction
 
Enhancing Unified Communication Experience through Microsoft Lync SDK and UCMA
Enhancing Unified Communication Experience through Microsoft Lync SDK and UCMAEnhancing Unified Communication Experience through Microsoft Lync SDK and UCMA
Enhancing Unified Communication Experience through Microsoft Lync SDK and UCMA
 
Webinar: Structured attestation to meaningful use stage 2
Webinar: Structured attestation to meaningful use stage 2Webinar: Structured attestation to meaningful use stage 2
Webinar: Structured attestation to meaningful use stage 2
 
Webinar: Building amazing web apps rapidly with emerging tech
Webinar: Building amazing web apps rapidly with emerging techWebinar: Building amazing web apps rapidly with emerging tech
Webinar: Building amazing web apps rapidly with emerging tech
 
Webinar: How to choose your outsourcing partner for building mobile apps?
Webinar: How to choose your outsourcing partner for building mobile apps?Webinar: How to choose your outsourcing partner for building mobile apps?
Webinar: How to choose your outsourcing partner for building mobile apps?
 
iOS 8 HealthKit: Driving Smart Health Solutions
iOS 8 HealthKit: Driving Smart Health SolutionsiOS 8 HealthKit: Driving Smart Health Solutions
iOS 8 HealthKit: Driving Smart Health Solutions
 
Webinar: Mobile UX: Doing It The Right Way
Webinar: Mobile UX: Doing It The Right WayWebinar: Mobile UX: Doing It The Right Way
Webinar: Mobile UX: Doing It The Right Way
 

Mais de Harbinger Systems - HRTech Builder of Choice

Mais de Harbinger Systems - HRTech Builder of Choice (20)

Using People Analytics for a Sustainable Remote Workforce
Using People Analytics for a Sustainable Remote WorkforceUsing People Analytics for a Sustainable Remote Workforce
Using People Analytics for a Sustainable Remote Workforce
 
5 Trends That Will Drive the Transformation of EdTech in 2021
5 Trends That Will Drive the Transformation of EdTech in 20215 Trends That Will Drive the Transformation of EdTech in 2021
5 Trends That Will Drive the Transformation of EdTech in 2021
 
Rapidly Transforming Organizational Content into Learning Experiences
Rapidly Transforming Organizational Content into Learning ExperiencesRapidly Transforming Organizational Content into Learning Experiences
Rapidly Transforming Organizational Content into Learning Experiences
 
Scalable HR Integrations for Better Data Analytics: Challenges & Solutions
Scalable HR Integrations for Better Data Analytics: Challenges & SolutionsScalable HR Integrations for Better Data Analytics: Challenges & Solutions
Scalable HR Integrations for Better Data Analytics: Challenges & Solutions
 
5 Key Items HR Should Consider Before Buying HR Technologies
5 Key Items HR Should Consider Before Buying HR Technologies5 Key Items HR Should Consider Before Buying HR Technologies
5 Key Items HR Should Consider Before Buying HR Technologies
 
Best Practices to Build Marketplace-Ready Integrations
Best Practices to Build Marketplace-Ready IntegrationsBest Practices to Build Marketplace-Ready Integrations
Best Practices to Build Marketplace-Ready Integrations
 
HRTech Integration Masterclass Session 4 How to Expand Your Recruitment Datab...
HRTech Integration Masterclass Session 4 How to Expand Your Recruitment Datab...HRTech Integration Masterclass Session 4 How to Expand Your Recruitment Datab...
HRTech Integration Masterclass Session 4 How to Expand Your Recruitment Datab...
 
Recalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
Recalibrating Product Strategy - Addressing Demand Shifts in Existing MarketsRecalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
Recalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
 
How to Gain Key Insights from Data Distributed Across Multiple HR Systems
How to Gain Key Insights from Data Distributed Across Multiple HR SystemsHow to Gain Key Insights from Data Distributed Across Multiple HR Systems
How to Gain Key Insights from Data Distributed Across Multiple HR Systems
 
HRTech Integration Master Class Session 1 -Delivering Seamless Learning Exper...
HRTech Integration Master Class Session 1 -Delivering Seamless Learning Exper...HRTech Integration Master Class Session 1 -Delivering Seamless Learning Exper...
HRTech Integration Master Class Session 1 -Delivering Seamless Learning Exper...
 
Recalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
Recalibrating Product Strategy - Addressing Demand Shifts in Existing MarketsRecalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
Recalibrating Product Strategy - Addressing Demand Shifts in Existing Markets
 
Integrating System of Records and Collaboration Tools
Integrating System of Records and Collaboration ToolsIntegrating System of Records and Collaboration Tools
Integrating System of Records and Collaboration Tools
 
How to Power Your HR Apps With AI And Make It Explainable
How to Power Your HR Apps With AI And Make It ExplainableHow to Power Your HR Apps With AI And Make It Explainable
How to Power Your HR Apps With AI And Make It Explainable
 
Chatbot for Continuous Performance Management
Chatbot for Continuous Performance Management Chatbot for Continuous Performance Management
Chatbot for Continuous Performance Management
 
Leveraging mobile capabilities in your HR application
Leveraging mobile capabilities in your HR applicationLeveraging mobile capabilities in your HR application
Leveraging mobile capabilities in your HR application
 
Automate HR applications using AI and ML
Automate HR applications using AI and MLAutomate HR applications using AI and ML
Automate HR applications using AI and ML
 
A Cloud-based Collaborative Learning and Coaching Platform
A Cloud-based Collaborative Learning and Coaching PlatformA Cloud-based Collaborative Learning and Coaching Platform
A Cloud-based Collaborative Learning and Coaching Platform
 
Extending LRSs and the xAPI for Event-driven Blended and Adaptive Learning
Extending LRSs and the xAPI for Event-driven Blended and Adaptive LearningExtending LRSs and the xAPI for Event-driven Blended and Adaptive Learning
Extending LRSs and the xAPI for Event-driven Blended and Adaptive Learning
 
Impact of SMAC Technology in HCM
Impact of SMAC Technology in HCMImpact of SMAC Technology in HCM
Impact of SMAC Technology in HCM
 
A medical prescription reminder app for i phone
A medical prescription reminder app for i phoneA medical prescription reminder app for i phone
A medical prescription reminder app for i phone
 

Último

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
giselly40
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
Enterprise Knowledge
 

Último (20)

CNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of ServiceCNv6 Instructor Chapter 6 Quality of Service
CNv6 Instructor Chapter 6 Quality of Service
 
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdfUnderstanding Discord NSFW Servers A Guide for Responsible Users.pdf
Understanding Discord NSFW Servers A Guide for Responsible Users.pdf
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
Data Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt RobisonData Cloud, More than a CDP by Matt Robison
Data Cloud, More than a CDP by Matt Robison
 
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot TakeoffStrategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
Strategize a Smooth Tenant-to-tenant Migration and Copilot Takeoff
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Boost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivityBoost PC performance: How more available memory can improve productivity
Boost PC performance: How more available memory can improve productivity
 
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
Raspberry Pi 5: Challenges and Solutions in Bringing up an OpenGL/Vulkan Driv...
 
IAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI SolutionsIAC 2024 - IA Fast Track to Search Focused AI Solutions
IAC 2024 - IA Fast Track to Search Focused AI Solutions
 
Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...Driving Behavioral Change for Information Management through Data-Driven Gree...
Driving Behavioral Change for Information Management through Data-Driven Gree...
 
GenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdfGenAI Risks & Security Meetup 01052024.pdf
GenAI Risks & Security Meetup 01052024.pdf
 
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
08448380779 Call Girls In Diplomatic Enclave Women Seeking Men
 
Tech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdfTech Trends Report 2024 Future Today Institute.pdf
Tech Trends Report 2024 Future Today Institute.pdf
 
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law DevelopmentsTrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
TrustArc Webinar - Stay Ahead of US State Data Privacy Law Developments
 
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time AutomationFrom Event to Action: Accelerate Your Decision Making with Real-Time Automation
From Event to Action: Accelerate Your Decision Making with Real-Time Automation
 
How to convert PDF to text with Nanonets
How to convert PDF to text with NanonetsHow to convert PDF to text with Nanonets
How to convert PDF to text with Nanonets
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
🐬 The future of MySQL is Postgres 🐘
🐬  The future of MySQL is Postgres   🐘🐬  The future of MySQL is Postgres   🐘
🐬 The future of MySQL is Postgres 🐘
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024The 7 Things I Know About Cyber Security After 25 Years | April 2024
The 7 Things I Know About Cyber Security After 25 Years | April 2024
 

Deploy Big Data solutions Rapidly in Cloud through Harbinger’s ABC model

  • 1. Welcome to the Webinar Deploy Big Data Solutions Rapidly in Cloud through Harbinger’s ABC Model by Harbinger Systems
  • 2. Panellists Dr. Prashant Khambekar Umesh Kanade Vice President Delivery General Manager Technology Solutions Dr. Asheesh Choksi Solutions Architect 2
  • 3. Agenda • Big Data Problem Space • Harbinger ABC Model • Case Studies • Q&A 3
  • 5. Manageable Data Variety Velocity RDBMS system for data storage Implementation of Business logic by Application server Business features are rendered by Request/Response model Volume 5
  • 8. Harbinger’s ABC Learning Model Big Data A-B-C Learning Agile Cloud 8
  • 11. Case 1 - Volume Space : Business Challenges • Data maintained by Legacy system is not queriable • Searching for information is becoming pain area as the data size is growing • Business wants to connect operational, clinical and financial properties of each record • App should support interoperability from multiple platforms (mobile devices, desktop OS …) 11
  • 12. Case 1 – ABC in Volume Space Data Volume ETL Hadoop DFS Search Multiple Business needs evolving over time AWS EMR 12
  • 13. Case 1 - Volume Space ETL Flat Files, Feeds Name Node Secondary Name Node Data Nodes Hadoop API Map Reduce Results 13
  • 14. Case 1 – Volume Space Scaling Hadoop distributed File System • Map Reduce Jobs for each type of query Search Solr based indexing • De-identification of sensitive information (HIPAA compliance) • Relevance search ETL Data migration from Legacy system • Custom ETL, Cleaning and Validation of records 14
  • 16. Case 2 - Velocity Space: Business Challenges Users Bet or Bid on Certain Resources Sport Events Live Show on TV… Application Should Synchronize Thousands of Users in Real-Time Application Usage Spikes with Popular Events 16
  • 17. ABC in Velocity Space Transaction Velocity Mongo DB Redis Evolving Business Requirements Tech POCs AWS EC2 Real time resource scale up/down 17
  • 18. Case 2 - Velocity Space Notifications Node JS, Socket IO • Dynamic Synchronization • Cross browser (HTML 5-based) Extensibility Grails, MVC, REST • Efficient Development • Support for Mobile 18
  • 20. Case 3 - Variety Space: Business Challenges Relationships: Structured and un-structured attributes Recommendations: Connections and preferences and Discovery Data Variety: Traditional design approach could be extremely complex 20
  • 21. Case 3 – Variety Space Data Variety Orient DB, PostgreSQL Graph Structures and Recommendation Engine Weekly Builds Synchronization with Business AWS EC2 Scalability, Multi-tenancy Auto-Scaling, Separate Schema for accounts 21
  • 22. Case 3 – Variety Space Multi-tenancy Cloud + PostgreSQL • Supports Schemas for Multi-tenancy Productivity RoR, Phusion Passenger Server • Developer Productivity • Resources exposed with REST APIs Responsive D3, SVG, VivaGraph • Renders scalable vector images in modern browsers 22
  • 24. Solution Space Variety Key Value Store (NoSQL) Document based or Graph database Velocity In memory Database Push (WebSocket) Volume Map Reduce (Hadoop) 24
  • 25. A-B-C Model Review Structured, Unstructured Data Volume, Velocity, Variety Analytics Frequent Builds Validations/POCs Re-alignment with business App Complexity Resource Scale-up/down Platform Services (Security, Backup, Metering) 25
  • 27. Thank You! Visit us at: www.harbinger-systems.com Write to us at: hsplinfo@harbingergroup.com Blog: blog.harbinger-systems.com Twitter: twitter.com/HarbingerSys (@HarbingerSys) Slideshare: slideshare.net/hsplmkting Facebook: facebook.com/harbingersys LinkedIn: linkedin.com/company/382306 27