Web portals are becoming more complex, as users want more interactivity and dynamic contents relevant to their interest. Further the businesses also want to know the sentiments of their customers about their products which may be appearing on social networking portals. The success of extracting people oriented Business Intelligence depends upon the ability to collect every possible expression and derive the business observations from it. However, often the requirements for big data analysis are really not well understood by the developers and business owners, thus creating an undesirable product. There is a need to develop expertise and process of creating small scale prototypes quickly and test them to demonstrate its correctness, matching with business goals.

1. Building Big Data Solutions
in Cloud using Agile Model

2. About Us
Shrikant Pattathil
Executive Vice President
Harbinger Systems

3. Big Data
A-B-C
Design
Agile
Cloud

4. Case 1
B2C: Real Time Betting Application

5. Background
Users Bet or Bid on certain resources
Sport events
Live show on TV …
Application should synchronize thousands
of users in real time
Application usage spikes with popular events

6. A-B-C Design Choices
Transaction Velocity
Mongo DB
Redis
Evolving business
requirements
Tech POCs
AWS EC2
Real time resource scale
up/down

7. Other Choices
Notifications Node JS, Socket IO
• Dynamic Synchronization
• Cross browser (HTML 5-based)
Extensibility
Grails, MVC, REST
• Efficient Development
• Support for Mobile

8. Case 2
B2B: Private Social Network for Talent Management

9. Background
Relationships: Structured and un-structured
Recommendations: Connections and preferences

10. A-B-C Design Choices
Data Variety
Neo4J, Reco4J
Graph Structures and
Recommendation Engine
Weekly Builds
Synchronization with
Business
AWS EC2
Scalability, Multi-tenancy
Auto-Scaling, Separate
Schema for accounts

11. Other Choices
Multi-tenancy Cloud + PostgreSQL
• Supports Schemas for Multi-tenancy
Productivity
RoR, Phusion Passenger Server
• Developer Productivity
• Resources exposed with REST APIs
Responsive
D3, SVG, VivaGraph
• Renders scalable vector images in modern browsers

12. Summary

13. A-B-C Design Relevance
Structured, Unstructured
Data
Volume, Velocity, Variety
Analytics
App Complexity
Frequent Builds
Resource Scale-up/down
Validations/POCs
Platform Services
(Security, Backup, Metering
)
Re-alignment with business

14. What’s Next
– Extending MongoDB
– Leveraging WebRTC
Your Questions?

15. Thank You
shrikant@harbingergroup.com
www.harbinger-systems.com