1. vFabric | Cloud Application Platform
Pronam Chatterjee
pronamc@vmware.com
twitter:pronamc
© 2011 VMware Inc. All rights reserved

2. VMware Solutions for Cloud Computing
End User
Computing
vFabric
vCloud
Infrastructure
2
2

3. VMware vFabric Cloud Application Platform
vFabric
The ideal application
platform environment to
run and manage your
custom, Java applications
– in the datacenter,
virtualized environment, or
the cloud. Messaging
Data Management
3

4. Use Case: App Intelligence for “Just-in-Time” Infrastructure
Hotel room promotion Hotel room
comes online Users are booking rooms promotion ends
Traffic
PST 8 am 9 am 10 am 11 am 12 pm 1 pm 2 pm 3 pm 4 pm 5 pm
Policy-based Capacity
4

5. New Applications Need To Be Portable
vCloud
partners
Private Cloud Hybrid Cloud
vFabric vFabric
Your Java vSphere vSphere
Spring App
“In partnership with
VMware, we are
bringing Spring to
Force.com.”
Build your application
“With VMware, we are making it easy
Select the runtime platform for developers to create Spring Java
apps in the cloud.”
Deploy your application
The industry’s first open PaaS
5

6. VMware Cloud Application Platform for Spring/Java Apps
Programming Rich Social and Data Integration Batch Spring WaveMaker Code2Cloud
Model Web Mobile Access Patterns Framework Tool Suite Services
Java Runtime Web Runtime Messaging Global Data In-mem SQL App Monitoring Performance Mgmt
(tc Server) (ERS) (RabbitMQ) (GemFire) (ElasticSQL) (Spring Insight) (Hyperic)
Java Automated
Optimizations Virtual Datacenter App Provisioning
(EM4J, …) (AppDirector)
Cloud Infrastructure and Management
6

7. Operational Control: tc Server Spring Edition
vFabric tc Server
7

8. STS - Developer Efficiency
SpringSource Tool Suite
Spring Roo Grails
Spring
Java (Core, Rich Web, Integration) Groovy
tc Server
(Spring Insight)
§ Agile Development - Integrated Testing
• Tight integration with tc Server minimizes application redeploys/restarts
• Links performance issues to code traces highlighted in Spring Insight
§ Supports flexible deployment targets
• tc Server, Java EE servers, VMware, Cloud, etc.
8

9. Tomcat is a Proven Standard
WebLogic 26% Spring Applications
JBoss 38%
WebSphere 43%
Apache Tomcat 68%
0% 10% 20% 30% 40% 50% 60% 70%
Java Application Server Usage, Source: 2008 Evans Data Survey
“
The adoption of Tomcat reflects the
Java developers' preference for
lighter, simpler technologies
”
9

10. tc Server Fills the Gap
10

11. Developer Efficiency: Deep Performance Insight into Spring Apps
11

12. Developer Efficiency: Deep Performance Insight into Spring Apps
12

13. Monitor: VM, OS, JVM, tcRuntime Container…
" Monitor Application Server Status, Health, and Response Times
" Availability, Session Count, Throughput, Utilization, Connection & Thread Pool Health, Deadlock Detection,
Garbage Collection
13

14. vFabric EM4J (Elastic Memory for Java)
Use ESX to Share Memory Between VMs Running Java
Description Benefits
• Use virtualization to • Higher consolidation through memory over-commit for
overcome the Java workloads
limitation of Java’s • Protect Java applications against workload spikes
static heap without wasting memory
• New ‘memory balloon’ • Lets you give Java more memory than it needs under
runs inside JVM to normal load. Memory your application doesn’t need is
capture unused returned to ESX but remains available in case it is
memory and return it needed to avoid Java out-of-memory errors
to ESX
• Memory returned to
JVM when it is under
pressure
14

15. Lightweight Application Platform Harmonizes Lifecycle
App Developer App Operator
Create Apps Quickly Meet Business Goals
Applications
Spring
tc Server
Build Run Manage
“ Setting up the infrastructure for an
application used to take days. With “ Everything we did in Tomcat works
the same way in tc Server, plus we
Spring, we can do it in two hours.
- Sahana Hussein
Visa Europe
” have the additional advantages.
”
- Jeffrey Hickman
Arizona State Retirement System
15

16. Deployment Flexibility: Distribute or Combine
tc Server tc Server tc Server
Instance 1 Instance m
... Instance X
Spring Spring Spring Spring Spring
tc Server ver X
(shared binaries)
... tc Server ver Y
(shared binaries)
Operating System & JVM
16

17. Breaking free of the RDBMS bottleneck
Data Management
17

18. Scaling the Tiers
The web and application tiers can
be easily combined and
virtualized. Nodes can be added or Load Balancer Add/remove web/
removed on the fly. application servers
Web Tier
Application Tier
The database only grows by
moving the VM to a larger Database Tier
machine
The disk systems can be
virtualized and can grow on Storage Tier
demand
18

19. Linear Scalability
GemFire can achieve near linear scalability with nodes
that can be added or removed on the fly.
Scale
Add/remove web/
application/data servers
Disks may be direct or network
attached
Web, Application and Data tiers can be collapsed into a
Optional reliable, asynchronous
feed to Data Warehouse or single virtual machine.
Archival Database
19

20. What is GemFire?
Database
• Storage • High Availability
= • Persistence • Load Balancing
• Transactions • Data Replication
• Queries • L1 Caching
+ Messaging System + Service Bus
• Data Distribution • System Integration
• Event Propagation • Data Transformation
• Guaranteed Delivery • Service Loose Coupling
+ Grid Controller + Complex Event Processor
• Task Decomposition • Business Event Detection
• Distributed Task Assignment • Real-time Analysis
• Map-Reduce, Scatter-Gather • Event Driven Architectures
• Result Summarization
GemFire combines select features from all of these products and
combines them into a low-latency, linearly scalable, memory-based data
fabric
20

21. Memory-based Performance
GemFire uses memory on a peer machine to make data updates
Perform durable, allowing the updating thread to return 10x to 100x faster than
updates that must be written through to disk, without risking any data
loss. Typical latencies are in the few hundreds of microseconds
instead of in the tens to hundreds of milliseconds.
GemFire can optionally write updates to disk, or to a data warehouse,
asynchronously and reliably.
21

22. Data-Aware Function Routing
Data Aware Function
Execute Batch Controller
or Client
Scatter-Gather (Map-Reduce)
Function
GemFire provides ‘data aware function routing’ – moving the behavior to
the correct data instead of moving the data to the behavior.
22

23. Data Distribution
Distribute
GemFire can keep clusters that are distributed around the world synchronized in real-
time and can operate reliably in Disconnected, Intermittent and Low-Bandwidth network
environments.
23

24. GemFire virtualizes the database into the application tier
Cloud Ready
Add/remove web/
application/data servers
Add/remove disk
GemFire server is a small Java jar file that can be easily
deployed with Java applications.
Optional reliable, asynchronous
feed to Data Warehouse or
Archival Database
24

25. vFabric SQLFire
Data Management
25

26. vFabric SQLFire: Scalability at the Data Tier
§ Speed: In-memory, distributed SQL database.
§ Scale: More scalable design than traditional RDBMS.
§ SQL: Familiar SQL interface, accessible from Java and C#.
26

27. vFabric SQLFire: Speed Through In-Memory Design
1Writes are
2Later asynchronously
synchronously
persisted across persisted to disk
two servers
SQLFire Database
27

28. vFabric SQLFire: Dynamic Scalability
3Remove nodes
1Add new nodes
when load returns
any time load spikes.
to normal
SQLFire Database
2Data is automatically rebalanced to new nodes.
28

29. vFabric SQLFire: A Real SQL Interface
§ SQLFire syntax is based on the SQL-92 standard.
§ SQLFire extensions are to Data Definition Language (DDL)
only, e.g. CREATE TABLE.
§ DML 100% standards compatible.
§ JDBC and ADO.NET drivers.
• Built-in, transparent high availability.
§ Easily accessible via Spring Data
29

30. Breaking free of the RDBMS bottleneck
vFabric data director
Powering Database-as-a-Service
for Your Cloud
30

31. Data Problems Addressed by Cloud
Database Sprawl Long Lead Time DB Tuning for Virtualization
Corporate IT Shadow IT
Database
Lead time of
provision or
weeks
clone
request
Server & Storage Database Implementation
Provisioning & Tuning
• Thousands of under-managed and • Database operations not fully • Database not designed for
under-secured databases automated virtualized environments with
• Long lead time for database dynamic resources
• Difficult to enforce policy and
compliance services for developers • DBA tunes databases to specific
setup
31

32. vFabric Data Director
• Powers database-as-a-service
across private and public App App App App App App App App
clouds
vFabric Data Director
Graphical User Interface/API
• Self-service database
virtualization platform for
Self-service IT Control vSphere-Optimized
traditional and new databases
• First database enabled is
PostgreSQL database with
optimization for vSphere
VMware vSphere 5
• Built on vSphere platform --
extends virtualization benefits
to database layer
32

33. vFabric Postgres
§ First database enabled on vFabric Data Director
§ Based on PostgreSQL 9.0
• Fully ACID compliant, ansi-SQL compliant relational database
• Proven architecture known for reliability and wildly used across
industries
§ Added vSphere-Optimization include
• Elastic database memory
• Self-tuning and automatic configuration
• Database-aware high availability
• Live on cloudfoundry.com on 8/29
• Soon to be included in Micro Cloud Foundry
33

34. vFabric rabbitMQ
An enterprise message
solution is critical to today’s
businesses. Messaging
That Just Works
Messaging
34

35. Customers love RabbitMQ – banking, web, social media, ...
Estimate 300-500 in production, 20,000 in dev
35 vfabric.co/rabbitmq

36. RabbitMQ
and
AMQP:
technical
overview
Consumers create queues; these buffer
messages for push to consumers
Queues are stateful, ordered, and can be
persistent, transient, private, shared.
Exchanges are stateless routing tables.
Consumers tell queues to bind to named
exchanges; each binding has a pattern e.g.
“tony” or “*.ibm.*”
Producers send messages to exchanges
with a routing key e.g. “tony”, or ordered set
of keys e.g. “buy.ibm.nyse”
Exchanges route messages to queues
whose binding pattern matches the
message routing key or keys
36 vfabric.co/rabbitmq

37. UID – a lifetime digital identity for 1.2bn India residents
37 vfabric.co/rabbitmq

38. Breaking free of the RDBMS bottleneck
vFabric App Director
Powering Database-as-a-Service
for Your Cloud
38

39. What is vFabric Application Director 1.0?
§ vFabric Application Director automates application deployments
on hybrid clouds, specifically on VCD 1.5
Applications
Custom
or
Packaged
App
binaries,
config
.war,
.jar,
.tar,
.zip
etc
Application Stack Middleware,
OS
App
servers,
messaging,
web
servers,
databases,
opera7ng
systems,
load
balancers,
etc
vCloud Director 1.5
39

40. vFabric Application Director – “Model-driven” cloud-ready App
provisioning
Application Blueprint Logical Application Topology with
Application Binaries
Application Policies, Configurations
Pre-instrumented with App Monitoring
Application Stack - (Middleware, OS)
Architect
Deployment Deployment Deployment Collection of deployment settings
Profile Profile Profile Makes blueprints portable across clouds
(dev) (test) (prod)
App Dev, QA,
Release Standardized configurations of
OS, Middleware
Automated Deployment Plans with Orchestration
Catalog
Deployment Environments
Dev Org VDC Test Org VDC Prod Org VDC
Middleware Admin
Cloud Admin
40

41. vFabric Application Director
Application Blueprint
Application Binaries
Application Stack - (Middleware, OS)
Architect
Deployment Deployment Deployment
Profile Profile Profile Simplified
(dev) (test) (prod)
Standardized
App Dev, QA,
Release
Cloud-Ready
Automated Deployment Plans with Orchestration Extensible
Deployment Environments
Dev Org VDC Test Org VDC Prod Org VDC
Cloud Admin
41

42. VMware’s Active Application Management strategy for IaaS
Integrate with Application Performance Management (vFabric APM) for pre-
instrumented monitoring & scaling of deployed apps
App Provisioning App Performance
Collaborate
Monitoring Add
Policy Capacity
Deploy
Monitor
Components,
Optimize
Resources,
Topology, resource Isolate, trouble
Topology compliancy,
allocation, Update Reboot shoot, remediate,
transactions, users,
environment change
change impact
binding .
Burst
Scale Policy compute
42

43. Application Director provisions vFabric and third party components
43

44. NPC International
vFabric Helps NPC International Stay Connected to 1,200 Locations
“ Application performance is considerably faster
since we moved from JBoss to vFabric … We
have been very happy with the performance – it is
fantastic.”
Jon Brisbin, Portal Webmaster, NPC International
Challenge Solution Results
Application not performing well on JBoss Replaced JBoss Application Severs with Enhanced Application Performance
causing downtime; load often exceeded VMware vFabric
planned capacity Server Costs Reduced by 75%
vFabric instances running on VMware
Application experienced regular lockups ESX Server-based private cloud High Availability
every time JBoss received out of infrastructure
memory errors causing server restarts Greater Scalability
Since all web applications built in
Costly downtime and other performance Spring, transition to vFabric was Virtual Private Cloud Infrastructure
issues caused problems for users and seamless
required substantial attention from Increased Developer Productivity
development team
44

45. Use Case - ForEx
real-life use case: Global Foreign Exchange Trading System
The project achieved:
Ø Low-latency trade insertion
Ø Permanent Archival of every trade
Ø Kept pace with fast ticking market data
Ø Rapid, Event Based Position Calculation
Ø Distribution of Position Updates Globally
Ø Consistent Global Views of Positions
Ø Pass the Book
Ø Regional Close-of-day
Ø High Availability
Ø Disaster Recovery
Ø Regional Autonomy
45