Jax London 2013

Steve Millidge | C2B2

Fast Data: Parallel Processing on
the Grid

SAFE HARBOR

This talk may contain nonsense.

www.c2b2.co.uk blog.c2b2.co.uk
@c2b2consulting

The Leading Independent Middleware Experts

WHO AM I
Founder C2B2
Java since 1.0
EG Member JSR107 and JSR347 (bit dead)

Our Mission
We ensure the middleware that forms the foundation of our
customer’s mission critical systems is Fast, Reliable,
Manageable and Secure.
@c2b2consulting


@c2b2consulting


Diagnose
Before
You
Prescribe

@c2b2consulting


Can you add more?
CPU
Disk
Memory
Bandwidth

@c2b2consulting


Ability to add more capacity in
response to more demand.
Without a reduction in
performance!
900
800
700
600
500

Linear Scalability

400

Typical
Scalability

300
200
100
0
1

@c2b2consulting

2

3

4


Time delay in requesting an
operation and it being
initiated

@c2b2consulting


1Gb Ethernet : 25 – 30MB/s
10Gb Ethernet : 250 – 350MB/s
Infiniband : 6GB/s (maybe)

@c2b2consulting


PING TIMES
Local : 57µs
LAN segment : 300µs
LAN: switches : 4ms
UK : 30ms
USA : 100ms
3G : 100s ms

@c2b2consulting


Spinning Rust

Source: tomshardware.com

Typical SSD Speed
540MB/s

@c2b2consulting

Disk BUS Speeds
SATA 1.0 : 150MB/s
SATA 2.0 : 300MB/s
SATA 3.0 : 600MB/s
SAS : 600MB/s
Fibre Channel : 1GB/s
Infiniband : 1GB/s

DDR3 1600 : 12.8GB/s
@c2b2consulting


Source www.cs.virginia.edu
Approx: 3-5GB/s per cpu still about 1 order magnitude faster than SSD and scales with cores
The general rule for STREAM is that each array must be at least 4x the size of the sum of all the last-level caches used in the run, or 1
Million elements -- whichever is larger.
@c2b2consulting


“As an extreme example, several current highend machines run simple arithmetic kernels for
out-of-cache operands at 4-5% of their rated
peak speeds --- that means that they are
spending 95-96% of their time idle and waiting
for cache misses to be satisfied”
http://www.cs.virginia.edu/stream/ref.html

@c2b2consulting


Other manufacturers
are available
;-)

XF PREMIUM LUXURY
Settle into soft grain leather seats with 10/6 way
electric adjustment and heating for driver and
passenger. The soft grain stitched instrument
panel and Gloss Rich Oak veneer complete the
luxurious look, while assertive 18 inch Vela alloy
wheels further enhance the dynamic exterior.
The rear parking aid and Touch-screen visual
indicator make slipping into tight spaces easy,
while distractions at night are reduced by autodimming rear view mirrors. The
Meridian™ 380W Sound System, with Digital
Audio Broadcasting (DAB) radio receiver and
Front Media Interface with USB and iPod®
connectivity, lets you listen to your favourite
music in rich detail.

@c2b2consulting


http://www.datasciencecentral.com/forum/topics/the-3vs-that-define-bigdata
@c2b2consulting


GET B

PUT C

PUT B

B
Application

Application

C
Application

Application

Key
Partition

Key
Partition

Key
Partition
C

Key
Partition
B

B

@c2b2consulting


public static void main( String[] args )
{
CacheManager cacheManager =
Caching.getCachingProvider().getCacheManager();
MutableConfiguration<String, String> config
= new MutableConfiguration<String, String>();
cacheManager.configureCache("C2B2",config);
Cache cache = cacheManager.getCache("C2B2");
cache.put("Key", "Value");
System.out.println(cache.get("Key"));
}
http://blog.c2b2.co.uk/2013/08/jsr107-getting-started.html
@c2b2consulting


Consistent Hashing
Node 1
Hash

Key
Hash

Node 3
Hash

Key Space
Hash Ring

Node 4
Hash
@c2b2consulting

Node 2
Hash

Key Partitioning
• Keys Assigned
Partition via Hash
• Nodes Own a
Partition
• Number of Partitions
Fixed
• Number of Nodes
isn’t
@c2b2consulting

Partition

Partition

Partition

Partition

Partition

Partition

Partition


PUT B

B
Application
Key
Partition
B

Application

Application

Application

Key
Partition

Key
Partition

Key
NODE
Partition

@c2b2consulting

CRASH
!!!


Application

Application

Application

Application

Application

Application

Application

Cache

Cache

Cache

Cache

Cache

Cache

Cache

Application

Application

Application

Application

Application

Application

Application

Cache

Cache

Cache

Cache

Cache

Cache

Cache

Application

Application

Application

Application

Application

Application

Application

Cache

Cache

Cache

Cache

Cache

Cache

Cache

21 Amazon m2.xLargeMemory Instance with 17Gb RAM
3 Nodes Per Instance with 4Gb 64bit JVM Heap + 5 Gb OS
63 Cluster Nodes
252 Gb JVM Heap Available
Approx 125Gb Data in the Grid when taking into account duplicates
42 vCPUs
Approx $3633 per month
@c2b2consulting


Application

Application

Application

Application

Key
Partition
Code

Key
Partition

Key
Partition

Key
partition

@c2b2consulting


Application

Application

Application

Application

Cache

Cache

Cache

Cache

Code

@c2b2consulting


Class Size of code to
Serialize is a few Kb

@c2b2consulting


// Invoking a Map
Object oResult = map.invoke(key, agent);
// Invoke on a subset of the cache
NamedCache map = CacheFactory.getCache("trades");
Filter filter = new AndFilter(new EqualsFilter("getTrader",
traderid), new EqualsFilter("getStatus", Status.OPEN));
Map mapResults = map.invokeAll(filter, agent);
// The Agent Interface
public interface EntryProcessor extends Serializable {
public Object process(Entry entry);
Map processAll(Set setEntries);
}

@c2b2consulting


<T> T invoke(K key,
EntryProcessor<K, V, T> entryProcessor,
Object... arguments) throws EntryProcessorException;
<T> Map<K, T> invokeAll(Set<? extends K> keys,
EntryProcessor<K, V, T> entryProcessor,
Object... arguments);
T process(MutableEntry<K, V> entry, Object... arguments)
throws EntryProcessorException;
}

@c2b2consulting


• Financial Risk
Calculation
– Can I book this Order

• Bet Placement
– Can I place this Bet
Application
Keys

Application
Keys

Application
Keys

• Hotel Availability
Search
– What hotels are available

• Web Translation
– Gather Translated Text

@c2b2consulting


• Consumer Trend Analysis
– Who orders what when

• Route Optimisation
– Delivery Trucks
Application
Keys

Application
Keys

Application
Keys

• Social Graph Search
– Patterns in social media
graphs

• Fraud Detection
– Transaction analysis

@c2b2consulting


public interface CacheEntryListener<K, V> extends EventListener {

}

public interface CacheEntryUpdatedListener<K, V> extends
CacheEntryListener<K, V> {
/**
* Called after one or more entries have been updated.
*
* @param events The entries just updated.
* @throws CacheEntryListenerException if there is problem executing the
listener
*/
void onUpdated(Iterable<CacheEntryEvent<? extends K, ? extends
V>> events)
throws CacheEntryListenerException;
}
@c2b2consulting


• Product
Recommendations
– Related products

• Alerting
– Truck has Stopped!

• Financial Position Calc
– Check regs during booking

• Nudge Purchasing
Application
Keys

Application

Application

Keys

@c2b2consulting

Keys

– 5 people are looking at this
hotel


http://blog.c2b2.co.uk/2012/06/infinispan-event-push-to-tomcat.html
http://demo.c2b2.co.uk:8080/infinispan/
@c2b2consulting


Coherence
GlassFish
WebSocket
http://demo.c2b2.co.uk:7080 or Full URL
http://demo.c2b2.co.uk:7080/CleanStockTicker/stockticker.jsp
http://blog.c2b2.co.uk/2012/10/java-one-2012-slides-and-code.html

@c2b2consulting


Jax London 2013

Recomendados

Recomendados

Mais conteúdo relacionado

Semelhante a Jax London 2013

Semelhante a Jax London 2013 (20)

Mais de C2B2 Consulting

Mais de C2B2 Consulting (20)

Último

Último (20)

Jax London 2013

Notas do Editor