Big Data in Real Time

•Transferir como PPT, PDF•

0 gostou•445 visualizações

Real time analytics on big data applications, what is real time, what are the challenges to achieve real time complex calculation on big data and how they can be solved.

Tecnologia

We’re Living in a Real Time World…
Social User Tracking & Homeland Security
Engagement

eCommerce Financial Services Real Time Search

2 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

The Flavors of Big Data Analytics

Counting Correlating Research

3 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Twitter in Numbers (March 2011)

It takes a week for users to
send 1 billion tweets
Source: http://blog.twitter.com/2011/03/numbers.html

4 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Twitter in Numbers (March 2011)

On average,
140 million
tweets get sent every day
Source: http://blog.twitter.com/2011/03/numbers.html

5 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Twitter in Numbers (March 2011)

The highest
throughput to date is
6,939 tweets/sec.
Source: http://blog.twitter.com/2011/03/numbers.html

6 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Twitter in Numbers (March 2011)

460,000 new
accounts
are created daily
Source: http://blog.twitter.com/2011/03/numbers.html

7 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Challenge – Word Count
Tweets

8
?
® Copyright 2011 Gigaspaces Ltd. All Rights Reserved
Count
Count
Word:Count

Analyze the Problem
 Thousands of tweets per second to process
 Aggregate counters for each word
 Latency – less than a second
 System needs to linearly scale
 System needs to be fault tolerant
 Querying & Persisting Data
 Managing the system

9 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Tier Based Architecture?

10 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Data Grid 

11 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Putting it all together

12 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

The 3 Most Popular Words on Twitter?

1. Just
2. Found
3. Love
- August 2012

13 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Q&A

RonZ@gigaspaces.com

14 ® Copyright 2011 Gigaspaces Ltd. All Rights Reserved

Mais conteúdo relacionado

Semelhante a Big Data in Real Time

Search Analytics Business Value & NoSQL BackendSematext Group, Inc.

Bigdata analytics-twitterdfilppi

Search Analytics What? Why? How?Lucidworks (Archived)

Project Controls Expo, 13th Nov 2013 - "A new visual way to engage executive ...Project Controls Expo

Learn The Characteristics Of World Class CommunitiesTelligent

Alfresco digital assetmanagement-042111-finalEmil Loreto

Social Radar 3.0 DeckJohn Mumford

How To Use It With SafePituphong Yavirach

Big data and APIs for PHP developers - SXSW 2011Eli White

Leveraging open source for big data stackFlytxt

How to measurably increase your email response rates webinar.041411.1Trinity Web Works

Digital Asset Management with Alfrescorivetlogic

Transform your Classified business into DigitalTANGERINE Digital

Sviluppare un backend serverless in real time attraverso GraphQLAmazon Web Services

Big Traffic, Big Trouble: Big Data Security AnalyticsDataWorks Summit

Big Traffic, Big Trouble: Big Data - TokyoDataWorks Summit

Aras ACE Conference PLM Keynote by Peter SchroerAras

Social media it support.pptxPink Elephant

Big data by_mcalMCAL Management Consulting and Advanced Learning

Final_Bigdata_pretSimranjit Mann

Semelhante a Big Data in Real Time (20)

Search Analytics Business Value & NoSQL Backend

Bigdata analytics-twitter

Search Analytics What? Why? How?

Project Controls Expo, 13th Nov 2013 - "A new visual way to engage executive ...

Learn The Characteristics Of World Class Communities

Alfresco digital assetmanagement-042111-final

Social Radar 3.0 Deck

How To Use It With Safe

Big data and APIs for PHP developers - SXSW 2011

Leveraging open source for big data stack

How to measurably increase your email response rates webinar.041411.1

Digital Asset Management with Alfresco

Transform your Classified business into Digital

Sviluppare un backend serverless in real time attraverso GraphQL

Big Traffic, Big Trouble: Big Data Security Analytics

Big Traffic, Big Trouble: Big Data - Tokyo

Aras ACE Conference PLM Keynote by Peter Schroer

Social media it support.pptx

Big data by_mcal

Final_Bigdata_pret

Último

A Journey Into the Emotions of Software DevelopersNicole Novielli

The Ultimate Guide to Choosing WordPress Pros and ConsPixlogix Infotech

From Family Reminiscence to Scholarly Archive .Alan Dix

Rise of the Machines: Known As Drones...Rick Flair

A Framework for Development in the AI AgeCprime

The Fit for Passkeys for Employee and Consumer Sign-ins: FIDO Paris Seminar.pptxLoriGlavin3

Manual 508 Accessibility Compliance AuditSkynet Technologies

Long journey of Ruby standard library at RubyConf AU 2024Hiroshi SHIBATA

Take control of your SAP testing with UiPath Test SuiteDianaGray10

The Future Roadmap for the Composable Data Stack - Wes McKinney - Data Counci...Wes McKinney

TeamStation AI System Report LATAM IT Salaries 2024Lonnie McRorey

How to write a Business Continuity PlanDatabarracks

Enhancing User Experience - Exploring the Latest Features of Tallyman Axis Lo...Scott Andery

Generative Artificial Intelligence: How generative AI works.pdfIngrid Airi González

Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptxLoriGlavin3

Modern Roaming for Notes and Nomad – Cheaper Faster Better Strongerpanagenda

Emixa Mendix Meetup 11 April 2024 about Mendix Native developmentPim van der Noll

Unleashing Real-time Insights with ClickHouse_ Navigating the Landscape in 20...Alkin Tezuysal

TrustArc Webinar - How to Build Consumer Trust Through Data PrivacyTrustArc

How AI, OpenAI, and ChatGPT impact business and software.Curtis Poe