SlideShare uma empresa Scribd logo
1 de 50
Baixar para ler offline
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Cox Automoti ve E mpowered to Scal e wi th
Spl unk Cl oud & AWS and Expl ores New
Innovati on wi th Amazon Ki nesi s F i rehose
R a y Z h u | P r o d u c t M a n a g e r , A W S
E l i a s H a d d a d | P r o d u c t M a n a g e r , S p l u n k
S t e v e n H a t c h | E n t e r p r i s e L o g g i n g S e r v i c e s M a n a g e r
N o v e m b e r 2 8 , 2 0 1 7
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Agenda
• What is Splunk
• Current Splunk ingestion landscape for AWS
• Current challenges
• New solution
• Cox Automotive use case
• Q&A
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Forward-looking statements
During the course of this presentation, we may make forward-looking statements regarding future events or
the expected performance of the company. We caution you that such statements reflect our current
expectations and estimates based on factors currently known to us and that actual events or results could
differ materially. For important factors that may cause actual results to differ from those contained in our
forward-looking statements, please review our filings with the SEC.
The forward-looking statements made in this presentation are being made as of the time and date of its live
presentation. If reviewed after its live presentation, this presentation may not contain current or accurate
information. We do not assume any obligation to update any forward-looking statements we may make. In
addition, any information about our roadmap outlines our general product direction and is subject to change
at any time without notice. It is for informational purposes only and shall not be incorporated into any
contract or other commitment. Splunk undertakes no obligation either to develop the features or
functionality described or to include any such feature or functionality in a future release.
Splunk, Splunk>, Listen to Your Data, The Engine for Machine Data, Splunk Cloud, Splunk Light and SPL are trademarks and regi stered
trademarks of Splunk Inc. in the United States and other countries. All other brand names, product names, or trademarks belon g to their
respective owners. © 2017 Splunk Inc. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Turn data into
answers with Splunk
© 2017 SPLUNK INC.
Machine data
Your data is talking. Are you listening?
© 2017 SPLUNK INC.
What is machine data?
Application data
Mobile app and website data
44% of the world’s population will own
smartphones in 2017*
IT infrastructure data
Network servers, cloud services
Average cost of downtime for a data center
is $7,900 per minute*
Security data
Firewall data, endpoint data
Cybercrime will cost the world in excess of
$6 trillion annually by 2021*
Customer-generated data
Social media data, support call logs
There are 2.8 billion social media users worldwide*
Internet of Things data
Temperature control, speed instruments
8.4 Billion connected "things" will be in use in 2017*
© 2017 SPLUNK INC.
To meet
higher
customer
expectations,
companies
must leverage
their machine
data.
I expect recommendations
& upgrades based on
my preferences
I expect seamless,
personalized interactions
I expect you to know
who I am, across channels
I expect you to proactively
resolve my issues
I expect you to know where I am
& what I need
Use machine
data. Meet
customer
expectations.
I expect you to protect my data
© 2017 SPLUNK INC.
Why is this so hard?
Machine data is
messy and
unpredictable
Requires
massive scale
You don’t always
know which
questions to ask
© 2017 SPLUNK INC.
Any question, any data, in real time
Single Platform,
Many Lenses
Open Ecosystem HybridPerformance
at Scale
Machine
Learning
© 2017 SPLUNK INC.
© 2017 SPLUNK INC.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Proven at 13,000+ customers in 110+ countries
More than 85 of the Fortune 100
Technology Travel and Leisure
ManufacturingGovernment
Education
Healthcare
Telecommunications
Energy and Utilities
Media
Financial Services and Insurance
Retail
Cloud and Online Services
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Splunk portfolio of AWS solutions
AMI on AWS Marketplace
Benefits of Splunk Enterprise as
SaaS
AMI on AWS Marketplace
App for AWS
AWS
Integrations
AWS Lambda, AWS IoT,
Amazon Kinesis, Amazon
EMR, Amazon EC2
Container Service
SaaS Contract Billed through
Marketplace
Available on Splunk
Enterprise, Splunk Cloud and
Splunk Insights for Cloud
Monitoring
End-to-end AWS
visibility
Self-deployed AMIs or SaaS
on AWS Marketplace
AWS-based SaaS
sdInsights for AWS Cloud Monitoring
© 2017 SPLUNK INC.
13
Splunk Cloud available worldwide
Monitored by
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Current Splunk end-to-end landscape for AWS
v1.2
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Poll-based ingestion challenges
• Reliability, scalability, and fault tolerance
• Management overhead of data-collection
nodes
• Delayed event delivery due to poll-based
ingestion
• API throttling with poll-based data ingestion
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Need for new solution
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Kinesis
Amazon Kinesis
Firehose
Easily load streaming
data into AWS
Amazon Kinesis
Analytics
Easily process and
analyze streaming data
with standard SQL
Amazon Kinesis
Streams
Build custom
applications that
process and analyze
streaming data
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Current state of Amazon Kinesis Firehose
Ingest
Transfor
m
Deliver
Amazon Kinesis Agent
Amazon Kinesis Streams
Amazon CloudWatch Logs
Amazon CloudWatch Events
AWS IoT
Amazon S3
Amazon Redshift
Amazon Elasticsearch
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Our answers to challenges
• Reliability, scalability, and fault-tolerance challenges
 Extremely reliable with underlying infrastructure operating in three different
AZs
 Extremely durable with three copies of same data in three different AZs
 Temporarily holds and buffers data to absorb back pressure
 Data backup to Amazon S3 upon failure
• Management overhead of data-collection nodes in existing solution
 Serverless with no resource provision or management overhead
• Delayed event delivery due to poll-based ingestion
 Push delivery with configurable buffer size and interval
• API throttling with poll-based data ingestion
 Horizontally scalable with no limit
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Kinesis Firehose with Splunk delivery
AWS IoT
Amazon S3
Amazon Redshift
Amazon Elasticsearch
Amazon Kinesis Agent
Amazon Kinesis Streams
Amazon CloudWatch Logs
Amazon CloudWatch Events
Ingest Transform Deliver
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Kinesis Firehose advantages
Why would I use Amazon Kinesis Firehose as opposed to other ingestion mechanisms for Splunk?
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Why Amazon Kinesis Firehose
• Fully managed service with serverless architecture
• Bypass the need for setting up and managing heavyweight
forwarder
• Greater reliability and scalability
• Well integrated with various data sources
• Easy to use with no programming requirement
• Ability to transform raw data prior to sending it to Splunk
• Very low cost—$0.029 per GB of data ingested via Amazon
Kinesis Firehose
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Serverless and scalable
• Supports native balancing to indexing tier
• Supports Splunk Cloud and Splunk Enterprise
• Leverages HTTP Event Collector’s indexer acknowledgment
• Makes sure events are written to disk on Splunk’s side
• Unacknowledged events are sent again
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Serverless and scalable
• Supports ELB and third-party load balancers
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Greater reliability: Hybrid push/pull
• Supports delivery acknowledgment. Unacknowledged events can be persisted to Amazon S3 and ingested again via
alternative delivery mechanism.
• Undelivered and unacknowledged events can be ingested from Amazon S3 bucket using poll-based mechanism
(Splunk add-on for AWS)
• Hybrid push/pull: backup route less prone to same bottleneck
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Greater reliability: Serverless architecture
• Undelivered and unacknowledged events can be ingested from Amazon S3 using AWS
Lambda for full push-based architecture
• Lambda can be configured to push data to a failover HEC endpoint
• Pure push, serverless-based architecture; no forwarder required
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
• Consolidate Amazon VPC flow data from multiple accounts into one Amazon Kinesis
Firehose delivery stream
• Ability to route events to different indexes based on AWS Lambda conditions
Cross-account delivery
New Splunk end-to-end landscape for AWS
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Amazon Kinesis Firehose use case
When would I use Amazon Kinesis Firehose as opposed to other ingestion mechanisms for Splunk?
Steven Hatch
30
Leading international Splunk
rollout across Cox Automotive
20 Years Enterprise IT Experience
Enterprise Logging Services Manager
A leading provider of products
and services that span the
automotive ecosystem worldwide.
More than 20 brands that
together provide end-to-end
solutions for customers large and
small.
A subsidiary of
Cox Enterprises, Inc.
Transform the way the world
buys, sells, and owns cars.
Audio / Video Network Gear Monitoring
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Internet Data
Center
App
Closed
Internet
Auction
Lane
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Internet Data
Center
App
Closed
Internet
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Monitoring App Monitoring App
Monitoring AppMonitoring App
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Correlation
Alert routing
Ingest all component
data
Homegrown anomaly
detection
Wrapping intelligence around noise
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Expansion of self-service @ Cox
Automotive
Build recipe of success by way of the key ingredients
Devs or application teams can build it however they want
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Center of Excellence
Build partnerships
Develop standards
Standardize infrastructure
Empower, educate, and delegate
Evangelize
Build for scale
Grow the business
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Q&A
© 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
Thank you!

Mais conteúdo relacionado

Mais procurados

DVC303-Technological Accelerants for Organizational Transformation
DVC303-Technological Accelerants for Organizational TransformationDVC303-Technological Accelerants for Organizational Transformation
DVC303-Technological Accelerants for Organizational TransformationAmazon Web Services
 
ABD327_Migrating Your Traditional Data Warehouse to a Modern Data Lake
ABD327_Migrating Your Traditional Data Warehouse to a Modern Data LakeABD327_Migrating Your Traditional Data Warehouse to a Modern Data Lake
ABD327_Migrating Your Traditional Data Warehouse to a Modern Data LakeAmazon Web Services
 
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...Amazon Web Services
 
ABD202_Best Practices for Building Serverless Big Data Applications
ABD202_Best Practices for Building Serverless Big Data ApplicationsABD202_Best Practices for Building Serverless Big Data Applications
ABD202_Best Practices for Building Serverless Big Data ApplicationsAmazon Web Services
 
ABD215_Serverless Data Prep with AWS Glue
ABD215_Serverless Data Prep with AWS GlueABD215_Serverless Data Prep with AWS Glue
ABD215_Serverless Data Prep with AWS GlueAmazon Web Services
 
STG302_Best Practices for Amazon S3
STG302_Best Practices for Amazon S3STG302_Best Practices for Amazon S3
STG302_Best Practices for Amazon S3Amazon Web Services
 
ABD301-Analyzing Streaming Data in Real Time with Amazon Kinesis
ABD301-Analyzing Streaming Data in Real Time with Amazon KinesisABD301-Analyzing Streaming Data in Real Time with Amazon Kinesis
ABD301-Analyzing Streaming Data in Real Time with Amazon KinesisAmazon Web Services
 
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdfGAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdfAmazon Web Services
 
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...Amazon Web Services
 
Deploying Business Analytics at Enterprise Scale - AWS Online Tech Talks
Deploying Business Analytics at Enterprise Scale - AWS Online Tech TalksDeploying Business Analytics at Enterprise Scale - AWS Online Tech Talks
Deploying Business Analytics at Enterprise Scale - AWS Online Tech TalksAmazon Web Services
 
FSV302_An Architecture for Trade Capture and Regulatory Reporting
FSV302_An Architecture for Trade Capture and Regulatory ReportingFSV302_An Architecture for Trade Capture and Regulatory Reporting
FSV302_An Architecture for Trade Capture and Regulatory ReportingAmazon Web Services
 
Big Data Breakthroughs: Process and Query Data In Place with Amazon S3 Select...
Big Data Breakthroughs: Process and Query Data In Place with Amazon S3 Select...Big Data Breakthroughs: Process and Query Data In Place with Amazon S3 Select...
Big Data Breakthroughs: Process and Query Data In Place with Amazon S3 Select...Amazon Web Services
 
A Look Under the Hood – How Amazon.com Uses AWS Services for Analytics at Mas...
A Look Under the Hood – How Amazon.com Uses AWS Services for Analytics at Mas...A Look Under the Hood – How Amazon.com Uses AWS Services for Analytics at Mas...
A Look Under the Hood – How Amazon.com Uses AWS Services for Analytics at Mas...Amazon Web Services
 
SID344-Soup to Nuts Identity Federation for AWS
SID344-Soup to Nuts Identity Federation for AWSSID344-Soup to Nuts Identity Federation for AWS
SID344-Soup to Nuts Identity Federation for AWSAmazon Web Services
 
How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...
How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...
How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...Amazon Web Services
 
AMF305_Autonomous Driving Algorithm Development on Amazon AI
AMF305_Autonomous Driving Algorithm Development on Amazon AIAMF305_Autonomous Driving Algorithm Development on Amazon AI
AMF305_Autonomous Driving Algorithm Development on Amazon AIAmazon Web Services
 
STG311_Deep Dive on Amazon S3 & Amazon Glacier Storage Management
STG311_Deep Dive on Amazon S3 & Amazon Glacier Storage ManagementSTG311_Deep Dive on Amazon S3 & Amazon Glacier Storage Management
STG311_Deep Dive on Amazon S3 & Amazon Glacier Storage ManagementAmazon Web Services
 

Mais procurados (20)

DVC303-Technological Accelerants for Organizational Transformation
DVC303-Technological Accelerants for Organizational TransformationDVC303-Technological Accelerants for Organizational Transformation
DVC303-Technological Accelerants for Organizational Transformation
 
ABD327_Migrating Your Traditional Data Warehouse to a Modern Data Lake
ABD327_Migrating Your Traditional Data Warehouse to a Modern Data LakeABD327_Migrating Your Traditional Data Warehouse to a Modern Data Lake
ABD327_Migrating Your Traditional Data Warehouse to a Modern Data Lake
 
ABD217_From Batch to Streaming
ABD217_From Batch to StreamingABD217_From Batch to Streaming
ABD217_From Batch to Streaming
 
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
RET301-Build Single Customer View across Multiple Retail Channels using AWS S...
 
STG401_This Is My Architecture
STG401_This Is My ArchitectureSTG401_This Is My Architecture
STG401_This Is My Architecture
 
ABD202_Best Practices for Building Serverless Big Data Applications
ABD202_Best Practices for Building Serverless Big Data ApplicationsABD202_Best Practices for Building Serverless Big Data Applications
ABD202_Best Practices for Building Serverless Big Data Applications
 
ABD215_Serverless Data Prep with AWS Glue
ABD215_Serverless Data Prep with AWS GlueABD215_Serverless Data Prep with AWS Glue
ABD215_Serverless Data Prep with AWS Glue
 
STG302_Best Practices for Amazon S3
STG302_Best Practices for Amazon S3STG302_Best Practices for Amazon S3
STG302_Best Practices for Amazon S3
 
ABD301-Analyzing Streaming Data in Real Time with Amazon Kinesis
ABD301-Analyzing Streaming Data in Real Time with Amazon KinesisABD301-Analyzing Streaming Data in Real Time with Amazon Kinesis
ABD301-Analyzing Streaming Data in Real Time with Amazon Kinesis
 
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdfGAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
GAM301-Migrating the League of Legends Platform into AWS Cloud.pdf
 
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
GPSTEC313_GPS Real-Time Data Processing with AWS Lambda Quickly, at Scale, an...
 
Deploying Business Analytics at Enterprise Scale - AWS Online Tech Talks
Deploying Business Analytics at Enterprise Scale - AWS Online Tech TalksDeploying Business Analytics at Enterprise Scale - AWS Online Tech Talks
Deploying Business Analytics at Enterprise Scale - AWS Online Tech Talks
 
FSV302_An Architecture for Trade Capture and Regulatory Reporting
FSV302_An Architecture for Trade Capture and Regulatory ReportingFSV302_An Architecture for Trade Capture and Regulatory Reporting
FSV302_An Architecture for Trade Capture and Regulatory Reporting
 
Big Data Breakthroughs: Process and Query Data In Place with Amazon S3 Select...
Big Data Breakthroughs: Process and Query Data In Place with Amazon S3 Select...Big Data Breakthroughs: Process and Query Data In Place with Amazon S3 Select...
Big Data Breakthroughs: Process and Query Data In Place with Amazon S3 Select...
 
A Look Under the Hood – How Amazon.com Uses AWS Services for Analytics at Mas...
A Look Under the Hood – How Amazon.com Uses AWS Services for Analytics at Mas...A Look Under the Hood – How Amazon.com Uses AWS Services for Analytics at Mas...
A Look Under the Hood – How Amazon.com Uses AWS Services for Analytics at Mas...
 
SID344-Soup to Nuts Identity Federation for AWS
SID344-Soup to Nuts Identity Federation for AWSSID344-Soup to Nuts Identity Federation for AWS
SID344-Soup to Nuts Identity Federation for AWS
 
How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...
How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...
How Netflix Monitors Applications in Near Real-time w Amazon Kinesis - ABD401...
 
AMF305_Autonomous Driving Algorithm Development on Amazon AI
AMF305_Autonomous Driving Algorithm Development on Amazon AIAMF305_Autonomous Driving Algorithm Development on Amazon AI
AMF305_Autonomous Driving Algorithm Development on Amazon AI
 
STG311_Deep Dive on Amazon S3 & Amazon Glacier Storage Management
STG311_Deep Dive on Amazon S3 & Amazon Glacier Storage ManagementSTG311_Deep Dive on Amazon S3 & Amazon Glacier Storage Management
STG311_Deep Dive on Amazon S3 & Amazon Glacier Storage Management
 
GAM305_Automating Mother Nature
GAM305_Automating Mother NatureGAM305_Automating Mother Nature
GAM305_Automating Mother Nature
 

Semelhante a ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores New Innovation with Amazon Kinesis Firehose

Building a Real-Time Data Platform on AWS
Building a Real-Time Data Platform on AWSBuilding a Real-Time Data Platform on AWS
Building a Real-Time Data Platform on AWSInjae Kwak
 
Real-time Analytics using Data from IoT Devices - AWS Online Tech Talks
Real-time Analytics using Data from IoT Devices - AWS Online Tech TalksReal-time Analytics using Data from IoT Devices - AWS Online Tech Talks
Real-time Analytics using Data from IoT Devices - AWS Online Tech TalksAmazon Web Services
 
How TrueCar Gains Actionable Insights with Splunk Cloud PPT
How TrueCar Gains Actionable Insights with Splunk Cloud PPTHow TrueCar Gains Actionable Insights with Splunk Cloud PPT
How TrueCar Gains Actionable Insights with Splunk Cloud PPTAmazon Web Services
 
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...Amazon Web Services
 
Innovations fueled by IoT and the Cloud
Innovations fueled by IoT and the CloudInnovations fueled by IoT and the Cloud
Innovations fueled by IoT and the CloudAdrian Hornsby
 
Intro To AWS for Mobile Developers: Collision 2018
Intro To AWS for Mobile Developers: Collision 2018Intro To AWS for Mobile Developers: Collision 2018
Intro To AWS for Mobile Developers: Collision 2018Amazon Web Services
 
Introduction to AWS for Mobile Developers
Introduction to AWS for Mobile DevelopersIntroduction to AWS for Mobile Developers
Introduction to AWS for Mobile DevelopersAmazon Web Services
 
ABD206-Building Visualizations and Dashboards with Amazon QuickSight
ABD206-Building Visualizations and Dashboards with Amazon QuickSightABD206-Building Visualizations and Dashboards with Amazon QuickSight
ABD206-Building Visualizations and Dashboards with Amazon QuickSightAmazon Web Services
 
NEW LAUNCH! AWS IoT Analytics from Consumer IoT to Industrial IoT - IOT211 - ...
NEW LAUNCH! AWS IoT Analytics from Consumer IoT to Industrial IoT - IOT211 - ...NEW LAUNCH! AWS IoT Analytics from Consumer IoT to Industrial IoT - IOT211 - ...
NEW LAUNCH! AWS IoT Analytics from Consumer IoT to Industrial IoT - IOT211 - ...Amazon Web Services
 
IOT311_Customer Stories of Things, Cloud, and Analytics on AWS
IOT311_Customer Stories of Things, Cloud, and Analytics on AWSIOT311_Customer Stories of Things, Cloud, and Analytics on AWS
IOT311_Customer Stories of Things, Cloud, and Analytics on AWSAmazon Web Services
 
ARC319_Multi-Region Active-Active Architecture
ARC319_Multi-Region Active-Active ArchitectureARC319_Multi-Region Active-Active Architecture
ARC319_Multi-Region Active-Active ArchitectureAmazon Web Services
 
I Want to Analyze and Visualize Website Access Logs, but Why Do I Need Server...
I Want to Analyze and Visualize Website Access Logs, but Why Do I Need Server...I Want to Analyze and Visualize Website Access Logs, but Why Do I Need Server...
I Want to Analyze and Visualize Website Access Logs, but Why Do I Need Server...Amazon Web Services
 
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...Amazon Web Services
 
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...Amazon Web Services
 
Design, Build, and Modernize Your Web Applications with AWS
 Design, Build, and Modernize Your Web Applications with AWS Design, Build, and Modernize Your Web Applications with AWS
Design, Build, and Modernize Your Web Applications with AWSDonnie Prakoso
 
ARC306_High Resiliency & Availability Of Online Entertainment Communities Usi...
ARC306_High Resiliency & Availability Of Online Entertainment Communities Usi...ARC306_High Resiliency & Availability Of Online Entertainment Communities Usi...
ARC306_High Resiliency & Availability Of Online Entertainment Communities Usi...Amazon Web Services
 
Containers on AWS - State of the Union - CON201 - re:Invent 2017
Containers on AWS - State of the Union - CON201 - re:Invent 2017Containers on AWS - State of the Union - CON201 - re:Invent 2017
Containers on AWS - State of the Union - CON201 - re:Invent 2017Amazon Web Services
 
Healthcare Payers and Serverless Batch Processing Engines - HLC308 - re:Inven...
Healthcare Payers and Serverless Batch Processing Engines - HLC308 - re:Inven...Healthcare Payers and Serverless Batch Processing Engines - HLC308 - re:Inven...
Healthcare Payers and Serverless Batch Processing Engines - HLC308 - re:Inven...Amazon Web Services
 

Semelhante a ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores New Innovation with Amazon Kinesis Firehose (20)

Building a Real-Time Data Platform on AWS
Building a Real-Time Data Platform on AWSBuilding a Real-Time Data Platform on AWS
Building a Real-Time Data Platform on AWS
 
Real-time Analytics using Data from IoT Devices - AWS Online Tech Talks
Real-time Analytics using Data from IoT Devices - AWS Online Tech TalksReal-time Analytics using Data from IoT Devices - AWS Online Tech Talks
Real-time Analytics using Data from IoT Devices - AWS Online Tech Talks
 
How TrueCar Gains Actionable Insights with Splunk Cloud PPT
How TrueCar Gains Actionable Insights with Splunk Cloud PPTHow TrueCar Gains Actionable Insights with Splunk Cloud PPT
How TrueCar Gains Actionable Insights with Splunk Cloud PPT
 
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
NEW LAUNCH! AWS PrivateLink: Bringing SaaS Solutions into Your VPCs and Your ...
 
Innovations fueled by IoT and the Cloud
Innovations fueled by IoT and the CloudInnovations fueled by IoT and the Cloud
Innovations fueled by IoT and the Cloud
 
Intro To AWS for Mobile Developers: Collision 2018
Intro To AWS for Mobile Developers: Collision 2018Intro To AWS for Mobile Developers: Collision 2018
Intro To AWS for Mobile Developers: Collision 2018
 
ENT315_Landing Zones
ENT315_Landing ZonesENT315_Landing Zones
ENT315_Landing Zones
 
Introduction to AWS for Mobile Developers
Introduction to AWS for Mobile DevelopersIntroduction to AWS for Mobile Developers
Introduction to AWS for Mobile Developers
 
ABD206-Building Visualizations and Dashboards with Amazon QuickSight
ABD206-Building Visualizations and Dashboards with Amazon QuickSightABD206-Building Visualizations and Dashboards with Amazon QuickSight
ABD206-Building Visualizations and Dashboards with Amazon QuickSight
 
NEW LAUNCH! AWS IoT Analytics from Consumer IoT to Industrial IoT - IOT211 - ...
NEW LAUNCH! AWS IoT Analytics from Consumer IoT to Industrial IoT - IOT211 - ...NEW LAUNCH! AWS IoT Analytics from Consumer IoT to Industrial IoT - IOT211 - ...
NEW LAUNCH! AWS IoT Analytics from Consumer IoT to Industrial IoT - IOT211 - ...
 
IOT311_Customer Stories of Things, Cloud, and Analytics on AWS
IOT311_Customer Stories of Things, Cloud, and Analytics on AWSIOT311_Customer Stories of Things, Cloud, and Analytics on AWS
IOT311_Customer Stories of Things, Cloud, and Analytics on AWS
 
ARC319_Multi-Region Active-Active Architecture
ARC319_Multi-Region Active-Active ArchitectureARC319_Multi-Region Active-Active Architecture
ARC319_Multi-Region Active-Active Architecture
 
I Want to Analyze and Visualize Website Access Logs, but Why Do I Need Server...
I Want to Analyze and Visualize Website Access Logs, but Why Do I Need Server...I Want to Analyze and Visualize Website Access Logs, but Why Do I Need Server...
I Want to Analyze and Visualize Website Access Logs, but Why Do I Need Server...
 
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
NEW LAUNCH! Data Driven Apps with GraphQL: AWS AppSync Deep Dive - MBL402 - r...
 
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
RET303_Drive Warehouse Efficiencies with the Same AWS IoT Technology that Pow...
 
Design, Build, and Modernize Your Web Applications with AWS
 Design, Build, and Modernize Your Web Applications with AWS Design, Build, and Modernize Your Web Applications with AWS
Design, Build, and Modernize Your Web Applications with AWS
 
ARC306_High Resiliency & Availability Of Online Entertainment Communities Usi...
ARC306_High Resiliency & Availability Of Online Entertainment Communities Usi...ARC306_High Resiliency & Availability Of Online Entertainment Communities Usi...
ARC306_High Resiliency & Availability Of Online Entertainment Communities Usi...
 
Containers on AWS - State of the Union - CON201 - re:Invent 2017
Containers on AWS - State of the Union - CON201 - re:Invent 2017Containers on AWS - State of the Union - CON201 - re:Invent 2017
Containers on AWS - State of the Union - CON201 - re:Invent 2017
 
HLC308_Refactoring to the Cloud
HLC308_Refactoring to the CloudHLC308_Refactoring to the Cloud
HLC308_Refactoring to the Cloud
 
Healthcare Payers and Serverless Batch Processing Engines - HLC308 - re:Inven...
Healthcare Payers and Serverless Batch Processing Engines - HLC308 - re:Inven...Healthcare Payers and Serverless Batch Processing Engines - HLC308 - re:Inven...
Healthcare Payers and Serverless Batch Processing Engines - HLC308 - re:Inven...
 

Mais de Amazon Web Services

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Amazon Web Services
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Amazon Web Services
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateAmazon Web Services
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSAmazon Web Services
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Amazon Web Services
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Amazon Web Services
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...Amazon Web Services
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsAmazon Web Services
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareAmazon Web Services
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSAmazon Web Services
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAmazon Web Services
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareAmazon Web Services
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWSAmazon Web Services
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckAmazon Web Services
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without serversAmazon Web Services
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...Amazon Web Services
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceAmazon Web Services
 

Mais de Amazon Web Services (20)

Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
Come costruire servizi di Forecasting sfruttando algoritmi di ML e deep learn...
 
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
Big Data per le Startup: come creare applicazioni Big Data in modalità Server...
 
Esegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS FargateEsegui pod serverless con Amazon EKS e AWS Fargate
Esegui pod serverless con Amazon EKS e AWS Fargate
 
Costruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWSCostruire Applicazioni Moderne con AWS
Costruire Applicazioni Moderne con AWS
 
Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot Come spendere fino al 90% in meno con i container e le istanze spot
Come spendere fino al 90% in meno con i container e le istanze spot
 
Open banking as a service
Open banking as a serviceOpen banking as a service
Open banking as a service
 
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
Rendi unica l’offerta della tua startup sul mercato con i servizi Machine Lea...
 
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...OpsWorks Configuration Management: automatizza la gestione e i deployment del...
OpsWorks Configuration Management: automatizza la gestione e i deployment del...
 
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows WorkloadsMicrosoft Active Directory su AWS per supportare i tuoi Windows Workloads
Microsoft Active Directory su AWS per supportare i tuoi Windows Workloads
 
Computer Vision con AWS
Computer Vision con AWSComputer Vision con AWS
Computer Vision con AWS
 
Database Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatareDatabase Oracle e VMware Cloud on AWS i miti da sfatare
Database Oracle e VMware Cloud on AWS i miti da sfatare
 
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJSCrea la tua prima serverless ledger-based app con QLDB e NodeJS
Crea la tua prima serverless ledger-based app con QLDB e NodeJS
 
API moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e webAPI moderne real-time per applicazioni mobili e web
API moderne real-time per applicazioni mobili e web
 
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatareDatabase Oracle e VMware Cloud™ on AWS: i miti da sfatare
Database Oracle e VMware Cloud™ on AWS: i miti da sfatare
 
Tools for building your MVP on AWS
Tools for building your MVP on AWSTools for building your MVP on AWS
Tools for building your MVP on AWS
 
How to Build a Winning Pitch Deck
How to Build a Winning Pitch DeckHow to Build a Winning Pitch Deck
How to Build a Winning Pitch Deck
 
Building a web application without servers
Building a web application without serversBuilding a web application without servers
Building a web application without servers
 
Fundraising Essentials
Fundraising EssentialsFundraising Essentials
Fundraising Essentials
 
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
AWS_HK_StartupDay_Building Interactive websites while automating for efficien...
 
Introduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container ServiceIntroduzione a Amazon Elastic Container Service
Introduzione a Amazon Elastic Container Service
 

ABD208_Cox Automotive Empowered to Scale with Splunk Cloud & AWS and Explores New Innovation with Amazon Kinesis Firehose

  • 1. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Cox Automoti ve E mpowered to Scal e wi th Spl unk Cl oud & AWS and Expl ores New Innovati on wi th Amazon Ki nesi s F i rehose R a y Z h u | P r o d u c t M a n a g e r , A W S E l i a s H a d d a d | P r o d u c t M a n a g e r , S p l u n k S t e v e n H a t c h | E n t e r p r i s e L o g g i n g S e r v i c e s M a n a g e r N o v e m b e r 2 8 , 2 0 1 7
  • 2. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Agenda • What is Splunk • Current Splunk ingestion landscape for AWS • Current challenges • New solution • Cox Automotive use case • Q&A
  • 3. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Forward-looking statements During the course of this presentation, we may make forward-looking statements regarding future events or the expected performance of the company. We caution you that such statements reflect our current expectations and estimates based on factors currently known to us and that actual events or results could differ materially. For important factors that may cause actual results to differ from those contained in our forward-looking statements, please review our filings with the SEC. The forward-looking statements made in this presentation are being made as of the time and date of its live presentation. If reviewed after its live presentation, this presentation may not contain current or accurate information. We do not assume any obligation to update any forward-looking statements we may make. In addition, any information about our roadmap outlines our general product direction and is subject to change at any time without notice. It is for informational purposes only and shall not be incorporated into any contract or other commitment. Splunk undertakes no obligation either to develop the features or functionality described or to include any such feature or functionality in a future release. Splunk, Splunk>, Listen to Your Data, The Engine for Machine Data, Splunk Cloud, Splunk Light and SPL are trademarks and regi stered trademarks of Splunk Inc. in the United States and other countries. All other brand names, product names, or trademarks belon g to their respective owners. © 2017 Splunk Inc. All rights reserved.
  • 4. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Turn data into answers with Splunk
  • 5. © 2017 SPLUNK INC. Machine data Your data is talking. Are you listening?
  • 6. © 2017 SPLUNK INC. What is machine data? Application data Mobile app and website data 44% of the world’s population will own smartphones in 2017* IT infrastructure data Network servers, cloud services Average cost of downtime for a data center is $7,900 per minute* Security data Firewall data, endpoint data Cybercrime will cost the world in excess of $6 trillion annually by 2021* Customer-generated data Social media data, support call logs There are 2.8 billion social media users worldwide* Internet of Things data Temperature control, speed instruments 8.4 Billion connected "things" will be in use in 2017*
  • 7. © 2017 SPLUNK INC. To meet higher customer expectations, companies must leverage their machine data. I expect recommendations & upgrades based on my preferences I expect seamless, personalized interactions I expect you to know who I am, across channels I expect you to proactively resolve my issues I expect you to know where I am & what I need Use machine data. Meet customer expectations. I expect you to protect my data
  • 8. © 2017 SPLUNK INC. Why is this so hard? Machine data is messy and unpredictable Requires massive scale You don’t always know which questions to ask
  • 9. © 2017 SPLUNK INC. Any question, any data, in real time Single Platform, Many Lenses Open Ecosystem HybridPerformance at Scale Machine Learning
  • 10. © 2017 SPLUNK INC. © 2017 SPLUNK INC.
  • 11. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Proven at 13,000+ customers in 110+ countries More than 85 of the Fortune 100 Technology Travel and Leisure ManufacturingGovernment Education Healthcare Telecommunications Energy and Utilities Media Financial Services and Insurance Retail Cloud and Online Services
  • 12. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Splunk portfolio of AWS solutions AMI on AWS Marketplace Benefits of Splunk Enterprise as SaaS AMI on AWS Marketplace App for AWS AWS Integrations AWS Lambda, AWS IoT, Amazon Kinesis, Amazon EMR, Amazon EC2 Container Service SaaS Contract Billed through Marketplace Available on Splunk Enterprise, Splunk Cloud and Splunk Insights for Cloud Monitoring End-to-end AWS visibility Self-deployed AMIs or SaaS on AWS Marketplace AWS-based SaaS sdInsights for AWS Cloud Monitoring
  • 13. © 2017 SPLUNK INC. 13 Splunk Cloud available worldwide Monitored by
  • 14. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Current Splunk end-to-end landscape for AWS v1.2
  • 15. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Poll-based ingestion challenges • Reliability, scalability, and fault tolerance • Management overhead of data-collection nodes • Delayed event delivery due to poll-based ingestion • API throttling with poll-based data ingestion
  • 16. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Need for new solution
  • 17. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Kinesis Amazon Kinesis Firehose Easily load streaming data into AWS Amazon Kinesis Analytics Easily process and analyze streaming data with standard SQL Amazon Kinesis Streams Build custom applications that process and analyze streaming data
  • 18. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Current state of Amazon Kinesis Firehose Ingest Transfor m Deliver Amazon Kinesis Agent Amazon Kinesis Streams Amazon CloudWatch Logs Amazon CloudWatch Events AWS IoT Amazon S3 Amazon Redshift Amazon Elasticsearch
  • 19. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Our answers to challenges • Reliability, scalability, and fault-tolerance challenges  Extremely reliable with underlying infrastructure operating in three different AZs  Extremely durable with three copies of same data in three different AZs  Temporarily holds and buffers data to absorb back pressure  Data backup to Amazon S3 upon failure • Management overhead of data-collection nodes in existing solution  Serverless with no resource provision or management overhead • Delayed event delivery due to poll-based ingestion  Push delivery with configurable buffer size and interval • API throttling with poll-based data ingestion  Horizontally scalable with no limit
  • 20. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Kinesis Firehose with Splunk delivery AWS IoT Amazon S3 Amazon Redshift Amazon Elasticsearch Amazon Kinesis Agent Amazon Kinesis Streams Amazon CloudWatch Logs Amazon CloudWatch Events Ingest Transform Deliver
  • 21. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Kinesis Firehose advantages Why would I use Amazon Kinesis Firehose as opposed to other ingestion mechanisms for Splunk?
  • 22. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Why Amazon Kinesis Firehose • Fully managed service with serverless architecture • Bypass the need for setting up and managing heavyweight forwarder • Greater reliability and scalability • Well integrated with various data sources • Easy to use with no programming requirement • Ability to transform raw data prior to sending it to Splunk • Very low cost—$0.029 per GB of data ingested via Amazon Kinesis Firehose
  • 23. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Serverless and scalable • Supports native balancing to indexing tier • Supports Splunk Cloud and Splunk Enterprise • Leverages HTTP Event Collector’s indexer acknowledgment • Makes sure events are written to disk on Splunk’s side • Unacknowledged events are sent again
  • 24. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Serverless and scalable • Supports ELB and third-party load balancers
  • 25. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Greater reliability: Hybrid push/pull • Supports delivery acknowledgment. Unacknowledged events can be persisted to Amazon S3 and ingested again via alternative delivery mechanism. • Undelivered and unacknowledged events can be ingested from Amazon S3 bucket using poll-based mechanism (Splunk add-on for AWS) • Hybrid push/pull: backup route less prone to same bottleneck
  • 26. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Greater reliability: Serverless architecture • Undelivered and unacknowledged events can be ingested from Amazon S3 using AWS Lambda for full push-based architecture • Lambda can be configured to push data to a failover HEC endpoint • Pure push, serverless-based architecture; no forwarder required
  • 27. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. • Consolidate Amazon VPC flow data from multiple accounts into one Amazon Kinesis Firehose delivery stream • Ability to route events to different indexes based on AWS Lambda conditions Cross-account delivery
  • 28. New Splunk end-to-end landscape for AWS
  • 29. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Amazon Kinesis Firehose use case When would I use Amazon Kinesis Firehose as opposed to other ingestion mechanisms for Splunk?
  • 30. Steven Hatch 30 Leading international Splunk rollout across Cox Automotive 20 Years Enterprise IT Experience Enterprise Logging Services Manager
  • 31. A leading provider of products and services that span the automotive ecosystem worldwide. More than 20 brands that together provide end-to-end solutions for customers large and small. A subsidiary of Cox Enterprises, Inc.
  • 32. Transform the way the world buys, sells, and owns cars.
  • 33.
  • 34.
  • 35.
  • 36.
  • 37.
  • 38.
  • 39. Audio / Video Network Gear Monitoring
  • 40. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Internet Data Center App Closed Internet Auction Lane
  • 41. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Internet Data Center App Closed Internet
  • 42. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved.
  • 43. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Monitoring App Monitoring App Monitoring AppMonitoring App
  • 44.
  • 45. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Correlation Alert routing Ingest all component data Homegrown anomaly detection
  • 47. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Expansion of self-service @ Cox Automotive Build recipe of success by way of the key ingredients Devs or application teams can build it however they want
  • 48. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Center of Excellence Build partnerships Develop standards Standardize infrastructure Empower, educate, and delegate Evangelize Build for scale Grow the business
  • 49. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Q&A
  • 50. © 2017, Amazon Web Services, Inc. or its Affiliates. All rights reserved. Thank you!