PistonHead's use of MongoDB for Analytics

•Transferir como PPTX, PDF•

0 gostou•10,305 visualizações

Haymarket Media Group is building a reporting and analytics suite called PistonHub to provide dealers and administrators insights into classifieds and stock performance data. PistonHub will aggregate data from various sources like classifieds, calls, emails, and stock information to generate daily statistics for each dealer that can be viewed on a dashboard. This consolidated data will give dealers and sales teams more visibility to help dealers improve performance. The initial feedback on PistonHub has been positive for providing extra insights.

Software

Haymarket Media Group
Building a reporting and analytics suite for dealers and
administrators
Pete Dignan - Platform Director
@RacingPete

PistonHeadsPistonHeads
Started in 1998
Original social network
Always irreverent
Classifieds
News
Forums

Classifieds
140,000 cars
6.5 million users
100 million page views
9 minute average visit duration
More 17k+ vehicles than competitors

Vision - PistonHub
“To create a stock insights and trading screen, providing secure access to the
statistics behind the classifieds, and opening up the true performance of our
classifieds to Dealer Groups, Individual Dealers and Internal Staff”

2nd Problem - Stock and Classifieds Data
MongoDB
Advert Data
Category
Make/Model
History
Ad Status
MySQL
Dealer Groups
Individual Dealers

PistonHub Architecture Solution
Abstract Data
Aggregator
Google Data API
HTTP/SOAP
.Net Driver
ADO .Net
API AngularJS App

${ "_id" : ObjectId("564a9892ad2e970fac7f6fff"), "CDRId" : "ac61259e35bacc174f3e9ff0afd4c0c58ff6ffff", "NTSNum" : "01234567890", "FromNum" : "0771234567", "ToNum" : "01234567891", "DialledNum" : "+44771234567", "ConnectTime" : ISODate("2015-11-11T02:18:14Z"), "CallDuration" : "3", "TalkTime" : "3", "TimeToAnswer" : "1975", "DisconnectText" : "Answered", "DisconnectType" : "Answered", "Recorded" : "N", "CallId" : "i1447208272.153117.xxxx", "LoadDate" : ISODate("2015-11-11T03:00:01.177Z") } { "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } { "DealerAltPhone" : "01234567891", "DealerGroupId" : 0, "DealerGroupIdStr" : "0", "DealerGroupName" : null, "DealerId" : 61056992, "DealerIdStr" : "61056992", "DealerName" : "Dealer LTD", "DealerPhone" : "01234567890", "TrackingAltPhone" : null, "TrackingPhone" : "01234567890", "_id" : ObjectId("555ef398e816135315639fff") } Raw Gamma Data Raw Dealer Data Phone Data Abstract Data Aggregator$

${ "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } Phone Data Abstract Data Aggregator { "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } { "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } { "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } View Data Email Data Stock Data { "AdViews" : 119, "CallLeads" : 0, "Calls" : 1, "Date" : ISODate("2015-11-10T00:00:00Z"), "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "DeepLinkClicks" : 1, "EmailLeads" : 1, "Emails" : 1, "NormalizedDealerName" : "DEALER LTD", "Phone" : "01234567890", "Stock" : 2, "TrackingPhone" : "0771234567", "WebsiteClicks" : 14, "_id" : "61xxxx_2015-10-10" } Dealer Stats$

Conclusions
Pipeline aggregation is super fast to collate data…
… and run queries for AngularJS
Storing day by day data means easy to do custom date formats
Dealer feedback has been very positive on the extra insights
Sales teams have used the system to proactively help dealers
Wish we were using 3.2

Mais conteúdo relacionado

Mais procurados

Today's customers demand applications which integrate intelligently with data from mobile, social media and cloud sources. A system of engagement meets these expectations by applying data and analytics drawn from an array of master systems. The enormous scale and performance required overwhelm relational approaches, but we can use MongoDB to meet the challenge. We'll learn to capture and transmit data changes among disparate systems, expose batch data as interactive operational queries and build systems with strong division of concerns, agility and flexibility.

Data Management 2: Conquering Data Proliferation

MongoDB

MongoDB - Back to Basics - La tua prima Applicazione

Massimo Brignoli

Analytics with MongoDB Aggregation Framework and Hadoop Connector

Henrik Ingo

ElasticSearch - Introduction to Aggregations

enterprisesearchmeetup

Just a few years ago all software systems were designed to be monoliths running on a single big and powerful machine. But nowadays most companies desire to scale out instead of scaling up, because it is much easier to buy or rent a large cluster of commodity hardware then to get a single machine that is powerful enough. In the database area scaling out is realized by utilizing a combination of polyglot persistence and sharding of data. On the application level scaling out is realized by microservices. In this talk I will briefly introduce the concepts and ideas of microservices and discuss their benefits and drawbacks. Afterwards I will focus on the point of intersection of a microservice based application talking to one or many NoSQL databases. We will try and find answers to these questions: Are the differences to a monolithic application? How to scale the whole system properly? What about polyglot persistence? Is there a data-centric way to split microservices?

Michael Hackstein - NoSQL meets Microservices - NoSQL matters Dublin 2015

NoSQLmatters

Immediate feedback is an essential part of modern application development where developers want to sync across platforms, systems, and users to provide better end-user experiences. Change streams empower developers to easily leverage the power of MongoDB's internal real-time functionality to react to relevant data changes immediately. Change streams also provide the backbone of MongoDB Atlas triggers. This session introduces change streams and walks you through developing with them. We will discuss use cases, integrating with Kafka, and explore how to make good architectural decisions around this new functionality.

MongoDB .local Toronto 2019: Using Change Streams to Keep Up with Your Data

MongoDB

The United States will be deploying 16,000 traffic speed monitoring sensors - 1 on every mile of US interstate in urban centers. These sensors update the speed, weather, and pavement conditions once per minute. MongoDB will collect and aggregate live sensor data feeds from roadways around the country, support real-time queries from cars on traffic conditions on their route as well as be the platform for real-time dashboards displaying traffic conditions and more complex analytical queries used to identify traffic trends. In this session, we’ll implement a few different data aggregation techniques to query and dashboard the metrics gathered from the US interstate.

MongoDB for Time Series Data Part 2: Analyzing Time Series Data Using the Agg...

MongoDB

This webinar will walk you through building a simple Java-based application in MongoDB. We’ll cover the basics of MongoDB’s document model, query language, aggregation framework, and deployment architecture. In this webinar, you will discover: - How easy it is to start building Java applications with MongoDB - Key features for manipulating and accessing data - High availability and scale-out architecture - WriteConcerns and ReadPreference

Webinar: Building Your First App with MongoDB and Java

MongoDB

Having recently implemented a new framework for the real-time collection, aggregation and visualization of web and mobile generated Clickstream traffic (realizing daily click-stream volumes of 1M+ events), this walkthrough is about the motivations, throughout-process and key decisions made, as well as an in depth look at the implementation of how to buildout a data-collection, analytics and visualization framework using MongoDB. Technologies covered in this presentation (as well as MongoDB) are Java, Spring, Django and Pymongo.

Implementing and Visualizing Clickstream data with MongoDB

MongoDB

Online | MongoDB Atlas on GCP Workshop

Natasha Wilson

One of MongoDB’s primary appeals to developers is that it gives them the ability to start application development without needing to define a formal, up-front schema. Operations teams appreciate the fact that they don't need to perform a time-consuming schema upgrade operation every time the developers need to store a different attribute (as an example, The Weather Channel is now able to launch new features in hours whereas it used to take weeks). For business leaders, the application gets launched much faster, and new features can be rolled out more frequently. MongoDB powers agility. Some projects reach a point where it's necessary to define rules on what's being stored in the database – for example, that for any document in a particular collection, you can be assured that certain attributes are present. To address the challenges discussed above, while at the same time maintaining the benefits of a dynamic schema, MongoDB 3.2 introduces document validation. There is significant flexibility to customize which parts of the documents are **and are not** validated for any collection.

Document validation in MongoDB 3.2

Andrew Morgan

Indexing and Query Optimizer (Mongo Austin)

MongoDB

Data modeling is hard, especially in the world of distributed NoSQL stores. With relational databases, developers have tended to store normalized data and shape their query model around that structure. This can come back to bite you when it comes time to scale, as complex queries across dozens of tables begin to affect application performance. It’s common to find developers rethinking their data model as query latency increases under load. With NoSQL stores, developers must consider their query patterns from the outset of application development, designing their data model to fit those patterns. A number of techniques, new and old, can be used to allow for maximum performance and scalability. Topics covered will include: De-normalization, time boxing, conflict resolution, and convergent & commutative replicated data types. Additionally, discussions of common query patterns in light of the capabilities of various NoSQL data stores will be reviewed.

Next Top Data Model by Ian Plosker

SyncConf

Spring Data, Jongo & Co.

Tobias Trelle

We all know that MongoDB is one of the most flexible and feature-rich databases available. In this session we'll discuss how you can leverage this feature set and maintain high performance with your project's massive data sets and high loads. We'll cover how indexes can be designed to optimize the performance of MongoDB. We'll also discuss tips for diagnosing and fixing performance issues should they arise.

2011 Mongo FR - Indexing in MongoDB

antoinegirbal

Faites évoluer votre accès aux données avec MongoDB Stitch

MongoDB

MongoDB Analytics: Learn Aggregation by Example - Exploratory Analytics and V...

MongoDB

MongoDB Europe 2016 - Graph Operations with MongoDB

MongoDB

MongoDB: Comparing WiredTiger In-Memory Engine to Redis

Jason Terpko

Developers love MongoDB because its flexible document model enhances their productivity. But did you know that MongoDB supports rich queries and lets you accomplish some of the same things you currently do with SQL statements? And that MongoDB's powerful aggregation framework makes it possible to perform real-time analytics for dashboards and reports? Watch this webinar for an introduction to the MongoDB aggregation framework and a walk through of what you can do with it. We'll also demo an analysis of U.S. census data.

Webinar: Exploring the Aggregation Framework

MongoDB

Mais procurados (20)

Data Management 2: Conquering Data Proliferation

MongoDB - Back to Basics - La tua prima Applicazione

Analytics with MongoDB Aggregation Framework and Hadoop Connector

ElasticSearch - Introduction to Aggregations

Michael Hackstein - NoSQL meets Microservices - NoSQL matters Dublin 2015

MongoDB .local Toronto 2019: Using Change Streams to Keep Up with Your Data

MongoDB for Time Series Data Part 2: Analyzing Time Series Data Using the Agg...

Webinar: Building Your First App with MongoDB and Java

Implementing and Visualizing Clickstream data with MongoDB

Online | MongoDB Atlas on GCP Workshop

Document validation in MongoDB 3.2

Indexing and Query Optimizer (Mongo Austin)

Next Top Data Model by Ian Plosker

Spring Data, Jongo & Co.

2011 Mongo FR - Indexing in MongoDB

Faites évoluer votre accès aux données avec MongoDB Stitch

MongoDB Analytics: Learn Aggregation by Example - Exploratory Analytics and V...

MongoDB Europe 2016 - Graph Operations with MongoDB

MongoDB: Comparing WiredTiger In-Memory Engine to Redis

Webinar: Exploring the Aggregation Framework

Destaque

One of MongoDB’s primary attractions for developers is that it gives them the ability to start application development without needing to define a formal, up-front schema. Operations teams appreciate the fact that they don't need to perform a time-consuming schema upgrade operation every time the developers need to store a different attribute. Some projects reach a point where it's necessary to define rules on what's being stored in the database. This webinar explains how MongoDB 3.2 allows that document validation work to be performed by the database rather than in the application code. This webinar focuses on the benefits of using document validation: how to set up the rules using the familiar MongoDB Query Language and how to safely roll it out into an existing, mature production environment.

Document Validation in MongoDB 3.2

MongoDB

MongoDB Developer's Notebook, March 2016 -- MongoDB Connector for Business In...

Daniel M. Farrell

Haymarket MotorRacing

Tim Bulley

Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...

Optimizely

MongoDB is known for being a developers database of choice, but what about data analysts? MongoDB 3.2 has introduced the MongoDB BI Connector – to allow users to connect to an instance using their analytics tool of choice. Now users of Tableau, QlikView, Excel, Cognos, and countless others can connect to MongoDB and immediately begin building reporting solutions. In this webinar, we will cover the architecture needed to use the BI Connector with MongoDB. We will also demonstrate how to build reports with your data.

Webinar: MongoDB and Analytics: Building Solutions with the MongoDB BI Connector

MongoDB

MongoDB 101 & Beyond: Get Started in MongoDB 3.0, Preview 3.2 & Demo of Ops M...

MongoDB

There’s a lot of excitement around NoSQL Data Stores with the promise of simple access patterns, flexible schemas, scalability and High Availability. The downside comes in the form of losing ACID transactions, consistency, flexible queries and data integrity checks. What if you could have the best of both worlds? This session shows how MySQL Cluster provides simultaneous SQL and native NoSQL access to your data – whether a simple key-value API (Memcached), REST, JavaScript, Java or C++. You will hear how the MySQL Cluster architecture delivers in-memory real-time performance, 99.999% availability, on-line maintenance and linear, horizontal scalability through transparent auto-sharding.

FOSDEM 2015 - NoSQL and SQL the best of both worlds

Andrew Morgan

A new generation of technologies is needed to consume and exploit today's real time, fast moving data sources. Apache Kafka, originally developed at LinkedIn, has emerged as one of these key new technologies. This webinar explores the use-cases and architecture for Kafka, and how it integrates with MongoDB to build sophisticated data-driven applications that exploit new sources of data. Watch the webinar to learn: - What MongoDB is and where it's used - What data streaming is and where it fits into modern data architectures - How Kafka works, what it delivers, and where it's used - How to operationalize the Data Lake with MongoDB & Kafka - How MongoDB integrates with Kafka – both as a producer and a consumer of event data The webinar is co-presented with Confluent, the company founded by the creators of Apache Kafka.

Webinar: Data Streaming with Apache Kafka & MongoDB

MongoDB

Data Streaming with Apache Kafka & MongoDB - EMEA

Andrew Morgan

Introduction to MongoDB

MongoDB

Mongo DB

Edureka!

Modeling Data in MongoDB

lehresman

MongoDB Schema Design

MongoDB

MongoDB Schema Design: Four Real-World Examples

Mike Friedman

Destaque (14)

Document Validation in MongoDB 3.2

MongoDB Developer's Notebook, March 2016 -- MongoDB Connector for Business In...

Haymarket MotorRacing

Case Study by Jon Warden and Shruti Ahuja of Haymarket - Optimizely Experienc...

Webinar: MongoDB and Analytics: Building Solutions with the MongoDB BI Connector

MongoDB 101 & Beyond: Get Started in MongoDB 3.0, Preview 3.2 & Demo of Ops M...

FOSDEM 2015 - NoSQL and SQL the best of both worlds

Webinar: Data Streaming with Apache Kafka & MongoDB

Data Streaming with Apache Kafka & MongoDB - EMEA

Introduction to MongoDB

Mongo DB

Modeling Data in MongoDB

MongoDB Schema Design

MongoDB Schema Design: Four Real-World Examples

Semelhante a PistonHead's use of MongoDB for Analytics

MongoDB World 2014 - BillRun, Billing on top of MongoDB

Ofer Cohen

IOOF IT System Modernisation

MongoDB

Kde jsou limity zákaznické 360°?

Taste Medio

In this session, learn how Bonobos, an online retailer for men's clothing and accessories, powers their personalized customer experiences on top of AWS. We start by exploring the foundational elements required to build an effective retail data platform as well as the building blocks provided by AWS to deliver these experiences. Learn how Bonobos leverages Segment in their architecture, and hear from Bonobos and Segment on the objectives, challenges, and outcomes realized by Bonobos through their journey in constructing and deploying their personalization platform.

Real-Time Personalized Customer Experiences at Bonobos (RET203) - AWS re:Inve...

Amazon Web Services

Next Generation Fraud Solutions using Neo4j

Neo4j

Neo4j GraphTalk Copenhagen - Next Generation Solutions using Neo4j

Neo4j

Flink Forward San Francisco 2022. Being in the payments space, Stripe requires strict correctness and freshness guarantees. We rely on Flink as the natural solution for delivering on this in support of our Change Data Capture (CDC) infrastructure. We heavily rely on CDC as a tool for capturing data change streams from our databases without critically impacting database reliability, scalability, and maintainability. Data derived from these streams is used broadly across the business and powers many of our critical financial reporting systems totalling over $640 Billion in payment volume annually. We use many components of Flink’s flexible DataStream API to perform aggregations and abstract away the complexities of stream processing from our downstreams. In this talk, we’ll walk through our experience from the very beginning to what we have in production today. We’ll share stories around the technical details and trade-offs we encountered along the way. by Jeff Chao

Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...

Flink Forward

Big Data is not just for Big Businesses. In this slideshare we will cover how small businesses and startups can leverage Big Data to increase revenue. HPCC Systems lets you get started with only one machine and grow to exabytes. 1. Mining and understanding customers behavior from data outside the firewall and joining it with internal data to turn it into actionable marketing strategies. 2. Understanding your whole business with BI tools. Learn how Big Data help join data from different parts of your business to see the big picture.

Big Data for Small Businesses & Startups

Fujio Turner

Mongo db world 2014 billrun

MongoDB

How do you run analytics queries on a dataset that grows by billions of entries a day? What if you need to be able to drill into it, filter it or aggregate it by any available dimension? On demand, without precomputing, and with sub second latency? Oh and this isn't for an internal dashboard. The interface is customer-facing and is going to be accessed by thousands of clients. In this talk, I'll tell you how Criteo, one of the biggest ad tech firms in the world, uses Druid to build its new analytics platform. Druid is an open-source, real-time data store designed to power interactive applications at scale. I’ll walk you through its architecture, explain how it scales and how data is stored on disk and in memory to serve queries faster than you can blink.

Interactive analytics at scale with druid

Julien Lavigne du Cadet

Event sourcing the best ubiquitous pattern you have never heard off

Joe Drumgoole

Proximus is one of the biggest Telecom companies in the Belgian market. This year the company began developing a new IoT network using LoRaWan technology. The talk will detail our development team’s search for a database suited to meet the needs of our IoT project, the selection and implementation of MongoDB as a database, as well as well as how we built a system for storing a variety of sensor data with high throughput by leveraging sleepy.mongoose. The talk will also discuss how different decisions around data storage impact applications in regards to both performance and total cost.

MongoDB Europe 2016 - Enabling the Internet of Things at Proximus - Belgium's...

MongoDB

Watch here: https://bit.ly/2D1fqB6 Today’s evolving data landscape has spawned new business challenges that require innovative solutions. These challenges include: - Strategic decision-making, which relies on multiple perspectives such as social and economic factors that require combining internal and external data. - Accounting for the increased volume and structural complexity of today’s data, and increased frequency required in delivering data assets. - Coping with data silos that house data that must be combined and provisioned to support decision-making. - Exposing purpose-built analytics, such as supply chain, for consumption in order to expedite decision-making. Attend this session to learn how Data as a Service, fueled by data virtualization, overcomes these common challenges from the three dimensions of: - Provisioning information-rich external data assets, - Connecting data silos, and - Enabling pre-built and packaged analytics.

Three Dimensions of Data as a Service

Denodo

Making the Most of Customer Data

WSO2

Simeon Simeonov, Founder & CTO of Swoop, shares how Swoop uses Mongo behind the scenes for their high-performance core data processing and analytics. The presentation goes over tips and tricks such as zero-overhead hierarchical relationships with MongoDB, high-performance MongoDB atomic update buffering, content-addressed storage using cryptographic hashing and more. Presented to the Boston MongoDB User Group.

The Rough Guide to MongoDB

Simeon Simeonov

Audit¢rio 09 mercado envios - novas funcionalidades - bruno elia

fsolari

Aif360 2018-21 dec-eno_kyam

YamashitaKatsushi

Securing MicroServices - ConFoo 2017

Majid Fatemian

Meteor — one of the largest open source platforms for building web and mobile apps — lives or dies by community growth and project adoption. Meteor pulls together all dimensions of their customer data — from Github to Zendesk — to power critical platform growth and adoption. They’ve developed a unique analytics stack that processes and analyzes millions of rows of data to deliver the insights they need. See the full webinar here: http://landing.chartio.com/webinar-meteor-and-segment

How To Drive Exponential Growth Using Unconventional Data Sources

Chartio

Events Processing and Data Analysis with Lucidworks Fusion: Presented by Kira...

Lucidworks

Semelhante a PistonHead's use of MongoDB for Analytics (20)

MongoDB World 2014 - BillRun, Billing on top of MongoDB

IOOF IT System Modernisation

Kde jsou limity zákaznické 360°?

Real-Time Personalized Customer Experiences at Bonobos (RET203) - AWS re:Inve...

Next Generation Fraud Solutions using Neo4j

Neo4j GraphTalk Copenhagen - Next Generation Solutions using Neo4j

Squirreling Away $640 Billion: How Stripe Leverages Flink for Change Data Cap...

Big Data for Small Businesses & Startups

Mongo db world 2014 billrun

Interactive analytics at scale with druid

Event sourcing the best ubiquitous pattern you have never heard off

MongoDB Europe 2016 - Enabling the Internet of Things at Proximus - Belgium's...

Three Dimensions of Data as a Service

Making the Most of Customer Data

The Rough Guide to MongoDB

Audit¢rio 09 mercado envios - novas funcionalidades - bruno elia

Aif360 2018-21 dec-eno_kyam

Securing MicroServices - ConFoo 2017

How To Drive Exponential Growth Using Unconventional Data Sources

Events Processing and Data Analysis with Lucidworks Fusion: Presented by Kira...

Mais de Andrew Morgan

In the age of digital transformation and disruption, your ability to thrive depends on how you adapt to the constantly changing environment. MongoDB 3.4 is the latest release of the leading database for modern applications, a culmination of native database features and enhancements that will allow you to easily evolve your solutions to address emerging challenges and use cases. In this webinar, we introduce you to what’s new, including: - Multimodel Done Right. Native graph computation, faceted navigation, rich real-time analytics, and powerful connectors for BI and Apache Spark bring additional multimodel database support right into MongoDB. - Mission-Critical Applications. Geo-distributed MongoDB zones, elastic clustering, tunable consistency, and enhanced security controls bring state-of-the-art database technology to your most mission-critical applications. - Modernized Tooling. Enhanced DBA and DevOps tooling for schema management, fine-grained monitoring, and cloud-native integration allow engineering teams to ship applications faster, with less overhead and higher quality.

MongoDB 3.4 webinar

Andrew Morgan

Organisations are building their applications around microservice architectures because of the flexibility, speed of delivery, and maintainability they deliver. Want to try out MongoDB on your laptop? Execute a single command and you have a lightweight, self-contained sandbox; another command removes all trace when you're done. Need an identical copy of your application stack in multiple environments? Build your own container image and then your entire development, test, operations, and support teams can launch an identical clone environment. Containers are revolutionizing the entire software lifecycle: from the earliest technical experiments and proofs of concept through development, test, deployment, and support. Orchestration tools manage how multiple containers are created, upgraded and made highly available. Orchestration also controls how containers are connected to build sophisticated applications from multiple, microservice containers. This presentation introduces you to technologies such as Docker, Kubernetes & Kafka which are driving the microservices revolution. Learn about containers and orchestration – and most importantly how to exploit them for stateful services such as MongoDB.

Powering Microservices with MongoDB, Docker, Kubernetes & Kafka – MongoDB Eur...

Andrew Morgan

The rise of microservices - containers and orchestration

Andrew Morgan

MySQL Cluster powers the subscriber databases of major communication services providers as well as next generation web, cloud, social and mobile applications. It is designed to deliver: - Real-time, in-memory performance for both OLTP and analytics workloads - Linear scale-out for both reads and writes 99.999% High Availability - Transparent, cross-shard transactions and joins - Update-Anywhere Geographic replication - SQL or native NoSQL APIs All that while still providing full ACID transactions.

What's new in MySQL Cluster 7.4 webinar charts

Andrew Morgan

How important is your data? Can you afford to lose it? What about just some of it? What would be the impact if you couldn’t access it for a minute, an hour, a day or a week? Different applications can have very different requirements for High Availability. Some need 100% data reliability with 24x7x365 read & write access while many others are better served by a simpler approach with more modest HA ambitions. MySQL has an array of High Availability solutions ranging from simple backups, through replication and shared storage clustering – all the way up to 99.999% available shared nothing, geographically replicated clusters. These solutions also have different ‘bonus’ features such as full InnoDB compatibility, in-memory real-time performance, linear scalability and SQL & NoSQL APIs. The purpose of this presentation is to help you decide where your application sits in terms of HA requirements and discover which of the MySQL solutions best fit the bill. It will also cover what you need outside of the database to ensure High Availability – state of the art monitoring being a prime example.

MySQL High Availability Solutions - Feb 2015 webinar

Andrew Morgan

Continuing in the footsteps of its predecessor, MySQL 5.7 is set to be a groundbreaking release. In this webinar, the engineers behind the product provide insights into what’s new for MySQL replication in the latest 5.7 Development Milestone Release and review the early access features available via labs.mysql.com. The next generation of replication features cover several technical areas such as better semi-synchronous replication, an enhanced multithreaded slave (per-transaction parallelism), improved monitoring with performance schema tables, online configuration changes, options for fine-tuning replication performance, support for more-advanced topologies with multisource replication, and much more. This is also a great chance to learn about MySQL Group Replication – the next generation of active-active, update-anywhere replication for MySQL.

MySQL Replication: What’s New in MySQL 5.7 and Beyond

Andrew Morgan

Theres a lot of excitement around NoSQL Data Stores with the promise of simple access patterns, flexible schemas, scalability and High Availability. The downside comes in the form of losing ACID transactions, consistency, flexible queries and data integrity checks. What if you could have the best of both worlds? This session shows how MySQL Cluster provides simultaneous SQL and native NoSQL access to your data whether a simple key-value API (Memcached), REST, JavaScript, Java or C++. You will hear how the MySQL Cluster architecture delivers in-memory real-time performance, 99.999% availability, on-line maintenance and linear, horizontal scalability through transparent auto-sharding.

NoSQL and SQL - Why Choose? Enjoy the best of both worlds with MySQL

Andrew Morgan

MySQL Cluster is the distributed, shared-nothing version of MySQL. It’s typically used for applications that need any combination of high availability, real-time performance, and scaling of reads and writes. After a brief introduction to the technology, its uses, and the new features added in MySQL Cluster 7.3, this session focuses on the very latest developments happening in MySQL Cluster 7.4. As you’d expect from a real-time, scalable, distributed, in-memory database, performance continues to be a top priority, as do simplicity of use and robustness. Come hear firsthand what’s being done to make sure MySQL Cluster continues to dominate in mission-critical, high-performance applications.

MySQL Cluster - Latest Developments (up to and including MySQL Cluster 7.4)

Andrew Morgan

OUG Scotland 2014 - NoSQL and MySQL - The best of both worlds

Andrew Morgan

NoSQL & SQL - Best of both worlds - BarCamp Berkshire 2013

Andrew Morgan

NoSQL and SQL - blending the best of both worlds

Andrew Morgan

Mysql cluster introduction

Andrew Morgan

Ever-increasing performance demands of Web-based services have generated significant interest in providing NoSQL access methods to MySQL (MySQL Cluster from Oracle and the InnoDB storage engine of MySQL), enabling users to maintain all the advantages of their existing relational databases while providing blazing-fast performance for simple queries. Get the best of both worlds: persistence; consistency; rich SQL queries; high availability; scalability; and simple, flexible APIs and schemas for agile development. This session describes the memcached connectors and examines some use cases for how MySQL and memcached fit together in application architectures. It does the same for the newest MySQL Cluster native connector, an easy-to-use, fully asynchronous connector for Node.js.

Developing high-throughput services with no sql ap-is to innodb and mysql clu...

Andrew Morgan

Mais de Andrew Morgan (13)

MongoDB 3.4 webinar

Powering Microservices with MongoDB, Docker, Kubernetes & Kafka – MongoDB Eur...

The rise of microservices - containers and orchestration

What's new in MySQL Cluster 7.4 webinar charts

MySQL High Availability Solutions - Feb 2015 webinar

MySQL Replication: What’s New in MySQL 5.7 and Beyond

NoSQL and SQL - Why Choose? Enjoy the best of both worlds with MySQL

MySQL Cluster - Latest Developments (up to and including MySQL Cluster 7.4)

OUG Scotland 2014 - NoSQL and MySQL - The best of both worlds

NoSQL & SQL - Best of both worlds - BarCamp Berkshire 2013

NoSQL and SQL - blending the best of both worlds

Mysql cluster introduction

Developing high-throughput services with no sql ap-is to innodb and mysql clu...

Último

%in tembisa+277-882-255-28 abortion pills for sale in tembisa

masabamasaba

%in Benoni+277-882-255-28 abortion pills for sale in Benoni

masabamasaba

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of Winnipeg back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal. Attraction Spells

%+27788225528 love spells in Knoxville Psychic Readings, Attraction spells,Br...

masabamasaba

ADR, or Architecture Decision Record, is a valuable tool in software development for several reasons. It provides a centralized location for documenting and tracking architectural decisions, aiding both current and future team members. ADRs enhance communication among team members by documenting the rationale behind architectural decisions, especially beneficial during onboarding of new team members or when revisiting decisions. They serve as a knowledge base, enabling teams to learn from past decisions and refine their decision-making process. Additionally, ADRs contribute to transparency by helping stakeholders understand the reasons behind specific architectural choices. As with any other tool or process, introducing them into an organization can face several obstacles, and overcoming these challenges is crucial for successful implementation. In this talk I go through some common problems and our way of solving them.

Architecture decision records - How not to get lost in the past

Papp Krisztián

%in kempton park+277-882-255-28 abortion pills for sale in kempton park

masabamasaba

WSO2CON 2024 Slides - Unlocking Value with AI

WSO2

WSO2Con2024 - Hello Choreo Presentation - Kanchana

WSO2

%in Stilfontein+277-882-255-28 abortion pills for sale in Stilfontein

masabamasaba

WSO2CON2024 - It's time to go Platformless

WSO2

WSO2Con204 - Hard Rock Presentation - Keynote

WSO2

WSO2CON 2024 - Does Open Source Still Matter?

WSO2

This presentation covers the following topics: What is logging? The purpose of logging: Debugging The purpose of logging: Security The purpose of logging: Stats & analytics Traditional logging Traditional logging: Advantages Traditional logging: Disadvantages The solution: Large-scale logging Large-scale logging: Core principles Large-scale logging: Solution types Large-scale logging: Cloud vs on-prem Large-scale logging: Operational complexity Large-scale logging: Security Large-scale logging: Costs Large-scale logging: On-prem comparison - Elasticsearch - Grafana Loki - VictoriaLogs On-prem comparison: Setup and operation On-prem comparison: Costs On-prem comparison: Full-text search support On-prem comparison: How to efficiently query 100TB of logs? On-prem comparison: Integration with CLI tools VictoriaLogs for large-scale logging VictoriaLogs demo instance - Ingestion rate: 3600 messages / minute - The number of log messages: 1.1 billion - Uncompressed log messages’ size: 1.5TB - Compressed log messages’ size: 23GB - Compression ratio: 47x - Memory usage: 150MB VictoriaLogs CLI integration demo - Which errors have occurred in all the apps during the last hour? - How many errors have occurred during the last hour? - Which apps generated the most of errors during the last hour? - The number of per-minute errors for the last 10 minutes - Status codes for the last hour - Non-200 status codes for the last week - Top client IPs for the last 4 weeks with 404 and 500 response status codes - Per-month stats for the given IP across all the logs Large-scale logging solution MUST provide excellent CLI integration VictoriaLogs: (temporary) drawbacks VictoriaLogs: Recap - Easy to setup and operate - The lowest RAM usage and disk space usage (up to 30x less than Elasticsearch and Grafana Loki) - Fast full-text search - Excellent integration with traditional command-line tools for log analysis - Accepts logs from popular log shippers (Filebeat, Fluentbit, Logstash, Vector, Promtail, Grafana Agent) - Open source and free to use!

Large-scale Logging Made Easy: Meetup at Deutsche Bank 2024

VictoriaMetrics

WSO2CON 2024 - WSO2's Digital Transformation Journey with Choreo: A Platforml...

WSO2

WSO2Con2024 - From Blueprint to Brilliance: WSO2's Guide to API-First Enginee...

WSO2

Direct Style Effect Systems -The Print[A] Example- A Comprehension Aid

Philip Schwarz

Artyushina_Guest lecture_YorkU CS May 2024.pptx

AnnaArtyushina1

VTU technical seminar 8Th Sem on Scikit-learn

AmarnathKambale

We specialize in Psychic Readings, Psychic Love Spells, Binding Love Spells, Obsession Spells, Voodoo Spells, Lottery Spells, Marriage Spells, Black Magic Spells, Palm Readings & much more. Are you depressed? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? We perform this come-to-me love spell that works instantly with the aim of bringing back the victim to the person performing the magic. Have you lost your lover? Do u need to solve any relationship problem? Contact the powerful spells caster chief kule with love spells that work overnight and love spells that really work. Have you found yourself infatuated with a special someone you think could be the one? Are you looking for a spell to provide them with a nudge in the right direction? Or maybe the spell you cast didn’t achieve the results you were hoping for? Whether you’re new or versed in the ways of spell casting, we’re here to help. Today we’re going to provide you with a detailed guide on the types of love spells to cast. Not only that but there’s something for those who wish to find outside advice from more advanced spell casters. We’re also going to provide you with the top sites available to help you with your dilemma. Let’s begin our journey by educating ourselves on love magic and what a real love caster looks like. Love Magic and Love Casters Love magic made its first appearance back in Ancient Egypt and has been an active practice since. This type of magic is a branch of traditional magic and can be practiced in various ways. Typically the more common use of love magic is through the work of spells, but other methods look like Charms Rituals-LOVE Potions-Dolls and even Amulets If you are interested in becoming a love caster, be prepared for what’s to come. A genuine love caster knows that the art of love casting is no easy feat and shouldn’t be done casually. You should know that not only does it require you to be gifted spiritually, but you must be ready to serve others. Someone who is considered a real love caster has experience in all manner of spells, no matter the difficulty. Training yourself in attraction, commitment, and marriage spells is an excellent place to start. But this by no means will make you a professional. Practice your craft and expand your knowledge; understand that you will possess the ability to help others in time truly. Types of Love Spells What better way to start broadening your experiences with love spells than by learning more about them? These spells work like just about any other spell. Simply apply your intention, use a medium (sigils, mantras, candles, or charm bags), and top it off with establishing the belief that you will receive what you want. So what kind of spells are available and which ones suit your needs the best? Let’s take a look at the many options you have at your disposal.

%+27788225528 love spells in Colorado Springs Psychic Readings, Attraction sp...

masabamasaba

OpenChain - The Ramifications of ISO/IEC 5230 and ISO/IEC 18974 for Legal Pro...

Shane Coughlan

WSO2Con2024 - From Code To Cloud: Fast Track Your Cloud Native Journey with C...

WSO2

PistonHead's use of MongoDB for Analytics

1. Haymarket Media Group Building a reporting and analytics suite for dealers and administrators Pete Dignan - Platform Director @RacingPete

2. PistonHeadsPistonHeads Started in 1998 Original social network Always irreverent Classifieds News Forums

3. Classifieds 140,000 cars 6.5 million users 100 million page views 9 minute average visit duration More 17k+ vehicles than competitors

4. Vision - PistonHub “To create a stock insights and trading screen, providing secure access to the statistics behind the classifieds, and opening up the true performance of our classifieds to Dealer Groups, Individual Dealers and Internal Staff”

5. 1st Problem - View Data

6. 2nd Problem - Stock and Classifieds Data MongoDB Advert Data Category Make/Model History Ad Status MySQL Dealer Groups Individual Dealers

7. 3rd Problem - Lead Data

8. PistonHub Architecture Solution Abstract Data Aggregator Google Data API HTTP/SOAP .Net Driver ADO .Net API AngularJS App

9. { "_id" : ObjectId("564a9892ad2e970fac7f6fff"), "CDRId" : "ac61259e35bacc174f3e9ff0afd4c0c58ff6ffff", "NTSNum" : "01234567890", "FromNum" : "0771234567", "ToNum" : "01234567891", "DialledNum" : "+44771234567", "ConnectTime" : ISODate("2015-11-11T02:18:14Z"), "CallDuration" : "3", "TalkTime" : "3", "TimeToAnswer" : "1975", "DisconnectText" : "Answered", "DisconnectType" : "Answered", "Recorded" : "N", "CallId" : "i1447208272.153117.xxxx", "LoadDate" : ISODate("2015-11-11T03:00:01.177Z") } { "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } { "DealerAltPhone" : "01234567891", "DealerGroupId" : 0, "DealerGroupIdStr" : "0", "DealerGroupName" : null, "DealerId" : 61056992, "DealerIdStr" : "61056992", "DealerName" : "Dealer LTD", "DealerPhone" : "01234567890", "TrackingAltPhone" : null, "TrackingPhone" : "01234567890", "_id" : ObjectId("555ef398e816135315639fff") } Raw Gamma Data Raw Dealer Data Phone Data Abstract Data Aggregator

10. { "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } Phone Data Abstract Data Aggregator { "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } { "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } { "CallDate" : ISODate("2015-11-10T22:27:00Z"), "CallDuration" : NumberLong(3), "CalledTrackingNumber" : "01234567890", "CallerNumber" : "0771234567", "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "RingTime" : NumberLong(1975), "Status" : "Answered", "_id" : ObjectId("564a9892ad2e970fac7f6fff") } View Data Email Data Stock Data { "AdViews" : 119, "CallLeads" : 0, "Calls" : 1, "Date" : ISODate("2015-11-10T00:00:00Z"), "DealerGroupId" : 0, "DealerGroupName" : null, "DealerId" : 61056992, "DealerName" : "Dealer LTD", "DeepLinkClicks" : 1, "EmailLeads" : 1, "Emails" : 1, "NormalizedDealerName" : "DEALER LTD", "Phone" : "01234567890", "Stock" : 2, "TrackingPhone" : "0771234567", "WebsiteClicks" : 14, "_id" : "61xxxx_2015-10-10" } Dealer Stats

18. Conclusions Pipeline aggregation is super fast to collate data… … and run queries for AngularJS Storing day by day data means easy to do custom date formats Dealer feedback has been very positive on the extra insights Sales teams have used the system to proactively help dealers Wish we were using 3.2

19. Questions?

PistonHead's use of MongoDB for Analytics

Recomendados

Recomendados

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Destaque

Destaque (14)

Semelhante a PistonHead's use of MongoDB for Analytics

Semelhante a PistonHead's use of MongoDB for Analytics (20)

Mais de Andrew Morgan

Mais de Andrew Morgan (13)

Último

Último (20)

PistonHead's use of MongoDB for Analytics