Enviar pesquisa
Carregar
Database Performance With Proxy Architectures
•
0 gostou
•
728 visualizações
P
PerconaPerformance
Seguir
Tecnologia
Denunciar
Compartilhar
Denunciar
Compartilhar
1 de 13
Baixar agora
Baixar para ler offline
Recomendados
Give Your Site a Boost with Memcache
Give Your Site a Boost with Memcache
Ben Ramsey
PostgreSQL replication
PostgreSQL replication
Masao Fujii
HBase 2.0 cluster topology
HBase 2.0 cluster topology
Mikhail Antonov
System Configuration for UltraESB
System Configuration for UltraESB
AdroitLogic
PostgreSQL Hangout Replication Features v9.4
PostgreSQL Hangout Replication Features v9.4
Ashnikbiz
Built-in Replication in PostgreSQL
Built-in Replication in PostgreSQL
Masao Fujii
MySQL Cluster Local Checkpoint (LCP) evolution in 7.6 (2019)
MySQL Cluster Local Checkpoint (LCP) evolution in 7.6 (2019)
Frazer Clement
Is There Anything PgBouncer Can’t Do?
Is There Anything PgBouncer Can’t Do?
EDB
Recomendados
Give Your Site a Boost with Memcache
Give Your Site a Boost with Memcache
Ben Ramsey
PostgreSQL replication
PostgreSQL replication
Masao Fujii
HBase 2.0 cluster topology
HBase 2.0 cluster topology
Mikhail Antonov
System Configuration for UltraESB
System Configuration for UltraESB
AdroitLogic
PostgreSQL Hangout Replication Features v9.4
PostgreSQL Hangout Replication Features v9.4
Ashnikbiz
Built-in Replication in PostgreSQL
Built-in Replication in PostgreSQL
Masao Fujii
MySQL Cluster Local Checkpoint (LCP) evolution in 7.6 (2019)
MySQL Cluster Local Checkpoint (LCP) evolution in 7.6 (2019)
Frazer Clement
Is There Anything PgBouncer Can’t Do?
Is There Anything PgBouncer Can’t Do?
EDB
UltraESB - Advanced services
UltraESB - Advanced services
AdroitLogic
JMS Backchannel
JMS Backchannel
Rupesh Sinha
Mulesoft ppt
Mulesoft ppt
Achyuta Lakshmi
UltraESB - an introduction
UltraESB - an introduction
AdroitLogic
Controlling Message Flow - Mule ESB
Controlling Message Flow - Mule ESB
Mani Rathnam Gudi
PostgreSQL9.3 Switchover/Switchback
PostgreSQL9.3 Switchover/Switchback
Vibhor Kumar
X-DB Replication Server and MMR
X-DB Replication Server and MMR
Ashnikbiz
Mule servlet connector
Mule servlet connector
Ankush Sharma
Scatter gather flow in mule
Scatter gather flow in mule
Praneethchampion
JBOSS ONLINE TRAINING
JBOSS ONLINE TRAINING
TRAINING ICON
Load Sharing and Balancing
Load Sharing and Balancing
CB UTBlog
Ensuring performance for real time packet processing in open stack white paper
Ensuring performance for real time packet processing in open stack white paper
hptoga
Overview usage of ProudNet
Overview usage of ProudNet
Hyun-jik Bae
Do we need JMS in 21st century?
Do we need JMS in 21st century?
Mikalai Alimenkou
Administration and Management with UltraESB
Administration and Management with UltraESB
AdroitLogic
UNC309 - Getting the Most out of Microsoft Exchange Server 2010: Performance ...
UNC309 - Getting the Most out of Microsoft Exchange Server 2010: Performance ...
Louis Göhl
Distributed Caching Essential Lessons (Ts 1402)
Distributed Caching Essential Lessons (Ts 1402)
Yury Kaliaha
Message structure
Message structure
Son Nguyen
Using scatter gather
Using scatter gather
Rahul Kumar
Eedc homework2-jsc
Eedc homework2-jsc
jsubirat
How To Think About Performance
How To Think About Performance
PerconaPerformance
Stones play for wiki
Stones play for wiki
laurenesam
Mais conteúdo relacionado
Mais procurados
UltraESB - Advanced services
UltraESB - Advanced services
AdroitLogic
JMS Backchannel
JMS Backchannel
Rupesh Sinha
Mulesoft ppt
Mulesoft ppt
Achyuta Lakshmi
UltraESB - an introduction
UltraESB - an introduction
AdroitLogic
Controlling Message Flow - Mule ESB
Controlling Message Flow - Mule ESB
Mani Rathnam Gudi
PostgreSQL9.3 Switchover/Switchback
PostgreSQL9.3 Switchover/Switchback
Vibhor Kumar
X-DB Replication Server and MMR
X-DB Replication Server and MMR
Ashnikbiz
Mule servlet connector
Mule servlet connector
Ankush Sharma
Scatter gather flow in mule
Scatter gather flow in mule
Praneethchampion
JBOSS ONLINE TRAINING
JBOSS ONLINE TRAINING
TRAINING ICON
Load Sharing and Balancing
Load Sharing and Balancing
CB UTBlog
Ensuring performance for real time packet processing in open stack white paper
Ensuring performance for real time packet processing in open stack white paper
hptoga
Overview usage of ProudNet
Overview usage of ProudNet
Hyun-jik Bae
Do we need JMS in 21st century?
Do we need JMS in 21st century?
Mikalai Alimenkou
Administration and Management with UltraESB
Administration and Management with UltraESB
AdroitLogic
UNC309 - Getting the Most out of Microsoft Exchange Server 2010: Performance ...
UNC309 - Getting the Most out of Microsoft Exchange Server 2010: Performance ...
Louis Göhl
Distributed Caching Essential Lessons (Ts 1402)
Distributed Caching Essential Lessons (Ts 1402)
Yury Kaliaha
Message structure
Message structure
Son Nguyen
Using scatter gather
Using scatter gather
Rahul Kumar
Eedc homework2-jsc
Eedc homework2-jsc
jsubirat
Mais procurados
(20)
UltraESB - Advanced services
UltraESB - Advanced services
JMS Backchannel
JMS Backchannel
Mulesoft ppt
Mulesoft ppt
UltraESB - an introduction
UltraESB - an introduction
Controlling Message Flow - Mule ESB
Controlling Message Flow - Mule ESB
PostgreSQL9.3 Switchover/Switchback
PostgreSQL9.3 Switchover/Switchback
X-DB Replication Server and MMR
X-DB Replication Server and MMR
Mule servlet connector
Mule servlet connector
Scatter gather flow in mule
Scatter gather flow in mule
JBOSS ONLINE TRAINING
JBOSS ONLINE TRAINING
Load Sharing and Balancing
Load Sharing and Balancing
Ensuring performance for real time packet processing in open stack white paper
Ensuring performance for real time packet processing in open stack white paper
Overview usage of ProudNet
Overview usage of ProudNet
Do we need JMS in 21st century?
Do we need JMS in 21st century?
Administration and Management with UltraESB
Administration and Management with UltraESB
UNC309 - Getting the Most out of Microsoft Exchange Server 2010: Performance ...
UNC309 - Getting the Most out of Microsoft Exchange Server 2010: Performance ...
Distributed Caching Essential Lessons (Ts 1402)
Distributed Caching Essential Lessons (Ts 1402)
Message structure
Message structure
Using scatter gather
Using scatter gather
Eedc homework2-jsc
Eedc homework2-jsc
Destaque
How To Think About Performance
How To Think About Performance
PerconaPerformance
Stones play for wiki
Stones play for wiki
laurenesam
Ict Examples Presentation 1210756047278583 9
Ict Examples Presentation 1210756047278583 9
laurenesam
Galera Multi Master Synchronous My S Q L Replication Clusters
Galera Multi Master Synchronous My S Q L Replication Clusters
PerconaPerformance
Performance Instrumentation Beyond What You Do Now
Performance Instrumentation Beyond What You Do Now
PerconaPerformance
Maailma LõPus
Maailma LõPus
guest9d757d6
High Performance Erlang
High Performance Erlang
PerconaPerformance
My S Q L Replication Getting The Most From Slaves
My S Q L Replication Getting The Most From Slaves
PerconaPerformance
Object Oriented Css For High Performance Websites And Applications
Object Oriented Css For High Performance Websites And Applications
PerconaPerformance
Running A Realtime Stats Service On My Sql
Running A Realtime Stats Service On My Sql
PerconaPerformance
Websites On Speed
Websites On Speed
PerconaPerformance
Trees And More With Postgre S Q L
Trees And More With Postgre S Q L
PerconaPerformance
Websites On Speed
Websites On Speed
PerconaPerformance
E M T Better Performance Monitoring
E M T Better Performance Monitoring
PerconaPerformance
Drizzles Approach To Improving Performance Of The Server
Drizzles Approach To Improving Performance Of The Server
PerconaPerformance
Boost Performance With My S Q L 51 Partitions
Boost Performance With My S Q L 51 Partitions
PerconaPerformance
Automated Performance Testing With J Meter And Maven
Automated Performance Testing With J Meter And Maven
PerconaPerformance
Destaque
(17)
How To Think About Performance
How To Think About Performance
Stones play for wiki
Stones play for wiki
Ict Examples Presentation 1210756047278583 9
Ict Examples Presentation 1210756047278583 9
Galera Multi Master Synchronous My S Q L Replication Clusters
Galera Multi Master Synchronous My S Q L Replication Clusters
Performance Instrumentation Beyond What You Do Now
Performance Instrumentation Beyond What You Do Now
Maailma LõPus
Maailma LõPus
High Performance Erlang
High Performance Erlang
My S Q L Replication Getting The Most From Slaves
My S Q L Replication Getting The Most From Slaves
Object Oriented Css For High Performance Websites And Applications
Object Oriented Css For High Performance Websites And Applications
Running A Realtime Stats Service On My Sql
Running A Realtime Stats Service On My Sql
Websites On Speed
Websites On Speed
Trees And More With Postgre S Q L
Trees And More With Postgre S Q L
Websites On Speed
Websites On Speed
E M T Better Performance Monitoring
E M T Better Performance Monitoring
Drizzles Approach To Improving Performance Of The Server
Drizzles Approach To Improving Performance Of The Server
Boost Performance With My S Q L 51 Partitions
Boost Performance With My S Q L 51 Partitions
Automated Performance Testing With J Meter And Maven
Automated Performance Testing With J Meter And Maven
Semelhante a Database Performance With Proxy Architectures
Implementing the Future of PostgreSQL Clustering with Tungsten
Implementing the Future of PostgreSQL Clustering with Tungsten
Command Prompt., Inc
Living the Easy Life with Rules-Based Autonomic Database Clusters
Living the Easy Life with Rules-Based Autonomic Database Clusters
Linas Virbalas
Solving the C20K problem: Raising the bar in PHP Performance and Scalability
Solving the C20K problem: Raising the bar in PHP Performance and Scalability
ZendCon
The Data Center and Hadoop
The Data Center and Hadoop
Michael Zhang
Tungsten University: Set Up And Manage Advanced Replication Topologies
Tungsten University: Set Up And Manage Advanced Replication Topologies
Continuent
Our Multi-Year Journey to a 10x Faster Confluent Cloud
Our Multi-Year Journey to a 10x Faster Confluent Cloud
HostedbyConfluent
Tungsten University: Setup and Operate Tungsten Replicators
Tungsten University: Setup and Operate Tungsten Replicators
Continuent
BigData Clusters Redefined
BigData Clusters Redefined
DataWorks Summit
Liberating Your Data From MySQL: Cross-Database Replication to the Rescue!
Liberating Your Data From MySQL: Cross-Database Replication to the Rescue!
Linas Virbalas
Building Tungsten Clusters with PostgreSQL Hot Standby and Streaming Replication
Building Tungsten Clusters with PostgreSQL Hot Standby and Streaming Replication
Linas Virbalas
Taming Latency: Case Studies in MapReduce Data Analytics
Taming Latency: Case Studies in MapReduce Data Analytics
EMC
XS Boston 2008 Network Topology
XS Boston 2008 Network Topology
The Linux Foundation
2007-05-23 Cecchet_PGCon2007.ppt
2007-05-23 Cecchet_PGCon2007.ppt
nadirpervez2
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]
Markus Michalewicz
Practice and challenges from building IaaS
Practice and challenges from building IaaS
Shawn Zhu
SQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teams
Sumeet Bansal
Large customers want postgresql too !!
Large customers want postgresql too !!
rosensteel
Lightweight Grids With Terracotta
Lightweight Grids With Terracotta
PT.JUG
Webcast: Reduce latency, improve analytics and maximize asset utilization in ...
Webcast: Reduce latency, improve analytics and maximize asset utilization in ...
Emulex Corporation
PostgreSQL replication
PostgreSQL replication
NTT DATA OSS Professional Services
Semelhante a Database Performance With Proxy Architectures
(20)
Implementing the Future of PostgreSQL Clustering with Tungsten
Implementing the Future of PostgreSQL Clustering with Tungsten
Living the Easy Life with Rules-Based Autonomic Database Clusters
Living the Easy Life with Rules-Based Autonomic Database Clusters
Solving the C20K problem: Raising the bar in PHP Performance and Scalability
Solving the C20K problem: Raising the bar in PHP Performance and Scalability
The Data Center and Hadoop
The Data Center and Hadoop
Tungsten University: Set Up And Manage Advanced Replication Topologies
Tungsten University: Set Up And Manage Advanced Replication Topologies
Our Multi-Year Journey to a 10x Faster Confluent Cloud
Our Multi-Year Journey to a 10x Faster Confluent Cloud
Tungsten University: Setup and Operate Tungsten Replicators
Tungsten University: Setup and Operate Tungsten Replicators
BigData Clusters Redefined
BigData Clusters Redefined
Liberating Your Data From MySQL: Cross-Database Replication to the Rescue!
Liberating Your Data From MySQL: Cross-Database Replication to the Rescue!
Building Tungsten Clusters with PostgreSQL Hot Standby and Streaming Replication
Building Tungsten Clusters with PostgreSQL Hot Standby and Streaming Replication
Taming Latency: Case Studies in MapReduce Data Analytics
Taming Latency: Case Studies in MapReduce Data Analytics
XS Boston 2008 Network Topology
XS Boston 2008 Network Topology
2007-05-23 Cecchet_PGCon2007.ppt
2007-05-23 Cecchet_PGCon2007.ppt
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]
Oracle RAC 12c Practical Performance Management and Tuning OOW13 [CON8825]
Practice and challenges from building IaaS
Practice and challenges from building IaaS
SQLintersection keynote a tale of two teams
SQLintersection keynote a tale of two teams
Large customers want postgresql too !!
Large customers want postgresql too !!
Lightweight Grids With Terracotta
Lightweight Grids With Terracotta
Webcast: Reduce latency, improve analytics and maximize asset utilization in ...
Webcast: Reduce latency, improve analytics and maximize asset utilization in ...
PostgreSQL replication
PostgreSQL replication
Último
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
Karmanjay Verma
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
marketing932765
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
LoriGlavin3
2024 April Patch Tuesday
2024 April Patch Tuesday
Ivanti
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
TopCSSGallery
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
BookNet Canada
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
Nicole Novielli
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Nikki Chapple
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
Inflectra
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#
Karmanjay Verma
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdf
Aarwolf Industries LLC
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
UiPathCommunity
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
itnewsafrica
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
Pixlogix Infotech
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
Hiroshi SHIBATA
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
Neo4j
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
Bernd Ruecker
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
Ravi Sanghani
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
panagenda
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Mark Goldstein
Último
(20)
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
React JS; all concepts. Contains React Features, JSX, functional & Class comp...
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Bridging Between CAD & GIS: 6 Ways to Automate Your Data Integration
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
Passkey Providers and Enabling Portability: FIDO Paris Seminar.pptx
2024 April Patch Tuesday
2024 April Patch Tuesday
Top 10 Hubspot Development Companies in 2024
Top 10 Hubspot Development Companies in 2024
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
Transcript: New from BookNet Canada for 2024: BNC SalesData and LibraryData -...
A Journey Into the Emotions of Software Developers
A Journey Into the Emotions of Software Developers
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
Microsoft 365 Copilot: How to boost your productivity with AI – Part one: Ado...
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
[Webinar] SpiraTest - Setting New Standards in Quality Assurance
Microservices, Docker deploy and Microservices source code in C#
Microservices, Docker deploy and Microservices source code in C#
Landscape Catalogue 2024 Australia-1.pdf
Landscape Catalogue 2024 Australia-1.pdf
UiPath Community: Communication Mining from Zero to Hero
UiPath Community: Communication Mining from Zero to Hero
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
Zeshan Sattar- Assessing the skill requirements and industry expectations for...
React Native vs Ionic - The Best Mobile App Framework
React Native vs Ionic - The Best Mobile App Framework
Long journey of Ruby standard library at RubyConf AU 2024
Long journey of Ruby standard library at RubyConf AU 2024
Connecting the Dots for Information Discovery.pdf
Connecting the Dots for Information Discovery.pdf
QCon London: Mastering long-running processes in modern architectures
QCon London: Mastering long-running processes in modern architectures
Potential of AI (Generative AI) in Business: Learnings and Insights
Potential of AI (Generative AI) in Business: Learnings and Insights
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Modern Roaming for Notes and Nomad – Cheaper Faster Better Stronger
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Arizona Broadband Policy Past, Present, and Future Presentation 3/25/24
Database Performance With Proxy Architectures
1.
Database Performance
with Proxy Architectures Tungsten SQL Router Robert Hodges CTO, Continuent, Inc. Percona Performance Is Everything 2009 © Continuent 2009
2.
The “Proxy Math”
Problem / Proxy layers solve a number of database problems • Seamless failover • Intelligent load balancing • Intelligent partitioning / Big Question: What’s the cost for applications? / Let’s run a few tests to show basic limits • Simple queries with data guaranteed to be in buffer cache • Dell SC 1425, Xeon 2 CPU x 2 Cores, 2.8Mhz • No/minimal proxy logic © Continuent 2009
3.
Proxy Overhead Compared
to Databases © Continuent 2009
4.
Proxy with Increasing
Result Sizes © Continuent 2009
5.
How Do We
Avoid Proxy Math? / Proxy performance is CPU intensive • Mostly copying and transforming bytes / Bad case: 4x CPU resources for same throughput • Could be far worse if proxy does more than copy data • It’s not enough to make proxies faster / Alternative 1: Hardware load balancer • If I only had a brain… / Alternative 2: VIPs • Handy for availability but load balancing is a problem / Alternative 3: An embeddable library • This would work on Amazon as well! © Continuent 2009
6.
Tungsten SQL Router
Overview / Library-based intelligent failover and load balancing / Connection-level routing / Implemented as JDBC library wrapper (Java!) • Adds intelligence to vendor drivers / DBMS-independent and non-partisan / 100% open source • http://sourceforge.net/projects/tungsten / Built-in management • Manageable from network • Monitoring integration / Routing based on CAP theorem • Trade off consistency vs. availability vs. partition tolerance © Continuent 2009
7.
CAP-Based Routing--“Quality of
Service” Connection for Writes Connection for Reads jdbc:t-router://mysvc/db1 jdbc:t-router://mysvc/db1 ?qos=RW_STRICT ?qos=RO_RELAXED (Data Service) Strict Session Relaxed Consistency Consistency* Consistency Replication Slave Master Slave (latency) Slave *In progress © Continuent 2009
8.
Services and Data
Sources / SQL Router connects to services, not hosts / Services are composed of data sources / Configuration stored in CLUSTER_HOME directory $CLUSTER_HOME/ services/ mysvc/ datasource/ db1.properties db2.properties db3.properties replicator/ / Configuration updated by administrative commands © Continuent 2009
9.
Administration and Monitoring
/ SQL Router library has JMX ports for administration / Update status of data sources using rmctl program: sql-router[mysvc:ONLINE]> db2 offline SENT NOTIFICATION: DATASTORE db2 offline sql-router[mysvc:ONLINE]> db1 online SENT NOTIFICATION: DATASTORE db1 online sql-router[mysvc:ONLINE]> db3 online SENT NOTIFICATION: DATASTORE db3 online / Listeners for monitoring events • Use UDP or group communications or… • Automatically take data sources online/offline © Continuent 2009
10.
Does It Work
with Non-Java Programs? / Yes / Use Tungsten Connector as front end / Full circle back to better SQL proxies © Continuent 2009
11.
Tungsten Drilldown –
SQL-Router © Continuent 2009
12.
Roadmap /
Upgraded monitoring • Create/remove data sources automatically from monitoring data • Specify maximum permitted latency / Session consistency / Partitioning / Sharding • Route databases to different servers © Continuent 2009
13.
Contact Information
HQ and Americas EMEA and APAC 560 S. Winchester Blvd., Suite 500 Lars Sonckin kaari 16 San Jose, CA 95128 02600 Espoo, Finland Tel (866) 998-3642 Tel +358 50 517 9059 Fax +358 9 863 0060 Fax (408) 668-1009 My e-mail: robert.hodges “at” continuent.com Commercial solutions: http://www.continuent.com Tungsten open source stack: http://community.continuent.com http://sourceforge.net/projects/tungsten © Continuent 2009
Baixar agora