SlideShare uma empresa Scribd logo
1 de 17
Baixar para ler offline
Cassandra
Performance
 Past, Present & Future

 Tom Wilkie, Founder
     Acunu Ltd
A Busy Year

11 Jan : Cassandra 0.7.0
3 Jun: Cassandra 0.8.0
18 Oct: Cassandra 1.0.0
11 Jan : Cassandra 0.7.0
• Dynamic endpoint snitch
• Row cache improvements
• Secondary indexes
3 Jun: Cassandra 0.8.0
18 Oct: Cassandra 1.0.0
11 Jan : Cassandra 0.7.0
3 Jun: Cassandra 0.8.0
• Counters
• CQL
18 Oct: Cassandra 1.0.0
11 Jan : Cassandra 0.7.0
3 Jun: Cassandra 0.8.0
18 Oct: Cassandra 1.0.0
• Compression
• Off heap caches, arena allocations etc
• LevelDB-style compactions
Benchmarking
Read the fine print
  24GB of memory ... a 300GB disk

         ...key size of 13 bytes and
            data size of 1108 bytes.

... 96 nodes storing 2.1 billion records

                   ~350k inserts / sec
    http://www.oracle.com/technetwork/database/nosqldb/learnmore/nosql-database-498041.pdf
“Read/write performance on a single four-core machine.
  One million inserts followed by one million updates”
          http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-0-performance
1 x Quad core Xeon E5620
Machine     24GB RAM, 8x1TB Disks
           1 commit log, 7 in RAID 10

           Keys: 8 byte,Values: 10 bytes
            Random key distribution
Workload        10 million Inserts,
              Random Point Gets,
                  Range Queries
Cassandra Performance Evolution
    90,000

    80,000

    70,000

    60,000

    50,000

    40,000

    30,000

    20,000

    10,000

        0
                Inserts    Point Gets   Range Queries
0.7.9
0.8.7
1.0.2
1 x Quad core Xeon E5620
Machine     24GB RAM, 8x1TB Disks
           1 commit log, 7 in RAID 10

           Keys: 8 byte,Values: 100 bytes
             Random key distribution
Workload        300 million Inserts,
               Random Point Gets,
                   Range Queries
Inserts/s




            Time / hours
Effect of Compression and Leveled Compaction
 60,000                       200


 50,000
                              160

 40,000
                              120
 30,000
                               80
 20,000

                               40
 10,000


     0                          0
                    Inserts         Point Gets
1.0.2
w/ Compression
w/ Leveled Compaction
Effect of Compression and Leveled Compaction
 60,000                   500


 50,000
                          400

 40,000
                          300
 30,000
                          200
 20,000

                          100
 10,000


      0                     0
1.0.2           Inserts         Point Gets   Range Queries
w/ Compression
w/ Leveled Compaction
Acunu
Future
Questions?
        Tom Wilkie
         @tom_wilkie
       tom@acunu.com

   http://bitbucket.org/acunu
    http://github.com/acunu

http://www.acunu.com/download
 http://www.acunu.com/insights
Cassandra Performance: Past, present & future

Mais conteúdo relacionado

Semelhante a Cassandra Performance: Past, present & future

Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...Enkitec
 
Usenix LISA 2012 - Choosing a Proxy
Usenix LISA 2012 - Choosing a ProxyUsenix LISA 2012 - Choosing a Proxy
Usenix LISA 2012 - Choosing a ProxyLeif Hedstrom
 
BFS Distribution Via DCM
BFS Distribution Via DCMBFS Distribution Via DCM
BFS Distribution Via DCMowenlin
 
Performance tuning
Performance tuningPerformance tuning
Performance tuningJon Haddad
 
Capacity Planning for Linux Systems
Capacity Planning for Linux SystemsCapacity Planning for Linux Systems
Capacity Planning for Linux SystemsRodrigo Campos
 
Perf Storwize V7000 Eng
Perf Storwize V7000 EngPerf Storwize V7000 Eng
Perf Storwize V7000 EngOleg Korol
 
ExportReport.pdf
ExportReport.pdfExportReport.pdf
ExportReport.pdfdevaraj ns
 
ずばり動く!kumofs と ずばり動かないケース
ずばり動く!kumofs と ずばり動かないケースずばり動く!kumofs と ずばり動かないケース
ずばり動く!kumofs と ずばり動かないケースSadayuki Furuhashi
 
MongoDB and Apache HBase: Benchmarking
MongoDB and Apache HBase: BenchmarkingMongoDB and Apache HBase: Benchmarking
MongoDB and Apache HBase: BenchmarkingOlga Lavrentieva
 
分散Key-valueストアkumofsの思想と設計
分散Key-valueストアkumofsの思想と設計分散Key-valueストアkumofsの思想と設計
分散Key-valueストアkumofsの思想と設計Sadayuki Furuhashi
 
Windows Debugging with WinDbg
Windows Debugging with WinDbgWindows Debugging with WinDbg
Windows Debugging with WinDbgArno Huetter
 
Storm worker redesign
Storm worker redesignStorm worker redesign
Storm worker redesignRoshan Naik
 
Capacity analysis of gsm systems using slow frequency hoppin
Capacity analysis of gsm systems using slow frequency hoppinCapacity analysis of gsm systems using slow frequency hoppin
Capacity analysis of gsm systems using slow frequency hoppinShiju Chacko
 
Trade and Event Processing at a Massive Scale - QCon NY 2012
Trade and Event Processing at a Massive Scale - QCon NY 2012Trade and Event Processing at a Massive Scale - QCon NY 2012
Trade and Event Processing at a Massive Scale - QCon NY 2012Uri Cohen
 

Semelhante a Cassandra Performance: Past, present & future (20)

Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
Bottlenecks, Bottlenecks, and more Bottlenecks: Lessons Learned from 2 Years ...
 
Usenix LISA 2012 - Choosing a Proxy
Usenix LISA 2012 - Choosing a ProxyUsenix LISA 2012 - Choosing a Proxy
Usenix LISA 2012 - Choosing a Proxy
 
BFS Distribution Via DCM
BFS Distribution Via DCMBFS Distribution Via DCM
BFS Distribution Via DCM
 
Performance tuning
Performance tuningPerformance tuning
Performance tuning
 
Shereef_MP3_decoder
Shereef_MP3_decoderShereef_MP3_decoder
Shereef_MP3_decoder
 
Documentation
DocumentationDocumentation
Documentation
 
Capacity Planning for Linux Systems
Capacity Planning for Linux SystemsCapacity Planning for Linux Systems
Capacity Planning for Linux Systems
 
Perf Storwize V7000 Eng
Perf Storwize V7000 EngPerf Storwize V7000 Eng
Perf Storwize V7000 Eng
 
Usenix lisa 2011
Usenix lisa 2011Usenix lisa 2011
Usenix lisa 2011
 
ExportReport.pdf
ExportReport.pdfExportReport.pdf
ExportReport.pdf
 
ずばり動く!kumofs と ずばり動かないケース
ずばり動く!kumofs と ずばり動かないケースずばり動く!kumofs と ずばり動かないケース
ずばり動く!kumofs と ずばり動かないケース
 
Virtual Box Aquarium May09
Virtual Box Aquarium May09Virtual Box Aquarium May09
Virtual Box Aquarium May09
 
MongoDB and Apache HBase: Benchmarking
MongoDB and Apache HBase: BenchmarkingMongoDB and Apache HBase: Benchmarking
MongoDB and Apache HBase: Benchmarking
 
分散Key-valueストアkumofsの思想と設計
分散Key-valueストアkumofsの思想と設計分散Key-valueストアkumofsの思想と設計
分散Key-valueストアkumofsの思想と設計
 
Windows Debugging with WinDbg
Windows Debugging with WinDbgWindows Debugging with WinDbg
Windows Debugging with WinDbg
 
NoSQLを知る
NoSQLを知るNoSQLを知る
NoSQLを知る
 
Storm worker redesign
Storm worker redesignStorm worker redesign
Storm worker redesign
 
Capacity analysis of gsm systems using slow frequency hoppin
Capacity analysis of gsm systems using slow frequency hoppinCapacity analysis of gsm systems using slow frequency hoppin
Capacity analysis of gsm systems using slow frequency hoppin
 
Prj2
Prj2Prj2
Prj2
 
Trade and Event Processing at a Massive Scale - QCon NY 2012
Trade and Event Processing at a Massive Scale - QCon NY 2012Trade and Event Processing at a Massive Scale - QCon NY 2012
Trade and Event Processing at a Massive Scale - QCon NY 2012
 

Mais de Acunu

Acunu and Hailo: a realtime analytics case study on Cassandra
Acunu and Hailo: a realtime analytics case study on CassandraAcunu and Hailo: a realtime analytics case study on Cassandra
Acunu and Hailo: a realtime analytics case study on CassandraAcunu
 
Virtual nodes: Operational Aspirin
Virtual nodes: Operational AspirinVirtual nodes: Operational Aspirin
Virtual nodes: Operational AspirinAcunu
 
Acunu Analytics and Cassandra at Hailo All Your Base 2013
Acunu Analytics and Cassandra at Hailo All Your Base 2013 Acunu Analytics and Cassandra at Hailo All Your Base 2013
Acunu Analytics and Cassandra at Hailo All Your Base 2013 Acunu
 
Understanding Cassandra internals to solve real-world problems
Understanding Cassandra internals to solve real-world problemsUnderstanding Cassandra internals to solve real-world problems
Understanding Cassandra internals to solve real-world problemsAcunu
 
Acunu Analytics: Simpler Real-Time Cassandra Apps
Acunu Analytics: Simpler Real-Time Cassandra AppsAcunu Analytics: Simpler Real-Time Cassandra Apps
Acunu Analytics: Simpler Real-Time Cassandra AppsAcunu
 
All Your Base
All Your BaseAll Your Base
All Your BaseAcunu
 
Realtime Analytics with Apache Cassandra
Realtime Analytics with Apache CassandraRealtime Analytics with Apache Cassandra
Realtime Analytics with Apache CassandraAcunu
 
Realtime Analytics with Apache Cassandra - JAX London
Realtime Analytics with Apache Cassandra - JAX LondonRealtime Analytics with Apache Cassandra - JAX London
Realtime Analytics with Apache Cassandra - JAX LondonAcunu
 
Real-time Cassandra
Real-time CassandraReal-time Cassandra
Real-time CassandraAcunu
 
Realtime Analytics on the Twitter Firehose with Apache Cassandra - Denormaliz...
Realtime Analytics on the Twitter Firehose with Apache Cassandra - Denormaliz...Realtime Analytics on the Twitter Firehose with Apache Cassandra - Denormaliz...
Realtime Analytics on the Twitter Firehose with Apache Cassandra - Denormaliz...Acunu
 
Realtime Analytics with Cassandra
Realtime Analytics with CassandraRealtime Analytics with Cassandra
Realtime Analytics with CassandraAcunu
 
Acunu Analytics @ Cassandra London
Acunu Analytics @ Cassandra LondonAcunu Analytics @ Cassandra London
Acunu Analytics @ Cassandra LondonAcunu
 
Exploring Big Data value for your business
Exploring Big Data value for your businessExploring Big Data value for your business
Exploring Big Data value for your businessAcunu
 
Realtime Analytics on the Twitter Firehose with Cassandra
Realtime Analytics on the Twitter Firehose with CassandraRealtime Analytics on the Twitter Firehose with Cassandra
Realtime Analytics on the Twitter Firehose with CassandraAcunu
 
Progressive NOSQL: Cassandra
Progressive NOSQL: CassandraProgressive NOSQL: Cassandra
Progressive NOSQL: CassandraAcunu
 
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...Acunu
 
Cassandra EU 2012 - Putting the X Factor into Cassandra
Cassandra EU 2012 - Putting the X Factor into CassandraCassandra EU 2012 - Putting the X Factor into Cassandra
Cassandra EU 2012 - Putting the X Factor into CassandraAcunu
 
Cassandra EU 2012 - Netflix's Cassandra Architecture and Open Source Efforts
Cassandra EU 2012 - Netflix's Cassandra Architecture and Open Source EffortsCassandra EU 2012 - Netflix's Cassandra Architecture and Open Source Efforts
Cassandra EU 2012 - Netflix's Cassandra Architecture and Open Source EffortsAcunu
 
Next Generation Cassandra
Next Generation CassandraNext Generation Cassandra
Next Generation CassandraAcunu
 
Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans
Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans
Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans Acunu
 

Mais de Acunu (20)

Acunu and Hailo: a realtime analytics case study on Cassandra
Acunu and Hailo: a realtime analytics case study on CassandraAcunu and Hailo: a realtime analytics case study on Cassandra
Acunu and Hailo: a realtime analytics case study on Cassandra
 
Virtual nodes: Operational Aspirin
Virtual nodes: Operational AspirinVirtual nodes: Operational Aspirin
Virtual nodes: Operational Aspirin
 
Acunu Analytics and Cassandra at Hailo All Your Base 2013
Acunu Analytics and Cassandra at Hailo All Your Base 2013 Acunu Analytics and Cassandra at Hailo All Your Base 2013
Acunu Analytics and Cassandra at Hailo All Your Base 2013
 
Understanding Cassandra internals to solve real-world problems
Understanding Cassandra internals to solve real-world problemsUnderstanding Cassandra internals to solve real-world problems
Understanding Cassandra internals to solve real-world problems
 
Acunu Analytics: Simpler Real-Time Cassandra Apps
Acunu Analytics: Simpler Real-Time Cassandra AppsAcunu Analytics: Simpler Real-Time Cassandra Apps
Acunu Analytics: Simpler Real-Time Cassandra Apps
 
All Your Base
All Your BaseAll Your Base
All Your Base
 
Realtime Analytics with Apache Cassandra
Realtime Analytics with Apache CassandraRealtime Analytics with Apache Cassandra
Realtime Analytics with Apache Cassandra
 
Realtime Analytics with Apache Cassandra - JAX London
Realtime Analytics with Apache Cassandra - JAX LondonRealtime Analytics with Apache Cassandra - JAX London
Realtime Analytics with Apache Cassandra - JAX London
 
Real-time Cassandra
Real-time CassandraReal-time Cassandra
Real-time Cassandra
 
Realtime Analytics on the Twitter Firehose with Apache Cassandra - Denormaliz...
Realtime Analytics on the Twitter Firehose with Apache Cassandra - Denormaliz...Realtime Analytics on the Twitter Firehose with Apache Cassandra - Denormaliz...
Realtime Analytics on the Twitter Firehose with Apache Cassandra - Denormaliz...
 
Realtime Analytics with Cassandra
Realtime Analytics with CassandraRealtime Analytics with Cassandra
Realtime Analytics with Cassandra
 
Acunu Analytics @ Cassandra London
Acunu Analytics @ Cassandra LondonAcunu Analytics @ Cassandra London
Acunu Analytics @ Cassandra London
 
Exploring Big Data value for your business
Exploring Big Data value for your businessExploring Big Data value for your business
Exploring Big Data value for your business
 
Realtime Analytics on the Twitter Firehose with Cassandra
Realtime Analytics on the Twitter Firehose with CassandraRealtime Analytics on the Twitter Firehose with Cassandra
Realtime Analytics on the Twitter Firehose with Cassandra
 
Progressive NOSQL: Cassandra
Progressive NOSQL: CassandraProgressive NOSQL: Cassandra
Progressive NOSQL: Cassandra
 
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
Cassandra EU 2012 - Overview of Case Studies and State of the Market by 451 R...
 
Cassandra EU 2012 - Putting the X Factor into Cassandra
Cassandra EU 2012 - Putting the X Factor into CassandraCassandra EU 2012 - Putting the X Factor into Cassandra
Cassandra EU 2012 - Putting the X Factor into Cassandra
 
Cassandra EU 2012 - Netflix's Cassandra Architecture and Open Source Efforts
Cassandra EU 2012 - Netflix's Cassandra Architecture and Open Source EffortsCassandra EU 2012 - Netflix's Cassandra Architecture and Open Source Efforts
Cassandra EU 2012 - Netflix's Cassandra Architecture and Open Source Efforts
 
Next Generation Cassandra
Next Generation CassandraNext Generation Cassandra
Next Generation Cassandra
 
Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans
Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans
Cassandra EU 2012 - CQL: Then, Now and When by Eric Evans
 

Cassandra Performance: Past, present & future

  • 1. Cassandra Performance Past, Present & Future Tom Wilkie, Founder Acunu Ltd
  • 2. A Busy Year 11 Jan : Cassandra 0.7.0 3 Jun: Cassandra 0.8.0 18 Oct: Cassandra 1.0.0
  • 3. 11 Jan : Cassandra 0.7.0 • Dynamic endpoint snitch • Row cache improvements • Secondary indexes 3 Jun: Cassandra 0.8.0 18 Oct: Cassandra 1.0.0
  • 4. 11 Jan : Cassandra 0.7.0 3 Jun: Cassandra 0.8.0 • Counters • CQL 18 Oct: Cassandra 1.0.0
  • 5. 11 Jan : Cassandra 0.7.0 3 Jun: Cassandra 0.8.0 18 Oct: Cassandra 1.0.0 • Compression • Off heap caches, arena allocations etc • LevelDB-style compactions
  • 7. Read the fine print 24GB of memory ... a 300GB disk ...key size of 13 bytes and data size of 1108 bytes. ... 96 nodes storing 2.1 billion records ~350k inserts / sec http://www.oracle.com/technetwork/database/nosqldb/learnmore/nosql-database-498041.pdf
  • 8. “Read/write performance on a single four-core machine. One million inserts followed by one million updates” http://www.datastax.com/dev/blog/whats-new-in-cassandra-1-0-performance
  • 9. 1 x Quad core Xeon E5620 Machine 24GB RAM, 8x1TB Disks 1 commit log, 7 in RAID 10 Keys: 8 byte,Values: 10 bytes Random key distribution Workload 10 million Inserts, Random Point Gets, Range Queries
  • 10. Cassandra Performance Evolution 90,000 80,000 70,000 60,000 50,000 40,000 30,000 20,000 10,000 0 Inserts Point Gets Range Queries 0.7.9 0.8.7 1.0.2
  • 11. 1 x Quad core Xeon E5620 Machine 24GB RAM, 8x1TB Disks 1 commit log, 7 in RAID 10 Keys: 8 byte,Values: 100 bytes Random key distribution Workload 300 million Inserts, Random Point Gets, Range Queries
  • 12. Inserts/s Time / hours
  • 13. Effect of Compression and Leveled Compaction 60,000 200 50,000 160 40,000 120 30,000 80 20,000 40 10,000 0 0 Inserts Point Gets 1.0.2 w/ Compression w/ Leveled Compaction
  • 14. Effect of Compression and Leveled Compaction 60,000 500 50,000 400 40,000 300 30,000 200 20,000 100 10,000 0 0 1.0.2 Inserts Point Gets Range Queries w/ Compression w/ Leveled Compaction Acunu
  • 16. Questions? Tom Wilkie @tom_wilkie tom@acunu.com http://bitbucket.org/acunu http://github.com/acunu http://www.acunu.com/download http://www.acunu.com/insights