SlideShare uma empresa Scribd logo
1 de 5
http://dotnetdlr.com



NoSql (It’s “Not only SQL” not “No to
Sql”)
This is my first post on NoSql database technologies. There have been drastic changes in database
technologies over the few years. Increase in user’s requests, high availability of applications, real time
performance forced to think on different database technologies. We have traditional RDBMS, memory
and NoSql databases available in market to suffice particular business needs. Here I’ll illustrate some of
key aspects of NoSql databases like what is NoSql, why we need it, advantages and disadvantages of
NoSql.


What is NoSql Movement?
It’s a different way of thinking in database technologies. It is unlike relational database management
system where we have tables, procedures,functions, normalization concepts. NoSql databases are not
built primarily on tables and don’t use sql for manipulation or querying database.

NoSql databases have specificpurpose to achieve, that means NoSql database might not support all the
features like in relational databases.

NoSql databases are based onCAPTheorem.

    Consistency: Most of the applications or services attempt to provide strong consistent data.
    Interactions with applications/services are expected to behave in transactional manner ie. Operation
    should be atomic (succeed or failure entirely), uncommitted transactions should be isolated from each
    other and transaction once committed should be permanent.
    Availability: Load on services /applications are increasing and eventually services should be highly
    available to users. Every request should be succeed.
    Partition tolerant:Your services should provide some amount of fault tolerance in case of crash,
    failure or heavy load. It is important that in case of these circumstances your services should still
    perform as expected. Partition tolerant is one of desirable property of service. Services can serve
    request from multiple nodes


Why NoSql?
        Since NoSql databases are using for specific purpose. They are normally using for huge data
        where performance matters. Relational database systems are hard to scale out in case of write
        operation. We can load balance database servers by replicating on multiple servers, in this case
        read operation can be load balance but write operation needs consistency across multiple
        servers. Writes can be scaled only by partitioning the data. This affects reads as distributed joins
        are usually slow and hard to implement. We can support increase in no. of users or requests by
        scaling up relational databases which means we need more hardware support, licensing,
        increase in costs etc.

        Relational databases are not good option on heavy load which are doing read and write
        operations simultaneously like Facebook, Google, Amazon, Twitter etc.

1
http://dotnetdlr.com


        A NoSQL implementation, on the other hand, can scale out, i.e. distribute the database load
        across more servers.




Source: Couchbase.com

Common characteristic in NoSql databases

    Aggregating (supported by column databases):Aggregation usage to calculate aggregated
    values like Count, Max, Avg, Min etc. Some of NoSql provides support for aggregationframework
    which have inbuilt aggregation of values. Approach in column databases is to store values in columns
    instead rows (de-normalized data). This kind of data mainly used in data analytics and business
    intelligence. Google’s BigTable and Apache’s Cassandra supports some feature of column
    databases.

    Relationships (support by graph databases):A graph database uses graph structures with
    nodes, edges and properties. Every element contains a direct pointer to adjacent element; in this
    case it doesn’t need to lookup indexes or scanning whole data. Graph databases are mostly use in
    relational or social data where elements are connected. Eg. Neo4j, BigData, OrientDB.




2
http://dotnetdlr.com




Source: wikipaedia




    Document based. Document databases are considered by many as the next logical step from
    simple key-/value-stores to slightly more complex and meaningful data structures as they at least
    allow encapsulating key-/value-pairs in documents. Eg. CouchDb, MongoDb.

    Mapping of document based db vs relational db

    Document Based Databases                     Relational databases
    Collections                                  Table
    Document                                     Row

    Key- Value Store: Values are stored as simply key-value pairs. Values only stored like blob object
    and doesn’t care about data content. Eg. Dynamo DB, LevelDB, RaptorDB.

    Databases Scale out:When the load increases on databases, database administrators were
    scaling up tradition databases by increasing hardware, buying bigger databases- instead of scale out
    i.e. distributing databases on multiple nodes /servers to balance load. Because of increase in
    transactions rates and availability requirements and availability of databases on cloud or virtual
    machine, scaling out is not economic pain in increasing cost anymore.

    On the other hand, NoSql databases can scale out by distributing on multiple servers. NoSQL
    databases typically use clusters of cheap commodity servers to manage the exploding and
    transaction volumes. The result is that the cost per gigabyte or transaction/second for NoSQL can be
    many times less than the cost for RDBMS, allowing you to store and process more data at a much
    lower price;

    Now question here is why scaling out in RDBMS is hard to implement. Traditional databases support
    ACID properties that guarantee that database transactions are processed reliably. A transaction can
    have write operations for multiple records, so to keep consistency across multiple nodes is slow and
    complex process, because multiple servers would need to communicate back and forth to keep data
    integrity and synchronize transactions while preventing deadlock. On the other hand NoSql databases

3
http://dotnetdlr.com


    supports single record transaction and data is partitioned on multiple nodes to process transactions
    fast.

    Auto Sharding (Elasticity): NoSql databases support automatic data sharding (horizontal
    partitioning of data), where database breaks down into smaller chunks (called shard) and can be
    shared across distributed servers or cluster. This feature provides faster responses to transactions
    and data requests.

    Data Replication:Most of NoSql supports data-replication like relational databases to support same
    data-availability across distributed servers.

    No schema required (Flexible data model):Data can be inserted in a NoSQL DB without first
    defining a rigid database schema. The format of the data being inserted can be changed at any time,
    without application disruption. This provides greater application flexibility, which ultimately delivers
    significant business flexibility.

    Caching:Most of NoSql databases supports integrated caching to support low latency and high
    throughput. This behavior is contrast with traditional database management systems where it needs
    separate configuration or development to support.


Challenges of No-SQL
Till now we have seen significant advantages of NoSql over RDBMS, however there are many challenges
to implement NoSql.

Maturity: Most of the NoSql databases are in open source or in pre-production stage. In this case it might
be risk to adopt these databases on enterprise level. For small business or use case it might be better to
consider. On the other hand RDBMS databases are matured, providing many features and having good
documentations or resources.

Support:Most of RDBMS are not open source that means they come with commitment and assurance in
case of failure. They are reliable products and properly tested. Most of NoSql databases are open source
and not widely adopted by organizations. It is very hard to get effective support from open sources
databases. Some of NoSql databases created by small startups for specific needs, not for global reach.

Tools: RDBMS databases have lot of tools to monitor databases, queries analyzing, optimizations,
performance profiling, analytics and Business Intelligence. Objective of NoSql databases are to minimize
use of admin tools which has not achieved fully yet, still there are certain things which need skills and
tools to monitor database activities.


When to consider NoSql
Following are some of indicators you can consider while choosing NoSql database for your application:

        If your application needs high performance databases.
        Need less or zero administration of databases.
        You want flexible data model. Minor of major changes should not impact whole system.
        Application that needs less complex transactions.

4
http://dotnetdlr.com


       High availability.
       Not or less consideration on Business Intelligence and analytics.




References:
       http://nosql-database.org/
       http://www.couchbase.com
       www.mongodb.org
       http://en.wikipedia.org/wiki/Nosql




5

Mais conteúdo relacionado

Mais procurados

DSM - Comparison of Hbase and Cassandra
DSM - Comparison of Hbase and CassandraDSM - Comparison of Hbase and Cassandra
DSM - Comparison of Hbase and CassandraShrikant Samarth
 
Chapter 4 terminolgy of keyvalue databses from nosql for mere mortals
Chapter 4 terminolgy of keyvalue databses from nosql for mere mortalsChapter 4 terminolgy of keyvalue databses from nosql for mere mortals
Chapter 4 terminolgy of keyvalue databses from nosql for mere mortalsnehabsairam
 
How to use Big Data and Data Lake concept in business using Hadoop and Spark...
 How to use Big Data and Data Lake concept in business using Hadoop and Spark... How to use Big Data and Data Lake concept in business using Hadoop and Spark...
How to use Big Data and Data Lake concept in business using Hadoop and Spark...Institute of Contemporary Sciences
 
The Warranty Data Lake – After, Inc.
The Warranty Data Lake – After, Inc.The Warranty Data Lake – After, Inc.
The Warranty Data Lake – After, Inc.Richard Vermillion
 
SQL Server 2016 - Stretch DB
SQL Server 2016 - Stretch DB SQL Server 2016 - Stretch DB
SQL Server 2016 - Stretch DB Shy Engelberg
 
Research on vector spatial data storage scheme based
Research on vector spatial data storage scheme basedResearch on vector spatial data storage scheme based
Research on vector spatial data storage scheme basedAnant Kumar
 
Planing and optimizing data lake architecture
Planing and optimizing data lake architecturePlaning and optimizing data lake architecture
Planing and optimizing data lake architectureMilos Milovanovic
 
Appache Cassandra
Appache Cassandra  Appache Cassandra
Appache Cassandra nehabsairam
 
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017Lviv Startup Club
 

Mais procurados (20)

DSM - Comparison of Hbase and Cassandra
DSM - Comparison of Hbase and CassandraDSM - Comparison of Hbase and Cassandra
DSM - Comparison of Hbase and Cassandra
 
Nosql
NosqlNosql
Nosql
 
Dsm project-h base-cassandra
Dsm project-h base-cassandraDsm project-h base-cassandra
Dsm project-h base-cassandra
 
Chapter 4 terminolgy of keyvalue databses from nosql for mere mortals
Chapter 4 terminolgy of keyvalue databses from nosql for mere mortalsChapter 4 terminolgy of keyvalue databses from nosql for mere mortals
Chapter 4 terminolgy of keyvalue databses from nosql for mere mortals
 
Big data hadoop rdbms
Big data hadoop rdbmsBig data hadoop rdbms
Big data hadoop rdbms
 
Know what is NOSQL
Know what is NOSQL Know what is NOSQL
Know what is NOSQL
 
Unit 3 MongDB
Unit 3 MongDBUnit 3 MongDB
Unit 3 MongDB
 
How to use Big Data and Data Lake concept in business using Hadoop and Spark...
 How to use Big Data and Data Lake concept in business using Hadoop and Spark... How to use Big Data and Data Lake concept in business using Hadoop and Spark...
How to use Big Data and Data Lake concept in business using Hadoop and Spark...
 
Beyond Relational Databases
Beyond Relational DatabasesBeyond Relational Databases
Beyond Relational Databases
 
SQL vs NoSQL
SQL vs NoSQLSQL vs NoSQL
SQL vs NoSQL
 
Data Storage Management
Data Storage ManagementData Storage Management
Data Storage Management
 
Datastores
DatastoresDatastores
Datastores
 
The Warranty Data Lake – After, Inc.
The Warranty Data Lake – After, Inc.The Warranty Data Lake – After, Inc.
The Warranty Data Lake – After, Inc.
 
NoSQL databases
NoSQL databasesNoSQL databases
NoSQL databases
 
SQL Server 2016 - Stretch DB
SQL Server 2016 - Stretch DB SQL Server 2016 - Stretch DB
SQL Server 2016 - Stretch DB
 
Introduction to Azure Data Lake
Introduction to Azure Data LakeIntroduction to Azure Data Lake
Introduction to Azure Data Lake
 
Research on vector spatial data storage scheme based
Research on vector spatial data storage scheme basedResearch on vector spatial data storage scheme based
Research on vector spatial data storage scheme based
 
Planing and optimizing data lake architecture
Planing and optimizing data lake architecturePlaning and optimizing data lake architecture
Planing and optimizing data lake architecture
 
Appache Cassandra
Appache Cassandra  Appache Cassandra
Appache Cassandra
 
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017
Artur Fejklowicz - “Data Lake architecture” AI&BigDataDay 2017
 

Destaque

Concurrent Collections Object In Dot Net 4
Concurrent Collections Object In Dot Net 4Concurrent Collections Object In Dot Net 4
Concurrent Collections Object In Dot Net 4Neeraj Kaushik
 
Implementation of fix messages for fix 5.0 sp2 and fixt1.1 specification
Implementation of fix messages for fix 5.0 sp2 and fixt1.1 specificationImplementation of fix messages for fix 5.0 sp2 and fixt1.1 specification
Implementation of fix messages for fix 5.0 sp2 and fixt1.1 specificationNeeraj Kaushik
 
Edison learning cms_manual
Edison learning cms_manualEdison learning cms_manual
Edison learning cms_manualJennifer Pricci
 
Implement Search Screen Using Knockoutjs
Implement Search Screen Using KnockoutjsImplement Search Screen Using Knockoutjs
Implement Search Screen Using KnockoutjsNeeraj Kaushik
 
Press Placement; Tri-Town News (Benefit Concert to Shine Light on Teen Suicide)
Press Placement; Tri-Town News (Benefit Concert to Shine Light on Teen Suicide) Press Placement; Tri-Town News (Benefit Concert to Shine Light on Teen Suicide)
Press Placement; Tri-Town News (Benefit Concert to Shine Light on Teen Suicide) Jennifer Pricci
 
C-Sharp Arithmatic Expression Calculator
C-Sharp Arithmatic Expression CalculatorC-Sharp Arithmatic Expression Calculator
C-Sharp Arithmatic Expression CalculatorNeeraj Kaushik
 
Bob burgeronlinepresskit
Bob burgeronlinepresskitBob burgeronlinepresskit
Bob burgeronlinepresskitJennifer Pricci
 
Z100 clearchannelgeneralcapabilities
Z100 clearchannelgeneralcapabilitiesZ100 clearchannelgeneralcapabilities
Z100 clearchannelgeneralcapabilitiesJennifer Pricci
 
Parallel Programming With Dot Net
Parallel Programming With Dot NetParallel Programming With Dot Net
Parallel Programming With Dot NetNeeraj Kaushik
 
New Directions in Project Management
New Directions in Project ManagementNew Directions in Project Management
New Directions in Project Managementguestbb073ee
 
Sell your house-patrick_parker_realty
Sell your house-patrick_parker_realtySell your house-patrick_parker_realty
Sell your house-patrick_parker_realtyJennifer Pricci
 
Multithreading Presentation
Multithreading PresentationMultithreading Presentation
Multithreading PresentationNeeraj Kaushik
 

Destaque (14)

Concurrent Collections Object In Dot Net 4
Concurrent Collections Object In Dot Net 4Concurrent Collections Object In Dot Net 4
Concurrent Collections Object In Dot Net 4
 
Implementation of fix messages for fix 5.0 sp2 and fixt1.1 specification
Implementation of fix messages for fix 5.0 sp2 and fixt1.1 specificationImplementation of fix messages for fix 5.0 sp2 and fixt1.1 specification
Implementation of fix messages for fix 5.0 sp2 and fixt1.1 specification
 
El corporate brochure
El corporate brochureEl corporate brochure
El corporate brochure
 
Edison learning cms_manual
Edison learning cms_manualEdison learning cms_manual
Edison learning cms_manual
 
E valuate brochure
E valuate brochureE valuate brochure
E valuate brochure
 
Implement Search Screen Using Knockoutjs
Implement Search Screen Using KnockoutjsImplement Search Screen Using Knockoutjs
Implement Search Screen Using Knockoutjs
 
Press Placement; Tri-Town News (Benefit Concert to Shine Light on Teen Suicide)
Press Placement; Tri-Town News (Benefit Concert to Shine Light on Teen Suicide) Press Placement; Tri-Town News (Benefit Concert to Shine Light on Teen Suicide)
Press Placement; Tri-Town News (Benefit Concert to Shine Light on Teen Suicide)
 
C-Sharp Arithmatic Expression Calculator
C-Sharp Arithmatic Expression CalculatorC-Sharp Arithmatic Expression Calculator
C-Sharp Arithmatic Expression Calculator
 
Bob burgeronlinepresskit
Bob burgeronlinepresskitBob burgeronlinepresskit
Bob burgeronlinepresskit
 
Z100 clearchannelgeneralcapabilities
Z100 clearchannelgeneralcapabilitiesZ100 clearchannelgeneralcapabilities
Z100 clearchannelgeneralcapabilities
 
Parallel Programming With Dot Net
Parallel Programming With Dot NetParallel Programming With Dot Net
Parallel Programming With Dot Net
 
New Directions in Project Management
New Directions in Project ManagementNew Directions in Project Management
New Directions in Project Management
 
Sell your house-patrick_parker_realty
Sell your house-patrick_parker_realtySell your house-patrick_parker_realty
Sell your house-patrick_parker_realty
 
Multithreading Presentation
Multithreading PresentationMultithreading Presentation
Multithreading Presentation
 

Semelhante a No sql

2.Introduction to NOSQL (Core concepts).pptx
2.Introduction to NOSQL (Core concepts).pptx2.Introduction to NOSQL (Core concepts).pptx
2.Introduction to NOSQL (Core concepts).pptxRushikeshChikane2
 
Sql vs NO-SQL database differences explained
Sql vs NO-SQL database differences explainedSql vs NO-SQL database differences explained
Sql vs NO-SQL database differences explainedSatya Pal
 
Why no sql ? Why Couchbase ?
Why no sql ? Why Couchbase ?Why no sql ? Why Couchbase ?
Why no sql ? Why Couchbase ?Ahmed Rashwan
 
Introduction to NoSQL
Introduction to NoSQLIntroduction to NoSQL
Introduction to NoSQLbalwinders
 
Brief introduction to NoSQL by fas mosleh
Brief introduction to NoSQL by fas moslehBrief introduction to NoSQL by fas mosleh
Brief introduction to NoSQL by fas moslehFas (Feisal) Mosleh
 
NOSQL- Presentation on NoSQL
NOSQL- Presentation on NoSQLNOSQL- Presentation on NoSQL
NOSQL- Presentation on NoSQLRamakant Soni
 
NOSQL in big data is the not only structure langua.pdf
NOSQL in big data is the not only structure langua.pdfNOSQL in big data is the not only structure langua.pdf
NOSQL in big data is the not only structure langua.pdfajajkhan16
 
NOSQL Databases types and Uses
NOSQL Databases types and UsesNOSQL Databases types and Uses
NOSQL Databases types and UsesSuvradeep Rudra
 
Comparative study of no sql document, column store databases and evaluation o...
Comparative study of no sql document, column store databases and evaluation o...Comparative study of no sql document, column store databases and evaluation o...
Comparative study of no sql document, column store databases and evaluation o...ijdms
 
Assignment_4
Assignment_4Assignment_4
Assignment_4Kirti J
 
Non relational databases-no sql
Non relational databases-no sqlNon relational databases-no sql
Non relational databases-no sqlRam kumar
 
Introduction to NoSQL database technology
Introduction to NoSQL database technologyIntroduction to NoSQL database technology
Introduction to NoSQL database technologynicolausalex722
 

Semelhante a No sql (20)

Report 1.0.docx
Report 1.0.docxReport 1.0.docx
Report 1.0.docx
 
2.Introduction to NOSQL (Core concepts).pptx
2.Introduction to NOSQL (Core concepts).pptx2.Introduction to NOSQL (Core concepts).pptx
2.Introduction to NOSQL (Core concepts).pptx
 
unit2-ppt1.pptx
unit2-ppt1.pptxunit2-ppt1.pptx
unit2-ppt1.pptx
 
Selecting best NoSQL
Selecting best NoSQL Selecting best NoSQL
Selecting best NoSQL
 
Report 2.0.docx
Report 2.0.docxReport 2.0.docx
Report 2.0.docx
 
Sql vs NO-SQL database differences explained
Sql vs NO-SQL database differences explainedSql vs NO-SQL database differences explained
Sql vs NO-SQL database differences explained
 
Why no sql ? Why Couchbase ?
Why no sql ? Why Couchbase ?Why no sql ? Why Couchbase ?
Why no sql ? Why Couchbase ?
 
NoSQL
NoSQLNoSQL
NoSQL
 
Introduction to NoSQL
Introduction to NoSQLIntroduction to NoSQL
Introduction to NoSQL
 
Brief introduction to NoSQL by fas mosleh
Brief introduction to NoSQL by fas moslehBrief introduction to NoSQL by fas mosleh
Brief introduction to NoSQL by fas mosleh
 
NOSQL- Presentation on NoSQL
NOSQL- Presentation on NoSQLNOSQL- Presentation on NoSQL
NOSQL- Presentation on NoSQL
 
NOSQL in big data is the not only structure langua.pdf
NOSQL in big data is the not only structure langua.pdfNOSQL in big data is the not only structure langua.pdf
NOSQL in big data is the not only structure langua.pdf
 
Unit-10.pptx
Unit-10.pptxUnit-10.pptx
Unit-10.pptx
 
the rising no sql technology
the rising no sql technologythe rising no sql technology
the rising no sql technology
 
NOSQL Databases types and Uses
NOSQL Databases types and UsesNOSQL Databases types and Uses
NOSQL Databases types and Uses
 
Comparative study of no sql document, column store databases and evaluation o...
Comparative study of no sql document, column store databases and evaluation o...Comparative study of no sql document, column store databases and evaluation o...
Comparative study of no sql document, column store databases and evaluation o...
 
Assignment_4
Assignment_4Assignment_4
Assignment_4
 
Non relational databases-no sql
Non relational databases-no sqlNon relational databases-no sql
Non relational databases-no sql
 
NoSQL Basics and MongDB
NoSQL Basics and  MongDBNoSQL Basics and  MongDB
NoSQL Basics and MongDB
 
Introduction to NoSQL database technology
Introduction to NoSQL database technologyIntroduction to NoSQL database technology
Introduction to NoSQL database technology
 

Mais de Neeraj Kaushik

How to place orders through FIX Message
How to place orders through FIX MessageHow to place orders through FIX Message
How to place orders through FIX MessageNeeraj Kaushik
 
DotNet & Sql Server Interview Questions
DotNet & Sql Server Interview QuestionsDotNet & Sql Server Interview Questions
DotNet & Sql Server Interview QuestionsNeeraj Kaushik
 

Mais de Neeraj Kaushik (7)

How to place orders through FIX Message
How to place orders through FIX MessageHow to place orders through FIX Message
How to place orders through FIX Message
 
Futures_Options
Futures_OptionsFutures_Options
Futures_Options
 
Linq Introduction
Linq IntroductionLinq Introduction
Linq Introduction
 
Quick Fix Sample
Quick Fix SampleQuick Fix Sample
Quick Fix Sample
 
DotNet & Sql Server Interview Questions
DotNet & Sql Server Interview QuestionsDotNet & Sql Server Interview Questions
DotNet & Sql Server Interview Questions
 
Design UML diagrams
Design UML diagramsDesign UML diagrams
Design UML diagrams
 
Design UML diagrams
Design UML diagramsDesign UML diagrams
Design UML diagrams
 

Último

Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxRustici Software
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Angeliki Cooney
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAndrey Devyatkin
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native ApplicationsWSO2
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfsudhanshuwaghmare1
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobeapidays
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MIND CTI
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...apidays
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...apidays
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyKhushali Kathiriya
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProduct Anonymous
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Victor Rentea
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerThousandEyes
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodJuan lago vázquez
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...Zilliz
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusZilliz
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingEdi Saputra
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024The Digital Insurer
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamUiPathCommunity
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfOverkill Security
 

Último (20)

Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
Biography Of Angeliki Cooney | Senior Vice President Life Sciences | Albany, ...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Architecting Cloud Native Applications
Architecting Cloud Native ApplicationsArchitecting Cloud Native Applications
Architecting Cloud Native Applications
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
Apidays New York 2024 - Passkeys: Developing APIs to enable passwordless auth...
 
Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...Apidays New York 2024 - The value of a flexible API Management solution for O...
Apidays New York 2024 - The value of a flexible API Management solution for O...
 
Artificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : UncertaintyArtificial Intelligence Chap.5 : Uncertainty
Artificial Intelligence Chap.5 : Uncertainty
 
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemkeProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
ProductAnonymous-April2024-WinProductDiscovery-MelissaKlemke
 
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
Modular Monolith - a Practical Alternative to Microservices @ Devoxx UK 2024
 
How to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected WorkerHow to Troubleshoot Apps for the Modern Connected Worker
How to Troubleshoot Apps for the Modern Connected Worker
 
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin WoodPolkadot JAM Slides - Token2049 - By Dr. Gavin Wood
Polkadot JAM Slides - Token2049 - By Dr. Gavin Wood
 
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ..."I see eyes in my soup": How Delivery Hero implemented the safety system for ...
"I see eyes in my soup": How Delivery Hero implemented the safety system for ...
 
Exploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with MilvusExploring Multimodal Embeddings with Milvus
Exploring Multimodal Embeddings with Milvus
 
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost SavingRepurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
Repurposing LNG terminals for Hydrogen Ammonia: Feasibility and Cost Saving
 
AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024AXA XL - Insurer Innovation Award Americas 2024
AXA XL - Insurer Innovation Award Americas 2024
 
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 AmsterdamDEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
DEV meet-up UiPath Document Understanding May 7 2024 Amsterdam
 
Cyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdfCyberprint. Dark Pink Apt Group [EN].pdf
Cyberprint. Dark Pink Apt Group [EN].pdf
 

No sql

  • 1. http://dotnetdlr.com NoSql (It’s “Not only SQL” not “No to Sql”) This is my first post on NoSql database technologies. There have been drastic changes in database technologies over the few years. Increase in user’s requests, high availability of applications, real time performance forced to think on different database technologies. We have traditional RDBMS, memory and NoSql databases available in market to suffice particular business needs. Here I’ll illustrate some of key aspects of NoSql databases like what is NoSql, why we need it, advantages and disadvantages of NoSql. What is NoSql Movement? It’s a different way of thinking in database technologies. It is unlike relational database management system where we have tables, procedures,functions, normalization concepts. NoSql databases are not built primarily on tables and don’t use sql for manipulation or querying database. NoSql databases have specificpurpose to achieve, that means NoSql database might not support all the features like in relational databases. NoSql databases are based onCAPTheorem. Consistency: Most of the applications or services attempt to provide strong consistent data. Interactions with applications/services are expected to behave in transactional manner ie. Operation should be atomic (succeed or failure entirely), uncommitted transactions should be isolated from each other and transaction once committed should be permanent. Availability: Load on services /applications are increasing and eventually services should be highly available to users. Every request should be succeed. Partition tolerant:Your services should provide some amount of fault tolerance in case of crash, failure or heavy load. It is important that in case of these circumstances your services should still perform as expected. Partition tolerant is one of desirable property of service. Services can serve request from multiple nodes Why NoSql? Since NoSql databases are using for specific purpose. They are normally using for huge data where performance matters. Relational database systems are hard to scale out in case of write operation. We can load balance database servers by replicating on multiple servers, in this case read operation can be load balance but write operation needs consistency across multiple servers. Writes can be scaled only by partitioning the data. This affects reads as distributed joins are usually slow and hard to implement. We can support increase in no. of users or requests by scaling up relational databases which means we need more hardware support, licensing, increase in costs etc. Relational databases are not good option on heavy load which are doing read and write operations simultaneously like Facebook, Google, Amazon, Twitter etc. 1
  • 2. http://dotnetdlr.com A NoSQL implementation, on the other hand, can scale out, i.e. distribute the database load across more servers. Source: Couchbase.com Common characteristic in NoSql databases Aggregating (supported by column databases):Aggregation usage to calculate aggregated values like Count, Max, Avg, Min etc. Some of NoSql provides support for aggregationframework which have inbuilt aggregation of values. Approach in column databases is to store values in columns instead rows (de-normalized data). This kind of data mainly used in data analytics and business intelligence. Google’s BigTable and Apache’s Cassandra supports some feature of column databases. Relationships (support by graph databases):A graph database uses graph structures with nodes, edges and properties. Every element contains a direct pointer to adjacent element; in this case it doesn’t need to lookup indexes or scanning whole data. Graph databases are mostly use in relational or social data where elements are connected. Eg. Neo4j, BigData, OrientDB. 2
  • 3. http://dotnetdlr.com Source: wikipaedia Document based. Document databases are considered by many as the next logical step from simple key-/value-stores to slightly more complex and meaningful data structures as they at least allow encapsulating key-/value-pairs in documents. Eg. CouchDb, MongoDb. Mapping of document based db vs relational db Document Based Databases Relational databases Collections Table Document Row Key- Value Store: Values are stored as simply key-value pairs. Values only stored like blob object and doesn’t care about data content. Eg. Dynamo DB, LevelDB, RaptorDB. Databases Scale out:When the load increases on databases, database administrators were scaling up tradition databases by increasing hardware, buying bigger databases- instead of scale out i.e. distributing databases on multiple nodes /servers to balance load. Because of increase in transactions rates and availability requirements and availability of databases on cloud or virtual machine, scaling out is not economic pain in increasing cost anymore. On the other hand, NoSql databases can scale out by distributing on multiple servers. NoSQL databases typically use clusters of cheap commodity servers to manage the exploding and transaction volumes. The result is that the cost per gigabyte or transaction/second for NoSQL can be many times less than the cost for RDBMS, allowing you to store and process more data at a much lower price; Now question here is why scaling out in RDBMS is hard to implement. Traditional databases support ACID properties that guarantee that database transactions are processed reliably. A transaction can have write operations for multiple records, so to keep consistency across multiple nodes is slow and complex process, because multiple servers would need to communicate back and forth to keep data integrity and synchronize transactions while preventing deadlock. On the other hand NoSql databases 3
  • 4. http://dotnetdlr.com supports single record transaction and data is partitioned on multiple nodes to process transactions fast. Auto Sharding (Elasticity): NoSql databases support automatic data sharding (horizontal partitioning of data), where database breaks down into smaller chunks (called shard) and can be shared across distributed servers or cluster. This feature provides faster responses to transactions and data requests. Data Replication:Most of NoSql supports data-replication like relational databases to support same data-availability across distributed servers. No schema required (Flexible data model):Data can be inserted in a NoSQL DB without first defining a rigid database schema. The format of the data being inserted can be changed at any time, without application disruption. This provides greater application flexibility, which ultimately delivers significant business flexibility. Caching:Most of NoSql databases supports integrated caching to support low latency and high throughput. This behavior is contrast with traditional database management systems where it needs separate configuration or development to support. Challenges of No-SQL Till now we have seen significant advantages of NoSql over RDBMS, however there are many challenges to implement NoSql. Maturity: Most of the NoSql databases are in open source or in pre-production stage. In this case it might be risk to adopt these databases on enterprise level. For small business or use case it might be better to consider. On the other hand RDBMS databases are matured, providing many features and having good documentations or resources. Support:Most of RDBMS are not open source that means they come with commitment and assurance in case of failure. They are reliable products and properly tested. Most of NoSql databases are open source and not widely adopted by organizations. It is very hard to get effective support from open sources databases. Some of NoSql databases created by small startups for specific needs, not for global reach. Tools: RDBMS databases have lot of tools to monitor databases, queries analyzing, optimizations, performance profiling, analytics and Business Intelligence. Objective of NoSql databases are to minimize use of admin tools which has not achieved fully yet, still there are certain things which need skills and tools to monitor database activities. When to consider NoSql Following are some of indicators you can consider while choosing NoSql database for your application: If your application needs high performance databases. Need less or zero administration of databases. You want flexible data model. Minor of major changes should not impact whole system. Application that needs less complex transactions. 4
  • 5. http://dotnetdlr.com High availability. Not or less consideration on Business Intelligence and analytics. References: http://nosql-database.org/ http://www.couchbase.com www.mongodb.org http://en.wikipedia.org/wiki/Nosql 5