SlideShare uma empresa Scribd logo
1 de 40
1
NOSQL
BIGDATA
BLOCKCHAIN
ТРИ КИТА СОВРЕМЕННЫХ ДАННЫХ
SEPTEMBER 24, 2017
2
• 8+ years in love with Java
• Roles: SE, TL, RM, DM
• Blockchain
– Researcher
– Educate my trade bot
– Working on Hyperledger Fabric solution
HELLO. MY NAME IS VLADIMIR
3
EPAM BLOCKCHAIN LAB
CURRENT STATE
• EPAM Blockchain Competency Center created in 2015
• Investigate frameworks and build knowledgebase
• Identify and qualify use cases and architecture solutions in a number of industries
• Monitor the market and communities: conferences, hackathons, discussion forums
• Develop solutions for our clients and for internal research needs
SOLUTIONS CREATED
• OTC Trade Capture and Matching (Ethereum)
• Digital Assets Management Platform (Ethereum + Amazon S3 + sMPC)
• Digital Assets Management Platform + Zero Knowledge
• Open Betting Platform (Ethereum)
• Digital Notary Service (NXT)
• Loyalty Network (Ethereum)
4
1. Is Blockchain a new paradigm?
2. Is Blockchain NoSQL?
3. Is Blockchain BigData?
4. How to compare Blockchain solutions?
5. How to apply Blockchain solutions?
MY QUESTIONS
5
BLOCKCHAIN IS
6
2
1
3
Not Only SQL MOTIVATION
DATA SIZE
• Web based applications with lots of data
• Vertical scalability constraints
• Price of storage
CLOUD
• SaaS, PaaS, IaaS
• Clustered environment
• Logical data decomposition
CHANGES IN
BUSINESS
• Fast adaptation for new business needs
• Flexible schema for PoC needs
• Iron Tringle for Time, Cost, Scope
7
• Not Only SQL
• Non-relational
• Key-Value: Redis, Riak, Berkley DB, Aerospike, DynamoDB
• Document Based: MongoDB, CouchDB, MarkLogic, ArangoDB
• Column Based: Cassandra, Hbase, Vertica, Accumulo, Hypertable
• Graph: Neo4J, IBM Graph, AllergoGraph
• Multi-Model: Couchbase, MarkLogic, ArangoDB
• Replication (Master-Slave, Peer-To-Peer, Combination)
• Sharding
WHAT IS NoSQL?
DEFINITION
ARCHITECTURE
DATA DISTRIBUTION
8
FEATURE / PROPERTY SQL NoSQL
Schema Design Yes Schema-less / Dynamic
Scalability Vertical scaling Horizontal scaling
Query Good to retrieve related data Good to retrieve big data
Flexibility By change log OOTB
Transactions ACID BASE
Objects Tables, Rows, Columns Collections, Documents, Fields
Storage Columns with Rows Key/Value, Document, Graph
Data Distribution Tune Sharding and Replication OOTB
Business Logic Stored Procedures Apps on top (e.g. MapReduce)
CAP CA AP/CP
SQL vs NoSQL
9
CAP THEOREM
10
• Volume – GBs, TBs, PBs
• Velocity – Fast Data processing with high performance and low latency
• Variety – concurrent processing of heterogeneous possibly not structured data sources
• Not about size but about how much useful insights can be extracted from data
• Data Lake, Lambda, Kappa
• MapReduce, Data Warehousing, Stream Processing, In-Memory Computation, Disaster Recovery
• NoSQL DBs, Hadoop, Kafka, Storm, Spark, ZooKeeper
WHAT IS BigData?
MEASUREMENT
INSIGHTS
ARCHITECTURE
TECHOLOGY
11
12
• A robust peer-to-peer network that allows transactions to be created by any party and propagated quickly to all
connected nodes
• A way to identify conflicts between transactions and resolve them automatically
• A synchronization technology that ensures all peers converge on an identical copy of the database
• A method for tagging different pieces of information as belonging to different participants, and enforcing this form of
data ownership without a central authority
• A paradigm for expressing restrictions on which operations are permitted, e.g. to prevent one company from inflating
the directory with fictitious entries
NoSQL CHALLENGES
TRANSACTIONS
CONSISTENCY
ROBUSTNESS
13
• Who controls the infrastructure when there are multiple actors involved?
• If you have multiple copies, how do you know which one is the most up-to-date?
• How do you reconcile a different system administrator role at each regional office?
• How well can you trust the data?
• If you generate the data yourself, how do you prove you were the originator? If you get data from others, how do you
know it was truly them?
• What about crashes and malicious behavior?
• How do you monetize the data?
• How do you transfer the rights of the data, or buy rights from others?
BigData CHALLENGES
CONTROL
TRUST
MONETIZATION
14
WHAT IS BLOCKCHAIN?
Blockchain is a concept of building decentralized applications to allow reliable peer to peer
transactions/interactions eliminating the need of a trusted intermediary with the help of the
following elements:
• Peer-To-Peer communication
• Transactions grouping into blocks
• Consensus protocol (resolves double spend problem and performs synchronization)
• Data Structures/Storage (resolve double spend problem, provides high availability,
reliability and immutability)
• Smart contracts (executes business logic on event/transaction)
• Crypto primitives
• Distributed Ledger Technology
Blockchain enables: Trusted efficient collaboration between several parties with no need for
intermediary
15
NEW PARADIGM?
DATA STRUCTURES
Hash pointers (1960s)
Merkle tree (1979)
Distributed hash table
DIGITAL SIGNATURE
Symmetric and asymmetric
cryptography (1970s)
CONSENSUS PROTOCOL
Proof-of-Work (1990s)
Proof-of-Stake
Others….
https://www.weusecoins.com/what-is-a-merkle-tree/
17
FEATURE / PROPERTY BLOCKCHAIN DISTRIBUTED DATABASE
Operations Append only Insert, Update, Delete
Redundancy Yes Yes
High-availability Yes Yes
Data Sharding Planned Yes
Replication Yes, peer-to-peer Yes
Consensus Block Row, Replica Set
Signatures Always Manual
Data Validation Always Manual
Business Logic Smart Contracts Triggers, Stored Procedures, etc.
Primary usage Ledger Generic
BLOCKCHAIN vs DISTRIBUTED DATABASE
18
ARCHITECTURALLY SIGNIFICANT REQUIREMENTS
PERFORMANCE (e.g. Bitcoin: 3 tps, Ethereum: 25 tps)
LATENCY (e.g. Bitcoin: 10 mins, Ethereum: 12 sec)
SCALABILITY (Blockchain size, Smart Contracts executed on every node)
SECURITY (Smart contract security, Consensus protocol security)
PRIVACY (All participant nodes see all transactions)
WASTE OF RESOURCES (e.g. Bitcoin PoW: 6300 nodes, 24 hours, 100% CPU load)
MATURITY (e.g. Ethereum: every other month have to change fork, breaking changes)
19
SIZE DOES MATTER
HOW BIG IS BITCOIN BLOCKCHAIN?
20
• 1.5 TB – 2021
• 3 TB – 2022
• 6 TB – 2023
• 1.5 PB - 2031
FORECAST
• No Sharding
• Consistency Time
• Storage
PROBLEM
21
1 TB – beginning of 2018
FORECAST
• Sharding TBD
• Parallel Processing
• Byzantine
SOLUTION
22
THROUGHPUT. BITCOIN
23
THROUGHPUT. ETHERIUM
24
THROUGHPUT. HYPERLEDGER
25
LATENCY. BITCOIN
26
LATENCY. ETHERIUM
27
PRIVACY. NETWORK TYPES
This is a closed system
checking all details
and controlling access
via invitation
All open network that
anybody can access like
the Bitcoin model
Permissioned Permissionless
28
PRIVACY. ENCRYPTION
RING SIGNATURES HOMOMORPHIC
ENCRYPTION
(HE)
SECURE MULTI-PARTY
COMPUTATION (MPC)
ZERO KNOWLEDGE
PROOFS (ZK)
29
PRIVACY. BY PERMISSIONED NATURE
30
FRAMEWORK NETWORK CONSENSUS PERFORMANCE LATENCY SECURITY PRIVACY AVAILABILITY SCALABILITY MATURITY
Bitcoin Public PoW
avg 3 tps
max 7 tps
avg 50 min manual
new
addresses
medium
Blocksize
change
2009
Ethereum Public
PoW, PoS,
PoA
25 tps PoW
300 tps PoA
14s PoW
2s PoA
manual ZK TBD
lot of
monitoring
Sharding
TBD
2015
Graphene Public
delegated
PoS
1000 tps 2s manual no 2014
Zcash Public ZK + PoW avg 15 tps avg 2.5 min ZK
Blocksize
change
2016
Monero Public
CryptoNight
PoW
dynamic Ring Sign 2014
Hyperledger Private
Kafka,
pluggable
avg 300 tps
on channel
1s
Membership
Service
Provider
Channels
HA by
ZooKeeper
Dynamic
and
Program
2017
R3 Corda Private
pluggable,
RAFT
exp 1200
tps
1s customize customize 2016
BigchainDB Private
underlying
DB, Raft
1000 blocks
* 1000 txn
630ms in
one region
Roles and
Permissions
Hidden
values
n/a
Clustered
env
2016
PLAYERS AND FRAMEWORKS
31
BigData HELPS
BaaS
• IBM Bluemix
• Microsoft Azure
• Rubix
NoSQL
• CouchDB for Hyperledger
• DAG for IOTA, Byteball
• BigchainDB
Elasticsearch
• Full-text search
• REST API
LOREM IPSUM DOLOR AMET
• Nulla nu nisi
• Risus purus id fusce
• Lobortis ipsum felis sed
Apache Kafka
• Streaming and Messaging system
• Consensus in Fabric
• Distributed and Scalable
ZooKeeper
• Maintain nodes
• Provide HA
• Quorum
MapReduce
• Plasma.io
• Scalable Computation
• Blockchain Indexing
32
1 2 3 4
BIG USE CASES
GOVERNMENT
• Trust Voting
• Public and private
assets notary records
• Identity Management
• Intellectual property
management
• Digital Assets
distribution
ENTERTAINMENT
• Trust Casino/Lottery
• Gaming
• Media Distribution
Network
• Crowdfunding
• Prediction Markets
ECOMMERCE
• Supply Chain
• Goods Tracking (guns,
devices, chemical)
• Loyalty Programs
• KYC/AML
• Gray Markets
IT
• Distributed
Supercomputer
• Decentralized
Storage/Hosting
• IoT
• Cybersecurity
• Data Verification
33
5 6 7 8
BIG USE CASES
LIFESCIENCE
• Donors Chain
• Secure Patient Data
Platform
• Medicaments lifecycle
EDUCATION
• Education Records
• Certifications
• Research Works and
Papers
B2C
• Car Sharing
• Lending
• Wine/Food Tracking
• Money Transfers
FUTURE
• AR/VR Internal Assets
Management
• Clone Prevention
• Distributed Energy
• Time Tracking and
Employee as a Service
(HR, TA, SE etc.)
• Insurance (AntiFraud
and Fast Payments)
34
1. Is Blockchain a new paradigm? - No
2. Is Blockchain NoSQL? – At most by nature
3. Is Blockchain BigData? – At least depends on cases
4. How to compare Blockchain solutions? – Use ASR
5. How to apply Blockchain solutions? – Wisely with imagination
SUMMARY
35
CONCLUSION
If you an engineer – blockchain is so much interesting and modern1
If you an investor – trust to engineers2
If you an observer – choose the right side3
36
THANK YOU
vladimir_bichev@epam.com
vladimir.bichev
@volod_i_mir
37
Appendix: NoSQL Family
38
Appendix: NoSQL Cheatsheet
39
Appendix: BLOCKTECH LANDSCAPE
40
Appendix: INVESTORS AND STARTUPS MAP
41
Appendix: Financial Services Firms Into Blockchain

Mais conteúdo relacionado

Mais procurados

Mais procurados (20)

Blockchain Technology
Blockchain TechnologyBlockchain Technology
Blockchain Technology
 
Hands on with multichain
Hands on with multichainHands on with multichain
Hands on with multichain
 
Blockchain Essentials for Enterprise Architects
Blockchain Essentials for Enterprise ArchitectsBlockchain Essentials for Enterprise Architects
Blockchain Essentials for Enterprise Architects
 
BLOCKCHAIN TECHNOLOGY
BLOCKCHAIN TECHNOLOGYBLOCKCHAIN TECHNOLOGY
BLOCKCHAIN TECHNOLOGY
 
Tangle: An alternative to Block chain for future of crypto currency
Tangle: An alternative to Block chain for future of crypto currency Tangle: An alternative to Block chain for future of crypto currency
Tangle: An alternative to Block chain for future of crypto currency
 
How to develop Decentralized App (ĐApp) on Ethereum
How to develop Decentralized App (ĐApp) on EthereumHow to develop Decentralized App (ĐApp) on Ethereum
How to develop Decentralized App (ĐApp) on Ethereum
 
Mining Opportunities of Block Chain and BitCoin
Mining Opportunities of Block Chain and BitCoinMining Opportunities of Block Chain and BitCoin
Mining Opportunities of Block Chain and BitCoin
 
Vilnius blockchain club 20170413 consensus
Vilnius blockchain club 20170413 consensusVilnius blockchain club 20170413 consensus
Vilnius blockchain club 20170413 consensus
 
Blockchain and its Scope in Retail
Blockchain and its Scope in RetailBlockchain and its Scope in Retail
Blockchain and its Scope in Retail
 
Information security in private blockchains
Information security in private blockchainsInformation security in private blockchains
Information security in private blockchains
 
Distributed Blockchain Processing
Distributed Blockchain ProcessingDistributed Blockchain Processing
Distributed Blockchain Processing
 
Blockchain Technology
Blockchain TechnologyBlockchain Technology
Blockchain Technology
 
BigchainDB 2.0 - The Blockchain Database
BigchainDB 2.0 - The Blockchain Database BigchainDB 2.0 - The Blockchain Database
BigchainDB 2.0 - The Blockchain Database
 
Introduction to blockchain
Introduction to blockchainIntroduction to blockchain
Introduction to blockchain
 
Metadata in the Blockchain: The OP_RETURN Explosion
Metadata in the Blockchain: The OP_RETURN ExplosionMetadata in the Blockchain: The OP_RETURN Explosion
Metadata in the Blockchain: The OP_RETURN Explosion
 
Demystify blockchain development with hyperledger fabric
Demystify blockchain development with hyperledger fabricDemystify blockchain development with hyperledger fabric
Demystify blockchain development with hyperledger fabric
 
Blockchain & the IoT
Blockchain & the IoTBlockchain & the IoT
Blockchain & the IoT
 
What is MultiChain Technology?
What is MultiChain Technology?What is MultiChain Technology?
What is MultiChain Technology?
 
Best practices to build secure smart contracts
Best practices to build secure smart contractsBest practices to build secure smart contracts
Best practices to build secure smart contracts
 
Testing in the blockchain
Testing in the blockchainTesting in the blockchain
Testing in the blockchain
 

Semelhante a Доклад Владимира Бичева на третьем митапе сообщества блокчейн-разработчиков Санкт-Петербурга #spblockchain

C13_blockchain introduction public (1).pptx
C13_blockchain introduction public (1).pptxC13_blockchain introduction public (1).pptx
C13_blockchain introduction public (1).pptx
haifaazka
 
Social Media, Cloud Computing, Machine Learning, Open Source, and Big Data An...
Social Media, Cloud Computing, Machine Learning, Open Source, and Big Data An...Social Media, Cloud Computing, Machine Learning, Open Source, and Big Data An...
Social Media, Cloud Computing, Machine Learning, Open Source, and Big Data An...
Open Analytics
 
Open Data Summit Presentation by Joe Olsen
Open Data Summit Presentation by Joe OlsenOpen Data Summit Presentation by Joe Olsen
Open Data Summit Presentation by Joe Olsen
Christopher Whitaker
 

Semelhante a Доклад Владимира Бичева на третьем митапе сообщества блокчейн-разработчиков Санкт-Петербурга #spblockchain (20)

[db tech showcase Tokyo 2018] #dbts2018 #B23 『Python, Oracle Cloud, Blockchai...
[db tech showcase Tokyo 2018] #dbts2018 #B23 『Python, Oracle Cloud, Blockchai...[db tech showcase Tokyo 2018] #dbts2018 #B23 『Python, Oracle Cloud, Blockchai...
[db tech showcase Tokyo 2018] #dbts2018 #B23 『Python, Oracle Cloud, Blockchai...
 
"Creating a Competitive Edge Using Blockchain Technology"
"Creating a Competitive Edge Using Blockchain Technology""Creating a Competitive Edge Using Blockchain Technology"
"Creating a Competitive Edge Using Blockchain Technology"
 
Blockchain agriculture-kh klub-final
Blockchain agriculture-kh klub-finalBlockchain agriculture-kh klub-final
Blockchain agriculture-kh klub-final
 
dfgsdjghkjsdhfg.pptx
dfgsdjghkjsdhfg.pptxdfgsdjghkjsdhfg.pptx
dfgsdjghkjsdhfg.pptx
 
C13_blockchain introduction public (1).pptx
C13_blockchain introduction public (1).pptxC13_blockchain introduction public (1).pptx
C13_blockchain introduction public (1).pptx
 
Blockchain and its impact on Data Science and Financial Services
Blockchain and its impact on Data Science and Financial ServicesBlockchain and its impact on Data Science and Financial Services
Blockchain and its impact on Data Science and Financial Services
 
Blockchain - Beyond the Hype
Blockchain - Beyond the HypeBlockchain - Beyond the Hype
Blockchain - Beyond the Hype
 
A Breathless Tour of Blockchain
A Breathless Tour of BlockchainA Breathless Tour of Blockchain
A Breathless Tour of Blockchain
 
Analytics&IoT
Analytics&IoTAnalytics&IoT
Analytics&IoT
 
blockchain-introduction-public.pptx
blockchain-introduction-public.pptxblockchain-introduction-public.pptx
blockchain-introduction-public.pptx
 
Towards high-level specification of Smart-Contracts
Towards high-level specification of Smart-ContractsTowards high-level specification of Smart-Contracts
Towards high-level specification of Smart-Contracts
 
The deep skill of blockchain david lee 27_april2017 final
The deep skill of blockchain david lee 27_april2017 finalThe deep skill of blockchain david lee 27_april2017 final
The deep skill of blockchain david lee 27_april2017 final
 
Blockchain Technology and Its Application in Artificial Intelligence and Mach...
Blockchain Technology and Its Application in Artificial Intelligence and Mach...Blockchain Technology and Its Application in Artificial Intelligence and Mach...
Blockchain Technology and Its Application in Artificial Intelligence and Mach...
 
Oracle OpenWorld 2017 Review (31st October 2017 - 250 slides)
Oracle OpenWorld 2017 Review (31st October 2017 - 250 slides)Oracle OpenWorld 2017 Review (31st October 2017 - 250 slides)
Oracle OpenWorld 2017 Review (31st October 2017 - 250 slides)
 
ADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
ADV Slides: When and How Data Lakes Fit into a Modern Data ArchitectureADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
ADV Slides: When and How Data Lakes Fit into a Modern Data Architecture
 
Blockchain Will Be Bigger Than the Internet
Blockchain Will Be Bigger Than the InternetBlockchain Will Be Bigger Than the Internet
Blockchain Will Be Bigger Than the Internet
 
Social Media, Cloud Computing, Machine Learning, Open Source, and Big Data An...
Social Media, Cloud Computing, Machine Learning, Open Source, and Big Data An...Social Media, Cloud Computing, Machine Learning, Open Source, and Big Data An...
Social Media, Cloud Computing, Machine Learning, Open Source, and Big Data An...
 
Open Data Summit Presentation by Joe Olsen
Open Data Summit Presentation by Joe OlsenOpen Data Summit Presentation by Joe Olsen
Open Data Summit Presentation by Joe Olsen
 
Introduction to Blockchain and Smart Contracts
Introduction to Blockchain and Smart ContractsIntroduction to Blockchain and Smart Contracts
Introduction to Blockchain and Smart Contracts
 
ClickHouse in Real Life. Case Studies and Best Practices, by Alexander Zaitsev
ClickHouse in Real Life. Case Studies and Best Practices, by Alexander ZaitsevClickHouse in Real Life. Case Studies and Best Practices, by Alexander Zaitsev
ClickHouse in Real Life. Case Studies and Best Practices, by Alexander Zaitsev
 

Último

Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
9953056974 Low Rate Call Girls In Saket, Delhi NCR
 

Último (20)

Introduction to Serverless with AWS Lambda
Introduction to Serverless with AWS LambdaIntroduction to Serverless with AWS Lambda
Introduction to Serverless with AWS Lambda
 
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced LoadsFEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
FEA Based Level 3 Assessment of Deformed Tanks with Fluid Induced Loads
 
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
VIP Model Call Girls Kothrud ( Pune ) Call ON 8005736733 Starting From 5K to ...
 
UNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its PerformanceUNIT - IV - Air Compressors and its Performance
UNIT - IV - Air Compressors and its Performance
 
data_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdfdata_management_and _data_science_cheat_sheet.pdf
data_management_and _data_science_cheat_sheet.pdf
 
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
COST-EFFETIVE  and Energy Efficient BUILDINGS ptxCOST-EFFETIVE  and Energy Efficient BUILDINGS ptx
COST-EFFETIVE and Energy Efficient BUILDINGS ptx
 
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
(INDIRA) Call Girl Aurangabad Call Now 8617697112 Aurangabad Escorts 24x7
 
Block diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.pptBlock diagram reduction techniques in control systems.ppt
Block diagram reduction techniques in control systems.ppt
 
2016EF22_0 solar project report rooftop projects
2016EF22_0 solar project report rooftop projects2016EF22_0 solar project report rooftop projects
2016EF22_0 solar project report rooftop projects
 
Design For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the startDesign For Accessibility: Getting it right from the start
Design For Accessibility: Getting it right from the start
 
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort ServiceCall Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
Call Girls in Ramesh Nagar Delhi 💯 Call Us 🔝9953056974 🔝 Escort Service
 
Thermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.pptThermal Engineering -unit - III & IV.ppt
Thermal Engineering -unit - III & IV.ppt
 
Unit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdfUnit 1 - Soil Classification and Compaction.pdf
Unit 1 - Soil Classification and Compaction.pdf
 
Generative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPTGenerative AI or GenAI technology based PPT
Generative AI or GenAI technology based PPT
 
Employee leave management system project.
Employee leave management system project.Employee leave management system project.
Employee leave management system project.
 
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdfONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
ONLINE FOOD ORDER SYSTEM PROJECT REPORT.pdf
 
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...Bhosari ( Call Girls ) Pune  6297143586  Hot Model With Sexy Bhabi Ready For ...
Bhosari ( Call Girls ) Pune 6297143586 Hot Model With Sexy Bhabi Ready For ...
 
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar  ≼🔝 Delhi door step de...
Call Now ≽ 9953056974 ≼🔝 Call Girls In New Ashok Nagar ≼🔝 Delhi door step de...
 
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
(INDIRA) Call Girl Meerut Call Now 8617697112 Meerut Escorts 24x7
 
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
(INDIRA) Call Girl Bhosari Call Now 8617697112 Bhosari Escorts 24x7
 

Доклад Владимира Бичева на третьем митапе сообщества блокчейн-разработчиков Санкт-Петербурга #spblockchain

  • 2. 2 • 8+ years in love with Java • Roles: SE, TL, RM, DM • Blockchain – Researcher – Educate my trade bot – Working on Hyperledger Fabric solution HELLO. MY NAME IS VLADIMIR
  • 3. 3 EPAM BLOCKCHAIN LAB CURRENT STATE • EPAM Blockchain Competency Center created in 2015 • Investigate frameworks and build knowledgebase • Identify and qualify use cases and architecture solutions in a number of industries • Monitor the market and communities: conferences, hackathons, discussion forums • Develop solutions for our clients and for internal research needs SOLUTIONS CREATED • OTC Trade Capture and Matching (Ethereum) • Digital Assets Management Platform (Ethereum + Amazon S3 + sMPC) • Digital Assets Management Platform + Zero Knowledge • Open Betting Platform (Ethereum) • Digital Notary Service (NXT) • Loyalty Network (Ethereum)
  • 4. 4 1. Is Blockchain a new paradigm? 2. Is Blockchain NoSQL? 3. Is Blockchain BigData? 4. How to compare Blockchain solutions? 5. How to apply Blockchain solutions? MY QUESTIONS
  • 6. 6 2 1 3 Not Only SQL MOTIVATION DATA SIZE • Web based applications with lots of data • Vertical scalability constraints • Price of storage CLOUD • SaaS, PaaS, IaaS • Clustered environment • Logical data decomposition CHANGES IN BUSINESS • Fast adaptation for new business needs • Flexible schema for PoC needs • Iron Tringle for Time, Cost, Scope
  • 7. 7 • Not Only SQL • Non-relational • Key-Value: Redis, Riak, Berkley DB, Aerospike, DynamoDB • Document Based: MongoDB, CouchDB, MarkLogic, ArangoDB • Column Based: Cassandra, Hbase, Vertica, Accumulo, Hypertable • Graph: Neo4J, IBM Graph, AllergoGraph • Multi-Model: Couchbase, MarkLogic, ArangoDB • Replication (Master-Slave, Peer-To-Peer, Combination) • Sharding WHAT IS NoSQL? DEFINITION ARCHITECTURE DATA DISTRIBUTION
  • 8. 8 FEATURE / PROPERTY SQL NoSQL Schema Design Yes Schema-less / Dynamic Scalability Vertical scaling Horizontal scaling Query Good to retrieve related data Good to retrieve big data Flexibility By change log OOTB Transactions ACID BASE Objects Tables, Rows, Columns Collections, Documents, Fields Storage Columns with Rows Key/Value, Document, Graph Data Distribution Tune Sharding and Replication OOTB Business Logic Stored Procedures Apps on top (e.g. MapReduce) CAP CA AP/CP SQL vs NoSQL
  • 10. 10 • Volume – GBs, TBs, PBs • Velocity – Fast Data processing with high performance and low latency • Variety – concurrent processing of heterogeneous possibly not structured data sources • Not about size but about how much useful insights can be extracted from data • Data Lake, Lambda, Kappa • MapReduce, Data Warehousing, Stream Processing, In-Memory Computation, Disaster Recovery • NoSQL DBs, Hadoop, Kafka, Storm, Spark, ZooKeeper WHAT IS BigData? MEASUREMENT INSIGHTS ARCHITECTURE TECHOLOGY
  • 11. 11
  • 12. 12 • A robust peer-to-peer network that allows transactions to be created by any party and propagated quickly to all connected nodes • A way to identify conflicts between transactions and resolve them automatically • A synchronization technology that ensures all peers converge on an identical copy of the database • A method for tagging different pieces of information as belonging to different participants, and enforcing this form of data ownership without a central authority • A paradigm for expressing restrictions on which operations are permitted, e.g. to prevent one company from inflating the directory with fictitious entries NoSQL CHALLENGES TRANSACTIONS CONSISTENCY ROBUSTNESS
  • 13. 13 • Who controls the infrastructure when there are multiple actors involved? • If you have multiple copies, how do you know which one is the most up-to-date? • How do you reconcile a different system administrator role at each regional office? • How well can you trust the data? • If you generate the data yourself, how do you prove you were the originator? If you get data from others, how do you know it was truly them? • What about crashes and malicious behavior? • How do you monetize the data? • How do you transfer the rights of the data, or buy rights from others? BigData CHALLENGES CONTROL TRUST MONETIZATION
  • 14. 14 WHAT IS BLOCKCHAIN? Blockchain is a concept of building decentralized applications to allow reliable peer to peer transactions/interactions eliminating the need of a trusted intermediary with the help of the following elements: • Peer-To-Peer communication • Transactions grouping into blocks • Consensus protocol (resolves double spend problem and performs synchronization) • Data Structures/Storage (resolve double spend problem, provides high availability, reliability and immutability) • Smart contracts (executes business logic on event/transaction) • Crypto primitives • Distributed Ledger Technology Blockchain enables: Trusted efficient collaboration between several parties with no need for intermediary
  • 15. 15 NEW PARADIGM? DATA STRUCTURES Hash pointers (1960s) Merkle tree (1979) Distributed hash table DIGITAL SIGNATURE Symmetric and asymmetric cryptography (1970s) CONSENSUS PROTOCOL Proof-of-Work (1990s) Proof-of-Stake Others…. https://www.weusecoins.com/what-is-a-merkle-tree/
  • 16. 17 FEATURE / PROPERTY BLOCKCHAIN DISTRIBUTED DATABASE Operations Append only Insert, Update, Delete Redundancy Yes Yes High-availability Yes Yes Data Sharding Planned Yes Replication Yes, peer-to-peer Yes Consensus Block Row, Replica Set Signatures Always Manual Data Validation Always Manual Business Logic Smart Contracts Triggers, Stored Procedures, etc. Primary usage Ledger Generic BLOCKCHAIN vs DISTRIBUTED DATABASE
  • 17. 18 ARCHITECTURALLY SIGNIFICANT REQUIREMENTS PERFORMANCE (e.g. Bitcoin: 3 tps, Ethereum: 25 tps) LATENCY (e.g. Bitcoin: 10 mins, Ethereum: 12 sec) SCALABILITY (Blockchain size, Smart Contracts executed on every node) SECURITY (Smart contract security, Consensus protocol security) PRIVACY (All participant nodes see all transactions) WASTE OF RESOURCES (e.g. Bitcoin PoW: 6300 nodes, 24 hours, 100% CPU load) MATURITY (e.g. Ethereum: every other month have to change fork, breaking changes)
  • 18. 19 SIZE DOES MATTER HOW BIG IS BITCOIN BLOCKCHAIN?
  • 19. 20 • 1.5 TB – 2021 • 3 TB – 2022 • 6 TB – 2023 • 1.5 PB - 2031 FORECAST • No Sharding • Consistency Time • Storage PROBLEM
  • 20. 21 1 TB – beginning of 2018 FORECAST • Sharding TBD • Parallel Processing • Byzantine SOLUTION
  • 26. 27 PRIVACY. NETWORK TYPES This is a closed system checking all details and controlling access via invitation All open network that anybody can access like the Bitcoin model Permissioned Permissionless
  • 27. 28 PRIVACY. ENCRYPTION RING SIGNATURES HOMOMORPHIC ENCRYPTION (HE) SECURE MULTI-PARTY COMPUTATION (MPC) ZERO KNOWLEDGE PROOFS (ZK)
  • 29. 30 FRAMEWORK NETWORK CONSENSUS PERFORMANCE LATENCY SECURITY PRIVACY AVAILABILITY SCALABILITY MATURITY Bitcoin Public PoW avg 3 tps max 7 tps avg 50 min manual new addresses medium Blocksize change 2009 Ethereum Public PoW, PoS, PoA 25 tps PoW 300 tps PoA 14s PoW 2s PoA manual ZK TBD lot of monitoring Sharding TBD 2015 Graphene Public delegated PoS 1000 tps 2s manual no 2014 Zcash Public ZK + PoW avg 15 tps avg 2.5 min ZK Blocksize change 2016 Monero Public CryptoNight PoW dynamic Ring Sign 2014 Hyperledger Private Kafka, pluggable avg 300 tps on channel 1s Membership Service Provider Channels HA by ZooKeeper Dynamic and Program 2017 R3 Corda Private pluggable, RAFT exp 1200 tps 1s customize customize 2016 BigchainDB Private underlying DB, Raft 1000 blocks * 1000 txn 630ms in one region Roles and Permissions Hidden values n/a Clustered env 2016 PLAYERS AND FRAMEWORKS
  • 30. 31 BigData HELPS BaaS • IBM Bluemix • Microsoft Azure • Rubix NoSQL • CouchDB for Hyperledger • DAG for IOTA, Byteball • BigchainDB Elasticsearch • Full-text search • REST API LOREM IPSUM DOLOR AMET • Nulla nu nisi • Risus purus id fusce • Lobortis ipsum felis sed Apache Kafka • Streaming and Messaging system • Consensus in Fabric • Distributed and Scalable ZooKeeper • Maintain nodes • Provide HA • Quorum MapReduce • Plasma.io • Scalable Computation • Blockchain Indexing
  • 31. 32 1 2 3 4 BIG USE CASES GOVERNMENT • Trust Voting • Public and private assets notary records • Identity Management • Intellectual property management • Digital Assets distribution ENTERTAINMENT • Trust Casino/Lottery • Gaming • Media Distribution Network • Crowdfunding • Prediction Markets ECOMMERCE • Supply Chain • Goods Tracking (guns, devices, chemical) • Loyalty Programs • KYC/AML • Gray Markets IT • Distributed Supercomputer • Decentralized Storage/Hosting • IoT • Cybersecurity • Data Verification
  • 32. 33 5 6 7 8 BIG USE CASES LIFESCIENCE • Donors Chain • Secure Patient Data Platform • Medicaments lifecycle EDUCATION • Education Records • Certifications • Research Works and Papers B2C • Car Sharing • Lending • Wine/Food Tracking • Money Transfers FUTURE • AR/VR Internal Assets Management • Clone Prevention • Distributed Energy • Time Tracking and Employee as a Service (HR, TA, SE etc.) • Insurance (AntiFraud and Fast Payments)
  • 33. 34 1. Is Blockchain a new paradigm? - No 2. Is Blockchain NoSQL? – At most by nature 3. Is Blockchain BigData? – At least depends on cases 4. How to compare Blockchain solutions? – Use ASR 5. How to apply Blockchain solutions? – Wisely with imagination SUMMARY
  • 34. 35 CONCLUSION If you an engineer – blockchain is so much interesting and modern1 If you an investor – trust to engineers2 If you an observer – choose the right side3
  • 40. 41 Appendix: Financial Services Firms Into Blockchain