Mais conteúdo relacionado Semelhante a Idera live 2021: Keynote Presentation The Future of Data is The Data Cloud by Kent Graziano (20) Mais de IDERA Software (20) Idera live 2021: Keynote Presentation The Future of Data is The Data Cloud by Kent Graziano1. © 2021 Snowflake Inc. All Rights Reserved
KENT GRAZIANO , CHIEF TECHNICAL EVANGELIST
@kentgraziano
THE FUTURE OF
DATA IS THE
SNOWFLAKE
DATA CLOUD
2. © 2021 Snowflake Inc. All Rights Reserved
© 2021 Snowflake Inc. All Rights Reserved
5. It’s not the data itself
it’s how you take full advantage of the insight it provides
Web ERP
3rd
party apps Enterprise apps IoT
Mobile
6. © 2021 Snowflake Inc. All Rights Reserved 6
Analytics is growing in
importance, everywhere,
and for everyone
IoT, mobile, and
social open up new
opportunities for insight
Cloud gives us the
ability to scale and
centralize data
Rise of the Cloud Explosion of Data Diversification of Analytics
NEW TECHNOLOGY CHANGES
HOW WE USE DATA
7. © 2021 Snowflake Inc. All Rights Reserved
CAPITALIZING ON THESE TRENDS LEADS
TO BIG BUSINESS IMPACT
7
Effectively manage security,
governance and compliance
Reduce the cost of
scaling data management
and analytics through
operational efficiency
Make better decisions to find
new opportunities for growth
8. © 2021 Snowflake Inc. All Rights Reserved
DATA SILOS PREVENT VALUE REALIZATION
Finance
Web/
Log Data
Product
Usage
Agencies OLTP
Databases
IoT
Enterprise
Applications
Sales Suppliers Third-Party
87%
Decision makers want to
expand their ability
to use external data1
1 “The Insights Professional's Guide To External Data Sourcing” Forrester, 2020
10. © 2021 Snowflake Inc. All Rights Reserved
THE DATA CLOUD IS A GLOBAL NETWORK
10
One global, unified system connecting companies and
data providers to the most relevant data for their business
11. © 2021 Snowflake Inc. All Rights Reserved
ACCESS GOVERNANCE ACTION
UNLOCK
YOUR DATA
PROTECT
YOUR DATA
KNOW
YOUR DATA
3RD PARTY
DATA
ECOSYSTEM
DATA
ANALYSTS
PRODUCT
DEV TEAMS
BIZ DEV
TEAMS
DATA
SCIENTISTS
BENEFITS OF THE DATA CLOUD
ORGANIZATION
DATA
12. © 2021 Snowflake Inc. All Rights Reserved
PLATFORM
ELEMENTS
OF THE
DATA
CLOUD
+
CONTENT
Applications Customer
Data
3rd Party
Data
Data
Services
SaaS
Data
Partner
Data
14. © 2021 Snowflake Inc. All Rights Reserved
ELASTIC PERFORMANCE ENGINE
Data science
ETL
BI/Visualization
Dev/QA
One engine for every workload
Simplify your architecture. Power complex
pipelines, analytics, data science,
interactive applications, and more.
Leading performance and concurrency
Fast, reliable performance every time with
no tuning or contention. Instantly and cost-
efficiently scale to any amount of users,
jobs, or data.
Support any user or skillset
Get the accessibility of SQL, with the
flexibility to support Java, Scala, and more.
Run external tools directly for extended
capabilities.
15. © 2021 Snowflake Inc. All Rights Reserved.
“2000 Simultaneous Queries
against a 40 Billion record table
all return in under 10 seconds.”
Larry Querbach,
Enterprise Data Architect
16. © 2021 Snowflake Inc. All Rights Reserved
MAINTENANCE
& TUNING
Automated and fully managed for you
Focus on what matters. Fully managed with
automations that encrypt data, control
access, and eliminate manual maintenance
and troubleshooting.
High availability, high reliability
Automate complex replication and failover
cross-clouds and cross-regions. Stay up-
and-running no matter what happens.
Optimized costs for all data
Usage-based model paired with patented
compression and fine-grained controls to
right-size costs. Continual improvements for
new efficiencies.
INTELLIGENT INFRASTRUCTURE
Snowflake Managed
MULTI-CLUSTER
COMPUTE RESOURCES
ADMINISTRATION
NETWORKING &
ENCRYPTION
DATA
MANAGEMENT
CENTRALIZED
STORAGE
17. © 2021 Snowflake Inc. All Rights Reserved
SNOWGRID
Maintain global business continuity
Eliminate disruptions, deliver better experiences, and
comply with changing regulations through unique cross-
cloud, cross-region connectivity.
Share data with no ETL or silos
Remove the barriers to data, regardless of cloud, region,
workload, or organizational domains. Get instant access
and distribution through a single copy of data.
Cross-cloud governance controls
Simplify governance at scale with flexible policies that
follow the data for consistent enforcement across users
and workloads.
Tap into the extended ecosystem
Enrich insights with a network of third-party data.
Discover and run new functions for extended workflows.
AWS GCP
Azure
Snowflake Regions
19. © 2021 Snowflake Inc. All Rights Reserved
SNOWFLAKE’S PLATFORM
DATA
SOURCES
OLTP DATABASES
ENTERPRISE
APPLICATIONS
THIRD-PARTY
WEB/LOG DATA
IoT
DATA
CONSUMERS
DATA MONETIZATION
OPERATIONAL
REPORTING
AD HOC ANALYSIS
REAL-TIME ANALYTICS
20. © 2021 Snowflake Inc. All Rights Reserved
20
Traditional Methods
Copy and move data
Data is delayed
Costly to manage and maintain
Unsecure, once data is moved
Error prone; pipelines break
SNOWGRID UNLOCKS DATA SHARING
Snowflake
FTP | APIs | ETL | Cloud
buckets
Secure Data Sharing
Single copy of live data, no delays
No costs of moving, copying, ingestion
No more data lake silos
Privacy compliant
Governed, revocable access
21. © 2021 Snowflake Inc. All Rights Reserved
SHARE AND COLLABORATE IN THE DATA CLOUD
DISCOVER AND BE
DISCOVERED
IN THE DATA CLOUD
SHARE ACROSS YOUR
BUSINESS ECOSYSTEM
Access data and services
from 150+ providers
SNOWFLAKE DATA
MARKETPLACE
Market and deliver your
products to customers
DIRECT SHARE
Share with other
Snowflake customers
YOUR
EXCHANGE
DATA EXCHANGE
Administer group sharing
and data discovery across
business units
READER ACCOUNTS
Share with companies not
yet on Snowflake
YOUR
ACCOUNT
22. © 2021 Snowflake Inc. All Rights Reserved
CONNECT TO THE MOST RELEVANT CONTENT
Discover and be discovered with
data and services from 175+
providers across 18+ categories.
Thousands of companies share
data with suppliers, partners, or
other business units.
Hundreds of applications that
businesses rely on run in the Data
Cloud.
SNOWFLAKE DATA MARKETPLACE
SNOWFLAKE CUSTOMERS
POWERED BY SNOWFLAKE APPLICATIONS
Partner
Data
Applications
Data
Services
Customer
Data
3rd Party
Data
SaaS
Data
23. © 2021 Snowflake Inc. All Rights Reserved
THE DATA CLOUD TODAY
A software company shares
terabytes of data with hundreds
of customers
COVID-19 data is available live on
Snowflake Data Marketplace from a
US State, and other organizations
Today’s financial data is
accessible immediately without
data pipelines
Thousands of companies share
data with suppliers, partners, or
other business units
* Visualization based on actual Data Cloud sharing activity as of July 31 2021
THOUSANDS OF
ORGANIZATIONS
ARE SHARING
DATA WITH
THEIR
ECOSYSTEM
25. © 2021 Snowflake Inc. All Rights Reserved
UNIFY GOVERNANCE
ACROSS ALL WORKLOADS
25
Includes consistency across:
Replication | Data pipelines | Tables | Streams & tasks
Governance with Snowflake
Know and control all your data across accounts, regions, and clouds.
26. © 2021 Snowflake Inc. All Rights Reserved
Know Your Data Protect Your Data
Row Access
Policies
Dynamic Data
Masking
External
Tokenization
Anonymization
Unlock Your Data
Access History
Classification
Object Tagging
What
Where
Who
SNOWFLAKE GOVERNANCE CAPABILITIES
Secure Data Sharing
Data Exchange
Data Marketplace
Conditional Masking
27. © 2021 Snowflake Inc. All Rights Reserved
KNOW YOUR DATA
Automatic Data Classification
27
Classify columns containing personal data
• Automatically detect columns with personal data
Apply System Tags to detected personal data
• Apply Snowflake-defined semantic and privacy
category tags
Assign policies to columns based on system tags
• Assign data access policies to columns based
on System Tags
Satisfy Compliance
• Use System Tags to audit personal data among
millions of columns
Natively integrated
• Seamlessly integrates across Snowflake’s
governance capabilities and Data Sharing
Data owner runs
Classification on
specific table(s)
Alex
(Data Owner)
name gender age zip_code phone
John Smith male 39 79007 123-555-1234
Jane Doe female 50 77001 333-555-1236
Mary Taylor female 46 77020 222-333-1111
Ann Marshall female 48 77042 555-555-1234
Michael Gaines male 75 79003 666-666-1357
Admin finds
columns with
personal data
based on
classification
Morgan
(Admin)
PUBLIC GA
PRIVATE
IN DEV
28. © 2021 Snowflake Inc. All Rights Reserved
Data owner
assigns with
tag value
OBJECT TAGGING
ID SSN Phone
101 ********* 248-222-3333
102 ********* 800-778-9904
103 ********* 415-887-8888
Admin creates
custom tags
Alex
(Data Owner)
Admin audits
tagged objects
Morgan
(Admin)
Morgan
(Admin)
Confidentiality
Track Sensitive Data and Compute Objects
PII_Type Department
Confidentiality
Sensitive
PII_Type
Phone
Department
Sales
GA
Track sensitive and PII data
• Create custom tags based on existing tag taxonomy
• Assign tags to any object (columns, tables, views,
external tables, materialized views)
• Easily track across 100s of thousands of objects for
reporting and access control
Track resource usage for cost visibility and attribution
• Assign tags to resources like compute clusters,
Snowpipe
• Easily aggregate resource usage by custom business
attributes like cost center, department, project, customer
Flexible privilege management options
• Centralized: Account-wide tag assignment privilege for
assignment without object ownership
• Decentralized: Role-specific tag assignment privilege for
assignment by object owner
28
28
IN DEV PUBLIC
PRIVATE
29. © 2021 Snowflake Inc. All Rights Reserved
Select *
from Info;
ID Phone Unique_ID
101 248-222-3333 333-78-9999
102 800-778-9904 779-66-8908
103 415-887-8888 111-00-8888
View: INFO (Directly Accessed)
Table: SENSITIVE
ID SSN
101 333-78-9999
102 779-66-8908
103 111-00-8888
Table: CONTACT
ID Mobile
101 248-222-3333
102 800-778-9904
103 415-887-8888
Log
Access History
User Tables Columns
Taylor
Info,
Sensitive,
Contact
ID,
Phone,
Unique_ID,
SSN,
Mobile
Morgan Sensitive ID, SSN
Select *
from
Sensitive;
PUBLIC GA
PRIVATE
Taylor
(Privileged
User)
Morgan
(Admin)
ACCESS HISTORY
Satisfy Regulatory Compliance, Understand Usage with Column-level Access Visibility
Satisfy regulatory compliance
requirements
• Audit log of tables, views, and columns
accessed by each query
• Includes base tables (i.e. tables serving
a view) indirectly accessed
• Easily query historic logs for reporting
and auditing purposes
Optimize storage cost and performance
• Discover unused tables and columns
for deletion or archival
• Identify your most frequently queried
tables and columns for performance
optimizations
29
29
IN DEV
31. © 2021 Snowflake Inc. All Rights Reserved
COVID-19 and the
first war of data
science”
Starschema brings single
source of truth for COVID-
19 incidence data to
Snowflake data
exchange”
How policymakers
should use the wealth
of COVID-19 data”
32. © 2021 Snowflake Inc. All Rights Reserved
USING DATA TO NAVIGATE A CHANGING WORLD
Local
Government &
Municipalities
Financial
Firms
Solution
Providers
COVID
Alliance
Technology
Companies
Federal
& State
Agencies
Healthcare
Systems & First
Responders
Research
Institutions
Retailers
Research
Institutions
33. © 2021 Snowflake Inc. All Rights Reserved
BUILDING STRONGER SUPPLY AND VALUE CHAINS
Pharmacies
and Hospitals
Suppliers
Pharmaceutical
Manufacturers
Wholesalers
34. © 2021 Snowflake Inc. All Rights Reserved
IoT data
5G data
Alternative Data Provider
Telematics Company
Alternative Data Provider
Telecommunications Company
BUILDING STRONGER SUPPLY AND VALUE CHAINS
Inventory
data
Pharmaceutical
Partners
35. © 2021 Snowflake Inc. All Rights Reserved
Customer
profile data
Market
data
Retail data
Fund
data
Retail data
Reference data
Consumer
marketing data
Market data
Strategic
Partners
Stock Exchanges
Data Curators
& Enrichers
CREATING AN INFORMATIONAL EDGE
Alternative Data Provider
Consumer Insights Vendor
Financial Data Providers
FactSet