Data Driven Advanced Analytics using Denodo Platform on AWS

Denodo
Denodo Denodo
Data Driven Advanced Analytics using Denodo Platform on AWS
Agenda
1. Introduction to Data Driven Everything on AWS
2. Challenges with Data Driven Cloud Modernization
3. Addressing Challenges with Denodo Platform for AWS
4. Denodo Platform Use Cases and Data Architectures.
5. Key Takeaways | Q&A
3
Modernizing leads to maximum innovation velocity and optimal
total cost of ownership
On-premises Lift
and shift
Move to managed
databases
Modernize with
purpose-built
databases
Innovation
velocity
Total
cost of
ownership
(TCO)
Break-free from
legacy databases
4
5
6
What are customers building?
Backup &
restore
Non-disruptive
Easy place to start
Integrated with all
major vendors
Archive &
compliance
Media workflows
Tape replacement
Public Sector,
FinServ,
Healthcare/Life
Sciences
Home
directories
Simple to move
Not sensitive to
latency
Significant cost
savings
Data lakes
Variety of analytics
tools
Built for
streaming data
Data visualization
Business-
critical
applications
Integrated with
major vendors
Fully managed
infrastructure
Lift-and-shift
migrations
7
AWS Customer- Analytics Challenges in a Distributed Data Landscape
Point-to-point data integration approaches are
challenging:
§ Extracting and moving data increases latency
and cost, and decreases quality, thus lacking
unified data access
§ Every project solves data access and
integration in a different way, increasing IT
dependency
§ Solutions are tightly coupled to data sources,
impacting flexibility, agility and overall
governance
DATA
SOURCE
DATA
CONSUMER
Data
Governance
Tools
DB, DW &
Data Lakes
Files
BI Dashboard
Report and Tools
Data Science &
Machine Learning
Apps
Mobile &
Enterprise Apps
Microservices
Apps
Cloud DB
& SaaS
Streaming
Data & IoT
Cube
8
• The business wants more useful data
• Timely, curated, usable
• IT can’t keep up
• 67% of companies use less than half
of their data*
• IT stuck in old school thinking about data
management
• ‘Business as usual’
The ‘Useful Data’ Gap
* Source: Denodo Global Cloud Survey 2022
9
AWS Analytics Data Strategy, Keynote
Remember, re:Invent 2022
10
10
Businesses need a new approach to
connect data silos in real-time to
support various applications, insights,
and analytics.
11
Modern Data Architectural Patterns & Data Driven Analytics
Data Mesh
Data Lakehouse
Data Lake
Data Fabric
Cloud Data Warehouse
12
Real World Data Lake Example – AWS
Trusted Data Zone
Raw Data Zone Refined Data Zone
Transformation Transformation Data Consumers
Networking, Infrastructure & Security
Data Ingestion
Data
Sources
Data Catalog and Search – Asset Registry Workflow Orchestration, DevOps and CI/CD
13
Denodo + AWS – Simple and Complementary Recipe!
• Embrace distributed data landscape
• Embrace the fact that data resides in multiple
locations or systems – on-prem, hybrid, multi-
cloud. All data needs to be managed with
consistency
• Use a Logical approach to manage it
• Consumers access data through a centralized
semantic model, decoupled from data location
and physical schemas, that can enforce security
and governance requirements
14
Denodo Platform: ONE Logical Platform for All Your Data
Ease of Use Fast Query
Response
Integrated,
Active Data Catalog
Universal
Connectivity
Modern Data
Services API Layer
Dynamic Data
Masking
Automated Cloud
Management
Key Differentiators
83% reduction
in time-to-revenue
67% reduction
in data preparation effort
65% decrease
in delivery times over ETL
Source: Forrester Total Economic ImpactTM of Data
Virtualization, 2021
Hybrid/
Multi-Cloud
Security &
Governance
Al/ML
Recommendations
Advanced
Semantics
Data Catalog
Discover / Explore /
Document
BI Tools
SQL / MDX
Data Science
Tools
Data as a Service
RESTful / Odata
GraphQL/ GeoJSON
Files
Cubes
Cloud
Stores
Traditional
DB & DW
INTEGRATE
MANAGE
DELIVER
Disparate data in
any location, format
or latency
Related data with a universal
semantic model and AI / ML
functionality enabling vital
data governance
And democratize data using
BI & data science tools,
data catalogs, and APIs
Data Lake &
NoSQL
Query
Optimization &
Acceleration
On-
Premise
Transition
to Cloud
Hybrid
Multi-
Cloud
Stages of the Cloud Journey
•
•
•
•
•
•
•
Transition (or Migration) to the Cloud Challenges
17
Reduce the Business Impact
1 - Transition to the AWS Cloud (Minimize Business Disruption)
Business Need
§ Transition to cloud – migrate
EDW
§ Real-time analytics from Business
Users and Data Scientists
§ Security and governance across
multiple analytical tools need to be
centralized
§ Acts as a single semantic layer
§ Homogeneous data access regardless of
back-end technology
§ No need to deal with new languages and
APIs: access to SFDC, Excel, Amazon
Redshift, Oracle, Hadoop, other SaaS
APIs, etc.
§ Consistent business data model across all
consumers and reporting tools
§ Reusability of analytical objects across
multiple tools and consuming applications
§ Abstracts access to disparate data sources
§ Change in the data sources buffered
minimizing the impact on consumer
business applications
§ New technology adoption with minimal
impact on the business
§ Minimizes impact on consumers
§ Minimizes cross-environment connectivity
§ reducing risks of unauthorized access to
data
§ Amazon Athena
§ Amazon S3 Buckets
§ Amazon Redshift
§ Amazon Aurora
§ AWS PaaS - RDBMs
Denodo AWS
18
Transition to Cloud | Cloud Migration Acceleration
Denodo becomes the common access layer for all on-
premise and cloud systems:
Access to all data from a single system
The data can be accessed directly from the
original system, without the need for replication
The data can still be easily replicated and hidden
if necessary
Simplify data aggregation, regardless of the location or
format of the data
Allows semantic models definition, independent of
the original formats and structures
Advanced security for all data
Documentation and usage statistics included in the
Data Catalog
•
•
•
•
Hybrid (Cloud and On-Premise) Data Integration – Customer 360 / Single View
20
AWS Cloud Modernization - LeasePlan Data Hub Architecture
`
DATA
ACQUISITION
DATA
SOURCES
DATA
STORE (RAW)
ANALYTICS
WAREHOUSE
DATA
SCIENCE
DATA
FABRIC
DATA
CONSUMER
Next Gen Data Management (Meta-data, data quality, governance)
Meta data management, data quality, data governance as central components guarding the overall
data-asset of the corporation to allow trusted access to data for utilisation across the enterprise
Structured
Unstructured
ETL/ELT
ORCHESTRATION
STREAMING
Native Extraction
No ETL Tool(s)
AWS
Kinesis
Airflow
SAP BW/4HANA +
HANA Native
Raw
Quality
Integration
Consumption
Glacier
Archive
BW/4HANA +
HANA Native
NG Finance 1
NG Insurance
NG Procurement
NG Marketing
NG Sales
NG Service
NG Commerce
NG Fleet Ops
NG Supplier
Engagement
NG Policy Mgt.
NG Portals
NG Contact Center
Legacy – NOLS/
DB2/AS400 etc.
Other External Data:
Telematics, IoT, GA,
Social feeds,
streams
Analytics for
Cloud
Analysis for Office
AWS
SageMaker
Power BI
Role Based Access
Control
Caching
21
Take the right decision on accurate data
2 - Real-Time Analytics for Business Users
Business Need
§ Transition to cloud – migrate EDW
§ Real-time analysis from
Business Users and Data
Scientists
§ Security and governance across
multiple analytical tools need to be
centralized
§ Enables Self-Service BI
§ IT delivers a governed layer of “business
views” to business users
§ Business users can generate any report
over those IT-governed business views
§ Business views can be adapted for every
type of user making use of the same
terminology and naming conventions for
every Line of Business
§ Incorporate geospatial, IoT, and
other streaming data, to enable
real-time data services
§ Accelerate cloud analytics with Amazon’s
elastic infrastructure (EC2, auto-scaling)
§ Data is immediately available for use
without delays
§ Integrate and Manage data across
Amazon Redshift, Amazon RDS,
Amazon S3 in real-time to drive
advanced analytics
§ Source data to Amazon Lambda
serverless processes and expose them
as data source for BI-Analytics
§ Visualize data and reports in real time
with QuickSights
Denodo AWS
22
How Does Denodo Platform Work?
Development
Lifecycle Mgmt
Monitoring & Audit
Governance
Security
Development Tools
and SDK
Scheduled Tasks
Data Caching
Query Optimizer
JDBC/ODBC/ADO.Net SOAP / REST WS
U
Customer 360
View
Virtual Data
Mart View
J
Application
Layer
Business
Layer
Unified View Unified View
Unified View
Unified View
A
J
J
Derived View Derived View
J
J
S
Transformation
& Cleansing
Data
Source
Layer
Base
View
Base
View
Base
View
Base
View
Base
View
Base
View
Base
View
Abstraction
23
FAA – Federal Aviation Administration – Streamline Operations/Analytics
ü Reduced the IT Operations Cost by 99.8%,
while accelerating data access by 96%.
ü To reduce costs and streamline IT operations,
the U.S. Federal Aviation Administration (FAA)
wanted to consolidate multiple IT
organizations – each supporting different
mission areas – into a single office reporting
to a single CIO.
FAA leveraged the Denodo platform on AWS to:
24
Across multiple analytical tools
3 - Centralized Security and Governance
Business Need
§ Transition to cloud – migrate EDW
§ Real-time analytics from Business
Users and Data Scientists
§ Security and governance across
multiple analytical tools need to
be centralized
§ Unified Security Layer
§ Global Tag-based Policy Engine
§ Role-based authorization to all tables in
the virtual layer (RBAC)
§ Attribute-based access control (ABAC)
§ Security is moved outside the reporting
layer to avoid security bypasses
§ Centralized access point simplifies
operations and auditing
§ Data Masking / Obfuscation
§ Centralized Governance Layer
§ Centralized metadata catalog accessible
for both technical and business users
§ Data Source refresh, change impact
analysis, full data lineage, etc.
§ Protects data sources from uncontrolled
access through query throttling, limiting
#concurrent queries over them, limiting
resulting datasets sizes, enabling the cache
for minimizing the access to data sources for
some views, etc.
Denodo AWS Services
§ Datawarehouse Built for the cloud
§ Athena
§ Redshift
§ Secured, Managed Access
§ With Amazon Resource Manager
§ Identity Management & SSO Amazon
IAM
25
Data Fabric Overview
Core Principles:
ü Data Integration
ü Data Governance
ü Data Democratization
ü Data Intelligence
ü Data Interoperability
26
Data Mesh Powered by Denodo Data Virtualization
SQL
Operational EDW
Data Lakes Files
SaaS APIs
REST GraphQL OData
Event
Product
Customer Location Employee
Common Domain Event Management Human Resources
MDX
2.Domains connect
their data sources
❷
1.Each domain is given a
separate virtual schema.
A common domain may be
useful to centralized data
products common across
domains
❶
3.Metadata is mapped
to relational views.
No data is replicated
❸
4.Domains SMEs can
model their Data
Products.
Products can be used to
define other products
❹
5.For execution, Products can
be served directly from
their sources, or replicated
to a central location, like a
lake
❺
6.A central team can
set guidelines and
governance to
ensure
interoperability
❻
7.Products can be access via
SQL, MDX or exposed as an
API. No coding is required
❼ 8.Infrastructure can
easily scale out in a
cluster
❽
New architectural paradigm for data management | distributed organizational paradigm | Domains in charge of Data Products
27
Data Fabric & Data Mesh Powered by Data Virtualization
Summary and Takeaways
Benefits of Logical Data Architectures
Benefits of a Logical Data Architecture
“Now, we can do weekly releases.
We’re able to add new data sources
within 2 to 3 hours. We’re about 60%
faster than we were in the old world.”
VP of data and analytics, real estate
“To me, it all boils down to speed to
insights. Not having to wait to get the
question that you have top-of-mind
answered with data is huge.”
VP of data and analytics, real estate
29
30
Try Denodo Platform on AWS – Get Started Today!
• 30 days Free Trial of Denodo Professional via AWS Marketplace
• AWS Marketplace Transactable Pay-Go/Private Offers
• Denodo – AWS Test Drives (free hands-on learning in 2 hours) :
Denodo-AWS BI
Denodo-AWS Data Science
Visit Denodo Platform and AWS
https://www.denodo.com/en/denodo-platform/denodo-platform-for-aws
Q&A
Thanks!
www.denodo.com info@denodo.com
© Copyright Denodo Technologies. All rights reserved
Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm,
without prior the written authorization from Denodo Technologies.
1 de 32

Recomendados

Modern Data Management for Federal Modernization por
Modern Data Management for Federal ModernizationModern Data Management for Federal Modernization
Modern Data Management for Federal ModernizationDenodo
218 visualizações24 slides
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC) por
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)
Simplifying Your Cloud Architecture with a Logical Data Fabric (APAC)Denodo
103 visualizações33 slides
Enabling Next Gen Analytics with Azure Data Lake and StreamSets por
Enabling Next Gen Analytics with Azure Data Lake and StreamSetsEnabling Next Gen Analytics with Azure Data Lake and StreamSets
Enabling Next Gen Analytics with Azure Data Lake and StreamSetsStreamsets Inc.
1.1K visualizações23 slides
Cloud Migration headache? Ease the pain with Data Virtualization! (EMEA) por
Cloud Migration headache? Ease the pain with Data Virtualization! (EMEA)Cloud Migration headache? Ease the pain with Data Virtualization! (EMEA)
Cloud Migration headache? Ease the pain with Data Virtualization! (EMEA)Denodo
121 visualizações26 slides
Data Virtualization: Introduction and Business Value (UK) por
Data Virtualization: Introduction and Business Value (UK)Data Virtualization: Introduction and Business Value (UK)
Data Virtualization: Introduction and Business Value (UK)Denodo
159 visualizações23 slides
Data Services and the Modern Data Ecosystem (ASEAN) por
Data Services and the Modern Data Ecosystem (ASEAN)Data Services and the Modern Data Ecosystem (ASEAN)
Data Services and the Modern Data Ecosystem (ASEAN)Denodo
312 visualizações39 slides

Mais conteúdo relacionado

Similar a Data Driven Advanced Analytics using Denodo Platform on AWS

Fast Data Strategy Houston Roadshow Presentation por
Fast Data Strategy Houston Roadshow PresentationFast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow PresentationDenodo
482 visualizações61 slides
Multi-Cloud Integration with Data Virtualization (ASEAN) por
Multi-Cloud Integration with Data Virtualization (ASEAN)Multi-Cloud Integration with Data Virtualization (ASEAN)
Multi-Cloud Integration with Data Virtualization (ASEAN)Denodo
73 visualizações33 slides
Virtualisation de données : Enjeux, Usages & Bénéfices por
Virtualisation de données : Enjeux, Usages & BénéficesVirtualisation de données : Enjeux, Usages & Bénéfices
Virtualisation de données : Enjeux, Usages & BénéficesDenodo
119 visualizações31 slides
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization por
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization Denodo
140 visualizações38 slides
Slides-Discover-Power-of-Live-Data(2).pdf por
Slides-Discover-Power-of-Live-Data(2).pdfSlides-Discover-Power-of-Live-Data(2).pdf
Slides-Discover-Power-of-Live-Data(2).pdfbutthead7
2 visualizações15 slides
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014 por
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014Amazon Web Services
1.3K visualizações17 slides

Similar a Data Driven Advanced Analytics using Denodo Platform on AWS(20)

Fast Data Strategy Houston Roadshow Presentation por Denodo
Fast Data Strategy Houston Roadshow PresentationFast Data Strategy Houston Roadshow Presentation
Fast Data Strategy Houston Roadshow Presentation
Denodo 482 visualizações
Multi-Cloud Integration with Data Virtualization (ASEAN) por Denodo
Multi-Cloud Integration with Data Virtualization (ASEAN)Multi-Cloud Integration with Data Virtualization (ASEAN)
Multi-Cloud Integration with Data Virtualization (ASEAN)
Denodo 73 visualizações
Virtualisation de données : Enjeux, Usages & Bénéfices por Denodo
Virtualisation de données : Enjeux, Usages & BénéficesVirtualisation de données : Enjeux, Usages & Bénéfices
Virtualisation de données : Enjeux, Usages & Bénéfices
Denodo 119 visualizações
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization por Denodo
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization
DAMA & Denodo Webinar: Modernizing Data Architecture Using Data Virtualization
Denodo 140 visualizações
Slides-Discover-Power-of-Live-Data(2).pdf por butthead7
Slides-Discover-Power-of-Live-Data(2).pdfSlides-Discover-Power-of-Live-Data(2).pdf
Slides-Discover-Power-of-Live-Data(2).pdf
butthead72 visualizações
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014 por Amazon Web Services
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014
(ENT211) Migrating the US Government to the Cloud | AWS re:Invent 2014
Amazon Web Services1.3K visualizações
Big Data: It’s all about the Use Cases por James Serra
Big Data: It’s all about the Use CasesBig Data: It’s all about the Use Cases
Big Data: It’s all about the Use Cases
James Serra9.1K visualizações
A Successful Journey to the Cloud with Data Virtualization por Denodo
A Successful Journey to the Cloud with Data VirtualizationA Successful Journey to the Cloud with Data Virtualization
A Successful Journey to the Cloud with Data Virtualization
Denodo 116 visualizações
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris... por DATAVERSITY
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...
ADV Slides: The Evolution of the Data Platform and What It Means to Enterpris...
DATAVERSITY829 visualizações
Azure Overview Csco por rajramab
Azure Overview CscoAzure Overview Csco
Azure Overview Csco
rajramab670 visualizações
Build Big Data Enterprise Solutions Faster on Azure HDInsight por DataWorks Summit/Hadoop Summit
Build Big Data Enterprise Solutions Faster on Azure HDInsightBuild Big Data Enterprise Solutions Faster on Azure HDInsight
Build Big Data Enterprise Solutions Faster on Azure HDInsight
DataWorks Summit/Hadoop Summit1.9K visualizações
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi... por Denodo
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Reinventing and Simplifying Data Management for a Successful Hybrid and Multi...
Denodo 231 visualizações
Govern and Protect Your End User Information por Denodo
Govern and Protect Your End User InformationGovern and Protect Your End User Information
Govern and Protect Your End User Information
Denodo 212 visualizações
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise... por Dataconomy Media
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...
Dr. Christian Kurze from Denodo, "Data Virtualization: Fulfilling the Promise...
Dataconomy Media1.1K visualizações
Opportunity: Data, Analytic & Azure por Abhimanyu Singhal
Opportunity: Data, Analytic & Azure Opportunity: Data, Analytic & Azure
Opportunity: Data, Analytic & Azure
Abhimanyu Singhal1.5K visualizações
Introduction to Modern Data Virtualization (US) por Denodo
Introduction to Modern Data Virtualization (US)Introduction to Modern Data Virtualization (US)
Introduction to Modern Data Virtualization (US)
Denodo 140 visualizações
ACdP Fiware.pdf por MASSAL3
ACdP Fiware.pdfACdP Fiware.pdf
ACdP Fiware.pdf
MASSAL318 visualizações
Delivering Data Democratization in the Cloud with Snowflake por Kent Graziano
Delivering Data Democratization in the Cloud with SnowflakeDelivering Data Democratization in the Cloud with Snowflake
Delivering Data Democratization in the Cloud with Snowflake
Kent Graziano805 visualizações
Windowsazureplatform Overviewlatest por rajramab
Windowsazureplatform OverviewlatestWindowsazureplatform Overviewlatest
Windowsazureplatform Overviewlatest
rajramab654 visualizações

Mais de Denodo

Mastering Cloud Data Cost Control: A FinOps Approach por
Mastering Cloud Data Cost Control: A FinOps ApproachMastering Cloud Data Cost Control: A FinOps Approach
Mastering Cloud Data Cost Control: A FinOps ApproachDenodo
4 visualizações24 slides
Data Services and Data Mesh projects made easy using Top-Down Modeling por
Data Services and Data Mesh projects made easy using Top-Down ModelingData Services and Data Mesh projects made easy using Top-Down Modeling
Data Services and Data Mesh projects made easy using Top-Down ModelingDenodo
3 visualizações1 slide
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ... por
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...Denodo
3 visualizações38 slides
Top Five Strategies for Modernizing Your Data Architecture (ASEAN) por
Top Five Strategies for Modernizing Your Data Architecture (ASEAN)Top Five Strategies for Modernizing Your Data Architecture (ASEAN)
Top Five Strategies for Modernizing Your Data Architecture (ASEAN)Denodo
8 visualizações29 slides
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern... por
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...Denodo
2 visualizações22 slides
MasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization por
MasterClass Series: Unlocking Data Sharing Velocity with Data VirtualizationMasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization
MasterClass Series: Unlocking Data Sharing Velocity with Data VirtualizationDenodo
3 visualizações21 slides

Mais de Denodo (20)

Mastering Cloud Data Cost Control: A FinOps Approach por Denodo
Mastering Cloud Data Cost Control: A FinOps ApproachMastering Cloud Data Cost Control: A FinOps Approach
Mastering Cloud Data Cost Control: A FinOps Approach
Denodo 4 visualizações
Data Services and Data Mesh projects made easy using Top-Down Modeling por Denodo
Data Services and Data Mesh projects made easy using Top-Down ModelingData Services and Data Mesh projects made easy using Top-Down Modeling
Data Services and Data Mesh projects made easy using Top-Down Modeling
Denodo 3 visualizações
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ... por Denodo
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...
Lunch and Learn ANZ: Data Accessibility: The key to Industrialising Decision ...
Denodo 3 visualizações
Top Five Strategies for Modernizing Your Data Architecture (ASEAN) por Denodo
Top Five Strategies for Modernizing Your Data Architecture (ASEAN)Top Five Strategies for Modernizing Your Data Architecture (ASEAN)
Top Five Strategies for Modernizing Your Data Architecture (ASEAN)
Denodo 8 visualizações
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern... por Denodo
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...
Mitigating Risk and Ensuring Compliance in Finance Using a Robust Data Govern...
Denodo 2 visualizações
MasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization por Denodo
MasterClass Series: Unlocking Data Sharing Velocity with Data VirtualizationMasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization
MasterClass Series: Unlocking Data Sharing Velocity with Data Virtualization
Denodo 3 visualizações
Data Fabric e Chat GPT - Unindo forças para a verdadeira democratização no ac... por Denodo
Data Fabric e Chat GPT - Unindo forças para a verdadeira democratização no ac...Data Fabric e Chat GPT - Unindo forças para a verdadeira democratização no ac...
Data Fabric e Chat GPT - Unindo forças para a verdadeira democratização no ac...
Denodo 7 visualizações
La gestione logica dei dati come chiave del successo per Data Scientist e Bus... por Denodo
La gestione logica dei dati come chiave del successo per Data Scientist e Bus...La gestione logica dei dati come chiave del successo per Data Scientist e Bus...
La gestione logica dei dati come chiave del successo per Data Scientist e Bus...
Denodo 5 visualizações
Partner Engagement Webinar Series: Highlights from DataFest North America por Denodo
Partner Engagement Webinar Series: Highlights from DataFest North AmericaPartner Engagement Webinar Series: Highlights from DataFest North America
Partner Engagement Webinar Series: Highlights from DataFest North America
Denodo 3 visualizações
Построение Data Mesh на основе Виртуальных Данных por Denodo
Построение Data Mesh на основе Виртуальных ДанныхПостроение Data Mesh на основе Виртуальных Данных
Построение Data Mesh на основе Виртуальных Данных
Denodo 10 visualizações
Achieving Self-service Analytics with a Governed Data Services Layer por Denodo
Achieving Self-service Analytics with a Governed Data Services LayerAchieving Self-service Analytics with a Governed Data Services Layer
Achieving Self-service Analytics with a Governed Data Services Layer
Denodo 11 visualizações
Top Five Strategies for Modernizing Your Data Architecture por Denodo
Top Five Strategies for Modernizing Your Data ArchitectureTop Five Strategies for Modernizing Your Data Architecture
Top Five Strategies for Modernizing Your Data Architecture
Denodo 7 visualizações
Tackling Data Risks Head-On: The Potential of Data Virtualization por Denodo
Tackling Data Risks Head-On: The Potential of Data VirtualizationTackling Data Risks Head-On: The Potential of Data Virtualization
Tackling Data Risks Head-On: The Potential of Data Virtualization
Denodo 8 visualizações
Green Data : à l'ère de l'emballement digital, comment engager la transition ... por Denodo
Green Data : à l'ère de l'emballement digital, comment engager la transition ...Green Data : à l'ère de l'emballement digital, comment engager la transition ...
Green Data : à l'ère de l'emballement digital, comment engager la transition ...
Denodo 11 visualizações
Denodo & FIN Cockpit (application de la virtualisation des données à la Finan... por Denodo
Denodo & FIN Cockpit (application de la virtualisation des données à la Finan...Denodo & FIN Cockpit (application de la virtualisation des données à la Finan...
Denodo & FIN Cockpit (application de la virtualisation des données à la Finan...
Denodo 20 visualizações
How to build Virtual Data Products in Denodo por Denodo
How to build Virtual Data Products in DenodoHow to build Virtual Data Products in Denodo
How to build Virtual Data Products in Denodo
Denodo 21 visualizações
Démonstration Denodo 8 por Denodo
Démonstration Denodo 8Démonstration Denodo 8
Démonstration Denodo 8
Denodo 7 visualizações
Modernizando o papel do Data Lake em uma arquitetura de Data Fabric por Denodo
Modernizando o papel do Data Lake em uma arquitetura de Data FabricModernizando o papel do Data Lake em uma arquitetura de Data Fabric
Modernizando o papel do Data Lake em uma arquitetura de Data Fabric
Denodo 28 visualizações
Importance of a Logical First Architecture in a Cloud First Data Landscape por Denodo
Importance of a Logical First Architecture in a Cloud First Data LandscapeImportance of a Logical First Architecture in a Cloud First Data Landscape
Importance of a Logical First Architecture in a Cloud First Data Landscape
Denodo 9 visualizações
Distributed Data Across Cloud and On-Premises: Opportunities and Challenges por Denodo
Distributed Data Across Cloud and On-Premises: Opportunities and ChallengesDistributed Data Across Cloud and On-Premises: Opportunities and Challenges
Distributed Data Across Cloud and On-Premises: Opportunities and Challenges
Denodo 13 visualizações

Último

Games, Queries, and Argumentation Frameworks: Time for a Family Reunion por
Games, Queries, and Argumentation Frameworks: Time for a Family ReunionGames, Queries, and Argumentation Frameworks: Time for a Family Reunion
Games, Queries, and Argumentation Frameworks: Time for a Family ReunionBertram Ludäscher
9 visualizações37 slides
PRIVACY AWRE PERSONAL DATA STORAGE por
PRIVACY AWRE PERSONAL DATA STORAGEPRIVACY AWRE PERSONAL DATA STORAGE
PRIVACY AWRE PERSONAL DATA STORAGEantony420421
8 visualizações56 slides
Employees attrition por
Employees attritionEmployees attrition
Employees attritionMaryAlejandraDiaz
7 visualizações5 slides
Data Journeys Hard Talk workshop final.pptx por
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptxinfo828217
11 visualizações18 slides
META.pptx por
META.pptxMETA.pptx
META.pptxvasanthan19012003
7 visualizações10 slides
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf por
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf10urkyr34
7 visualizações259 slides

Último(20)

Games, Queries, and Argumentation Frameworks: Time for a Family Reunion por Bertram Ludäscher
Games, Queries, and Argumentation Frameworks: Time for a Family ReunionGames, Queries, and Argumentation Frameworks: Time for a Family Reunion
Games, Queries, and Argumentation Frameworks: Time for a Family Reunion
Bertram Ludäscher9 visualizações
PRIVACY AWRE PERSONAL DATA STORAGE por antony420421
PRIVACY AWRE PERSONAL DATA STORAGEPRIVACY AWRE PERSONAL DATA STORAGE
PRIVACY AWRE PERSONAL DATA STORAGE
antony4204218 visualizações
Employees attrition por MaryAlejandraDiaz
Employees attritionEmployees attrition
Employees attrition
MaryAlejandraDiaz7 visualizações
Data Journeys Hard Talk workshop final.pptx por info828217
Data Journeys Hard Talk workshop final.pptxData Journeys Hard Talk workshop final.pptx
Data Journeys Hard Talk workshop final.pptx
info82821711 visualizações
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf por 10urkyr34
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf
6498-Butun_Beyinli_Cocuq-Daniel_J.Siegel-Tina_Payne_Bryson-2011-259s.pdf
10urkyr347 visualizações
Inawsidom - Data Journey por PhilipBasford
Inawsidom - Data JourneyInawsidom - Data Journey
Inawsidom - Data Journey
PhilipBasford9 visualizações
Business administration Project File.pdf por KiranPrajapati91
Business administration Project File.pdfBusiness administration Project File.pdf
Business administration Project File.pdf
KiranPrajapati9110 visualizações
GDG Cloud Community Day 2022 - Managing data quality in Machine Learning por SARADINDU SENGUPTA
GDG Cloud Community Day 2022 -  Managing data quality in Machine LearningGDG Cloud Community Day 2022 -  Managing data quality in Machine Learning
GDG Cloud Community Day 2022 - Managing data quality in Machine Learning
SARADINDU SENGUPTA5 visualizações
Inawisdom Quick Sight por PhilipBasford
Inawisdom Quick SightInawisdom Quick Sight
Inawisdom Quick Sight
PhilipBasford8 visualizações
PyData Global 2022 - Things I learned while running neural networks on microc... por SARADINDU SENGUPTA
PyData Global 2022 - Things I learned while running neural networks on microc...PyData Global 2022 - Things I learned while running neural networks on microc...
PyData Global 2022 - Things I learned while running neural networks on microc...
SARADINDU SENGUPTA5 visualizações
LIVE OAK MEMORIAL PARK.pptx por ms2332always
LIVE OAK MEMORIAL PARK.pptxLIVE OAK MEMORIAL PARK.pptx
LIVE OAK MEMORIAL PARK.pptx
ms2332always8 visualizações
Underfunded.pptx por vgarcia19
Underfunded.pptxUnderfunded.pptx
Underfunded.pptx
vgarcia1915 visualizações
4_4_WP_4_06_ND_Model.pptx por d6fmc6kwd4
4_4_WP_4_06_ND_Model.pptx4_4_WP_4_06_ND_Model.pptx
4_4_WP_4_06_ND_Model.pptx
d6fmc6kwd47 visualizações
VoxelNet por taeseon ryu
VoxelNetVoxelNet
VoxelNet
taeseon ryu20 visualizações
Oral presentation (1).pdf por reemalmazroui8
Oral presentation (1).pdfOral presentation (1).pdf
Oral presentation (1).pdf
reemalmazroui86 visualizações
Custom Tag Manager Templates por Markus Baersch
Custom Tag Manager TemplatesCustom Tag Manager Templates
Custom Tag Manager Templates
Markus Baersch30 visualizações

Data Driven Advanced Analytics using Denodo Platform on AWS

  • 2. Agenda 1. Introduction to Data Driven Everything on AWS 2. Challenges with Data Driven Cloud Modernization 3. Addressing Challenges with Denodo Platform for AWS 4. Denodo Platform Use Cases and Data Architectures. 5. Key Takeaways | Q&A
  • 3. 3 Modernizing leads to maximum innovation velocity and optimal total cost of ownership On-premises Lift and shift Move to managed databases Modernize with purpose-built databases Innovation velocity Total cost of ownership (TCO) Break-free from legacy databases
  • 4. 4
  • 5. 5
  • 6. 6 What are customers building? Backup & restore Non-disruptive Easy place to start Integrated with all major vendors Archive & compliance Media workflows Tape replacement Public Sector, FinServ, Healthcare/Life Sciences Home directories Simple to move Not sensitive to latency Significant cost savings Data lakes Variety of analytics tools Built for streaming data Data visualization Business- critical applications Integrated with major vendors Fully managed infrastructure Lift-and-shift migrations
  • 7. 7 AWS Customer- Analytics Challenges in a Distributed Data Landscape Point-to-point data integration approaches are challenging: § Extracting and moving data increases latency and cost, and decreases quality, thus lacking unified data access § Every project solves data access and integration in a different way, increasing IT dependency § Solutions are tightly coupled to data sources, impacting flexibility, agility and overall governance DATA SOURCE DATA CONSUMER Data Governance Tools DB, DW & Data Lakes Files BI Dashboard Report and Tools Data Science & Machine Learning Apps Mobile & Enterprise Apps Microservices Apps Cloud DB & SaaS Streaming Data & IoT Cube
  • 8. 8 • The business wants more useful data • Timely, curated, usable • IT can’t keep up • 67% of companies use less than half of their data* • IT stuck in old school thinking about data management • ‘Business as usual’ The ‘Useful Data’ Gap * Source: Denodo Global Cloud Survey 2022
  • 9. 9 AWS Analytics Data Strategy, Keynote Remember, re:Invent 2022
  • 10. 10 10 Businesses need a new approach to connect data silos in real-time to support various applications, insights, and analytics.
  • 11. 11 Modern Data Architectural Patterns & Data Driven Analytics Data Mesh Data Lakehouse Data Lake Data Fabric Cloud Data Warehouse
  • 12. 12 Real World Data Lake Example – AWS Trusted Data Zone Raw Data Zone Refined Data Zone Transformation Transformation Data Consumers Networking, Infrastructure & Security Data Ingestion Data Sources Data Catalog and Search – Asset Registry Workflow Orchestration, DevOps and CI/CD
  • 13. 13 Denodo + AWS – Simple and Complementary Recipe! • Embrace distributed data landscape • Embrace the fact that data resides in multiple locations or systems – on-prem, hybrid, multi- cloud. All data needs to be managed with consistency • Use a Logical approach to manage it • Consumers access data through a centralized semantic model, decoupled from data location and physical schemas, that can enforce security and governance requirements
  • 14. 14 Denodo Platform: ONE Logical Platform for All Your Data Ease of Use Fast Query Response Integrated, Active Data Catalog Universal Connectivity Modern Data Services API Layer Dynamic Data Masking Automated Cloud Management Key Differentiators 83% reduction in time-to-revenue 67% reduction in data preparation effort 65% decrease in delivery times over ETL Source: Forrester Total Economic ImpactTM of Data Virtualization, 2021 Hybrid/ Multi-Cloud Security & Governance Al/ML Recommendations Advanced Semantics Data Catalog Discover / Explore / Document BI Tools SQL / MDX Data Science Tools Data as a Service RESTful / Odata GraphQL/ GeoJSON Files Cubes Cloud Stores Traditional DB & DW INTEGRATE MANAGE DELIVER Disparate data in any location, format or latency Related data with a universal semantic model and AI / ML functionality enabling vital data governance And democratize data using BI & data science tools, data catalogs, and APIs Data Lake & NoSQL Query Optimization & Acceleration
  • 17. 17 Reduce the Business Impact 1 - Transition to the AWS Cloud (Minimize Business Disruption) Business Need § Transition to cloud – migrate EDW § Real-time analytics from Business Users and Data Scientists § Security and governance across multiple analytical tools need to be centralized § Acts as a single semantic layer § Homogeneous data access regardless of back-end technology § No need to deal with new languages and APIs: access to SFDC, Excel, Amazon Redshift, Oracle, Hadoop, other SaaS APIs, etc. § Consistent business data model across all consumers and reporting tools § Reusability of analytical objects across multiple tools and consuming applications § Abstracts access to disparate data sources § Change in the data sources buffered minimizing the impact on consumer business applications § New technology adoption with minimal impact on the business § Minimizes impact on consumers § Minimizes cross-environment connectivity § reducing risks of unauthorized access to data § Amazon Athena § Amazon S3 Buckets § Amazon Redshift § Amazon Aurora § AWS PaaS - RDBMs Denodo AWS
  • 18. 18 Transition to Cloud | Cloud Migration Acceleration Denodo becomes the common access layer for all on- premise and cloud systems: Access to all data from a single system The data can be accessed directly from the original system, without the need for replication The data can still be easily replicated and hidden if necessary Simplify data aggregation, regardless of the location or format of the data Allows semantic models definition, independent of the original formats and structures Advanced security for all data Documentation and usage statistics included in the Data Catalog
  • 19. • • • • Hybrid (Cloud and On-Premise) Data Integration – Customer 360 / Single View
  • 20. 20 AWS Cloud Modernization - LeasePlan Data Hub Architecture ` DATA ACQUISITION DATA SOURCES DATA STORE (RAW) ANALYTICS WAREHOUSE DATA SCIENCE DATA FABRIC DATA CONSUMER Next Gen Data Management (Meta-data, data quality, governance) Meta data management, data quality, data governance as central components guarding the overall data-asset of the corporation to allow trusted access to data for utilisation across the enterprise Structured Unstructured ETL/ELT ORCHESTRATION STREAMING Native Extraction No ETL Tool(s) AWS Kinesis Airflow SAP BW/4HANA + HANA Native Raw Quality Integration Consumption Glacier Archive BW/4HANA + HANA Native NG Finance 1 NG Insurance NG Procurement NG Marketing NG Sales NG Service NG Commerce NG Fleet Ops NG Supplier Engagement NG Policy Mgt. NG Portals NG Contact Center Legacy – NOLS/ DB2/AS400 etc. Other External Data: Telematics, IoT, GA, Social feeds, streams Analytics for Cloud Analysis for Office AWS SageMaker Power BI Role Based Access Control Caching
  • 21. 21 Take the right decision on accurate data 2 - Real-Time Analytics for Business Users Business Need § Transition to cloud – migrate EDW § Real-time analysis from Business Users and Data Scientists § Security and governance across multiple analytical tools need to be centralized § Enables Self-Service BI § IT delivers a governed layer of “business views” to business users § Business users can generate any report over those IT-governed business views § Business views can be adapted for every type of user making use of the same terminology and naming conventions for every Line of Business § Incorporate geospatial, IoT, and other streaming data, to enable real-time data services § Accelerate cloud analytics with Amazon’s elastic infrastructure (EC2, auto-scaling) § Data is immediately available for use without delays § Integrate and Manage data across Amazon Redshift, Amazon RDS, Amazon S3 in real-time to drive advanced analytics § Source data to Amazon Lambda serverless processes and expose them as data source for BI-Analytics § Visualize data and reports in real time with QuickSights Denodo AWS
  • 22. 22 How Does Denodo Platform Work? Development Lifecycle Mgmt Monitoring & Audit Governance Security Development Tools and SDK Scheduled Tasks Data Caching Query Optimizer JDBC/ODBC/ADO.Net SOAP / REST WS U Customer 360 View Virtual Data Mart View J Application Layer Business Layer Unified View Unified View Unified View Unified View A J J Derived View Derived View J J S Transformation & Cleansing Data Source Layer Base View Base View Base View Base View Base View Base View Base View Abstraction
  • 23. 23 FAA – Federal Aviation Administration – Streamline Operations/Analytics ü Reduced the IT Operations Cost by 99.8%, while accelerating data access by 96%. ü To reduce costs and streamline IT operations, the U.S. Federal Aviation Administration (FAA) wanted to consolidate multiple IT organizations – each supporting different mission areas – into a single office reporting to a single CIO. FAA leveraged the Denodo platform on AWS to:
  • 24. 24 Across multiple analytical tools 3 - Centralized Security and Governance Business Need § Transition to cloud – migrate EDW § Real-time analytics from Business Users and Data Scientists § Security and governance across multiple analytical tools need to be centralized § Unified Security Layer § Global Tag-based Policy Engine § Role-based authorization to all tables in the virtual layer (RBAC) § Attribute-based access control (ABAC) § Security is moved outside the reporting layer to avoid security bypasses § Centralized access point simplifies operations and auditing § Data Masking / Obfuscation § Centralized Governance Layer § Centralized metadata catalog accessible for both technical and business users § Data Source refresh, change impact analysis, full data lineage, etc. § Protects data sources from uncontrolled access through query throttling, limiting #concurrent queries over them, limiting resulting datasets sizes, enabling the cache for minimizing the access to data sources for some views, etc. Denodo AWS Services § Datawarehouse Built for the cloud § Athena § Redshift § Secured, Managed Access § With Amazon Resource Manager § Identity Management & SSO Amazon IAM
  • 25. 25 Data Fabric Overview Core Principles: ü Data Integration ü Data Governance ü Data Democratization ü Data Intelligence ü Data Interoperability
  • 26. 26 Data Mesh Powered by Denodo Data Virtualization SQL Operational EDW Data Lakes Files SaaS APIs REST GraphQL OData Event Product Customer Location Employee Common Domain Event Management Human Resources MDX 2.Domains connect their data sources ❷ 1.Each domain is given a separate virtual schema. A common domain may be useful to centralized data products common across domains ❶ 3.Metadata is mapped to relational views. No data is replicated ❸ 4.Domains SMEs can model their Data Products. Products can be used to define other products ❹ 5.For execution, Products can be served directly from their sources, or replicated to a central location, like a lake ❺ 6.A central team can set guidelines and governance to ensure interoperability ❻ 7.Products can be access via SQL, MDX or exposed as an API. No coding is required ❼ 8.Infrastructure can easily scale out in a cluster ❽ New architectural paradigm for data management | distributed organizational paradigm | Domains in charge of Data Products
  • 27. 27 Data Fabric & Data Mesh Powered by Data Virtualization
  • 28. Summary and Takeaways Benefits of Logical Data Architectures
  • 29. Benefits of a Logical Data Architecture “Now, we can do weekly releases. We’re able to add new data sources within 2 to 3 hours. We’re about 60% faster than we were in the old world.” VP of data and analytics, real estate “To me, it all boils down to speed to insights. Not having to wait to get the question that you have top-of-mind answered with data is huge.” VP of data and analytics, real estate 29
  • 30. 30 Try Denodo Platform on AWS – Get Started Today! • 30 days Free Trial of Denodo Professional via AWS Marketplace • AWS Marketplace Transactable Pay-Go/Private Offers • Denodo – AWS Test Drives (free hands-on learning in 2 hours) : Denodo-AWS BI Denodo-AWS Data Science Visit Denodo Platform and AWS https://www.denodo.com/en/denodo-platform/denodo-platform-for-aws
  • 31. Q&A
  • 32. Thanks! www.denodo.com info@denodo.com © Copyright Denodo Technologies. All rights reserved Unless otherwise specified, no part of this PDF file may be reproduced or utilized in any for or by any means, electronic or mechanical, including photocopying and microfilm, without prior the written authorization from Denodo Technologies.