In that session we will discuss about Data Governance, mainly around that fantastic platform Power BI (but also around on-prem concerns).
How to avoid dataset-hell ? What are the best practices for sharing queries ? Who is the famous Data Steward and what is its role in a department or in the whole company ? How do you choose the right person ?
Keywords : Power Query, Data Management Gateway, Power BI Admin Center, Datastewardship, SharePoint 2013, eDiscovery
Level 200
Injustice - Developers Among Us (SciFiDevCon 2024)
Fasten you seatbelt and listen to the Data Steward
1. @Djeepy1 | @Fleid_bi | @GUSS_France
Fasten your seatbelt and
listen to the (Data) Steward
Jean-Pierre Riehl
Florian Eiden
http://blog.djeepy1.net | @djeepy1
http://fleid.net | @fleid_BI
2. @Djeepy1 | @Fleid_bi | @GUSS_France
Jean-Pierre Riehl
Practice Manager Data & BI – AZEO
MVP SQL Server
President at GUSS
Florian Eiden
Managing Consultant, Data & Analytics - Cellenza
MVP SQL Server
Board Member at GUSS
Who are we ?
3. @Djeepy1 | @Fleid_bi | @GUSS_France
GUSS : PASS France chapter
Webcasts, Conferences, Afterworks
.Pro
Next event :
SQLSaturday Paris 2014
September 13th
Tour Montparnasse, Paris
English-speaking track
5. @Djeepy1 | @Fleid_bi | @GUSS_France
Self-Service BI
Corporate BI
• Managed
• DatawareHouse
• Company-wide
Team BI
• Shared
• Models
• Department-wide
Self-Service BI
• Quick & Easy
• Personal data
• Document-centric
9. @Djeepy1 | @Fleid_bi | @GUSS_France
Writer’s block
also known as
White Worksheet Syndrom
Issue #1
?
10. @Djeepy1 | @Fleid_bi | @GUSS_France
Too much Data !
« I want the Employee’s List »
– Duplicates
– Wrong sources
– Bad Data
– Poor or Bad description
– Etc.
Issue #2
14. @Djeepy1 | @Fleid_bi | @GUSS_France
Features and tools
Analyze
Visualize
Share
Question
Q&A
Mobility
Discover
Search, access, and transform
public and internal data sources
with Power Query
Share datasets and workbooks
refreshable from on-premises
and cloud based data sources,
with Power BI Sites
Easy data modeling and
lightning fast in-memory
analytics with Power Pivot
Bold new interactive data
visualizations with Power View
and Power Map
Ask questions and get
immediate answers with natural
language query
Mobile access through HTML5
and touch optimized apps
Scalable | Manageable | Trusted
15. @Djeepy1 | @Fleid_bi | @GUSS_France
Power BI - Big Picture
Power BI O365 Tenant
Power BI
Admin
Center
SQL
Data
Catalog
External
Data
Q&A
Cloud On-Prem
Oracle …
Excel
Power BI Sites Power Query Power Pivot
Power View Power Map
Cloud
Power Query
Data
Refresh
Index
Search Data
Management
Gateway
16. @Djeepy1 | @Fleid_bi | @GUSS_France
Ideas of costs
Q&A
All Inclusive
(ie. including Office 2013 ProPlus Licences)
17. @Djeepy1 | @Fleid_bi | @GUSS_France
Power BI* On-Prem
Data Sources Gateways & Data Sources
Shared Data Sources (SSRS)
Office Data Connection
Datasets Queries
Shared Datasets (SSRS)
Power Pivot for SharePoint
Models
Power Pivot
Data Management Gateway
Power Pivot for SharePoint
Dashboards Power View
Power View (BISM)
SSRS over Power Pivot
There was some SSBI before Power BI
Power BI vs. On-Prem
* Many more features to come
19. @Djeepy1 | @Fleid_bi | @GUSS_France
• Tools are only a part of the solution
• Good formula : People + Processes + Tools
– « Data governance is between 80 and 95%
communication » - Dec 2006 Data Governance Conference
• We have the tools, let’s talk about the rest…
If all you have is hammer…
21. @Djeepy1 | @Fleid_bi | @GUSS_France
• Wikipedia: Stewardship is an ethic that
embodies the responsible planning and
management of resources.
A Steward?
Data Steward of Gondor…
Not our idea, see Matthew Roche for complaints
22. @Djeepy1 | @Fleid_bi | @GUSS_France
IT : Information Technology
My pretty typical organization
Piercing items
Slashing items
Bludgeoning items
Armors & Shield
Business Divisions Functional Units
Finance HR Legal
23. @Djeepy1 | @Fleid_bi | @GUSS_France
Where are stewards needed in the org?
Piercing items
Slashing items
Bludgeoning items
Armors & Shield
Business Divisions Functional Units
Finance HR Legal
IT : Information Technology
24. @Djeepy1 | @Fleid_bi | @GUSS_France
My organization : actual perception
Piercing items
Slashing items
Bludgeoning items
Armors & Shield
Business Divisions Functional Units
Finance HR Legal
IT
25. @Djeepy1 | @Fleid_bi | @GUSS_France
Well, let’s be honest about what it looks like
Piercing items
Slashing items
Bludgeoning items
Armors & Shield
Business Divisions Functional Units
Finance HR Legal
IT
26. @Djeepy1 | @Fleid_bi | @GUSS_France
For maximum results: local initiatives
Piercing items
Slashing items
Bludgeoning items
Armors & Shield
Business Divisions Functional Units
Finance HR Legal
IT
27. @Djeepy1 | @Fleid_bi | @GUSS_France
• Why :
– Specific to your company, to be defined in your master plan
• How :
– “Responsible planning and management of resources”
• What :
– Elect data stewards that will enable, teach, police
Let’s get back to our steward
Slashing items
28. @Djeepy1 | @Fleid_bi | @GUSS_France
• Skills
– Interpersonal skills
– Good personal organization
– Data-awareness
• Data lifecycle specific to the company
• General understanding of BI/data technologies
• Data merging, cleaning, metadata maintenance
– Training in tools used in the company
• A chosen career path
– It’s an actual job, usually part time
– But not just an additional task in the schedule!
Required skills
30. @Djeepy1 | @Fleid_bi | @GUSS_France
The Journey of a Data Steward
• Help to find data
– Manage the Data Lake
– Create Data Sources
– Facilitate exploration
– Manage metadata
31. @Djeepy1 | @Fleid_bi | @GUSS_France
The Journey of a Data Steward
• Manage new data
– Find new Data Sources
– Find new Datasets
• Verify new datasets
– Check for Accuracy
– Check for duplicates
– Fix sources and queries
• Use of Workflows
32. @Djeepy1 | @Fleid_bi | @GUSS_France
The Journey of a Data Steward
• Certify
– Ensure Corporate Policies
• Train & Teach
– Help for modeling
– Help for analysis
34. @Djeepy1 | @Fleid_bi | @GUSS_France
Information Management Platform
IT
Developers
Data
Steward
Importance of relations
Business
Users
Tools Tools Tools
35. @Djeepy1 | @Fleid_bi | @GUSS_France
Information Management Platform
Sales
IT
And reality is more complex
Mktg Production
44. @Djeepy1 | @Fleid_bi | @GUSS_France
• Tools are nothing without people and
processes
• Governance is different in every company
– Decided and sponsored by the executives, inscribed in
a global strategy
– Adapted to your organization
– The Data Steward as the local implementation of it
A matter of governance
45. @Djeepy1 | @Fleid_bi | @GUSS_France
1. Build an Information Management Platform
2. Identify your processes & Org Chart
3. Write the Data Steward « Job Profile »
4. Identify the right people for the job
5. Leverage Self-Service BI
• Ask your local experts
How to start tomorrow ?
46. @Djeepy1 | @Fleid_bi | @GUSS_France
• A Data Culture
– See Satya Nadella
April 15th 2015 presentation in SF
• To at last step up in the
knowledge pyramid!
– Machine learning o/
All this for what?