2024: Domino Containers - The Next Step. News from the Domino Container commu...
RFT for Business Intelligence and Data Strategy
1. Liam Costello, IT Project Manager, SEAI
Business Intelligence
and Data Strategy RFT
Stakeholder Engagement Meeting
01 March 2022
2. This event is being recorded
WebEx Housekeeping Slide
2 Please note that information presented on these slides are for information only and may or may not be used in
drafting the RFT.
Attendees are muted with cameras off
Questions submitted by clicking Q&A bubble
Questions will be answered at end of event
An FAQ will be created from all questions submitted and shared
A recording and slides will be distributed after the event
3. Agenda
3 Please note that information presented on these slides are for information only and may or may not be
used in drafting the RFT.
Key Drivers
SEAI Data Maturity Assessment
High Level Requirements
SEAI Technology Stack
Timelines
Q&A
5. 5 Please note that information presented on these slides are for information only
and may or may not be used in drafting the RFT.
National Retrofit Plan (Climate Action Plan)
• €8 Billion exchequer investment to 2030
• 500,000 B2 homes
• SEAI as the National Retrofit Delivery Body
Legislation and Policies
• Public Sector Data Strategy 2019- 2023
• Open Data Strategy 2017 - 2022
• Data Sharing and Governance Act 2019
• General Data Protection Regulations (GDPR)
SEAI internal drivers
• Organisation Growth
• Strategic Objectives
• IT Strategy
• Project Evolve
• SEAI Draft Data Strategy / Maturity Assessment
Key Drivers
6. 6
Please note that information presented on these slides are for information only and may or may not be used in drafting the RFT.
SEAI Board
CEO
Research and
Policy Insights
Business, Public
Sector and
Transport
Corporate
Services
Finance & ICT
IT Programme
IT Operations,
Service Delivery
and Security
Business
Applications and
Project
Excellence
Data
Management
National Retrofit
SMT
IT
Steering
EA
Forum
ELT
Organisation Structure
8. DAMA DMBOK Data Maturity Assessment (2020/21)
8 Please note that information presented on these slides are for information only
and may or may not be used in drafting the RFT.
DAMA DMBOK Data Management Knowledge Areas
• 33 Business Units Interviewed
• Data Maturity Assessment Survey
• Assessment of Data Landscape, Reporting and Storage
• Draft Data Strategy and suggested Roadmap
Year 1 Year 2 Year 3 onwards
Governance,
Policies &
Processes
Roles and
Responsibilities
Data Gov
Model
GDPR
Review
Data Polices
& Processes
Data
Lifecycles
Update Risk
Register
Standard
Templates
ISO 27001 Accreditation
Review 3rd Party
Agreements
Year 1 Year 2 Year 3 onwards
Document &
Content
Classification
Document
Management Platform
Logical and Physical Data Model Definition
Meta Data
Management
New Modern Data Platform (BI / DW solution)
Data Quality Programme (KPIs, Controls, Processes)
Data Integration Platform / Automated data exchange
Master &
Reference Data
Management
Tools &
Technology
Year 1 Year 2 Year 3 onwards
Governance,
Policies &
Processes
Roles and
Responsibilities
Data Gov
Model
GDPR
Review
Data Polices
& Processes
Data
Lifecycles
Update Risk
Register
Standard
Templates
ISO 27001 Accreditation
Review 3rd Party
Agreements
Year 1 Year 2 Year 3 onwards
Culture and
Enablem ent
Establish Analytics Service Hub
Data Skills Programme
Document Management Training
Open Data Initiatives
9. Assessment Findings
From Business Workshops
• Lack of centralised data governance,
controls, and processes
• Inconsistent multi-vendor approaches
• Data lifecycle not defined or managed.
• Data quality issues and duplication
• no approach to Master Data
Management (MDM)
• Proliferation of repositories for storing
documents
• Commercial and reputational risks
9 Please note that information presented on these slides are for information only
and may or may not be used in drafting the RFT.
Data Landscape, Storage and
Reporting
• SEAI lacks a consistent data model
• Poor integration of data sources
• Regulatory reporting is often not
accurate
• No data quality standards
• No organisational metadata policy or
process
• Retention policies are not enforced
• Information requests require heavy
resourcing
• No Open Data Publishing Plan
10. 10
High Level Requirements
Please note that information presented on these slides are for information
only and may or may not be used in drafting the RFT. Actual details and
requirements will be specified in the RFT when it is published on eTenders.
High Level Summary of RFT Requirements
11. Data Strategy Vision and Objectives
11 Please note that information presented on these slides are for information
only and may or may not be used in drafting the RFT.
“We will combine leading technologies, best practices, and SEAI-led innovation to transform how we
manage, share, and use data within the organisation and for the benefit of our stakeholders.”
12. Data Principles (EA Forum)
12 Please note that information presented on these slides are for information
only and may or may not be used in drafting the RFT.
Principle Statement Rationale
1
Treat Information as an
Asset
Information is a valuable asset to SEAI and our
stakeholders and must be managed accordingly
through its life cycle. This implies a need to plan
for the strategic use of information to enable
differentiating business capabilities.
Information represents a valuable corporate resource, with actual and
measurable value. Information is the basis of the decision-making
process and Government policy. Therefore, it must be carefully managed
to ensure constant awareness of its location, reliability of its contents, and
access whenever and wherever necessary.
2
Make Information
Accessible, Shareable and
Consumable
SEAI programmes have access to information that
is necessary for performance of their respective
functions. Therefore, information is shared
between different programmes and teams
depending on the security levels established for
that particular set of information.
Access to accurate information is essential to improve the quality and
efficiency of the decision-making, low response turnaround time for
information requests and delivery.
It is less expensive to maintain timely and accurate information in a single
repository and share that than to maintain repetitive information in
multiple sources.
Shared information from a centralized authoritative source promotes
better decisions-making, cost-efficiencies, accuracy and better
governance of information.
3
Use Common Terminology
and Definitions
Define information consistently and coherently
throughout the Corporation through
comprehensible and accessible definition by staff.
The information used in the development of applications must have a
common definition so that the information can be shared. A common
terminology facilitates communication and promotes efficient dialog and
allows information and interfaces to be shared among different systems.
4
Data security, Privacy and
Security Safeguards
Appropriate technical and organisational controls
must be implemented to protect data and keep it
confidential.
The privacy and security of data is everyone’s responsibility. Data
protection legislation requires organisations that process personal data to
ensure they maintain the security and privacy of this data. It is necessary
to have policies and security safeguards implemented to protect health
information whether stored on paper or electronically.
5
Ensure data is mastered
and shared
Everyone must work from the same data and
know its source.
Proliferation of structured data and unstructured data must be controlled
to ensure accurate data is provided.
13. Target State and Work Programme
13
Please note that information presented on these slides are for information only and may or may not be used in drafting the RFT.
DAMA Domain AS – IS TO - BE
Data Governance 2.68 3.5
Data Architecture 2.15 3.0
Data Modelling & Design 1.66 3.0
Data Storage & Operations 1.89 3.0
Data Security 3.00 3.5
Data Integration & Operability 1.98 3.5
Document & Content 2.08 3.0
Reference & Master Data 1.92 3.0
Data Warehousing & BI 1.88 3.0
Metadata 1.98 3.0
Data Quality 2.41 3.5
Tender Work Programme
Governance, Policies & Procedures
Tools & Technologies
Culture & Enablement
14. Year 1 Year 2 Year 3 onwards
Governance,
Policies&
Processes
Roles and
Responsibilities
Data Gov
Model
GDPR Review
Develop the Data Governance Model (DAMA Framework)
• Data Management Charter (Vision, Mission, business drivers, principles, known issues, processes)
• Operating Framework (roles and responsibilities, governance structures, terms and conditions, RACI matrix)
• Data Management Implementation Roadmap (timeframe for policies, technology roadmap etc.)
Conduct a GDPR review
• Based on a 2018 data gap analysis.
Governance, Polices and Procedures
Please note that information presented on these slides are for information only and may or may not be
15. Year 1 Year 2 Year 3 onwards
Governance,
Policies&
Processes
Roles and
Responsibilities
Data Gov
Model
GDPR Review
Data Policies
& Processes
Data
Lifecycles
Data Policies and Processes
• Gap analysis of existing data related policy and creating of new policies as required
• Document and manage existing data related processes and procedures
• Version control, manage and regular review of policy set to best practice (e.g. ISO27001)
Define and manage key data lifecycles
• Data lifecycle mapping to represent flow of data between people and systems tracking from creating to destruction
(feeds into Master and Reference Data)
Review and classify data exchanged with 3rd Parties
• Obligation as Data Controller to handle data in secure and compliant manner
• Review of all data coming in and out of SEAI to understand what is being exchanged, how is happens, and security and
risk issues
Governance, Polices and Procedures
Review 3rd Party
Agreements
Please note that information presented on these slides are for information only and may or may not be
16. Year 1 Year 2 Year 3 onwards
Governance,
Policies&
Processes
Roles and
Responsibilities
Data Gov
Model
GDPR Review
Data Polices &
Processes
Data
Lifecycles
Update Risk
Register
Standard
Templates
Update Risk Management Framework & Risk Register
• Review to ensure alignment with Data Governance Model and policies
• Data risk scoring, mitigation strategies, continuous review and monitoring
Standard Templates and Documents
• Classify documents and agree templates for common types (e.g. have these for IT PMO)
• Agree metadata for classification and mange with version control, reviews
Governance, Polices and Procedures
Review 3rd Party
Agreements
Please note that information presented on these slides are for information only and may or may not be
17. Year 1 Year 2 Year 3 onwards
Governance,
Policies&
Processes
Roles and
Responsibilities
Data Gov
Model
GDPR Review
Data Polices &
Processes
Data
Lifecycles
Update Risk
Register
Standard
Templates
ISO 27001 Accreditation
ISO27001 implementation and accreditation
• Extend from existing alignment to a subset standard in IT Programme to full SEAI adoption
• Drive maturity and culture shift across the organisation
• Would require significant organisation buy-in in terms of time and resources
Governance, Polices and Procedures
Data
Governance
Data Modelling
& Design
Data Storage&
Operations
Data Security
Data Integration
& Operability
Documents
& Content
Reference
& Master Data
Data
Warehousing
& BI
Metadata
Data
Architecture
Data Quality
Review 3rd Party
Agreements
Please note that information presented on these slides are for information only and may or may not be
18. Deliverables
• Target Operating Model
• DG Structures, roles and responsibilities, data quality management, data principles
• Defined and Managed Data Processes and Lifecycles
• Data acquisition, storage, processing and disposal
• Updated Risk Register and Risk Framework
• Continually evaluate and manage data related risk
• Suite of Policies and procedures to support Data Governance Programme
• Gap analysis and continual review
• ISO 27001 accreditation
• This will require agreement withing the organisation, currently IT aligns to this in certain areas but not fully accredited
Governance, Polices and Procedures
Year 1 Year 2 Year 3 onwards
Governance,
Policies&
Processes
Roles and
Responsibilities
Data Gov
Model
GDPR Review
Data Polices &
Processes
Data
Lifecycles
Update Risk
Register
Standard
Templates
ISO 27001 Accreditation
Review 3rd Party
Agreements
Please note that information presented on these slides are for information only and may or may not be
19. Master Data Management / Reference Data Management
• Identify and manage SEAI Master and Reference Data (Core business entities in Data Modelling work stream)
• Include where created, how managed, ownership, and lifecycle of data
• Incorporate MDM and RDM into SEAI Technology and Project Pipelines
• SEAI contact Management System, central repository of reference data (e.g. measures)
Document & Content Classification
• Content types, document sets, classification / metadata to enable searching, workflows, automated routing, retention, security and access,
Single Document Management Platform (SharePoint)
• Move documents from other platforms to SharePoint
• Integrate with other SEAI Systems
Tools and Technology
Year 1 Year 2 Year 3 onwards
Tools &
Technology
Master &
Reference Data
Management
Document & Content
Classification
Document
Management Platform
Please note that information presented on these slides are for information only and may or may not be
20. Logical and Physical Data Models
• Logical Data Model that represents all key SEAI data entities across all programmes
• Define attributes, primary identifiers, data types, relationships between entities
• Translate to physical data models for each system
• Common definitions and naming conventions
• Incorporated into system architecture and design
Meta Data Management
• Data catalogue that automatically scans data estate, shows data lineage, and all required metadata elements
• Start with Key entities identified in SEAI Logical Model
• Single Tool to manage and version control (integrated with new data platform)
Tools and Technology
Year 1 Year 2 Year 3 onwards
Document & Content
Classification
Document
Management Platform
Logical and Physical Data Model Definition
Meta Data
Management
Master &
Reference Data
Management
Tools &
Technology
Please note that information presented on these slides are for information only and may or may not be
21. New Modern Data Platform (BI / DW solution)
• Support and enable data-driven decision making and data analytics
• Cater for structured, semi-structured, unstructured, streamed data (scalable for future data volumes and needs)
• Link to MDM and RDM workstreams, and Data Quality Progarmme
• Azure based solution preferred as aligned to SEAI Technical Stack and investments
• Data ingestion, preparation, transforming, analysis, publishing, and consumption
• Include a Data Catalogue to enable data discovery, data lineage, business glossary, data classification, scan data estate
Existing Data Infrastructure
• Bring into a managed service (estimated for 1 year)
• Recreate existing reports in new environment when ready
Tools and Technology
Year 1 Year 2 Year 3 onwards
Document & Content
Classification
Document
Management Platform
Logical and Physical Data Model Definition
Meta Data
Management
New Modern Data Platform (BI / DW solution)
Master &
Reference Data
Management
Tools &
Technology
Please note that information presented on these slides are for information only and may or may not be
22. Data Quality Management Framework
• Data quality audit
• Timeliness, Completeness, Consistency, Accuracy, Availability, Integrity, Validity, and Currency
• Identify and manage a set of Data Quality Metrics across SEAI data estate
• Assess to metrics via dashboards, updated automatically, scoring in place
• QA checks for manually entered data
• Data quality control mechanisms
• New process to log, manage and resolve data issues
• Workflows for “Bad data” (e.g. exclude from reporting, flag for remediation)
• Roles and Responsibilities
• Data Stewards
Tools and Technology
Year 1 Year 2 Year 3 onwards
Document & Content
Classification
Document
Management Platform
Logical and Physical Data Model Definition
Meta Data
Management
New Modern Data Platform (BI / DW solution)
Data Quality Programme (KPIs, Controls, Processes)
Master &
Reference Data
Management
Tools &
Technology
Please note that information presented on these slides are for information only and may or may not be
23. Data Integration Platform
• Automate data flows between SEAI Systems (e.g. APIs)
• Eliminate file based extracts from systems for integration
• Ensure compliance with legislation / regulation
• Automate data flows externally
• Input from review of 3rd Party data exchanges
• Ensure compliance with legislation / regulation
• Data services, APIs, Document sharing approach
• Centralised service approach to sharing data (EA Forum)
Tools and Technology
Year 1 Year 2 Year 3 onwards
Document & Content
Classification
Document
Management Platform
Logical and Physical Data Model Definition
Meta Data
Management
New Modern Data Platform (BI / DW solution)
Data Quality Programme (KPIs, Controls, Processes)
Data Integration Platform / Automated data exchange
Master &
Reference Data
Management
Tools &
Technology
Please note that information presented on these slides are for information only and may or may not be
24. Deliverables
• Common SEAI Data Model (Conceptual and Physical)
• Meta Data solution
• Master and Reference Data solutions
• BI / DW solution
• Data Integration solution(s)
• Data Catalogue
• Data Quality Framework and associated solutions
Tools and Technology
Year 1 Year 2 Year 3 onwards
Document & Content
Classification
Document
Management Platform
Logical and Physical Data Model Definition
Meta Data
Management
New Modern Data Platform (BI / DW solution)
Data Quality Programme (KPIs, Controls, Processes)
Data Integration Platform / Automated data exchange
Master &
Reference Data
Management
Tools &
Technology
Please note that information presented on these slides are for information only and may or may not be
25. Analytics Service Hub
• Determine best model for SEAI (may change over time)
• Hub and spoke recommended
• Shared service providing access to high quality data and support business with DA initiatives
• Higher level of skills in DA techniques, ML and AI
Culture and Enablement
Year 1 Year 2 Year 3 onwards
Culture and
Enablement
Establish Analytics Service Hub
Please note that information presented on these slides are for information only and may or may not be
26. Data Skill Programme
• Enable employees to manage their data and gain insights using adopted DA and visualisation tools
• Structured training programme tailored to users specific needs
• Using an common toolset (e.g. Power BI)
• Break down silos and foster collaboration
• Supported by enhanced data discovery and BI / DW technology platform development
Culture and Enablement
Year 1 Year 2 Year 3 onwards
Culture and
Enablement
Establish Analytics Service Hub
Data Skills Programme
Please note that information presented on these slides are for information only and may or may not be
27. Open Data Publishing Framework
• Data Audits and Data valuation
• Data cleaning and anonymisation rules
• Data publishing process and approval path
• Open Data solutions and support automated publishing process to data.gov.ie
• Integrated with BI / DW solution data source
Culture and Enablement
Year 1 Year 2 Year 3 onwards
Culture and
Enablement
Establish Analytics Service Hub
Data Skills Programme
Open Data Initiatives
Please note that information presented on these slides are for information only and may or may not be
28. SharePoint training
• Classification and tagging of documents and content
• Workflows associated with documents and how to trigger
• Access and sharing rules
• Version controls
• Build on existing SharePoint training within SEAI
Culture and Enablement
Year 1 Year 2 Year 3 onwards
Culture and
Enablement
Establish Analytics Service Hub
Data Skills Programme
Document Management Training
Open Data Initiatives
Please note that information presented on these slides are for information only and may or may not be
29. Deliverables
• Analytics Service Hub with higher level of skills
• Targeted skills development and training plans (data visualisation and analytics tools)
• Open Data solutions to ensure SEAI compliant with Open Data Strategy
• Document Management Training
Culture and Enablement
Year 1 Year 2 Year 3 onwards
Culture and
Enablement
Establish Analytics Service Hub
Data Skills Programme
Document Management Training
Open Data Initiatives
Please note that information presented on these slides are for information only and may or may not be
31. SEAI technology
On Premise Cloud (MS Azure)
Windows 2012 and 2016
Servers
D365 CRM (SAAS)
(EGS, PEP,WH,EED,MSA)
SQL Server 2008 & 2012 Office 365 (SAAS)
VMWare VCenter 6.7 Azure AD
Veeam backup TPC
Checkpoint .NET portals
Dell Servers and SAN Azure SQL Reporting DB
Cisco Switching
On Prem Staging DBs
On Prem DW
32. 32 Please note that information presented on these slides are for information
only and may or may not be used in drafting the RFT.
Internet
Gov-Networks
PEP
WHS
BER
ECMS
GIS
Workstation
SEAI Azure
Reporting
PEP
WHS
CallQ
HES/
Admi
n
EV
M&R
ACA/
TripleE
NAS/
NDNAS
File
Print
Workstatio
n
BO Network
Web Network DB
Network
SEAI SAAS
Corporate
Website
Cloud Service
3PP (DR)
Dun
Slg
Crk SEAI - Gov Networks
Wifi
Fexco
KSN
MPRN Eircode
BOI
Insp
EGS
• Firewalls
• Network Segmentation
• Patching
• Anti-Virus
• Web filter
• Encryption
• Backups
• Access Control, MFA
• Conditional Access
34. 34 Please note that information presented on these slides are for information
only and may or may not be used in drafting the RFT.
eTenders, ESPD and submitting a tender
Ensure you are signed up to eTenders
https://www.etenders.gov.ie/
Contact eTenders directly for technical support queries
Tender queries
All queries must only be sent in via the messaging facility on eTenders
Questions will be anonymised, and answers will be distributed to all bidders
Monitor eTenders / TED for publication of the tender
SEAI will publish the RFT using the same CPV codes as published in the PIN
Ensure you are signed up to CPV codes to get notifications of tenders
Complete an ESPD
The European single procurement document (ESPD) is a self-declaration form.
Most Economically Advantageous Tender (MEAT) is the method of assessment used and is determined based on a combination of
qualitive and cost criteria.
Two steps in a tender, selection criteria and award criteria.
Selection criteria tests the suitability of the tenderer, it examines their previous experience and has minimum rules that must be passed in
order to proceed further in the evaluation process, evaluated on a pass/fail basis to decide which candidates are suitable.
Award criteria examines the capability of the tenderer to meet the requirements set out in the tender specifications.
Give yourself plenty of time to submit your
response, ensure you upload documents in
good time, do not leave it until the last hour to
upload, make sure you click submit.
Once you click submit you cannot
amend/change the documents.
35. 35 Please note that information presented on these slides are for information
only and may or may not be used in drafting the RFT.
Steps in a tender process
•Prior Information Notice (PIN) published on eTenders, Etender reference 207848
• Publish RFT: Request for Tender (RFT) will be published in Q1/Q2 2022, containing
the award criteria, specifications and minimum requirements
• Queries/clarification period: gives all potential tenderers an opportunity to ask
questions via messaging facility on eTenders about the tender or the services
• Evaluation: Once tender closing date has passed, all valid tenders will be evaluated by an SEAI
evaluation team
• Decide, Notify & Award: Once evaluation is complete, all tenderers will be notified
via eTenders whether they were successful or unsuccessful
• Standstill Period: SEAI will hold a 14 calendar day standstill period.
• Conclude Contract with successful tenderer.
36. 36 Please note that information presented on these slides are for information
only and may or may not be used in drafting the RFT.
Key tips for compiling your tender response
Avoid repetition, copying and pasting and generic answers
Keep on point per requirement
Keep audience in mind – the tender evaluators need to be able to read submission
Keep it simple- effort in presentation is good but a good edited document is superior, demonstrates
the company approach
Ask yourself, does this demonstrate the company in the best possible way?
Take a step back, examine and review as if this is new content to you
Be neat, use readable fonts
Examine the award criteria, What is the ask?
Tailor your response to the RFT requirements and award criteria by reflecting back to the wording of
the award criteria to ensure you have addressed the ask.
37. - Partnership on our data journey
- Ambitious but achievable
Q&A
liam.costello@seai.ie