SlideShare uma empresa Scribd logo
1 de 20
Baixar para ler offline
Improve Telco
Network
Observability with
ElasticCloud
Elastic Observability & Security Meetup
T-Mobile - Elastic – Devoteam
Wednesday, March 24th, 2023
Who’s who from T-Mobile’s Data Driven Assurance?
Michael
Bayes
Data Analyst
QA - Data Driven Assurance
mike.bayes@t-mobile.nl
Designs, builds and delivers network
observability solutions via
ElasticCloud.
Implements, optimizes and maintains
ElasticCloud Instances for multiple
teams
Jan
Stegink
Domain Architect
QA - Data Driven Assurance
jan.stegink@t-mobile.nl
Erwin
Halmans
Product Owner
QA - Data Driven Assurance
erwin.halmans@t-mobile.nl
Creator and guardian of the Event
based big data architecture for Network
Technology
Delivers the solution architecture for
various network observability
implementations
Champion and facilitator of the Data
Driven Assurance team
Translating prioritized business requests
& guiding the implementation of
network observability solutions
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 3
T-Mobile Nederland
T-Mobile Nederland is a Dutch telecommunication
service provider delivering mobile and fixed services
• Owned by investmentfunds Apax and Warburg Pincus,
and independent from Deutsche Telekom
• Awarded “best mobile network of The Netherlands”
five consecutive years
• Largest mobile service provider of the Netherlands
• 7 million mobile subscribers
• 800 thousand fixed subscribers
• 2 billion Euro revenue
• Headquarters in The Hague
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 4
Data Driven Assurance team
Make a substantial contribution to improving our Network Observability which leads to increased
operational stability and reduced operational costs of our networks and services
We achieve this by developing and maintaining a big data platform to distribute real time streaming
network data to consuming parties. It enables the delivery ofAIOps type applications
Mission
Network Operations & Network Operations Center, Network Security & Security Operations Center,
Network Design, Strategy, Quality Assurance, Intelligence & Insights
Stakeholders
Three data engineers, two data analysts, a domain architect and a product owner
Frontrunners in innovations, such as applying Big Data for telco networks , MDT and AI
Skillset: SNMP, Syslog, SFTP and MDT (data collection), Kafka platform management, Python,Java and
KSQL (streaming data pipelines), ElasticCloud platform management and APM, ML and Kibana
(analytical applications)
Team
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 5
The team’s evolution, achievements and outlook
‘18 ‘19 ‘20 ‘21 ‘22 ‘23 ‘24
The adventure begins:
Data Driven Assurance is
born //There is budget,
hardware, tools and
staffing
Big Data architecture for
Networks comes to
maturity// Migration from
Hadoop to Kafka begins //
AI Sandbox
Implemented Anodot’s
anomaly detection
platform // Predictive
model for failure and
replacement of optical
devices
DDA proves its value:
Delivered various Network
Observability applications
for ‘Thuis’ // Early detection
of hundreds of ‘Critical’
situations // Increase in
‘Thuis’ NPS
Focus on improving
‘Thuis’ leads to replacing
Anodot by ElasticCloud //
Changed data scientist
role to data analyst //
Fast tracked delivery of
network observability
applications for‘Thuis’
ElasticCloud usage goes
through the roof – data
optimization required //
Adoption of MDT takes a
flight: phase out of
legacy data collectors
5
9
3
3
6
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 6
9
Focus on Elastic ML//
Adoption of ‘Self Service’
analytics // Implement
container management
solution // Expand Kafka
cluster // . . . . . . . . .
?
Dark NOC
Architecture for
Network
Observability
Jan Stegink | Elastic Meetup | Diemen | 24-05-2023
Three
architecture
viewpoints 01 Business Viewpoint
02 Application Viewpoint
03 Technical viewpoint
Business Viewpoint
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 9
ISSUES & OPPORTUNITIES: NEED FOR AUTOMATION
acquisition >100K devices >4M metrics / 5 min.
>50 tools >1y learning Technology: MDT
5G FMC Fiber
5G/ IoT applications
Operations
Cost
Customer
Care
Business viewpoint
10
Complexity Demand Technology
Observability (full picture, instant insights)
Anomaly
Detection
Root cause
Analysis
Impact analysis
ISSUES & OPPORTUNITIES: NEED FOR AUTOMATION
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
Business viewpoint
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 11
Overview
Insight
Anomaly detection,
RCA
Impact analysis
Mitigation
Performance network & customer operations
Cost
(Incidents, complaints)
Service level
(Claims, pro-active)
Satisfaction
(Churn)
Busines viewpoint
12
01
02
03
04
FULL PICTURE
INSTANT INSIGHTS
DETECTION
PREVENTIVE
PRO-ACTIVE (*)
CONTRIBUTION
AIOPS
DARK NOC
Benefits so far: Simplification/Consolidation, Observability,
Detection, MTTD, Availability, Outage Communication
CONTRIBUTION
DDA
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
Application viewpoint
13
EVENT PRODUCTION EVENT SOURCING EVENT CONSUMPTION
KEY FEATURES:
BIG DATA
STREAM ANALYTICS
AI/ML
PRODUCERS METRICS
LOGS
TRACES
FAULTS
INSIGHTS
ALARMS
SEARCH
ACTION
CONFIG.
CONSUMERS
Network
Operations
Network
Design
Customer
Operations
Quality
Assurance
Mobile
Network
Fixed
Network
(TMT)
Fixed
Network
(former
Tele2)
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
Application viewpoint
14
KEY FEATURES:
BIG DATA
STREAM ANALYTICS
AI/ML
SENSORS USE CASES
EVENT PRODUCTION EVENT SOURCING EVENT CONSUMPTION
M
L
VOLUME
VARIATY
VELOCITY
F
IM
MAINT
SEC
QA
T
C CC
VALUE
VARIABILITY
(self-service)
VERACITY
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
Application viewpoint
15
KEY FEATURES:
BIG DATA
STREAM ANALYTICS
AI/ML
SENSORS USE CASES
EVENT PRODUCTION EVENT SOURCING EVENT CONSUMPTION
M
L
F
IM
MAINT
SEC
QA
T
C CC
VISUALISATION
PREDICTION (*)
NOTIFICATION
DETECTION !
NORMA-
LISATION
ENRICHMENT
FILTERING
TRANSFOR-
MATION
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
Technology viewpoint
16
Production Collection Transformation & Storage Distribution Consumption
BI, CC, SEC
We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
Demo - Network
Observability with
ElasticCloud
Mike Bayes | Elastic Meetup | Diemen | 24-05-2023
Network Observability with Elastic
• Elastic Agents for system
monitoring
• APM to monitor key
operational support
applications
• Server log monitoring
• Network Operations
Dashboards to identify
network issues
• Anomaly Detection for
alerting
• Root cause analysis via
Discover
Demo – Network
Anomaly Detection
RADIUS Explained
Router
BNG DHCP Server RADIUS Server Internet
DHCP Discover
DHCP Discover
DHCP Offer
DHCP Request
Access request & Response
DHCP Acknowledge
DHCP Acknowledge
Success: Add service to internet access

Mais conteúdo relacionado

Semelhante a Improve Telco Network Observability with ElasticCloud

Effective IoT System on Openstack
Effective IoT System on OpenstackEffective IoT System on Openstack
Effective IoT System on OpenstackTakashi Kajinami
 
EMEA ENTERPRISE IT SOLUTIONS AND SECURITY SERVICES PROFILE.PDF
EMEA ENTERPRISE IT SOLUTIONS AND SECURITY SERVICES PROFILE.PDFEMEA ENTERPRISE IT SOLUTIONS AND SECURITY SERVICES PROFILE.PDF
EMEA ENTERPRISE IT SOLUTIONS AND SECURITY SERVICES PROFILE.PDFFaleh M.
 
Making IoT a Reality_Axeda _ May 8 2013 _Mahbubul Alam
Making IoT a Reality_Axeda _ May 8 2013 _Mahbubul AlamMaking IoT a Reality_Axeda _ May 8 2013 _Mahbubul Alam
Making IoT a Reality_Axeda _ May 8 2013 _Mahbubul AlamMahbubul Alam
 
Making io t a reality axeda _ may 8 2013 _mahbubul alam
Making io t a reality   axeda _ may 8 2013 _mahbubul alamMaking io t a reality   axeda _ may 8 2013 _mahbubul alam
Making io t a reality axeda _ may 8 2013 _mahbubul alamMahbubul Alam
 
Cloud Security: Perception Vs. Reality
Cloud Security: Perception Vs. RealityCloud Security: Perception Vs. Reality
Cloud Security: Perception Vs. RealityInternap
 
Tech equity - Cloud presentation
Tech equity - Cloud presentationTech equity - Cloud presentation
Tech equity - Cloud presentationAdrian Hall
 
Dynamic Software Defined Network Infrastructure Test Bed at Marist College
Dynamic Software Defined Network Infrastructure Test Bed at Marist CollegeDynamic Software Defined Network Infrastructure Test Bed at Marist College
Dynamic Software Defined Network Infrastructure Test Bed at Marist CollegeADVA
 
EMC - Bruno Melandri, Cloud Computing, Milano 2 luglio 2009
EMC - Bruno Melandri, Cloud Computing, Milano 2 luglio 2009EMC - Bruno Melandri, Cloud Computing, Milano 2 luglio 2009
EMC - Bruno Melandri, Cloud Computing, Milano 2 luglio 2009Manuela Moroncini
 
Cisco Connect 2018 Thailand - Secure, intelligent platform for the digital bu...
Cisco Connect 2018 Thailand - Secure, intelligent platform for the digital bu...Cisco Connect 2018 Thailand - Secure, intelligent platform for the digital bu...
Cisco Connect 2018 Thailand - Secure, intelligent platform for the digital bu...NetworkCollaborators
 
MT81 Keys to Successful Enterprise IoT Initiatives
MT81 Keys to Successful Enterprise IoT InitiativesMT81 Keys to Successful Enterprise IoT Initiatives
MT81 Keys to Successful Enterprise IoT InitiativesDell EMC World
 
Cloud Security @ TIM - Current Practises and Future Challanges
Cloud Security @ TIM - Current Practises and Future ChallangesCloud Security @ TIM - Current Practises and Future Challanges
Cloud Security @ TIM - Current Practises and Future ChallangesMichele Vecchione
 
Keys-to-Success-and-Security-in-the-Cloud
Keys-to-Success-and-Security-in-the-CloudKeys-to-Success-and-Security-in-the-Cloud
Keys-to-Success-and-Security-in-the-Cloudpatmisasi
 
Keys to success and security in the cloud
Keys to success and security in the cloudKeys to success and security in the cloud
Keys to success and security in the cloudScalar Decisions
 
Telecity Group Corporate Overview 2009
Telecity Group Corporate Overview 2009Telecity Group Corporate Overview 2009
Telecity Group Corporate Overview 2009RoCo1980
 
Cloud Computing - Beyond the Hype
Cloud Computing - Beyond the HypeCloud Computing - Beyond the Hype
Cloud Computing - Beyond the HypeRH
 
Cloud computing (2)
Cloud computing (2)Cloud computing (2)
Cloud computing (2)Vincent Kwon
 
The Canopy Cloud Vision
The Canopy Cloud VisionThe Canopy Cloud Vision
The Canopy Cloud VisionThomas Kunz
 

Semelhante a Improve Telco Network Observability with ElasticCloud (20)

Effective IoT System on Openstack
Effective IoT System on OpenstackEffective IoT System on Openstack
Effective IoT System on Openstack
 
EMEA ENTERPRISE IT SOLUTIONS AND SECURITY SERVICES PROFILE.PDF
EMEA ENTERPRISE IT SOLUTIONS AND SECURITY SERVICES PROFILE.PDFEMEA ENTERPRISE IT SOLUTIONS AND SECURITY SERVICES PROFILE.PDF
EMEA ENTERPRISE IT SOLUTIONS AND SECURITY SERVICES PROFILE.PDF
 
Ibm iot overview
Ibm   iot overviewIbm   iot overview
Ibm iot overview
 
Making IoT a Reality_Axeda _ May 8 2013 _Mahbubul Alam
Making IoT a Reality_Axeda _ May 8 2013 _Mahbubul AlamMaking IoT a Reality_Axeda _ May 8 2013 _Mahbubul Alam
Making IoT a Reality_Axeda _ May 8 2013 _Mahbubul Alam
 
Making io t a reality axeda _ may 8 2013 _mahbubul alam
Making io t a reality   axeda _ may 8 2013 _mahbubul alamMaking io t a reality   axeda _ may 8 2013 _mahbubul alam
Making io t a reality axeda _ may 8 2013 _mahbubul alam
 
Cloud Security: Perception Vs. Reality
Cloud Security: Perception Vs. RealityCloud Security: Perception Vs. Reality
Cloud Security: Perception Vs. Reality
 
Tech equity - Cloud presentation
Tech equity - Cloud presentationTech equity - Cloud presentation
Tech equity - Cloud presentation
 
Dynamic Software Defined Network Infrastructure Test Bed at Marist College
Dynamic Software Defined Network Infrastructure Test Bed at Marist CollegeDynamic Software Defined Network Infrastructure Test Bed at Marist College
Dynamic Software Defined Network Infrastructure Test Bed at Marist College
 
EMC - Bruno Melandri, Cloud Computing, Milano 2 luglio 2009
EMC - Bruno Melandri, Cloud Computing, Milano 2 luglio 2009EMC - Bruno Melandri, Cloud Computing, Milano 2 luglio 2009
EMC - Bruno Melandri, Cloud Computing, Milano 2 luglio 2009
 
Key Capibilities.pptx
Key Capibilities.pptxKey Capibilities.pptx
Key Capibilities.pptx
 
Cisco Connect 2018 Thailand - Secure, intelligent platform for the digital bu...
Cisco Connect 2018 Thailand - Secure, intelligent platform for the digital bu...Cisco Connect 2018 Thailand - Secure, intelligent platform for the digital bu...
Cisco Connect 2018 Thailand - Secure, intelligent platform for the digital bu...
 
MT81 Keys to Successful Enterprise IoT Initiatives
MT81 Keys to Successful Enterprise IoT InitiativesMT81 Keys to Successful Enterprise IoT Initiatives
MT81 Keys to Successful Enterprise IoT Initiatives
 
Cloud Security @ TIM - Current Practises and Future Challanges
Cloud Security @ TIM - Current Practises and Future ChallangesCloud Security @ TIM - Current Practises and Future Challanges
Cloud Security @ TIM - Current Practises and Future Challanges
 
Keys-to-Success-and-Security-in-the-Cloud
Keys-to-Success-and-Security-in-the-CloudKeys-to-Success-and-Security-in-the-Cloud
Keys-to-Success-and-Security-in-the-Cloud
 
Keys to success and security in the cloud
Keys to success and security in the cloudKeys to success and security in the cloud
Keys to success and security in the cloud
 
Telecity Group Corporate Overview 2009
Telecity Group Corporate Overview 2009Telecity Group Corporate Overview 2009
Telecity Group Corporate Overview 2009
 
Cloud Computing - Beyond the Hype
Cloud Computing - Beyond the HypeCloud Computing - Beyond the Hype
Cloud Computing - Beyond the Hype
 
Cloud computing (2)
Cloud computing (2)Cloud computing (2)
Cloud computing (2)
 
The Canopy Cloud Vision
The Canopy Cloud VisionThe Canopy Cloud Vision
The Canopy Cloud Vision
 
ECI - The Elastic Network - winds of change
ECI - The Elastic Network - winds of changeECI - The Elastic Network - winds of change
ECI - The Elastic Network - winds of change
 

Último

Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfNicoChristianSunaryo
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfPratikPatil591646
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etclalithasri22
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformationAnnie Melnic
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfnikeshsingh56
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBoston Institute of Analytics
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are successPratikSingh115843
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaManalVerma4
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...Dr Arash Najmaei ( Phd., MBA, BSc)
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Boston Institute of Analytics
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksdeepakthakur548787
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfblazblazml
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...Jack Cole
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelBoston Institute of Analytics
 

Último (17)

Digital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdfDigital Indonesia Report 2024 by We Are Social .pdf
Digital Indonesia Report 2024 by We Are Social .pdf
 
Non Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdfNon Text Magic Studio Magic Design for Presentations L&P.pdf
Non Text Magic Studio Magic Design for Presentations L&P.pdf
 
DATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etcDATA ANALYSIS using various data sets like shoping data set etc
DATA ANALYSIS using various data sets like shoping data set etc
 
Role of Consumer Insights in business transformation
Role of Consumer Insights in business transformationRole of Consumer Insights in business transformation
Role of Consumer Insights in business transformation
 
Statistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdfStatistics For Management by Richard I. Levin 8ed.pdf
Statistics For Management by Richard I. Levin 8ed.pdf
 
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis ProjectBank Loan Approval Analysis: A Comprehensive Data Analysis Project
Bank Loan Approval Analysis: A Comprehensive Data Analysis Project
 
Presentation of project of business person who are success
Presentation of project of business person who are successPresentation of project of business person who are success
Presentation of project of business person who are success
 
IBEF report on the Insurance market in India
IBEF report on the Insurance market in IndiaIBEF report on the Insurance market in India
IBEF report on the Insurance market in India
 
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
6 Tips for Interpretable Topic Models _ by Nicha Ruchirawat _ Towards Data Sc...
 
Data Analysis Project: Stroke Prediction
Data Analysis Project: Stroke PredictionData Analysis Project: Stroke Prediction
Data Analysis Project: Stroke Prediction
 
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
Data Analysis Project Presentation: Unveiling Your Ideal Customer, Bank Custo...
 
Insurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis ProjectInsurance Churn Prediction Data Analysis Project
Insurance Churn Prediction Data Analysis Project
 
Digital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing worksDigital Marketing Plan, how digital marketing works
Digital Marketing Plan, how digital marketing works
 
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdfEnglish-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
English-8-Q4-W3-Synthesizing-Essential-Information-From-Various-Sources-1.pdf
 
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
why-transparency-and-traceability-are-essential-for-sustainable-supply-chains...
 
2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use2023 Survey Shows Dip in High School E-Cigarette Use
2023 Survey Shows Dip in High School E-Cigarette Use
 
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis modelDecoding Movie Sentiments: Analyzing Reviews with Data Analysis model
Decoding Movie Sentiments: Analyzing Reviews with Data Analysis model
 

Improve Telco Network Observability with ElasticCloud

  • 1.
  • 2. Improve Telco Network Observability with ElasticCloud Elastic Observability & Security Meetup T-Mobile - Elastic – Devoteam Wednesday, March 24th, 2023
  • 3. Who’s who from T-Mobile’s Data Driven Assurance? Michael Bayes Data Analyst QA - Data Driven Assurance mike.bayes@t-mobile.nl Designs, builds and delivers network observability solutions via ElasticCloud. Implements, optimizes and maintains ElasticCloud Instances for multiple teams Jan Stegink Domain Architect QA - Data Driven Assurance jan.stegink@t-mobile.nl Erwin Halmans Product Owner QA - Data Driven Assurance erwin.halmans@t-mobile.nl Creator and guardian of the Event based big data architecture for Network Technology Delivers the solution architecture for various network observability implementations Champion and facilitator of the Data Driven Assurance team Translating prioritized business requests & guiding the implementation of network observability solutions We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 3
  • 4. T-Mobile Nederland T-Mobile Nederland is a Dutch telecommunication service provider delivering mobile and fixed services • Owned by investmentfunds Apax and Warburg Pincus, and independent from Deutsche Telekom • Awarded “best mobile network of The Netherlands” five consecutive years • Largest mobile service provider of the Netherlands • 7 million mobile subscribers • 800 thousand fixed subscribers • 2 billion Euro revenue • Headquarters in The Hague We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 4
  • 5. Data Driven Assurance team Make a substantial contribution to improving our Network Observability which leads to increased operational stability and reduced operational costs of our networks and services We achieve this by developing and maintaining a big data platform to distribute real time streaming network data to consuming parties. It enables the delivery ofAIOps type applications Mission Network Operations & Network Operations Center, Network Security & Security Operations Center, Network Design, Strategy, Quality Assurance, Intelligence & Insights Stakeholders Three data engineers, two data analysts, a domain architect and a product owner Frontrunners in innovations, such as applying Big Data for telco networks , MDT and AI Skillset: SNMP, Syslog, SFTP and MDT (data collection), Kafka platform management, Python,Java and KSQL (streaming data pipelines), ElasticCloud platform management and APM, ML and Kibana (analytical applications) Team We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 5
  • 6. The team’s evolution, achievements and outlook ‘18 ‘19 ‘20 ‘21 ‘22 ‘23 ‘24 The adventure begins: Data Driven Assurance is born //There is budget, hardware, tools and staffing Big Data architecture for Networks comes to maturity// Migration from Hadoop to Kafka begins // AI Sandbox Implemented Anodot’s anomaly detection platform // Predictive model for failure and replacement of optical devices DDA proves its value: Delivered various Network Observability applications for ‘Thuis’ // Early detection of hundreds of ‘Critical’ situations // Increase in ‘Thuis’ NPS Focus on improving ‘Thuis’ leads to replacing Anodot by ElasticCloud // Changed data scientist role to data analyst // Fast tracked delivery of network observability applications for‘Thuis’ ElasticCloud usage goes through the roof – data optimization required // Adoption of MDT takes a flight: phase out of legacy data collectors 5 9 3 3 6 We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 6 9 Focus on Elastic ML// Adoption of ‘Self Service’ analytics // Implement container management solution // Expand Kafka cluster // . . . . . . . . . ? Dark NOC
  • 7. Architecture for Network Observability Jan Stegink | Elastic Meetup | Diemen | 24-05-2023
  • 8. Three architecture viewpoints 01 Business Viewpoint 02 Application Viewpoint 03 Technical viewpoint
  • 9. Business Viewpoint We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 9 ISSUES & OPPORTUNITIES: NEED FOR AUTOMATION acquisition >100K devices >4M metrics / 5 min. >50 tools >1y learning Technology: MDT 5G FMC Fiber 5G/ IoT applications Operations Cost Customer Care
  • 10. Business viewpoint 10 Complexity Demand Technology Observability (full picture, instant insights) Anomaly Detection Root cause Analysis Impact analysis ISSUES & OPPORTUNITIES: NEED FOR AUTOMATION We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
  • 11. Business viewpoint We are very proud to call ourselves “Top Employer”! www.teammagenta.nl 11 Overview Insight Anomaly detection, RCA Impact analysis Mitigation Performance network & customer operations Cost (Incidents, complaints) Service level (Claims, pro-active) Satisfaction (Churn)
  • 12. Busines viewpoint 12 01 02 03 04 FULL PICTURE INSTANT INSIGHTS DETECTION PREVENTIVE PRO-ACTIVE (*) CONTRIBUTION AIOPS DARK NOC Benefits so far: Simplification/Consolidation, Observability, Detection, MTTD, Availability, Outage Communication CONTRIBUTION DDA We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
  • 13. Application viewpoint 13 EVENT PRODUCTION EVENT SOURCING EVENT CONSUMPTION KEY FEATURES: BIG DATA STREAM ANALYTICS AI/ML PRODUCERS METRICS LOGS TRACES FAULTS INSIGHTS ALARMS SEARCH ACTION CONFIG. CONSUMERS Network Operations Network Design Customer Operations Quality Assurance Mobile Network Fixed Network (TMT) Fixed Network (former Tele2) We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
  • 14. Application viewpoint 14 KEY FEATURES: BIG DATA STREAM ANALYTICS AI/ML SENSORS USE CASES EVENT PRODUCTION EVENT SOURCING EVENT CONSUMPTION M L VOLUME VARIATY VELOCITY F IM MAINT SEC QA T C CC VALUE VARIABILITY (self-service) VERACITY We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
  • 15. Application viewpoint 15 KEY FEATURES: BIG DATA STREAM ANALYTICS AI/ML SENSORS USE CASES EVENT PRODUCTION EVENT SOURCING EVENT CONSUMPTION M L F IM MAINT SEC QA T C CC VISUALISATION PREDICTION (*) NOTIFICATION DETECTION ! NORMA- LISATION ENRICHMENT FILTERING TRANSFOR- MATION We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
  • 16. Technology viewpoint 16 Production Collection Transformation & Storage Distribution Consumption BI, CC, SEC We are very proud to call ourselves “Top Employer”! www.teammagenta.nl
  • 17. Demo - Network Observability with ElasticCloud Mike Bayes | Elastic Meetup | Diemen | 24-05-2023
  • 18. Network Observability with Elastic • Elastic Agents for system monitoring • APM to monitor key operational support applications • Server log monitoring • Network Operations Dashboards to identify network issues • Anomaly Detection for alerting • Root cause analysis via Discover
  • 20. RADIUS Explained Router BNG DHCP Server RADIUS Server Internet DHCP Discover DHCP Discover DHCP Offer DHCP Request Access request & Response DHCP Acknowledge DHCP Acknowledge Success: Add service to internet access