Aymeric Gerardin, Manager Big Data infrastructure at Amadeus: “Amadeus Big Data journey, lessons learned and observed value”
•
4 gostaram•975 visualizações
Aymeric Gerardin, Manager Big Data infrastructure at Amadeus: “Amadeus Big Data journey, lessons learned and observed value”
Recomendados
Recomendados
Mais conteúdo relacionado
Semelhante a Aymeric Gerardin, Manager Big Data infrastructure at Amadeus: “Amadeus Big Data journey, lessons learned and observed value”
Semelhante a Aymeric Gerardin, Manager Big Data infrastructure at Amadeus: “Amadeus Big Data journey, lessons learned and observed value” (20)
Mais de Dataconomy Media
Mais de Dataconomy Media (20)
Último
Último (20)
Aymeric Gerardin, Manager Big Data infrastructure at Amadeus: “Amadeus Big Data journey, lessons learned and observed value”
- 1. Big Data Journey A bumpy road Aymeric Gerardin ©AmadeusITGroupanditsaffiliatesandsubsidiaries
- 5. 5 ©AmadeusITGroupanditsaffiliatesandsubsidiaries Amadeus Shape the future of travel 595 million total bookings processed in 2016 1.4 billion passengers boarded in 2016 1.3 Petabytes of Data produced by day
- 6. 6 ©AmadeusITGroupanditsaffiliatesandsubsidiaries Why Amadeus BI products _ Booking _ Search _ Traffic _ Schedule _ Booking _ Search _ Productivity Airlines Insight Agency Insight
- 8. 8 ©AmadeusITGroupanditsaffiliatesandsubsidiaries Why Prepare the future Customers Data Lake Chatbot AI Digitalization IOT BI Mobile Analytics platform Open API Security Cloud
- 10. 10 2012 Experimentation _ Record replay framework _ Repurposed Hardware 2014 - 2015 Implementation _ Pilot project _ Infrastructure • Hardware • Network ©AmadeusITGroupanditsaffiliatesandsubsidiaries Big data Journey Timeline 5 years! Time is flying so fast 2016 Expansion _ From 1 to 30+ projects _ From 300TB to 13 PB of data 2017 Optimization _ Industrialization _ Governance _ Object store _ GPU based HW
- 11. Data Lake ©2015AmadeusITGroupSA ©2016AmadeusITGroupSA Data Archive BI Platform The Architecture slide I think I achieved having all the fancy logos in one slide! Amadeus Products & ext. sources Bulk File Unified Data ingestion Visualization for users Analytics platform
- 12. 12 Dedicated Big data network 300Gb/s of maximal bandwidth 1. 2. Hpe DL380 and Apollo series 28 cores, 512GB RAM, 40-210 TB of storage by node 3. Future • Solid state Drive storage (SSD) • Graphics Processing unit (GPU) ©AmadeusITGroupanditsaffiliatesandsubsidiaries Infrastructure Yes, hardware! It is like speaking about cars
- 13. 13 ©AmadeusITGroupanditsaffiliatesandsubsidiaries How many days to transfer 600TB from Nice to Munich? • Hint : Network: 2Gb/s (250MB/s)
- 14. 14 ©AmadeusITGroupanditsaffiliatesandsubsidiaries 2 Days!* With the Network it is 27 days minimum
- 17. 17 ©AmadeusITGroupanditsaffiliatesandsubsidiaries Processes and tools Regulations! Proof of concept Is your best friend Don’t fit a square peg in a round hole
- 18. 18 ©AmadeusITGroupanditsaffiliatesandsubsidiaries OrganizationalCommunity Show value! Even if small End to end delivery (POC)
- 20. 20 TSM/ NAS decommission Logging infrastructure BI Travel intelligence Billing Security Security audit Fraud detection Operations Monitoring Quality KPI ©AmadeusITGroupanditsaffiliatesandsubsidiaries Added value In cost, quality or service Cost efficiency