High Availability in YARN - Project Preview

•

1 gostou•1,205 visualizações

Arinto Murdopo

Project preview presentation for ID2219.

Educação

Highly Available
NG Hadoop MapReduce
Arinto Murdopo
Mário Almeida
Umit Cavus
Strahinja Lazetic

Supervisor: Jim Dowling

Outcome
● Highly Available implementation of YARN
○ with Zookeeper before the hadoop team
○ with NDB MySql-Cluster before Jim kicks us out

● (Secondary goal) make RM stateless so we
can have more than one running at each
moment.
○ So we can have failover when there is failure in a
RM

● (Eventual goal) Get a job!

Mais conteúdo relacionado

Destaque

Practica 2 luis ivan cruz val.persi-10

Sam houston chess teamSam Houston Lmc

Maailmassa on parempia pankkejaPankki2

Uso correto de epi´s abafadoresPaulo Carvalho

Why File Sharing is Dangerous?Arinto Murdopo

Arviointi ja palaute 2011Marko Havu

Architecting a Cloud-Scale Identity FabricArinto Murdopo

The counting system for small animals in japaneseCheyanneStotlar

Moodboards edaedaozdemir

Pechakuchacmcgrupo8

Distributed Computing - What, why, how..Arinto Murdopo

153 test plan< <

UX homework4mylovelymac

Parts of SpeechJen Lawson

Quantum Cryptography and Possible AttacksArinto Murdopo

Pankki 2.0-hankkeen esittelyPankki2

Cultura mitesComalat1D

Netcare csi kelvin's talk aug 2015Kelvin Glen

Parallelization of Smith-Waterman Algorithm using MPIArinto Murdopo

Destaque (20)

Practica 2 luis ivan cruz val.

Sam houston chess team

Maailmassa on parempia pankkeja

Uso correto de epi´s abafadores

Why File Sharing is Dangerous?

Arviointi ja palaute 2011

Architecting a Cloud-Scale Identity Fabric

The counting system for small animals in japanese

Moodboards eda

Pechakucha

Distributed Computing - What, why, how..

153 test plan

UX homework4

Parts of Speech

Quantum Cryptography and Possible Attacks

Pankki 2.0-hankkeen esittely

Cultura mites

Netcare csi kelvin's talk aug 2015

Parallelization of Smith-Waterman Algorithm using MPI

Mais de Arinto Murdopo

Distributed Decision Tree Learning for Mining Big Data StreamsArinto Murdopo

Next Generation Hadoop: High Availability for YARN Arinto Murdopo

High Availability in YARNArinto Murdopo

An Integer Programming Representation for Data Center Power-Aware Management ...Arinto Murdopo

Quantum Cryptography and Possible Attacks-slideArinto Murdopo

Dremel Paper ReviewArinto Murdopo

Megastore - ID2220 PresentationArinto Murdopo

Flume Event ScalabilityArinto Murdopo

Large Scale Distributed Storage Systems in Volunteer Computing - SlideArinto Murdopo

Large-Scale Decentralized Storage Systems for Volunter Computing SystemsArinto Murdopo

Rise of Network VirtualizationArinto Murdopo

Consistency Tradeoffs in Modern Distributed Database System DesignArinto Murdopo

Distributed Storage System for Volunteer ComputingArinto Murdopo

Apache FlumeArinto Murdopo

Why Use “REST” Architecture for Web Services?Arinto Murdopo

Distributed SystemsArinto Murdopo

Mais de Arinto Murdopo (17)

Distributed Decision Tree Learning for Mining Big Data Streams

Next Generation Hadoop: High Availability for YARN

High Availability in YARN

An Integer Programming Representation for Data Center Power-Aware Management ...

Quantum Cryptography and Possible Attacks-slide

Dremel Paper Review

Megastore - ID2220 Presentation

Flume Event Scalability

Large Scale Distributed Storage Systems in Volunteer Computing - Slide

Large-Scale Decentralized Storage Systems for Volunter Computing Systems

Rise of Network Virtualization

Consistency Tradeoffs in Modern Distributed Database System Design

Distributed Storage System for Volunteer Computing

Apache Flume

Why Use “REST” Architecture for Web Services?

Distributed Systems

Último

Virtual-Orientation-on-the-Administration-of-NATG12-NATG6-and-ELLNA.pdfErwinPantujan2

Culture Uniformity or Diversity IN SOCIOLOGY.pptxPoojaSen20

Student Profile Sample - We help schools to connect the data they have, with ...Seán Kennedy

GRADE 4 - SUMMATIVE TEST QUARTER 4 ALL SUBJECTSJoshuaGantuangco2

USPS® Forced Meter Migration - How to Know if Your Postage Meter Will Soon be...Postal Advocate Inc.

Judging the Relevance and worth of ideas part 2.pptxSherlyMaeNeri

YOUVE_GOT_EMAIL_PRELIMS_EL_DORADO_2024.pptxConquiztadors- the Quiz Society of Sri Venkateswara College

AMERICAN LANGUAGE HUB_Level2_Student'sBook_Answerkey.pdfphamnguyenenglishnb

Difference Between Search & Browse Methods in Odoo 17Celine George

Inclusivity Essentials_ Creating Accessible Websites for Nonprofits .pdfTechSoup

Keynote by Prof. Wurzer at Nordex about IP-designMIPLM

call girls in Kamla Market (DELHI) 🔝 >༒9953330565🔝 genuine Escort Service 🔝✔️✔️9953056974 Low Rate Call Girls In Saket, Delhi NCR

LEFT_ON_C'N_ PRELIMS_EL_DORADO_2024.pptxConquiztadors- the Quiz Society of Sri Venkateswara College

THEORIES OF ORGANIZATION-PUBLIC ADMINISTRATIONHumphrey A Beña

YOUVE GOT EMAIL_FINALS_EL_DORADO_2024.pptxConquiztadors- the Quiz Society of Sri Venkateswara College

HỌC TỐT TIẾNG ANH 11 THEO CHƯƠNG TRÌNH GLOBAL SUCCESS ĐÁP ÁN CHI TIẾT - CẢ NĂ...Nguyen Thanh Tu Collection

Procuring digital preservation CAN be quick and painless with our new dynamic...Jisc

Earth Day Presentation wow hello nice greatYousafMalik24

What is Model Inheritance in Odoo 17 ERPCeline George

ANG SEKTOR NG agrikultura.pptx QUARTER 4MiaBumagat1