SlideShare a Scribd company logo

SDEC2011 Essentials of map reduce

•
•
K
Korea Sdec
Technology
1 of 8
Download to read offline
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Essentials of MapReduce Mastering Hadoop Map-reduce for Data Analysis Shashank Tiwari blog: shanky.org | twitter: @tshanky st@treasuryofideas.com
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Walk Through a Map Reduce Example • A mapper class that emits key/value pairs. • A reducer class that takes the values emitted from mapper and manipulates it to create aggregations. In the data upload example, the mapper only inserts the data into an HBase table. • A driver class that puts the mapper class and the reducer class together. • A class that triggers the job in its main method • NYSE HLOC Data Hadoop MapReduce
Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Questions? • blog: shanky.org | twitter: @tshanky • st@treasuryofideas.com

Recommended

Map Essentials (TODALSIGS)
Map Essentials (TODALSIGS)Map Essentials (TODALSIGS)
Map Essentials (TODALSIGS)jbartley
 
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and HiveSDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and HiveKorea Sdec
 
Interpreting maps
Interpreting mapsInterpreting maps
Interpreting mapsrrodri37
 
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...Making Student Learning Visible: Using Concept Map Analysis as an Assessment...
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...Gail Matthews-DeNatale
 
Transilience map & analysis
Transilience map & analysisTransilience map & analysis
Transilience map & analysisCarlos Hidalgo
 
Types of Maps and other Interpretation
Types of Maps and other Interpretation Types of Maps and other Interpretation
Types of Maps and other Interpretation Lyn Gile Facebook
 
Earth system science notes
Earth system science notesEarth system science notes
Earth system science notesRachael Hubbard
 
The risk reward diagrams
The risk reward diagramsThe risk reward diagrams
The risk reward diagramshttp://www.drawpack.com
 

Recommended

Map Essentials (TODALSIGS)
Map Essentials (TODALSIGS)Map Essentials (TODALSIGS)
Map Essentials (TODALSIGS)jbartley
 
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and HiveSDEC2011 Replacing legacy Telco DB/DW to Hadoop and Hive
SDEC2011 Replacing legacy Telco DB/DW to Hadoop and HiveKorea Sdec
 
Interpreting maps
Interpreting mapsInterpreting maps
Interpreting mapsrrodri37
 
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...Making Student Learning Visible: Using Concept Map Analysis as an Assessment...
Making Student Learning Visible: Using Concept Map Analysis as an Assessment...Gail Matthews-DeNatale
 
Transilience map & analysis
Transilience map & analysisTransilience map & analysis
Transilience map & analysisCarlos Hidalgo
 
Types of Maps and other Interpretation
Types of Maps and other Interpretation Types of Maps and other Interpretation
Types of Maps and other Interpretation Lyn Gile Facebook
 
Earth system science notes
Earth system science notesEarth system science notes
Earth system science notesRachael Hubbard
 
The risk reward diagrams
The risk reward diagramsThe risk reward diagrams
The risk reward diagramshttp://www.drawpack.com
 
Chapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedChapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedMissST
 
Basics of Map reading
Basics of Map reading Basics of Map reading
Basics of Map reading Javed Iqbal Student of M.S (Teacher Education) at University of Tennessee USA
 
Concept Maps: Types, uses, software
Concept Maps: Types, uses, softwareConcept Maps: Types, uses, software
Concept Maps: Types, uses, softwareNadia Spang Bovey
 
The risk reward diagram
The risk reward diagramThe risk reward diagram
The risk reward diagramhttp://www.drawpack.com
 
You Got Skills #3: Types of Maps
You Got Skills #3: Types of MapsYou Got Skills #3: Types of Maps
You Got Skills #3: Types of Mapsmaggiedesmond
 
Topographic map with animation
Topographic map with animationTopographic map with animation
Topographic map with animationrbritton24
 
Map Reading
Map ReadingMap Reading
Map ReadingYee Seng Gan
 
Types of Maps
Types of MapsTypes of Maps
Types of Mapsitutor
 
Reading a topographic map
Reading a topographic mapReading a topographic map
Reading a topographic mapRachael Hubbard
 
Secondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapSecondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapMarioSonic54
 
Class X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperClass X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperAtrayee SenGupta
 
Topography powerpoint
Topography powerpointTopography powerpoint
Topography powerpointJennifer Bertolino
 
LS GE Slides - Map Reading
LS GE Slides - Map ReadingLS GE Slides - Map Reading
LS GE Slides - Map ReadingLEEENNA
 
Map & a diagram (1)
Map & a diagram (1)Map & a diagram (1)
Map & a diagram (1)jasminerachel
 
Geography: Different Kinds Of Maps
Geography: Different Kinds Of MapsGeography: Different Kinds Of Maps
Geography: Different Kinds Of MapsDan Klumper
 
Class X geography question bank
Class X geography question bankClass X geography question bank
Class X geography question bankPK121
 
Concept Mapping
Concept MappingConcept Mapping
Concept MappingDr. Ann Marie E. McSwain
 
Introduction to Concept Mapping
Introduction to Concept MappingIntroduction to Concept Mapping
Introduction to Concept MappingJames Neill
 
SDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerSDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerKorea Sdec
 
SDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionSDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionKorea Sdec
 
SDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopSDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopKorea Sdec
 
Sdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopSdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopKorea Sdec
 

More Related Content

Viewers also liked

Chapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedChapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedMissST
 
Concept Maps: Types, uses, software
Concept Maps: Types, uses, softwareConcept Maps: Types, uses, software
Concept Maps: Types, uses, softwareNadia Spang Bovey
 
You Got Skills #3: Types of Maps
You Got Skills #3: Types of MapsYou Got Skills #3: Types of Maps
You Got Skills #3: Types of Mapsmaggiedesmond
 
Topographic map with animation
Topographic map with animationTopographic map with animation
Topographic map with animationrbritton24
 
Types of Maps
Types of MapsTypes of Maps
Types of Mapsitutor
 
Reading a topographic map
Reading a topographic mapReading a topographic map
Reading a topographic mapRachael Hubbard
 
Secondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapSecondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapMarioSonic54
 
Class X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperClass X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperAtrayee SenGupta
 
LS GE Slides - Map Reading
LS GE Slides - Map ReadingLS GE Slides - Map Reading
LS GE Slides - Map ReadingLEEENNA
 
Geography: Different Kinds Of Maps
Geography: Different Kinds Of MapsGeography: Different Kinds Of Maps
Geography: Different Kinds Of MapsDan Klumper
 
Class X geography question bank
Class X geography question bankClass X geography question bank
Class X geography question bankPK121
 
Introduction to Concept Mapping
Introduction to Concept MappingIntroduction to Concept Mapping
Introduction to Concept MappingJames Neill
 

Viewers also liked (18)

Chapter 3 gateway 123 combined
Chapter 3 gateway 123 combinedChapter 3 gateway 123 combined
Chapter 3 gateway 123 combined
 
Basics of Map reading
Basics of Map reading Basics of Map reading
Basics of Map reading
 
Concept Maps: Types, uses, software
Concept Maps: Types, uses, softwareConcept Maps: Types, uses, software
Concept Maps: Types, uses, software
 
The risk reward diagram
The risk reward diagramThe risk reward diagram
The risk reward diagram
 
You Got Skills #3: Types of Maps
You Got Skills #3: Types of MapsYou Got Skills #3: Types of Maps
You Got Skills #3: Types of Maps
 
Topographic map with animation
Topographic map with animationTopographic map with animation
Topographic map with animation
 
Map Reading
Map ReadingMap Reading
Map Reading
 
Types of Maps
Types of MapsTypes of Maps
Types of Maps
 
Reading a topographic map
Reading a topographic mapReading a topographic map
Reading a topographic map
 
Secondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic MapSecondary 1 Geography-Topographic Map
Secondary 1 Geography-Topographic Map
 
Class X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question PaperClass X ICSE Geography Solved Question Paper
Class X ICSE Geography Solved Question Paper
 
Topography powerpoint
Topography powerpointTopography powerpoint
Topography powerpoint
 
LS GE Slides - Map Reading
LS GE Slides - Map ReadingLS GE Slides - Map Reading
LS GE Slides - Map Reading
 
Map & a diagram (1)
Map & a diagram (1)Map & a diagram (1)
Map & a diagram (1)
 
Geography: Different Kinds Of Maps
Geography: Different Kinds Of MapsGeography: Different Kinds Of Maps
Geography: Different Kinds Of Maps
 
Class X geography question bank
Class X geography question bankClass X geography question bank
Class X geography question bank
 
Concept Mapping
Concept MappingConcept Mapping
Concept Mapping
 
Introduction to Concept Mapping
Introduction to Concept MappingIntroduction to Concept Mapping
Introduction to Concept Mapping
 

More from Korea Sdec

SDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerSDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerKorea Sdec
 
SDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionSDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionKorea Sdec
 
SDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopSDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopKorea Sdec
 
Sdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopSdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopKorea Sdec
 
SDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modellingSDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modellingKorea Sdec
 
SDEC2011 Essentials of Pig
SDEC2011 Essentials of PigSDEC2011 Essentials of Pig
SDEC2011 Essentials of PigKorea Sdec
 
SDEC2011 Essentials of Mahout
SDEC2011 Essentials of MahoutSDEC2011 Essentials of Mahout
SDEC2011 Essentials of MahoutKorea Sdec
 
SDEC2011 Essentials of Hive
SDEC2011 Essentials of HiveSDEC2011 Essentials of Hive
SDEC2011 Essentials of HiveKorea Sdec
 
SDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and modelsSDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and modelsKorea Sdec
 
Sdec2011 Introducing Hadoop
Sdec2011 Introducing HadoopSdec2011 Introducing Hadoop
Sdec2011 Introducing HadoopKorea Sdec
 
SDEC2011 Rapidant
SDEC2011 RapidantSDEC2011 Rapidant
SDEC2011 RapidantKorea Sdec
 
SDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the whySDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the whyKorea Sdec
 
SDEC2011 Going by TACC
SDEC2011 Going by TACCSDEC2011 Going by TACC
SDEC2011 Going by TACCKorea Sdec
 
SDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & ExperiencesSDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & ExperiencesKorea Sdec
 
SDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speedSDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speedKorea Sdec
 
SDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloudSDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloudKorea Sdec
 

More from Korea Sdec (16)

SDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuerSDEC2011 Big engineer vs small entreprenuer
SDEC2011 Big engineer vs small entreprenuer
 
SDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestionSDEC2011 Implementing me2day friend suggestion
SDEC2011 Implementing me2day friend suggestion
 
SDEC2011 Introducing Hadoop
SDEC2011 Introducing HadoopSDEC2011 Introducing Hadoop
SDEC2011 Introducing Hadoop
 
Sdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoopSdec2011 shashank-introducing hadoop
Sdec2011 shashank-introducing hadoop
 
SDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modellingSDEC2011 NoSQL Data modelling
SDEC2011 NoSQL Data modelling
 
SDEC2011 Essentials of Pig
SDEC2011 Essentials of PigSDEC2011 Essentials of Pig
SDEC2011 Essentials of Pig
 
SDEC2011 Essentials of Mahout
SDEC2011 Essentials of MahoutSDEC2011 Essentials of Mahout
SDEC2011 Essentials of Mahout
 
SDEC2011 Essentials of Hive
SDEC2011 Essentials of HiveSDEC2011 Essentials of Hive
SDEC2011 Essentials of Hive
 
SDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and modelsSDEC2011 NoSQL concepts and models
SDEC2011 NoSQL concepts and models
 
Sdec2011 Introducing Hadoop
Sdec2011 Introducing HadoopSdec2011 Introducing Hadoop
Sdec2011 Introducing Hadoop
 
SDEC2011 Rapidant
SDEC2011 RapidantSDEC2011 Rapidant
SDEC2011 Rapidant
 
SDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the whySDEC2011 Mahout - the what, the how and the why
SDEC2011 Mahout - the what, the how and the why
 
SDEC2011 Going by TACC
SDEC2011 Going by TACCSDEC2011 Going by TACC
SDEC2011 Going by TACC
 
SDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & ExperiencesSDEC2011 Glory-FS development & Experiences
SDEC2011 Glory-FS development & Experiences
 
SDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speedSDEC2011 Using Couchbase for social game scaling and speed
SDEC2011 Using Couchbase for social game scaling and speed
 
SDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloudSDEC2011 Arcus NHN memcached cloud
SDEC2011 Arcus NHN memcached cloud
 

Recently uploaded

My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024The Digital Insurer
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationRidwan Fadjar
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek SchlawackFwdays
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 3652toLead Limited
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebUiPathCommunity
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machinePadma Pradeep
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Scott Keck-Warren
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfSeasiaInfotech2
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationSafe Software
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticscarlostorres15106
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostZilliz
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubKalema Edgar
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024BookNet Canada
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Commit University
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embeddingZilliz
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLScyllaDB
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii SoldatenkoFwdays
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024Stephanie Beckett
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyAlfredo García Lavilla
 

Recently uploaded (20)

My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024My INSURER PTE LTD - Insurtech Innovation Award 2024
My INSURER PTE LTD - Insurtech Innovation Award 2024
 
My Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 PresentationMy Hashitalk Indonesia April 2024 Presentation
My Hashitalk Indonesia April 2024 Presentation
 
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
"Subclassing and Composition – A Pythonic Tour of Trade-Offs", Hynek Schlawack
 
Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365Ensuring Technical Readiness For Copilot in Microsoft 365
Ensuring Technical Readiness For Copilot in Microsoft 365
 
Dev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio WebDev Dives: Streamline document processing with UiPath Studio Web
Dev Dives: Streamline document processing with UiPath Studio Web
 
Install Stable Diffusion in windows machine
Install Stable Diffusion in windows machineInstall Stable Diffusion in windows machine
Install Stable Diffusion in windows machine
 
Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024Advanced Test Driven-Development @ php[tek] 2024
Advanced Test Driven-Development @ php[tek] 2024
 
The Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdfThe Future of Software Development - Devin AI Innovative Approach.pdf
The Future of Software Development - Devin AI Innovative Approach.pdf
 
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry InnovationBeyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
Beyond Boundaries: Leveraging No-Code Solutions for Industry Innovation
 
DMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special EditionDMCC Future of Trade Web3 - Special Edition
DMCC Future of Trade Web3 - Special Edition
 
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmaticsKotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
Kotlin Multiplatform & Compose Multiplatform - Starter kit for pragmatics
 
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage CostLeverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
Leverage Zilliz Serverless - Up to 50X Saving for Your Vector Storage Cost
 
Unleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding ClubUnleash Your Potential - Namagunga Girls Coding Club
Unleash Your Potential - Namagunga Girls Coding Club
 
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
New from BookNet Canada for 2024: BNC CataList - Tech Forum 2024
 
Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!Nell’iperspazio con Rocket: il Framework Web di Rust!
Nell’iperspazio con Rocket: il Framework Web di Rust!
 
Training state-of-the-art general text embedding
Training state-of-the-art general text embeddingTraining state-of-the-art general text embedding
Training state-of-the-art general text embedding
 
Developer Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQLDeveloper Data Modeling Mistakes: From Postgres to NoSQL
Developer Data Modeling Mistakes: From Postgres to NoSQL
 
"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko"Debugging python applications inside k8s environment", Andrii Soldatenko
"Debugging python applications inside k8s environment", Andrii Soldatenko
 
What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024What's New in Teams Calling, Meetings and Devices March 2024
What's New in Teams Calling, Meetings and Devices March 2024
 
Commit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easyCommit 2024 - Secret Management made easy
Commit 2024 - Secret Management made easy
 

SDEC2011 Essentials of map reduce

  • 1. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Essentials of MapReduce Mastering Hadoop Map-reduce for Data Analysis Shashank Tiwari blog: shanky.org | twitter: @tshanky st@treasuryofideas.com
  • 2. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 3. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 4. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 5. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 6. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Understanding Map Reduce
  • 7. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Walk Through a Map Reduce Example • A mapper class that emits key/value pairs. • A reducer class that takes the values emitted from mapper and manipulates it to create aggregations. In the data upload example, the mapper only inserts the data into an HBase table. • A driver class that puts the mapper class and the reducer class together. • A class that triggers the job in its main method • NYSE HLOC Data Hadoop MapReduce
  • 8. Confidential, for personal use only. All original content copyright owned by Treasury of Ideas LLC. Copyright for all other & referenced work is retained by their respective owners. Questions? • blog: shanky.org | twitter: @tshanky • st@treasuryofideas.com