SlideShare uma empresa Scribd logo
1 de 19
Baixar para ler offline
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
05/27/2021
Weekday Demand
Sensing at Walmart
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Walmart Stores
Overview
• The largest grocer in the U.S.
• Walmart employs over 2.3
million associates worldwide
• Over $500B annual sales
(over $330B in the U.S.)
• Over 11,300 stores worldwide
(over 4300 stores in the U.S.)
• Over 90% of the population
in the U.S. lives within 10
miles of a Walmart store
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Smart Forecasting
• A scalable forecasting platform to improve Walmart’s ability to predict customer demand
while improving item in-stocks and reducing food waste
• Adopted by all key departments in several global markets
• Generating weekly forecast for more than 100+ million item-store combinations every
week for the next 52 weeks
• Purpose:
• Inventory control (0-6 week horizon forecast)
• Purchase/vendor order and production planning
Our mission is to drive operational efficiency through
improvements in the ability to predict
customer demand
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Table of
contents Introduction
& Motivation
Model Results
Implementation
& scale
Introduction & Motivation
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Motivation
• Our store forecasting models are trained at scale every week, and weekly forecasts are
delivered every Monday
• We do not incorporate the most recent weekend sales in training our models as our ETL
processes start soon after Friday data has come in
• The idea for In Week Adjustments (IWA) project came from a Walmart Demand Manager
who devised and implemented a working prototype to prove out the concept
• The Weekend Sales Correction process uses replenishment rules to make practical store
forecast adjustments by accounting for factors such as days of supply and case pack sizes.
• IWA algorithm leverages historical sales patterns and linear models to predict the demand
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
In-week Adjustments (IWA) Algorithm
• A simple linear modeling approach to introduce forecast enhancements based on weekend
sales
• Adjusts initial weekly demand horizon 0 forecasts for Tuesday to Friday based on Saturday
and Sunday sales. E.g. if a product sells higher than forecasted on the weekend, we could
expect the remaining week’s sales to be higher than forecasted
• This algorithmic approach has been readily adopted by our business partners and has
consistently delivered business impact over the past year
• In addition to boosting the quality of the demand forecasts the algorithm reduces forecast
adjustment touches for busy demand managers without adding additional ETL overhead
Model
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Algorithm: Training
Load Input
Data
Pre-process
data
Train Linear
Model
• Load historical weekly
demand forecasts for
target categories
• Load 52 weeks of
store-item-week sales
• Calculate each item’s
daily sales %age using
robust estimators
• Remove all store-item-
week combinations
which may not need
adjustments
• For each item, select
the store-item-week
where it is overselling
or underselling
• Train a linear model to predict
demand as:
𝒅𝒆𝒎𝒂𝒏𝒅 ~ 𝒒𝒕𝒚𝒔𝒂𝒕 + 𝒒𝒕𝒚𝒔𝒖𝒏 + 𝒇𝒐𝒓𝒆𝒄𝒂𝒔𝒕
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Algorithm: Scoring
Pull current week sales data including Saturday, Sunday sales, on
hand qty, Saturday stock, received qty and promotions
Score current week store-item combinations using the model
𝒇𝒐𝒓𝒆𝒄𝒂𝒔𝒕 𝒂𝒅𝒋𝒖𝒔𝒕𝒎𝒆𝒏𝒕 = 𝒔𝒄𝒐𝒓𝒆𝒅 𝒑𝒓𝒆𝒅𝒊𝒄𝒕𝒊𝒐𝒏 − 𝒇𝒐𝒓𝒆𝒄𝒂𝒔𝒕
Accept the scored prediction as the new forecast if the
adjustment suggests adjusting store inventory based on the
current on hand quantity and case pack sizes of the item
Results
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Evaluation & Impact
• We performed a comprehensive back-test across all categories in produce and grocery for
a period of 12 weeks
• As shown in the plot below, IWA showed tremendous promise as evidenced by BPS
improvement in over 70% of produce categories
Walmart	produce	categories
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Impact Contd.
For the produce department, the algorithm has consistently delivered week on week 40+
basis points improvement in the forecast accuracy metric.
Implementation & scale
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Model Implementation
Current Scope – Runs for one department : Produce
• Input data stored in HDFS, Teradata and NFS drive
• Model runs on a single server, parallelized across 56 cores
Why Spark?
Enable scale up to new departments and markets through:
1. Cloud data storage: The current data storage is split across HDFS & Teradata which is
difficult to maintain and refresh. Redundant file transfer between storage systems
Spark ecosystem offers blob storage + Hive (delta tables) as a unified data storage
solution for easy maintainability
2. Runtime improvement: Partitioning the data by item will help large forecast and sales
files to be processed faster. Parquet I/O is lot faster than CSV
By saving runtime we will be able to train and score for more departments and
markets without risking high compute costs
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Planned Implementation
Data Storage
Data stored in
blob storage as
parquet
files partitioned
by item
Model training &
scoring
Parallelized
implementation
of the model on
Spark using
Spark DFs
Model outputs
Model outputs
saved to parquet
Model integrated
with the Smart
forecasting
platform
©2021 Walmart Inc. All Rights Reserved.
SENSITIVE INFORMATION CLASSIFICATION
Conclusion
Since its implementation in
March 2019, the IWA algorithm
has successfully delivered
hundreds of basis points
improvements week on week,
and helped reduce food waste
and improve customer availability
Thank you!();
Divya Hindupur
Jay Kakkar
Johann Posch
John Bowman
Feedback
Your feedback is important to us.
Don’t forget to rate and review the
sessions.

Mais conteúdo relacionado

Mais procurados

Distribution Systems in the Retail Industry a Walmart Case Study
Distribution Systems in the Retail Industrya Walmart Case StudyDistribution Systems in the Retail Industrya Walmart Case Study
Distribution Systems in the Retail Industry a Walmart Case Study InaAnt
 
Amazon.com Strategic Analysis
Amazon.com Strategic AnalysisAmazon.com Strategic Analysis
Amazon.com Strategic AnalysisMax Jallifier
 
Unilever strategic marketing
Unilever strategic marketingUnilever strategic marketing
Unilever strategic marketingguest84d97e
 
Supply Chain Management - Walmart
Supply Chain Management - WalmartSupply Chain Management - Walmart
Supply Chain Management - WalmartSweta Ramdas
 
Amazon.com History, Facts n lots more
Amazon.com History, Facts n lots moreAmazon.com History, Facts n lots more
Amazon.com History, Facts n lots moreMVIT
 
Pricing Analytics Case Study
Pricing Analytics Case StudyPricing Analytics Case Study
Pricing Analytics Case StudyMichael Wolfe
 
Seven- Eleven Japan Co. Case Analysis
Seven- Eleven Japan Co. Case AnalysisSeven- Eleven Japan Co. Case Analysis
Seven- Eleven Japan Co. Case AnalysisGeeta Hansdah
 
IKEA - STRATEGIC RETAILING
IKEA - STRATEGIC RETAILING IKEA - STRATEGIC RETAILING
IKEA - STRATEGIC RETAILING Roshan Jacob
 
Walmart value chain analysis
Walmart value chain analysisWalmart value chain analysis
Walmart value chain analysisArpan Ghosh
 
Case Study on Product Management for an ed-tech company (Biswadeep Ghosh Hazr...
Case Study on Product Management for an ed-tech company (Biswadeep Ghosh Hazr...Case Study on Product Management for an ed-tech company (Biswadeep Ghosh Hazr...
Case Study on Product Management for an ed-tech company (Biswadeep Ghosh Hazr...Biswadeep Ghosh Hazra
 

Mais procurados (20)

Walmart's SCM
Walmart's SCMWalmart's SCM
Walmart's SCM
 
Walmart ppt
Walmart pptWalmart ppt
Walmart ppt
 
Distribution Systems in the Retail Industry a Walmart Case Study
Distribution Systems in the Retail Industrya Walmart Case StudyDistribution Systems in the Retail Industrya Walmart Case Study
Distribution Systems in the Retail Industry a Walmart Case Study
 
Walmart
WalmartWalmart
Walmart
 
Amazon.com Strategic Analysis
Amazon.com Strategic AnalysisAmazon.com Strategic Analysis
Amazon.com Strategic Analysis
 
Case analysis walmart case group i
Case analysis walmart case group iCase analysis walmart case group i
Case analysis walmart case group i
 
Unilever strategic marketing
Unilever strategic marketingUnilever strategic marketing
Unilever strategic marketing
 
Supply Chain Management - Walmart
Supply Chain Management - WalmartSupply Chain Management - Walmart
Supply Chain Management - Walmart
 
Case study of IKEA
Case study of IKEACase study of IKEA
Case study of IKEA
 
Amazon.com History, Facts n lots more
Amazon.com History, Facts n lots moreAmazon.com History, Facts n lots more
Amazon.com History, Facts n lots more
 
Pricing Analytics Case Study
Pricing Analytics Case StudyPricing Analytics Case Study
Pricing Analytics Case Study
 
Seven- Eleven Japan Co. Case Analysis
Seven- Eleven Japan Co. Case AnalysisSeven- Eleven Japan Co. Case Analysis
Seven- Eleven Japan Co. Case Analysis
 
IKEA - STRATEGIC RETAILING
IKEA - STRATEGIC RETAILING IKEA - STRATEGIC RETAILING
IKEA - STRATEGIC RETAILING
 
Wirlpool ppt
Wirlpool pptWirlpool ppt
Wirlpool ppt
 
Walmart
WalmartWalmart
Walmart
 
Hp case study
Hp case studyHp case study
Hp case study
 
Walmart value chain analysis
Walmart value chain analysisWalmart value chain analysis
Walmart value chain analysis
 
Case Study on Product Management for an ed-tech company (Biswadeep Ghosh Hazr...
Case Study on Product Management for an ed-tech company (Biswadeep Ghosh Hazr...Case Study on Product Management for an ed-tech company (Biswadeep Ghosh Hazr...
Case Study on Product Management for an ed-tech company (Biswadeep Ghosh Hazr...
 
Hrm of walmart
Hrm of walmartHrm of walmart
Hrm of walmart
 
Sears Final Project
Sears Final ProjectSears Final Project
Sears Final Project
 

Semelhante a Weekday Demand Sensing at Walmart

130219 CPC Introduction AE
130219 CPC Introduction AE130219 CPC Introduction AE
130219 CPC Introduction AERohit Dandona
 
HICAM Presentation Oracle Symposium.pdf
HICAM Presentation Oracle Symposium.pdfHICAM Presentation Oracle Symposium.pdf
HICAM Presentation Oracle Symposium.pdfBrianVolentine1
 
Swift-sense Slides
Swift-sense Slides Swift-sense Slides
Swift-sense Slides Affan javaid
 
Joachim_Sculte_Hungary_Appsday_Demantra_081007.ppt
Joachim_Sculte_Hungary_Appsday_Demantra_081007.pptJoachim_Sculte_Hungary_Appsday_Demantra_081007.ppt
Joachim_Sculte_Hungary_Appsday_Demantra_081007.pptbhagatsingh9
 
Data warehousing - Dr. Radhika Kotecha
Data warehousing - Dr. Radhika KotechaData warehousing - Dr. Radhika Kotecha
Data warehousing - Dr. Radhika KotechaRadhika Kotecha
 
Analytic servise BI Datawiz
Analytic servise BI DatawizAnalytic servise BI Datawiz
Analytic servise BI DatawizDatawiz.io
 
Leading a Supply Chain Turnaround - Whirlpool
Leading a Supply Chain Turnaround - WhirlpoolLeading a Supply Chain Turnaround - Whirlpool
Leading a Supply Chain Turnaround - WhirlpoolLokendra Singh Rathore
 
1.1DetailsCase Study Scenario - Global Trading PLCGlo.docx
1.1DetailsCase Study Scenario - Global Trading PLCGlo.docx1.1DetailsCase Study Scenario - Global Trading PLCGlo.docx
1.1DetailsCase Study Scenario - Global Trading PLCGlo.docxelliotkimberlee
 
Speed without accidents : Kafka Exemplified | Dhawal Soni and Suman Pattnaik,...
Speed without accidents : Kafka Exemplified | Dhawal Soni and Suman Pattnaik,...Speed without accidents : Kafka Exemplified | Dhawal Soni and Suman Pattnaik,...
Speed without accidents : Kafka Exemplified | Dhawal Soni and Suman Pattnaik,...HostedbyConfluent
 
CM Webinar B2C EMI Preview
CM Webinar B2C EMI PreviewCM Webinar B2C EMI Preview
CM Webinar B2C EMI PreviewMirakl
 
Magneto implementation by synoptek
Magneto implementation by synoptekMagneto implementation by synoptek
Magneto implementation by synoptekNandita Nityanandam
 
Inventory Optimization for Multi-Location Distribution
Inventory Optimization for Multi-Location DistributionInventory Optimization for Multi-Location Distribution
Inventory Optimization for Multi-Location DistributionJim Kolassa
 
439 Michael Zazzera Hyperion Final - Soulutions 2001
439 Michael Zazzera Hyperion Final - Soulutions 2001439 Michael Zazzera Hyperion Final - Soulutions 2001
439 Michael Zazzera Hyperion Final - Soulutions 2001Michael Zazzera
 
Data warehousev2.1
Data warehousev2.1Data warehousev2.1
Data warehousev2.1Tuan Luong
 
SALES_FORECASTING of sparkflows.pdf
SALES_FORECASTING of sparkflows.pdfSALES_FORECASTING of sparkflows.pdf
SALES_FORECASTING of sparkflows.pdfSparkflows
 
Webinar_DemandPlanning_Forecasting.pdf
Webinar_DemandPlanning_Forecasting.pdfWebinar_DemandPlanning_Forecasting.pdf
Webinar_DemandPlanning_Forecasting.pdfssuser252a1f
 
Land O' Lakes: Harnessing Big Data Variety
Land O' Lakes: Harnessing Big Data VarietyLand O' Lakes: Harnessing Big Data Variety
Land O' Lakes: Harnessing Big Data VarietyAlithya
 
Ucg ems-distribution-november2013
Ucg ems-distribution-november2013Ucg ems-distribution-november2013
Ucg ems-distribution-november2013Noah Truax
 

Semelhante a Weekday Demand Sensing at Walmart (20)

130219 CPC Introduction AE
130219 CPC Introduction AE130219 CPC Introduction AE
130219 CPC Introduction AE
 
HICAM Presentation Oracle Symposium.pdf
HICAM Presentation Oracle Symposium.pdfHICAM Presentation Oracle Symposium.pdf
HICAM Presentation Oracle Symposium.pdf
 
Swift-sense Slides
Swift-sense Slides Swift-sense Slides
Swift-sense Slides
 
Joachim_Sculte_Hungary_Appsday_Demantra_081007.ppt
Joachim_Sculte_Hungary_Appsday_Demantra_081007.pptJoachim_Sculte_Hungary_Appsday_Demantra_081007.ppt
Joachim_Sculte_Hungary_Appsday_Demantra_081007.ppt
 
Data warehousing - Dr. Radhika Kotecha
Data warehousing - Dr. Radhika KotechaData warehousing - Dr. Radhika Kotecha
Data warehousing - Dr. Radhika Kotecha
 
KRANTHI_ABAP_RESUME
KRANTHI_ABAP_RESUMEKRANTHI_ABAP_RESUME
KRANTHI_ABAP_RESUME
 
Analytic servise BI Datawiz
Analytic servise BI DatawizAnalytic servise BI Datawiz
Analytic servise BI Datawiz
 
Leading a Supply Chain Turnaround - Whirlpool
Leading a Supply Chain Turnaround - WhirlpoolLeading a Supply Chain Turnaround - Whirlpool
Leading a Supply Chain Turnaround - Whirlpool
 
1.1DetailsCase Study Scenario - Global Trading PLCGlo.docx
1.1DetailsCase Study Scenario - Global Trading PLCGlo.docx1.1DetailsCase Study Scenario - Global Trading PLCGlo.docx
1.1DetailsCase Study Scenario - Global Trading PLCGlo.docx
 
Speed without accidents : Kafka Exemplified | Dhawal Soni and Suman Pattnaik,...
Speed without accidents : Kafka Exemplified | Dhawal Soni and Suman Pattnaik,...Speed without accidents : Kafka Exemplified | Dhawal Soni and Suman Pattnaik,...
Speed without accidents : Kafka Exemplified | Dhawal Soni and Suman Pattnaik,...
 
BEFORE! Predictive Analytics
BEFORE! Predictive Analytics BEFORE! Predictive Analytics
BEFORE! Predictive Analytics
 
CM Webinar B2C EMI Preview
CM Webinar B2C EMI PreviewCM Webinar B2C EMI Preview
CM Webinar B2C EMI Preview
 
Magneto implementation by synoptek
Magneto implementation by synoptekMagneto implementation by synoptek
Magneto implementation by synoptek
 
Inventory Optimization for Multi-Location Distribution
Inventory Optimization for Multi-Location DistributionInventory Optimization for Multi-Location Distribution
Inventory Optimization for Multi-Location Distribution
 
439 Michael Zazzera Hyperion Final - Soulutions 2001
439 Michael Zazzera Hyperion Final - Soulutions 2001439 Michael Zazzera Hyperion Final - Soulutions 2001
439 Michael Zazzera Hyperion Final - Soulutions 2001
 
Data warehousev2.1
Data warehousev2.1Data warehousev2.1
Data warehousev2.1
 
SALES_FORECASTING of sparkflows.pdf
SALES_FORECASTING of sparkflows.pdfSALES_FORECASTING of sparkflows.pdf
SALES_FORECASTING of sparkflows.pdf
 
Webinar_DemandPlanning_Forecasting.pdf
Webinar_DemandPlanning_Forecasting.pdfWebinar_DemandPlanning_Forecasting.pdf
Webinar_DemandPlanning_Forecasting.pdf
 
Land O' Lakes: Harnessing Big Data Variety
Land O' Lakes: Harnessing Big Data VarietyLand O' Lakes: Harnessing Big Data Variety
Land O' Lakes: Harnessing Big Data Variety
 
Ucg ems-distribution-november2013
Ucg ems-distribution-november2013Ucg ems-distribution-november2013
Ucg ems-distribution-november2013
 

Mais de Databricks

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDatabricks
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Databricks
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Databricks
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Databricks
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Databricks
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of HadoopDatabricks
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDatabricks
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceDatabricks
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringDatabricks
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixDatabricks
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationDatabricks
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchDatabricks
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesDatabricks
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesDatabricks
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsDatabricks
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkDatabricks
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkDatabricks
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesDatabricks
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkDatabricks
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeDatabricks
 

Mais de Databricks (20)

DW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptxDW Migration Webinar-March 2022.pptx
DW Migration Webinar-March 2022.pptx
 
Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1Data Lakehouse Symposium | Day 1 | Part 1
Data Lakehouse Symposium | Day 1 | Part 1
 
Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2Data Lakehouse Symposium | Day 1 | Part 2
Data Lakehouse Symposium | Day 1 | Part 2
 
Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2Data Lakehouse Symposium | Day 2
Data Lakehouse Symposium | Day 2
 
Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4Data Lakehouse Symposium | Day 4
Data Lakehouse Symposium | Day 4
 
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
5 Critical Steps to Clean Your Data Swamp When Migrating Off of Hadoop
 
Democratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized PlatformDemocratizing Data Quality Through a Centralized Platform
Democratizing Data Quality Through a Centralized Platform
 
Learn to Use Databricks for Data Science
Learn to Use Databricks for Data ScienceLearn to Use Databricks for Data Science
Learn to Use Databricks for Data Science
 
Why APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML MonitoringWhy APM Is Not the Same As ML Monitoring
Why APM Is Not the Same As ML Monitoring
 
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch FixThe Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
The Function, the Context, and the Data—Enabling ML Ops at Stitch Fix
 
Stage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI IntegrationStage Level Scheduling Improving Big Data and AI Integration
Stage Level Scheduling Improving Big Data and AI Integration
 
Simplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorchSimplify Data Conversion from Spark to TensorFlow and PyTorch
Simplify Data Conversion from Spark to TensorFlow and PyTorch
 
Scaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on KubernetesScaling your Data Pipelines with Apache Spark on Kubernetes
Scaling your Data Pipelines with Apache Spark on Kubernetes
 
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark PipelinesScaling and Unifying SciKit Learn and Apache Spark Pipelines
Scaling and Unifying SciKit Learn and Apache Spark Pipelines
 
Sawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature AggregationsSawtooth Windows for Feature Aggregations
Sawtooth Windows for Feature Aggregations
 
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen SinkRedis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
Redis + Apache Spark = Swiss Army Knife Meets Kitchen Sink
 
Re-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and SparkRe-imagine Data Monitoring with whylogs and Spark
Re-imagine Data Monitoring with whylogs and Spark
 
Raven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction QueriesRaven: End-to-end Optimization of ML Prediction Queries
Raven: End-to-end Optimization of ML Prediction Queries
 
Processing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache SparkProcessing Large Datasets for ADAS Applications using Apache Spark
Processing Large Datasets for ADAS Applications using Apache Spark
 
Massive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta LakeMassive Data Processing in Adobe Using Delta Lake
Massive Data Processing in Adobe Using Delta Lake
 

Último

Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz1
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Researchmichael115558
 
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...amitlee9823
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...SUHANI PANDEY
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysismanisha194592
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% SecurePooja Nehwal
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...amitlee9823
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxolyaivanovalion
 
Ravak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxRavak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxolyaivanovalion
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...amitlee9823
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxolyaivanovalion
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Standamitlee9823
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxolyaivanovalion
 
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfAccredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfadriantubila
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxolyaivanovalion
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusTimothy Spann
 

Último (20)

Invezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signalsInvezz.com - Grow your wealth with trading signals
Invezz.com - Grow your wealth with trading signals
 
Discover Why Less is More in B2B Research
Discover Why Less is More in B2B ResearchDiscover Why Less is More in B2B Research
Discover Why Less is More in B2B Research
 
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
Call Girls Jalahalli Just Call 👗 7737669865 👗 Top Class Call Girl Service Ban...
 
Sampling (random) method and Non random.ppt
Sampling (random) method and Non random.pptSampling (random) method and Non random.ppt
Sampling (random) method and Non random.ppt
 
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
VIP Model Call Girls Hinjewadi ( Pune ) Call ON 8005736733 Starting From 5K t...
 
April 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's AnalysisApril 2024 - Crypto Market Report's Analysis
April 2024 - Crypto Market Report's Analysis
 
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% SecureCall me @ 9892124323  Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
Call me @ 9892124323 Cheap Rate Call Girls in Vashi with Real Photo 100% Secure
 
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get CytotecAbortion pills in Doha Qatar (+966572737505 ! Get Cytotec
Abortion pills in Doha Qatar (+966572737505 ! Get Cytotec
 
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
Chintamani Call Girls: 🍓 7737669865 🍓 High Profile Model Escorts | Bangalore ...
 
Carero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptxCarero dropshipping via API with DroFx.pptx
Carero dropshipping via API with DroFx.pptx
 
Ravak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptxRavak dropshipping via API with DroFx.pptx
Ravak dropshipping via API with DroFx.pptx
 
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
Mg Road Call Girls Service: 🍓 7737669865 🍓 High Profile Model Escorts | Banga...
 
BabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptxBabyOno dropshipping via API with DroFx.pptx
BabyOno dropshipping via API with DroFx.pptx
 
Anomaly detection and data imputation within time series
Anomaly detection and data imputation within time seriesAnomaly detection and data imputation within time series
Anomaly detection and data imputation within time series
 
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night StandCall Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
Call Girls In Bellandur ☎ 7737669865 🥵 Book Your One night Stand
 
CebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptxCebaBaby dropshipping via API with DroFX.pptx
CebaBaby dropshipping via API with DroFX.pptx
 
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICECHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
CHEAP Call Girls in Saket (-DELHI )🔝 9953056974🔝(=)/CALL GIRLS SERVICE
 
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdfAccredited-Transport-Cooperatives-Jan-2021-Web.pdf
Accredited-Transport-Cooperatives-Jan-2021-Web.pdf
 
Smarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptxSmarteg dropshipping via API with DroFx.pptx
Smarteg dropshipping via API with DroFx.pptx
 
Generative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and MilvusGenerative AI on Enterprise Cloud with NiFi and Milvus
Generative AI on Enterprise Cloud with NiFi and Milvus
 

Weekday Demand Sensing at Walmart

  • 1. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION 05/27/2021 Weekday Demand Sensing at Walmart
  • 2. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Walmart Stores Overview • The largest grocer in the U.S. • Walmart employs over 2.3 million associates worldwide • Over $500B annual sales (over $330B in the U.S.) • Over 11,300 stores worldwide (over 4300 stores in the U.S.) • Over 90% of the population in the U.S. lives within 10 miles of a Walmart store
  • 3. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Smart Forecasting • A scalable forecasting platform to improve Walmart’s ability to predict customer demand while improving item in-stocks and reducing food waste • Adopted by all key departments in several global markets • Generating weekly forecast for more than 100+ million item-store combinations every week for the next 52 weeks • Purpose: • Inventory control (0-6 week horizon forecast) • Purchase/vendor order and production planning Our mission is to drive operational efficiency through improvements in the ability to predict customer demand
  • 4. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Table of contents Introduction & Motivation Model Results Implementation & scale
  • 6. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Motivation • Our store forecasting models are trained at scale every week, and weekly forecasts are delivered every Monday • We do not incorporate the most recent weekend sales in training our models as our ETL processes start soon after Friday data has come in • The idea for In Week Adjustments (IWA) project came from a Walmart Demand Manager who devised and implemented a working prototype to prove out the concept • The Weekend Sales Correction process uses replenishment rules to make practical store forecast adjustments by accounting for factors such as days of supply and case pack sizes. • IWA algorithm leverages historical sales patterns and linear models to predict the demand
  • 7. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION In-week Adjustments (IWA) Algorithm • A simple linear modeling approach to introduce forecast enhancements based on weekend sales • Adjusts initial weekly demand horizon 0 forecasts for Tuesday to Friday based on Saturday and Sunday sales. E.g. if a product sells higher than forecasted on the weekend, we could expect the remaining week’s sales to be higher than forecasted • This algorithmic approach has been readily adopted by our business partners and has consistently delivered business impact over the past year • In addition to boosting the quality of the demand forecasts the algorithm reduces forecast adjustment touches for busy demand managers without adding additional ETL overhead
  • 9. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Algorithm: Training Load Input Data Pre-process data Train Linear Model • Load historical weekly demand forecasts for target categories • Load 52 weeks of store-item-week sales • Calculate each item’s daily sales %age using robust estimators • Remove all store-item- week combinations which may not need adjustments • For each item, select the store-item-week where it is overselling or underselling • Train a linear model to predict demand as: 𝒅𝒆𝒎𝒂𝒏𝒅 ~ 𝒒𝒕𝒚𝒔𝒂𝒕 + 𝒒𝒕𝒚𝒔𝒖𝒏 + 𝒇𝒐𝒓𝒆𝒄𝒂𝒔𝒕
  • 10. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Algorithm: Scoring Pull current week sales data including Saturday, Sunday sales, on hand qty, Saturday stock, received qty and promotions Score current week store-item combinations using the model 𝒇𝒐𝒓𝒆𝒄𝒂𝒔𝒕 𝒂𝒅𝒋𝒖𝒔𝒕𝒎𝒆𝒏𝒕 = 𝒔𝒄𝒐𝒓𝒆𝒅 𝒑𝒓𝒆𝒅𝒊𝒄𝒕𝒊𝒐𝒏 − 𝒇𝒐𝒓𝒆𝒄𝒂𝒔𝒕 Accept the scored prediction as the new forecast if the adjustment suggests adjusting store inventory based on the current on hand quantity and case pack sizes of the item
  • 12. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Evaluation & Impact • We performed a comprehensive back-test across all categories in produce and grocery for a period of 12 weeks • As shown in the plot below, IWA showed tremendous promise as evidenced by BPS improvement in over 70% of produce categories Walmart produce categories
  • 13. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Impact Contd. For the produce department, the algorithm has consistently delivered week on week 40+ basis points improvement in the forecast accuracy metric.
  • 15. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Model Implementation Current Scope – Runs for one department : Produce • Input data stored in HDFS, Teradata and NFS drive • Model runs on a single server, parallelized across 56 cores Why Spark? Enable scale up to new departments and markets through: 1. Cloud data storage: The current data storage is split across HDFS & Teradata which is difficult to maintain and refresh. Redundant file transfer between storage systems Spark ecosystem offers blob storage + Hive (delta tables) as a unified data storage solution for easy maintainability 2. Runtime improvement: Partitioning the data by item will help large forecast and sales files to be processed faster. Parquet I/O is lot faster than CSV By saving runtime we will be able to train and score for more departments and markets without risking high compute costs
  • 16. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Planned Implementation Data Storage Data stored in blob storage as parquet files partitioned by item Model training & scoring Parallelized implementation of the model on Spark using Spark DFs Model outputs Model outputs saved to parquet Model integrated with the Smart forecasting platform
  • 17. ©2021 Walmart Inc. All Rights Reserved. SENSITIVE INFORMATION CLASSIFICATION Conclusion Since its implementation in March 2019, the IWA algorithm has successfully delivered hundreds of basis points improvements week on week, and helped reduce food waste and improve customer availability
  • 18. Thank you!(); Divya Hindupur Jay Kakkar Johann Posch John Bowman
  • 19. Feedback Your feedback is important to us. Don’t forget to rate and review the sessions.