stackconf 2023 | Dynamic Image Optimization with imgproxy at Schwarz IT by Andreas Lehr.pdf

NETWAYS
NETWAYSNETWAYS
Dynamic Image Optimization with
imgproxy at Schwarz IT
An d r e a s L e h r, s t a c k c o n f 1 3 . 0 9 . 2 0 2 3
about me
➢ Passionate for all things powering
the modern web.​
➢ Interested in and helping with all
challenges around cloud,
scaling, reliability and monitoring.
➢ SRE at STACKIT
➢ Newsletter "allesnurgecloud.com"
➢ Podcast "Happy Bootstrapping"
➢ @shakalandy
4 3 , f a t h e r o f 3 , s w a b i a n g e r m a n
Retail
The Schwarz Group
Recyclables
Production
Shaping a
sustainable company
Europe's largest trading
company
Less plastic / Close the loop
Ensuring the supply of the
Schwarz Group
SIMPLE
SECURE
STABLE
OUR TARGET IMAGE 2025
Cloud transformation of the Schwarz Group
12.09.2023 STACKIT Onboarding 5
80%
20%
Cloud
Enterprise IT
Images are everywhere
6
7
8
Past & Present
„Solutions“​
o r w h y w e n e e d „ D y n a m i c
I m a g e O p t i m i za t i o n “.
SHIT IN – SHIT OUT.
The „Shit In – Shit Out“ Problem​
Images delivered as uploaded
variations in Size and Quality​
CMS restrictions not sustainable​
metadata included​
Bad User Experience
11
Unfortunately….​
12
„SHIT IN – SHIT OUT“
is still there in 20223
the “42 resolutions“ solution
The „42 resolutions“ solution
14
Upload Source
Batch Job creates 42 solutions
Images are not live
Takes a lot of CPU
Bad CMS User Experience
Images account for 42 % of
the Largest Contentful Paint
(LCP) element for websites
We b - Pe r f o r m a n c e i m p o r t a n t d u e t o
impact on
 Customer Experience
 Conversion rate
 SEO
 and more
12.09.2023
Fußzeile 15
WebP and AVIF
to the rescue
17
WebP
• released 2010
• Better compression than JPEG
& PNG
• Finally supported in Safari since
09/2022
• widespread
• caniuse.com/webp
AVIF
• released 2019
• Image Version of AV1
• driven by Netflix
• Open Source
• will supersede WebP
• use when bandwith is priority
• caniuse.com/avif
Modern image Formats
WebP and AVIF to the rescue
12.09.2023 18
Shopping cart JPEG (413 kb)
12.09.2023 19
Shopping cart webp (226kb)
12.09.2023 20
Shopping cart AVIF(195kb)
Doing the math
12.09.2023 21
requests JPEG WEBP AVIF hint
1 413 KB 226 KB 195 KB 1 image
10 4,13 MB 2,26 MB 1,95 MB 10 images per page
10000 4,13 GB 2,26 GB 1,95 GB 100 page impressions
1.000.000 4,13 TB 2,26 TB 1,95 TB 100.000 pi
10.000.000 41,3 TB 22,6 TB 19,5 TB 1 millionpi
100.000.000 413 TB 226 TB 195 TB 10 mio pi
The carefree solution
meet imgproxy
„ D y n a m i c I m a g e
O p t i m i za t i o n“ d o n e r i g h t
About imgproxy
24
• Open-Source Project by Evil Martians
• Developed in GO code using libvips
• 55+ features
• all Security features included in OS
• Paid Version available
• See NASA demo on imgproxy.net
Digital Leaflets
D i g i t a l F l y e r f o r a l l K a u f l a n d & L i d l C o u n t r i e s
▪ Separation in multiple applications
▪ imgproxy for Images
▪ Managed databases
▪ Object Storage for PDFs & Images
▪ Direct PDF delivery / CDN for images
▪ Cost transparency
26
1,9 TB Source Images
5,278,808,359 requests – only 4,742,986 at origin
751 TB traffic – only 925GB at origin
mean requests: 1.970 rps vs. 1,77 rps
mean bandwith: 2.24 Gbps vs 2.8 Mbps
Some figures
27
AppCloud Instances for Leaflets
Autoscaling in Action
DEMO Time
Key Takeaways
30
don‘t reinvent the wheel
check WebP & AVIF
use autoscaling & descaling
Checkout imgproxy
Key Takeaways
31
Questions? Thank you!
1 de 30

Recomendados

Has responsive had it's day? : Amplience Customer Day 2014 por
Has responsive had it's day? : Amplience Customer Day 2014Has responsive had it's day? : Amplience Customer Day 2014
Has responsive had it's day? : Amplience Customer Day 2014Ben Seymour
616 visualizações82 slides
Andreas Zeitler (Vuframe): Virtual & Augmented Business: How to Discover and ... por
Andreas Zeitler (Vuframe): Virtual & Augmented Business: How to Discover and ...Andreas Zeitler (Vuframe): Virtual & Augmented Business: How to Discover and ...
Andreas Zeitler (Vuframe): Virtual & Augmented Business: How to Discover and ...AugmentedWorldExpo
192 visualizações28 slides
Cairo Graphics Kit por
Cairo Graphics KitCairo Graphics Kit
Cairo Graphics KitESUG
1.3K visualizações20 slides
Kernel Con 2022: Securing Cloud Native Workloads por
Kernel Con 2022: Securing Cloud Native WorkloadsKernel Con 2022: Securing Cloud Native Workloads
Kernel Con 2022: Securing Cloud Native WorkloadsGabriel Schuyler
218 visualizações15 slides
CloudCamp por
CloudCampCloudCamp
CloudCampRightScale
624 visualizações91 slides
How the hell do I run my microservices in production, and will it scale? por
How the hell do I run my microservices in production, and will it scale?How the hell do I run my microservices in production, and will it scale?
How the hell do I run my microservices in production, and will it scale?Katarzyna Hoffman
226 visualizações52 slides

Mais conteúdo relacionado

Similar a stackconf 2023 | Dynamic Image Optimization with imgproxy at Schwarz IT by Andreas Lehr.pdf

Prepare for the Mobilacalypse por
Prepare for the MobilacalypsePrepare for the Mobilacalypse
Prepare for the MobilacalypseJeff Eaton
1.6K visualizações60 slides
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat... por
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...Henning Jacobs
535 visualizações99 slides
CloudStack - Apache's best kept secret por
CloudStack - Apache's best kept secretCloudStack - Apache's best kept secret
CloudStack - Apache's best kept secretShapeBlue
253 visualizações44 slides
[drupalday2017] - Speed-up your Drupal instance! por
[drupalday2017] - Speed-up your Drupal instance![drupalday2017] - Speed-up your Drupal instance!
[drupalday2017] - Speed-up your Drupal instance!DrupalDay
352 visualizações63 slides
Speed up your Drupal instance!! por
Speed up your Drupal instance!!Speed up your Drupal instance!!
Speed up your Drupal instance!!bmeme
239 visualizações63 slides
John Landry at Mass TLC Feb09 por
John Landry at Mass TLC Feb09John Landry at Mass TLC Feb09
John Landry at Mass TLC Feb09John Landry
590 visualizações51 slides

Similar a stackconf 2023 | Dynamic Image Optimization with imgproxy at Schwarz IT by Andreas Lehr.pdf(20)

Prepare for the Mobilacalypse por Jeff Eaton
Prepare for the MobilacalypsePrepare for the Mobilacalypse
Prepare for the Mobilacalypse
Jeff Eaton1.6K visualizações
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat... por Henning Jacobs
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...
Why we don’t use the Term DevOps: the Journey to a Product Mindset - Destinat...
Henning Jacobs535 visualizações
CloudStack - Apache's best kept secret por ShapeBlue
CloudStack - Apache's best kept secretCloudStack - Apache's best kept secret
CloudStack - Apache's best kept secret
ShapeBlue253 visualizações
[drupalday2017] - Speed-up your Drupal instance! por DrupalDay
[drupalday2017] - Speed-up your Drupal instance![drupalday2017] - Speed-up your Drupal instance!
[drupalday2017] - Speed-up your Drupal instance!
DrupalDay352 visualizações
Speed up your Drupal instance!! por bmeme
Speed up your Drupal instance!!Speed up your Drupal instance!!
Speed up your Drupal instance!!
bmeme239 visualizações
John Landry at Mass TLC Feb09 por John Landry
John Landry at Mass TLC Feb09John Landry at Mass TLC Feb09
John Landry at Mass TLC Feb09
John Landry590 visualizações
Adobe Managed Services: Complicated Cloud Deployments by Adam Pazik, Mike Til... por AEM HUB
Adobe Managed Services: Complicated Cloud Deployments by Adam Pazik, Mike Til...Adobe Managed Services: Complicated Cloud Deployments by Adam Pazik, Mike Til...
Adobe Managed Services: Complicated Cloud Deployments by Adam Pazik, Mike Til...
AEM HUB1.6K visualizações
Superfast Business - Moving to the Cloud por Superfast Business
Superfast Business - Moving to the CloudSuperfast Business - Moving to the Cloud
Superfast Business - Moving to the Cloud
Superfast Business1.2K visualizações
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP por Daniel Zivkovic
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCPSimpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
Simpler, faster, cheaper Enterprise Apps using only Spring Boot on GCP
Daniel Zivkovic189 visualizações
Future Proof Development por Jeff Segars
Future Proof DevelopmentFuture Proof Development
Future Proof Development
Jeff Segars982 visualizações
Webinar - Order out of Chaos: Avoiding the Migration Migraine por Peak Hosting
Webinar - Order out of Chaos: Avoiding the Migration MigraineWebinar - Order out of Chaos: Avoiding the Migration Migraine
Webinar - Order out of Chaos: Avoiding the Migration Migraine
Peak Hosting846 visualizações
Cloud Driven Development: a better workflow, less worries, and more power por Marzee Labs
Cloud Driven Development: a better workflow, less worries, and more powerCloud Driven Development: a better workflow, less worries, and more power
Cloud Driven Development: a better workflow, less worries, and more power
Marzee Labs1.5K visualizações
PuppetConf 2017: Cloud, Containers, Puppet and You- Carl Caum, Puppet por Puppet
PuppetConf 2017: Cloud, Containers, Puppet and You- Carl Caum, PuppetPuppetConf 2017: Cloud, Containers, Puppet and You- Carl Caum, Puppet
PuppetConf 2017: Cloud, Containers, Puppet and You- Carl Caum, Puppet
Puppet246 visualizações
Webinar | So You Think You Know the Cloud: Hosting Alternatives You May Not K... por Peak Hosting
Webinar | So You Think You Know the Cloud: Hosting Alternatives You May Not K...Webinar | So You Think You Know the Cloud: Hosting Alternatives You May Not K...
Webinar | So You Think You Know the Cloud: Hosting Alternatives You May Not K...
Peak Hosting535 visualizações
MTC Spring 2013 - crossplatform woes - robert virkus - 2013-03-13 por Enough Software
MTC Spring 2013 -  crossplatform woes - robert virkus - 2013-03-13MTC Spring 2013 -  crossplatform woes - robert virkus - 2013-03-13
MTC Spring 2013 - crossplatform woes - robert virkus - 2013-03-13
Enough Software468 visualizações
Drbd9 and drbdmanage_june_2016 por Philipp Reisner
Drbd9 and drbdmanage_june_2016Drbd9 and drbdmanage_june_2016
Drbd9 and drbdmanage_june_2016
Philipp Reisner937 visualizações
Thinking after that disaster in cloud por Amazon Web Services
Thinking after that disaster in cloudThinking after that disaster in cloud
Thinking after that disaster in cloud
Amazon Web Services257 visualizações
From Data Science to Production - deploy, scale, enjoy! / PyData Amsterdam - ... por Sergii Khomenko
From Data Science to Production - deploy, scale, enjoy! / PyData Amsterdam - ...From Data Science to Production - deploy, scale, enjoy! / PyData Amsterdam - ...
From Data Science to Production - deploy, scale, enjoy! / PyData Amsterdam - ...
Sergii Khomenko1K visualizações
DockerCon EU 2015: Day 1 General Session por Docker, Inc.
DockerCon EU 2015: Day 1 General SessionDockerCon EU 2015: Day 1 General Session
DockerCon EU 2015: Day 1 General Session
Docker, Inc.37.7K visualizações
To G or not to G por Peter Batty
To G or not to GTo G or not to G
To G or not to G
Peter Batty1.2K visualizações

Último

Serial Acquisitions and Industry Roll-ups – GOGA – December 2023 OECD discussion por
Serial Acquisitions and Industry Roll-ups – GOGA – December 2023 OECD discussionSerial Acquisitions and Industry Roll-ups – GOGA – December 2023 OECD discussion
Serial Acquisitions and Industry Roll-ups – GOGA – December 2023 OECD discussionOECD Directorate for Financial and Enterprise Affairs
128 visualizações13 slides
Serial Acquisitions and Industry Roll-ups – OECD – December 2023 OECD discussion por
Serial Acquisitions and Industry Roll-ups – OECD – December 2023 OECD discussionSerial Acquisitions and Industry Roll-ups – OECD – December 2023 OECD discussion
Serial Acquisitions and Industry Roll-ups – OECD – December 2023 OECD discussionOECD Directorate for Financial and Enterprise Affairs
140 visualizações5 slides
PB CV v0.4 por
PB CV v0.4PB CV v0.4
PB CV v0.4Pedro Borracha
8 visualizações16 slides
limited green areas in albateen.pdf por
limited green areas in albateen.pdflimited green areas in albateen.pdf
limited green areas in albateen.pdfmetha4399
5 visualizações7 slides
Serial Acquisitions and Industry Roll-ups –TZANAKI – December 2023 OECD discu... por
Serial Acquisitions and Industry Roll-ups –TZANAKI – December 2023 OECD discu...Serial Acquisitions and Industry Roll-ups –TZANAKI – December 2023 OECD discu...
Serial Acquisitions and Industry Roll-ups –TZANAKI – December 2023 OECD discu...OECD Directorate for Financial and Enterprise Affairs
131 visualizações9 slides
NguyenChristine_Portfolio (1).pdf por
NguyenChristine_Portfolio (1).pdfNguyenChristine_Portfolio (1).pdf
NguyenChristine_Portfolio (1).pdfchnguyentv9
30 visualizações41 slides

Último(20)

PB CV v0.4 por Pedro Borracha
PB CV v0.4PB CV v0.4
PB CV v0.4
Pedro Borracha8 visualizações
limited green areas in albateen.pdf por metha4399
limited green areas in albateen.pdflimited green areas in albateen.pdf
limited green areas in albateen.pdf
metha43995 visualizações
NguyenChristine_Portfolio (1).pdf por chnguyentv9
NguyenChristine_Portfolio (1).pdfNguyenChristine_Portfolio (1).pdf
NguyenChristine_Portfolio (1).pdf
chnguyentv930 visualizações
CIS1- Final-Project- COPY-Presentation-JinHuan Chen, Tammy Ling, JingCheng Zh... por tmmling
CIS1- Final-Project- COPY-Presentation-JinHuan Chen, Tammy Ling, JingCheng Zh...CIS1- Final-Project- COPY-Presentation-JinHuan Chen, Tammy Ling, JingCheng Zh...
CIS1- Final-Project- COPY-Presentation-JinHuan Chen, Tammy Ling, JingCheng Zh...
tmmling13 visualizações
Maximiliano Roa - eRetail Week Blended [Professional] Experience 2023 por eCommerce Institute
Maximiliano Roa - eRetail Week Blended [Professional] Experience 2023Maximiliano Roa - eRetail Week Blended [Professional] Experience 2023
Maximiliano Roa - eRetail Week Blended [Professional] Experience 2023
eCommerce Institute6 visualizações
Learning from Disaster - How a positive safety approach saves lives_MYOSH Web... por kristinashields1
Learning from Disaster - How a positive safety approach saves lives_MYOSH Web...Learning from Disaster - How a positive safety approach saves lives_MYOSH Web...
Learning from Disaster - How a positive safety approach saves lives_MYOSH Web...
kristinashields138 visualizações
ORAL PRESENTATION por alghalakhalid15
ORAL PRESENTATIONORAL PRESENTATION
ORAL PRESENTATION
alghalakhalid155 visualizações
unmasking toxicity in online gaming por aminabumelha
unmasking toxicity in online gamingunmasking toxicity in online gaming
unmasking toxicity in online gaming
aminabumelha5 visualizações
ERGONOMIC RISK ASSESSMENT (ERA).pptx por j967z4hcnp
ERGONOMIC RISK ASSESSMENT (ERA).pptxERGONOMIC RISK ASSESSMENT (ERA).pptx
ERGONOMIC RISK ASSESSMENT (ERA).pptx
j967z4hcnp8 visualizações

stackconf 2023 | Dynamic Image Optimization with imgproxy at Schwarz IT by Andreas Lehr.pdf

  • 1. Dynamic Image Optimization with imgproxy at Schwarz IT An d r e a s L e h r, s t a c k c o n f 1 3 . 0 9 . 2 0 2 3
  • 2. about me ➢ Passionate for all things powering the modern web.​ ➢ Interested in and helping with all challenges around cloud, scaling, reliability and monitoring. ➢ SRE at STACKIT ➢ Newsletter "allesnurgecloud.com" ➢ Podcast "Happy Bootstrapping" ➢ @shakalandy 4 3 , f a t h e r o f 3 , s w a b i a n g e r m a n
  • 3. Retail The Schwarz Group Recyclables Production Shaping a sustainable company Europe's largest trading company Less plastic / Close the loop Ensuring the supply of the Schwarz Group
  • 4. SIMPLE SECURE STABLE OUR TARGET IMAGE 2025 Cloud transformation of the Schwarz Group 12.09.2023 STACKIT Onboarding 5 80% 20% Cloud Enterprise IT
  • 6. 7
  • 7. 8
  • 8. Past & Present „Solutions“​ o r w h y w e n e e d „ D y n a m i c I m a g e O p t i m i za t i o n “.
  • 9. SHIT IN – SHIT OUT.
  • 10. The „Shit In – Shit Out“ Problem​ Images delivered as uploaded variations in Size and Quality​ CMS restrictions not sustainable​ metadata included​ Bad User Experience 11
  • 11. Unfortunately….​ 12 „SHIT IN – SHIT OUT“ is still there in 20223
  • 13. The „42 resolutions“ solution 14 Upload Source Batch Job creates 42 solutions Images are not live Takes a lot of CPU Bad CMS User Experience
  • 14. Images account for 42 % of the Largest Contentful Paint (LCP) element for websites We b - Pe r f o r m a n c e i m p o r t a n t d u e t o impact on  Customer Experience  Conversion rate  SEO  and more 12.09.2023 Fußzeile 15
  • 15. WebP and AVIF to the rescue
  • 16. 17 WebP • released 2010 • Better compression than JPEG & PNG • Finally supported in Safari since 09/2022 • widespread • caniuse.com/webp AVIF • released 2019 • Image Version of AV1 • driven by Netflix • Open Source • will supersede WebP • use when bandwith is priority • caniuse.com/avif Modern image Formats WebP and AVIF to the rescue
  • 20. Doing the math 12.09.2023 21 requests JPEG WEBP AVIF hint 1 413 KB 226 KB 195 KB 1 image 10 4,13 MB 2,26 MB 1,95 MB 10 images per page 10000 4,13 GB 2,26 GB 1,95 GB 100 page impressions 1.000.000 4,13 TB 2,26 TB 1,95 TB 100.000 pi 10.000.000 41,3 TB 22,6 TB 19,5 TB 1 millionpi 100.000.000 413 TB 226 TB 195 TB 10 mio pi
  • 22. meet imgproxy „ D y n a m i c I m a g e O p t i m i za t i o n“ d o n e r i g h t
  • 23. About imgproxy 24 • Open-Source Project by Evil Martians • Developed in GO code using libvips • 55+ features • all Security features included in OS • Paid Version available • See NASA demo on imgproxy.net
  • 24. Digital Leaflets D i g i t a l F l y e r f o r a l l K a u f l a n d & L i d l C o u n t r i e s ▪ Separation in multiple applications ▪ imgproxy for Images ▪ Managed databases ▪ Object Storage for PDFs & Images ▪ Direct PDF delivery / CDN for images ▪ Cost transparency
  • 25. 26 1,9 TB Source Images 5,278,808,359 requests – only 4,742,986 at origin 751 TB traffic – only 925GB at origin mean requests: 1.970 rps vs. 1,77 rps mean bandwith: 2.24 Gbps vs 2.8 Mbps Some figures
  • 26. 27 AppCloud Instances for Leaflets Autoscaling in Action
  • 29. 30 don‘t reinvent the wheel check WebP & AVIF use autoscaling & descaling Checkout imgproxy Key Takeaways