Anúncio

Building a First ML Component from 0 to Optimization with a Product-First Approach

Product School
21 de Feb de 2023
Anúncio

Mais conteúdo relacionado

Similar a Building a First ML Component from 0 to Optimization with a Product-First Approach(20)

Mais de Product School(20)

Anúncio

Building a First ML Component from 0 to Optimization with a Product-First Approach

  1. Building a First ML Component from 0 to Optimization with a Product-First Approach by Getaround VP of Product productschool.com
  2. Your Product Management Certificate Path Certificates Product Manager Certification™ Senior Product Manager Certification™ Product Leader Certification™
  3. Corporate Training Level Up Your Team Management Skills productschool.com
  4. Free Product Management Resources Resources Events Courses Podcasts Newsletters Communities eBooks and Reports
  5. 5 Raphaël Korach VP Product - 8years @ Build a first machine learning component with a product-first approach
  6. Transportation Electricity Industry Agriculture Commercial Cars 2970 kg Trucks 1210 kg Coal 2310 kg Natural gas 1880 kg Chemicals 790 kg Refining 750kg Cattle 700 kg Soil management 960 kg Others Metal Others 1 2 3 4 5 0 Yearly tCO2e per capita - source United States Environmental Protection Agency Residential Planes 495 kg 1200 kg 1020 kg Personal car is the #1 cause of GHG emissions worldwide USA cars: 18% 󰑔
  7. 7 4.2 million premature deaths from air pollution worldwide each year Source: World Health Organization - 2019
  8. 20% of public space is wasted on idle cars that are used less than 1x / week 8 Sources: Voirie de Paris, Opendata Paris
  9. Product beekly Empower people to carshare everywhere. Our mission at Getaround
  10. 10 We provide our customers with access to safe, convenient, and affordable cars everywhere around them. Our vision at Getaround
  11. First connected Carsharing Marketplace 1000+ cities in 8 countries 1.7M users 11 Getaround
  12. Product beekly Build a machine learning component from scratch with a product-first approach.
  13. Money and Time 💸 Hard to find the right price, Time-consuming to update regularly Smart Pricing 📈 Machine learning component to recommend optimal prices to owners Context: Smart Pricing 13 Scope: EU 󰎾
  14. “Launching a machine learning component is a technical challenge.” 14
  15. 15 Launching a machine learning component is a technical challenge.” “
  16. 1 It’s a product marketing challenge 📣 2 3 16 Ok, It’s also a technical challenge ⚙ (but…) It’s a design challenge 󰳒 Launching a machine learning component is a technical challenge.” “
  17. Adoption rate by owners 50% 10% Incremental revenue for adopters 17 Rollout objectives of Smart Pricing
  18. The Marketplace Dynamics squad 18 Its mission is to maximise long term revenues of the marketplace 2 Data Scientists 2 Full Stack developers 2 Pricing Managers 1 Product Manager 1 Product Designer Meet: Product Manager Designer Engineer Data
  19. 1It’s a design challenge.
  20. Product Design at Getaround 20 UI/UX Design User Research UX Writing
  21. Product beekly User tests.
  22. Remote user-tests Designs on Figma 8 private owners (existing user base) Goal: Improve & adjust design to increase conversion 22 ➔ ➔ ➔
  23. Results
  24. 24 “I hope the algorithm does its job well enough so that I don’t lose money” “I would have tried Smart Pricing just to see prices that the algorithm suggest.” “There is a button to deactivate at anytime. Reversibility in one click, that’s reassuring” Learnings - It’s all about trust.
  25. They don’t trust the “machine” Owners understood how smart pricing works, but are suspicious on the fact that the algorithm can do better than their manual work. 👉 Reinforce trust with transparency (Preview) They are afraid to lose money Owners need proof they would earn more with smart pricing. More bookings ? More earnings ? 👉 Give more info before activating Smart Pricing (copy) Learnings - It’s all about trust. 25 They want to keep some control Owners feared the switch would be a one-way thing. They wanted a preview of prices before making their mind. 👉 Leave control on smart pricing (min price, price edit)
  26. Follow the language used by owners 26 “Area” “Renters” “Client” “Modulate prices” “Booking stream” “My car part” “Edit prices” “How much I get / In my pocket” “High tier” “Old option” “You set prices” “Minimum price”
  27. 27
  28. 28 Propose & engage + Present benefits
  29. 29 Make the algo sound legitimate Vulgarization
  30. Stay in control 30
  31. 31 Preview based on minimum price Preview to reassure
  32. 32 Make the user feel something important is happening “Make it count”
  33. 2 It’s a Product Marketing challenge.
  34. 34 Product Marketing 1 1 - Announcement Announce the new offer when opening the app 2 - Banner Promote the feature in-product (here, pricing page) 3 - Emailing To all eligible owners, with repeated campaigns 4 - Blog post On the owner community blog 2 1
  35. 3 It’s a technical challenge. (But it’s also a people and process challenge)
  36. 36 �� ½ human ½ machine
  37. 1 2 3 Organisation 😊 Oracle 🤖 Optimisation 🤖 The four O 37 4 Observation 😊
  38. Organisation
  39. Organisation 😊 Data 39
  40. 40 Organisation 😊 Routine Mon. Tue. Wed. Thur. Price computations Analysis Adjustments Import
  41. Oracle
  42. 42 Oracle 🤖 Searches/Cars
  43. 43 Oracle 🤖 Searches Searches (Paris) All searches Scrappers filtered out
  44. 44 Oracle 🤖 Bookings < 3 weeks 3+ weeks Now
  45. 45 Oracle 🤖 Results Result of prediction demand / offer Prediction Ground truth
  46. Observation
  47. 47 Observation 😊 Competition
  48. 48 Observation 😊 Trends
  49. Optimisation
  50. 50 Booking probability Price Revenue = Booking probability x Price Optimisation 🤖 Revenue
  51. 51 Demand/Supply market context Characteristics for a given car
  52. 52 Optimisation 🤖 Time Lun. Mar. Mer. Jeu. Price computations Analysis Adjustments Import Before Now 󰛍 󰛍 󰛍 󰛍 🦾 󰛍 🦾 🦾
  53. Recap.
  54. 54 In order to boost adoption, invest early in qualitative research and product marketing
  55. 55 Double-down on UX writing to make your algorithms tangibles
  56. 56 A good routine is as important as a precise model
  57. 57 If you are starting with machine learning, start narrow but vertically integrated.
  58. 58 Data org. Prediction Model precision Adjustments Production releases Monitoring Pedagogy Benchmark Narrow perimeter Large perimeter ✔ 🚫 Data org. Prediction Model precision Adjustments Production releases Monitoring - limited region - limited car types - limited owners typology - … Pedagogy Benchmark - all regions - all cars - all owners - … Start narrow, vertically integrated
  59. Getaround Raphaël Korach - linkedin.com/in/raphaelkorach Thanks! Inside Getaround - medium.com/getaround-eu
  60. Part-time Product Management Training Courses and Corporate Training productschool.com
Anúncio