Modern problems in backend engineering, Marten Meikop

MobileMonday Estonia
MobileMonday EstoniaMobileMonday Estonia
Modern problems in backend engineering, Marten Meikop
About me
● Hobbies
○ Mindsports (chess, checkers)
○ Programming (vint.ee - 30 online
games)
● Wrote first line of code in 1999
● Professional career:
○ C coding for Bang & Olufsen
○ Software architect in Telia
○ Site lead in Proekspert
○ Startup founder
(atmosphere.ee)
90k
Customers in
170 countries
600+
Employees
8
Offices
Pipedrive - The best sales CRM
2010
Founded
$90m
Total Venture Capital
Funding
70+
Live deployments
every day
2
Data centers
1 billion
Requests
per week
Pipedrive Engineering in Numbers
250
People in
Engineering
250
Back-end
Services
1
Management
region
The Beginning (2010)
PHP framework
CodeIgniter
Percona Server
for MySQL
Schema per customer
database architecture
LEMP Stack
Natural Growth (2015)
Webapp
Websocket
Microservices
Microservice
DatabasePipedrive DB
Data Center in US
Company DB
Megaparsec: Moving to
Multi-datacenter environment (2016-2018)
The Needs Challenges
Serving end users from physically
closer location
Legal aspects (GDPR)
Not to put all eggs in one basket
Running out of physical space - one DC
might grow too big
Gateway
Service Discovery
Backoffice / management
CI/CD multi-dc support
Monitoring
1 parsec = 3.0857x1016m
Customer data in one DC
PipedriveDB in multi-master sync between datacenters
Universal domain name (pipedrive.com, not
eu.pipedrive.com)
Geolocation routing
Multi-DC architecture: Key concepts
Datacenter 1 Datacenter 2
Gateway Gateway
Our own custom public gateway
Written in NodeJS
User authentication
(Crypto cookie, api-token, Oauth)
Rate limiting
Service discovery & load balancing
Enriching headers
Producing full access log
Routing between Datacenters
Barista
eu-central-1
F5
BaristaIdentity
Microservice A
us-east-1
F5
BaristaIdentity
Microservice B
Pipedrive tech stack
● Monolith split continues
Are we already there?
● Kubernetes
• Service mesh
• Sidecar
• Vault (Security between
microservices)
● Event driven architecture (Kafka)
● Composite API
● Independent DC-s
Thank you.
Marten Meikop · Engineering Manager @ Core Tribe Pipedrive
Any questions?
Email me at marten.meikop@pipedrive.com
1 de 13

Recomendados

Netflix IT Ops 2014 Roadmap por
Netflix IT Ops 2014 RoadmapNetflix IT Ops 2014 Roadmap
Netflix IT Ops 2014 Roadmapmike d. kail
12.6K visualizações13 slides
Big data and innovation at the service of the editorial team by Julien Palier... por
Big data and innovation at the service of the editorial team by Julien Palier...Big data and innovation at the service of the editorial team by Julien Palier...
Big data and innovation at the service of the editorial team by Julien Palier...ACTUONDA
883 visualizações24 slides
On demand cloud services por
On demand cloud servicesOn demand cloud services
On demand cloud servicesFuture Cloud Summit
96 visualizações12 slides
AI Solutions with Macnica.ai - AI Expo 2018 Tokyo Japan por
AI Solutions with Macnica.ai - AI Expo 2018 Tokyo JapanAI Solutions with Macnica.ai - AI Expo 2018 Tokyo Japan
AI Solutions with Macnica.ai - AI Expo 2018 Tokyo JapanAvkash Chauhan
642 visualizações20 slides
About Claranet por
About ClaranetAbout Claranet
About ClaranetClaranet Portugal
334 visualizações14 slides

Mais conteúdo relacionado

Similar a Modern problems in backend engineering, Marten Meikop

MobilFlex - BP Presentation - 2023.3.pdf por
MobilFlex - BP Presentation - 2023.3.pdfMobilFlex - BP Presentation - 2023.3.pdf
MobilFlex - BP Presentation - 2023.3.pdfMihai Buta
7 visualizações29 slides
Mobil Flex_fv .pdf por
Mobil Flex_fv .pdfMobil Flex_fv .pdf
Mobil Flex_fv .pdfMihai Buta
25 visualizações10 slides
Borhan Resume updated por
Borhan Resume updatedBorhan Resume updated
Borhan Resume updatedborhen chraigui
153 visualizações3 slides
MobilFlex - BP Presentation - 2023.2.pdf por
MobilFlex - BP Presentation - 2023.2.pdfMobilFlex - BP Presentation - 2023.2.pdf
MobilFlex - BP Presentation - 2023.2.pdfMihai Buta
6 visualizações29 slides
Scandinavia por
ScandinaviaScandinavia
Scandinaviajaromik
148 visualizações21 slides
SII IT Services por
SII IT ServicesSII IT Services
SII IT Servicesjaromik
271 visualizações21 slides

Similar a Modern problems in backend engineering, Marten Meikop(20)

MobilFlex - BP Presentation - 2023.3.pdf por Mihai Buta
MobilFlex - BP Presentation - 2023.3.pdfMobilFlex - BP Presentation - 2023.3.pdf
MobilFlex - BP Presentation - 2023.3.pdf
Mihai Buta7 visualizações
Mobil Flex_fv .pdf por Mihai Buta
Mobil Flex_fv .pdfMobil Flex_fv .pdf
Mobil Flex_fv .pdf
Mihai Buta25 visualizações
Borhan Resume updated por borhen chraigui
Borhan Resume updatedBorhan Resume updated
Borhan Resume updated
borhen chraigui153 visualizações
MobilFlex - BP Presentation - 2023.2.pdf por Mihai Buta
MobilFlex - BP Presentation - 2023.2.pdfMobilFlex - BP Presentation - 2023.2.pdf
MobilFlex - BP Presentation - 2023.2.pdf
Mihai Buta6 visualizações
Scandinavia por jaromik
ScandinaviaScandinavia
Scandinavia
jaromik148 visualizações
SII IT Services por jaromik
SII IT ServicesSII IT Services
SII IT Services
jaromik271 visualizações
ITT CNS Capstone Project por Kyle Montoya
ITT CNS Capstone ProjectITT CNS Capstone Project
ITT CNS Capstone Project
Kyle Montoya9.9K visualizações
Internet of Things (IoT) - in the cloud or rather on-premises? por Guido Schmutz
Internet of Things (IoT) - in the cloud or rather on-premises?Internet of Things (IoT) - in the cloud or rather on-premises?
Internet of Things (IoT) - in the cloud or rather on-premises?
Guido Schmutz650 visualizações
Sii It Services por jaromik
Sii It ServicesSii It Services
Sii It Services
jaromik251 visualizações
Industrial IoT and the emergence of Edge Computing Navigating the Technologic... por Roberto Siagri
Industrial IoT and the emergence of Edge Computing Navigating the Technologic...Industrial IoT and the emergence of Edge Computing Navigating the Technologic...
Industrial IoT and the emergence of Edge Computing Navigating the Technologic...
Roberto Siagri99 visualizações
MobilFlex - BP Presentation - 2023.1.pdf por Mihai Buta
MobilFlex - BP Presentation - 2023.1.pdfMobilFlex - BP Presentation - 2023.1.pdf
MobilFlex - BP Presentation - 2023.1.pdf
Mihai Buta16 visualizações
Internap Solutions Presentation por TomErickson
Internap Solutions PresentationInternap Solutions Presentation
Internap Solutions Presentation
TomErickson369 visualizações
MobilFlex - BP Presentation - 2023.2.pdf por Mihai Buta
MobilFlex - BP Presentation - 2023.2.pdfMobilFlex - BP Presentation - 2023.2.pdf
MobilFlex - BP Presentation - 2023.2.pdf
Mihai Buta7 visualizações
Sii It Services por jaromik
Sii It ServicesSii It Services
Sii It Services
jaromik215 visualizações
Sii Nearshoring Services por gbrzostowski
Sii Nearshoring ServicesSii Nearshoring Services
Sii Nearshoring Services
gbrzostowski531 visualizações
Activeeon - Scale Beyond Limits por Activeeon
Activeeon - Scale Beyond LimitsActiveeon - Scale Beyond Limits
Activeeon - Scale Beyond Limits
Activeeon292 visualizações
Datenvirtualisierung: Wie Sie Ihre Datenarchitektur agiler machen (German) por Denodo
Datenvirtualisierung: Wie Sie Ihre Datenarchitektur agiler machen (German)Datenvirtualisierung: Wie Sie Ihre Datenarchitektur agiler machen (German)
Datenvirtualisierung: Wie Sie Ihre Datenarchitektur agiler machen (German)
Denodo 98 visualizações
[Global logic] media high availability service por GlobalLogic Ukraine
[Global logic] media high availability service[Global logic] media high availability service
[Global logic] media high availability service
GlobalLogic Ukraine68 visualizações
AI as a service por Asher Sterkin
AI as a serviceAI as a service
AI as a service
Asher Sterkin2.3K visualizações

Mais de MobileMonday Estonia

Modern problems in backend engineering, Siim Kaspar Uustalu por
Modern problems in backend engineering, Siim Kaspar UustaluModern problems in backend engineering, Siim Kaspar Uustalu
Modern problems in backend engineering, Siim Kaspar UustaluMobileMonday Estonia
350 visualizações19 slides
Modern problems in backend engineering, Asko Tiidumaa por
Modern problems in backend engineering, Asko TiidumaaModern problems in backend engineering, Asko Tiidumaa
Modern problems in backend engineering, Asko TiidumaaMobileMonday Estonia
365 visualizações8 slides
Modern problems in backend engineering, Joel Mislav Kunst por
Modern problems in backend engineering, Joel Mislav KunstModern problems in backend engineering, Joel Mislav Kunst
Modern problems in backend engineering, Joel Mislav KunstMobileMonday Estonia
247 visualizações11 slides
Modern problems in backend engineering, Jüri Tarkpea por
Modern problems in backend engineering, Jüri TarkpeaModern problems in backend engineering, Jüri Tarkpea
Modern problems in backend engineering, Jüri TarkpeaMobileMonday Estonia
378 visualizações18 slides
Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute... por
Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute...Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute...
Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute...MobileMonday Estonia
351 visualizações50 slides
Scientists meet Entrepreneurs - AI & Machine Learning, Kristjan Korjus, Starship por
Scientists meet Entrepreneurs - AI & Machine Learning, Kristjan Korjus, StarshipScientists meet Entrepreneurs - AI & Machine Learning, Kristjan Korjus, Starship
Scientists meet Entrepreneurs - AI & Machine Learning, Kristjan Korjus, StarshipMobileMonday Estonia
405 visualizações29 slides

Mais de MobileMonday Estonia(20)

Modern problems in backend engineering, Siim Kaspar Uustalu por MobileMonday Estonia
Modern problems in backend engineering, Siim Kaspar UustaluModern problems in backend engineering, Siim Kaspar Uustalu
Modern problems in backend engineering, Siim Kaspar Uustalu
MobileMonday Estonia350 visualizações
Modern problems in backend engineering, Asko Tiidumaa por MobileMonday Estonia
Modern problems in backend engineering, Asko TiidumaaModern problems in backend engineering, Asko Tiidumaa
Modern problems in backend engineering, Asko Tiidumaa
MobileMonday Estonia365 visualizações
Modern problems in backend engineering, Joel Mislav Kunst por MobileMonday Estonia
Modern problems in backend engineering, Joel Mislav KunstModern problems in backend engineering, Joel Mislav Kunst
Modern problems in backend engineering, Joel Mislav Kunst
MobileMonday Estonia247 visualizações
Modern problems in backend engineering, Jüri Tarkpea por MobileMonday Estonia
Modern problems in backend engineering, Jüri TarkpeaModern problems in backend engineering, Jüri Tarkpea
Modern problems in backend engineering, Jüri Tarkpea
MobileMonday Estonia378 visualizações
Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute... por MobileMonday Estonia
Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute...Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute...
Scientists meet Entrepreneurs - AI & Machine Learning, Mark Fishel, Institute...
MobileMonday Estonia351 visualizações
Scientists meet Entrepreneurs - AI & Machine Learning, Kristjan Korjus, Starship por MobileMonday Estonia
Scientists meet Entrepreneurs - AI & Machine Learning, Kristjan Korjus, StarshipScientists meet Entrepreneurs - AI & Machine Learning, Kristjan Korjus, Starship
Scientists meet Entrepreneurs - AI & Machine Learning, Kristjan Korjus, Starship
MobileMonday Estonia405 visualizações
Scientists meet Entrepreneurs - AI & Machine Learning, Peeter Piksarv, Moonca... por MobileMonday Estonia
Scientists meet Entrepreneurs - AI & Machine Learning, Peeter Piksarv, Moonca...Scientists meet Entrepreneurs - AI & Machine Learning, Peeter Piksarv, Moonca...
Scientists meet Entrepreneurs - AI & Machine Learning, Peeter Piksarv, Moonca...
MobileMonday Estonia298 visualizações
Scientists meet Entrepreneurs - AI & Machine Learning, Tambet Matiisen, Unive... por MobileMonday Estonia
Scientists meet Entrepreneurs - AI & Machine Learning, Tambet Matiisen, Unive...Scientists meet Entrepreneurs - AI & Machine Learning, Tambet Matiisen, Unive...
Scientists meet Entrepreneurs - AI & Machine Learning, Tambet Matiisen, Unive...
MobileMonday Estonia346 visualizações
Scientists meet Entrepreneurs - AI & Machine Learning, Dima Fishman, Universi... por MobileMonday Estonia
Scientists meet Entrepreneurs - AI & Machine Learning, Dima Fishman, Universi...Scientists meet Entrepreneurs - AI & Machine Learning, Dima Fishman, Universi...
Scientists meet Entrepreneurs - AI & Machine Learning, Dima Fishman, Universi...
MobileMonday Estonia368 visualizações
Space Edition, Sven Lilla, ESA BIC por MobileMonday Estonia
Space Edition, Sven Lilla, ESA BICSpace Edition, Sven Lilla, ESA BIC
Space Edition, Sven Lilla, ESA BIC
MobileMonday Estonia252 visualizações
Space Edition, Kadri Bussov, EST Cube por MobileMonday Estonia
Space Edition, Kadri Bussov, EST CubeSpace Edition, Kadri Bussov, EST Cube
Space Edition, Kadri Bussov, EST Cube
MobileMonday Estonia225 visualizações
Space Edition, Kalev Koppel, KappaZetta por MobileMonday Estonia
Space Edition, Kalev Koppel, KappaZettaSpace Edition, Kalev Koppel, KappaZetta
Space Edition, Kalev Koppel, KappaZetta
MobileMonday Estonia230 visualizações
Space Edition, Dr. Ali Nadir Arslan por MobileMonday Estonia
Space Edition, Dr. Ali Nadir Arslan Space Edition, Dr. Ali Nadir Arslan
Space Edition, Dr. Ali Nadir Arslan
MobileMonday Estonia708 visualizações
Product Marketing, Kair Käsper, Pipedrive por MobileMonday Estonia
Product Marketing, Kair Käsper, PipedriveProduct Marketing, Kair Käsper, Pipedrive
Product Marketing, Kair Käsper, Pipedrive
MobileMonday Estonia188 visualizações
Product Marketing, Marelle Ellen por MobileMonday Estonia
Product Marketing, Marelle EllenProduct Marketing, Marelle Ellen
Product Marketing, Marelle Ellen
MobileMonday Estonia159 visualizações
Product Marketing, Mattias Liivak, Fortumo por MobileMonday Estonia
Product Marketing, Mattias Liivak, FortumoProduct Marketing, Mattias Liivak, Fortumo
Product Marketing, Mattias Liivak, Fortumo
MobileMonday Estonia178 visualizações
What Does it take to Develop Kickass Products?, Laura Noodapera por MobileMonday Estonia
What Does it take to Develop Kickass Products?, Laura NoodaperaWhat Does it take to Develop Kickass Products?, Laura Noodapera
What Does it take to Develop Kickass Products?, Laura Noodapera
MobileMonday Estonia212 visualizações
What Does it take to Develop Kickass Products?, Britt Maasalu por MobileMonday Estonia
What Does it take to Develop Kickass Products?, Britt MaasaluWhat Does it take to Develop Kickass Products?, Britt Maasalu
What Does it take to Develop Kickass Products?, Britt Maasalu
MobileMonday Estonia175 visualizações
Meeting Female Entrepreneurs in Tech, Triinu Sirge por MobileMonday Estonia
Meeting Female Entrepreneurs in Tech, Triinu SirgeMeeting Female Entrepreneurs in Tech, Triinu Sirge
Meeting Female Entrepreneurs in Tech, Triinu Sirge
MobileMonday Estonia945 visualizações
Meeting Female Entrepreneurs in Tech, Triin Kask por MobileMonday Estonia
Meeting Female Entrepreneurs in Tech, Triin KaskMeeting Female Entrepreneurs in Tech, Triin Kask
Meeting Female Entrepreneurs in Tech, Triin Kask
MobileMonday Estonia870 visualizações

Último

Software evolution understanding: Automatic extraction of software identifier... por
Software evolution understanding: Automatic extraction of software identifier...Software evolution understanding: Automatic extraction of software identifier...
Software evolution understanding: Automatic extraction of software identifier...Ra'Fat Al-Msie'deen
9 visualizações33 slides
SAP FOR CONTRACT MANUFACTURING.pdf por
SAP FOR CONTRACT MANUFACTURING.pdfSAP FOR CONTRACT MANUFACTURING.pdf
SAP FOR CONTRACT MANUFACTURING.pdfVirendra Rai, PMP
13 visualizações2 slides
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium... por
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...Lisi Hocke
35 visualizações124 slides
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ... por
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...Donato Onofri
860 visualizações34 slides
Programming Field por
Programming FieldProgramming Field
Programming Fieldthehardtechnology
5 visualizações9 slides
Generic or specific? Making sensible software design decisions por
Generic or specific? Making sensible software design decisionsGeneric or specific? Making sensible software design decisions
Generic or specific? Making sensible software design decisionsBert Jan Schrijver
6 visualizações60 slides

Último(20)

Software evolution understanding: Automatic extraction of software identifier... por Ra'Fat Al-Msie'deen
Software evolution understanding: Automatic extraction of software identifier...Software evolution understanding: Automatic extraction of software identifier...
Software evolution understanding: Automatic extraction of software identifier...
Ra'Fat Al-Msie'deen9 visualizações
SAP FOR CONTRACT MANUFACTURING.pdf por Virendra Rai, PMP
SAP FOR CONTRACT MANUFACTURING.pdfSAP FOR CONTRACT MANUFACTURING.pdf
SAP FOR CONTRACT MANUFACTURING.pdf
Virendra Rai, PMP13 visualizações
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium... por Lisi Hocke
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...
Team Transformation Tactics for Holistic Testing and Quality (Japan Symposium...
Lisi Hocke35 visualizações
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ... por Donato Onofri
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...
Unmasking the Dark Art of Vectored Exception Handling: Bypassing XDR and EDR ...
Donato Onofri860 visualizações
Generic or specific? Making sensible software design decisions por Bert Jan Schrijver
Generic or specific? Making sensible software design decisionsGeneric or specific? Making sensible software design decisions
Generic or specific? Making sensible software design decisions
Bert Jan Schrijver6 visualizações
Agile 101 por John Valentino
Agile 101Agile 101
Agile 101
John Valentino9 visualizações
nintendo_64.pptx por paiga02016
nintendo_64.pptxnintendo_64.pptx
nintendo_64.pptx
paiga020165 visualizações
Bootstrapping vs Venture Capital.pptx por Zeljko Svedic
Bootstrapping vs Venture Capital.pptxBootstrapping vs Venture Capital.pptx
Bootstrapping vs Venture Capital.pptx
Zeljko Svedic12 visualizações
Copilot Prompting Toolkit_All Resources.pdf por Riccardo Zamana
Copilot Prompting Toolkit_All Resources.pdfCopilot Prompting Toolkit_All Resources.pdf
Copilot Prompting Toolkit_All Resources.pdf
Riccardo Zamana10 visualizações
HarshithAkkapelli_Presentation.pdf por harshithakkapelli
HarshithAkkapelli_Presentation.pdfHarshithAkkapelli_Presentation.pdf
HarshithAkkapelli_Presentation.pdf
harshithakkapelli11 visualizações
Fleet Management Software in India por Fleetable
Fleet Management Software in India Fleet Management Software in India
Fleet Management Software in India
Fleetable11 visualizações
Sprint 226 por ManageIQ
Sprint 226Sprint 226
Sprint 226
ManageIQ5 visualizações
Myths and Facts About Hospice Care: Busting Common Misconceptions por Care Coordinations
Myths and Facts About Hospice Care: Busting Common MisconceptionsMyths and Facts About Hospice Care: Busting Common Misconceptions
Myths and Facts About Hospice Care: Busting Common Misconceptions
Care Coordinations6 visualizações
The Era of Large Language Models.pptx por AbdulVahedShaik
The Era of Large Language Models.pptxThe Era of Large Language Models.pptx
The Era of Large Language Models.pptx
AbdulVahedShaik6 visualizações
BushraDBR: An Automatic Approach to Retrieving Duplicate Bug Reports por Ra'Fat Al-Msie'deen
BushraDBR: An Automatic Approach to Retrieving Duplicate Bug ReportsBushraDBR: An Automatic Approach to Retrieving Duplicate Bug Reports
BushraDBR: An Automatic Approach to Retrieving Duplicate Bug Reports
Ra'Fat Al-Msie'deen8 visualizações
WebAssembly por Jens Siebert
WebAssemblyWebAssembly
WebAssembly
Jens Siebert51 visualizações
predicting-m3-devopsconMunich-2023.pptx por Tier1 app
predicting-m3-devopsconMunich-2023.pptxpredicting-m3-devopsconMunich-2023.pptx
predicting-m3-devopsconMunich-2023.pptx
Tier1 app7 visualizações
Keep por Geniusee
KeepKeep
Keep
Geniusee77 visualizações
MS PowerPoint.pptx por Litty Sylus
MS PowerPoint.pptxMS PowerPoint.pptx
MS PowerPoint.pptx
Litty Sylus5 visualizações

Modern problems in backend engineering, Marten Meikop

Notas do Editor

  1. Custom (primitive) CI/CD . Dreadnot Infra setup with bash scripts + Chef
  2. Closing slide - you can add some social media handles to share as additional touchpoints.