1) OpenSooq transitioned from a monolithic architecture to microservices to address scaling challenges from exponential growth. This improved scalability, allowed workload partitioning, and enabled automated operations. 2) They experienced performance issues with MySQL, Solr, and Redis as single points of failure in their first two chat architectures. Their third generation architecture using MongoDB addressed these issues. 3) OpenSooq advocates for stateless microservice design to allow elastic scaling, consistency across services, and reduced memory usage. Through right-sizing and elasticity, they achieved over 60% cost reduction while improving performance.

1. 1
Mastering Chaos
OpenSooq’s journey from
Monolithic to Microservices
Ramzi Alqrainy
Chief Technology Officer

2. OpenSooq Technology
Ramzi Alqrainy
● Chief Technology Officer – OpenSooq
● MSc. In Artificial intelligence and
Information Retrieval, University of Jordan
● Contributor in Apache Solr
● Contributor in Slack
● Technical Reviewer for “Scaling Apache
Solr” , “Scaling Big Data with Hadoop
and Solr” and “Apache Solr Search
Patterns” (Books)
2

3. Consumer Platforms: Buying & Selling
3
OpenSooq is available on all platforms. We ensure compatibility on all browsers, device types
and network speeds

4. OpenSooq App Journey
4

5. Experiencing Exponential Growth
5

6. OpenSooq Technology
OpenSooq at Scale
6
2.2 Billion
Screen Views per
Month and growing
Ship
Fast
One App
Lots of Features
Low
Tolerance
For error

7. OpenSooq Technology
What microservices are not
7

8. OpenSooq Technology
15 hour time / week spent on deployment
8

9. OpenSooq Technology
What is Microservice ?
9

10. An Evolutionary Response
● Separation of concerns
○ Modularity, encapsulation
● Scalability
○ Horizontally scaling Workload
partitioning
● Virtualization & elasticity
○ Automated operations
○ On demand provisioning
10

11. OpenSooq Technology
The brain of OpenSooq
11

12. OpenSooq Technology
What are we solving for?
12

13. OpenSooq Technology
AWS S3 Down - 28 Feb 2017
13

14. OpenSooq Technology
Think Smart for Availability
14

15. OpenSooq Technology
Creating Scalability through Microservices
15

16. OpenSooq Technology
Creating Scalability through Microservices
16

17. OpenSooq Technology
Chat Scalability
17

18. OpenSooq Technology
Solving the Problem not Consequences
18

19. OpenSooq Technology
OpenSooq Chat Architecture – 1st Generation
19
● MySQL Performance
● MySQL doesn’t scale well with many application servers
● Difficulties to build a real-time application.

20. OpenSooq Technology
OpenSooq Chat Architecture – 2nd Generation
● Apache Solr Performance
● Single point of failure for Redis
● Scaling issue
20

21. OpenSooq Technology
OpenSooq Chat Architecture – 3rd Generation
● Got us this far
● Never lost data from MongoDB
● Redis Performance
21

22. OpenSooq Technology
The brain of OpenSooq
22

23. OpenSooq Technology
Stateless Service
23

24. OpenSooq Technology
The Difference
24

25. OpenSooq Technology
Why Stateless Services Matters?
○ New instances of an application added/removed on
demand.
○ It allows consistency across various applications.
○ Statelessness makes an application more comfortable to
work with and maintainable.
○ Reduces memory usage at the server-side.
25

26. OpenSooq Technology
Can Microservices reduce the cost?
26

27. OpenSooq Technology
OpenSooq with Right Sizing and Elasticity to Lower Cost
60%+ Cost Reduction while improving the
performance and increasing KPIs
27

28. OpenSooq Technology
Microservices are not always a solution for you
28

29. OpenSooq Technology
Sharing what we’ve learnt
● Open Source
29

30. OpenSooq Technology
Sharing what we’ve learnt
● Engineering Blog
30

31. OpenSooq Technology
Sharing what we’ve learnt
● Facebook Channel
31

32. OpenSooq Technology 32
Thank You!
Ramzi Alqrainy
ramzi.q@opensooq.com