Lê Anh Tuấn - Build a High Performance Identification at GHTK with Zookeeper, Redis and Snowflake

1. Build a high performance
identification at GHTK with
ZooKeeper, Redis and
Snowflake
Hà Nội – 08/2022
1

2. @me
• Lê Anh Tuấn
• tuanla.hust@gmail.com
• Tech leader – GHTK
2

3. Agenda
• Identification
• Solutions
• Snowflake
• High performance and application
• Q&A
3

4. Identification
• Unique
• Order
• Sharding & merge
• Security
• Data size
• Range of values
4

5. Identification solutions
• AUTO INCREMENT
• UUID & RANDOM STRING
• HASH
• SNOWFLAKE
5

6. AUTO INCREMENT
• Advantages:
• Simple to use
• Small system
• Disadvantages:
• nextId()
• Database not support
• Security
• Sharding
6

7. UUID & RANDOM STRING
• Advantages:
• Simple to use
• Range of values
• Disadvantages:
• Data size, traffic
• Order
• Slow query
7

8. Hash
• Advantages:
• Data size small
• nextId
• Fast
• Disadvantages:
• Duplicate
• Order
8

9. Snowflake
• Advantages:
• 1 second ~ 4 billion ID, used in 70 years
• Order & fast
• Distribution & sharding
• Security
• Disadvantages:
• Time
• NodeId
• Sequence
9

10. Snowflake - Timestamp
10

11. Snowflake - NodeId
• File
• Random
• IP
• ZooKeeper
11

12. NodeId – File config
12

13. NodeId - Random
13

14. NodeId – IP address
14

15. NodeId - ZooKeeper
15

16. Snowflake - Sequence
• Variable static
• Redis INCR
16

17. Snowflake Sequence – Local static
17

18. Snowflake sequence
18

19. Snowflake sequence redis
19

20. Snowflake at GHTK
20

21. 21

22. 22