Slides from my talk at JavaDay Lviv 2019

1. 1
LOW LATENCY DATA
PROCESSING IN THE ERA OF
SERVERLESS
Nazarii Cherkas | Hazelcast
nazarii@hazelcast.com
https://twitter.com/n_cherkas

2. 2
Brief Agenda

3. 3
Brief Agenda
• Serverless - Not Just The Lambda Functions?
• What do we call Serverless?
• Why industry goes Serverless

4. 4
Brief Agenda
• Serverless - Not Just The Lambda Functions?
• What do we call Serverless?
• Why industry goes Serverless
• Low-Latency Data Processing in Serverless – Any Chance?
• Typical scenarios of Low-Latency Processing
• What brings the latency in Serverless
• Approaches to optimize Serverless Computing

5. 5
Brief Agenda
• Serverless - Not Just The Lambda Functions?
• What do we call Serverless?
• Why industry goes Serverless
• Low-Latency Data Processing in Serverless – Any Chance?
• Typical scenarios of Low-Latency Processing
• What brings the latency in Serverless
• Approaches to optimize Serverless Computing
• Demo Time – The Serverless Fraud Detection

6. 6
About me

7. 7
About me
• 8 years of experience of on different
positions from Java Engineer to
Team Lead and Solutions Architect

8. 8
About me
• 8 years of experience of on different
positions from Java Engineer to
Team Lead and Solutions Architect
• Cloud Developer at Hazelcast Inc.

9. 9
About me
• 8 years of experience of on different
positions from Java Engineer to
Team Lead and Solutions Architect
• Cloud Developer at Hazelcast Inc.
• Moving you to the Cloud

10. 10
Serverless - Not Just The Lambda
Functions

11. 11
What do we call Serverless?

12. 12
What do we call Serverless?
Next step in the Cloud Computing evolution

13. 13
What do we call Serverless?
Next step in the Cloud Computing evolution

14. 14
What do we call Serverless?
Next step in the Cloud Computing evolution

15. 15
What do we call Serverless?
Next step in the Cloud Computing evolution

16. 16
What do we call Serverless?
Next step in the Cloud Computing evolution

17. 17
What do we call Serverless?
Significantly use cloud-managed services (BaaS) to manage server-
side logic and state

18. 18
What do we call Serverless?
Significantly use cloud-managed services (BaaS) to manage server-
side logic and state

19. 19
What do we call Serverless?
Significantly use cloud-managed services (BaaS) to manage server-
side logic and state

20. 20
What do we call Serverless?
Significantly use cloud-managed services (BaaS) to manage server-
side logic and state

21. 21
What do we call Serverless?
Significantly use cloud-managed services (BaaS) to manage server-
side logic and state

22. 22
What do we call Serverless?
Run code in stateless compute containers (FaaS) that are event-
triggered and fully managed by Cloud Provider

23. 23
What do we call Serverless?
Run code in stateless compute containers (FaaS) that are event-
triggered and fully managed by Cloud Provider

24. 24
What do we call Serverless?
Run code in stateless compute containers (FaaS) that are event-
triggered and fully managed by Cloud Provider

25. 25
What do we call Serverless?
Run code in stateless compute containers (FaaS) that are event-
triggered and fully managed by Cloud Provider

26. 26
What do we call Serverless?
Run code in stateless compute containers (FaaS) that are event-
triggered and fully managed by Cloud Provider

27. 27
What do we call Serverless?
Run code in stateless compute containers (FaaS) that are event-
triggered and fully managed by Cloud Provider

28. 28
What do we call Serverless?
Allows to develop and run applications without thinking about the
underlying infrastructure*

29. 29
Why industry goes Serverless?

30. 30
Why industry goes Serverless?
• Lower costs

31. 31
Why industry goes Serverless?
• Lower costs
• Cloud Native

32. 32
Why industry goes Serverless?
• Lower costs
• Cloud Native
• Elastic Scalability

33. 33
Why industry goes Serverless?
• Lower costs
• Cloud Native
• Elastic Scalability
• Significantly reduced time to market

34. 34
Why industry goes Serverless?
• Lower costs
• Cloud Native
• Elastic Scalability
• Significantly reduced time to market
• Less complexity

35. 35
Low-Latency Data Processing in
Serverless – Any chance?

36. 36
Typical scenarios of Low-Latency Processing

37. 37
Typical scenarios of Low-Latency Processing
• Algorithmic trading in Financial markets

38. 38
Typical scenarios of Low-Latency Processing
• Algorithmic trading in Financial markets
• Real-time Bidding for Ads

39. 39
Typical scenarios of Low-Latency Processing
• Algorithmic trading in Financial markets
• Real-time Bidding for Ads
• Fraud detection for the in-flight transactions

40. 40
Typical scenarios of Low-Latency Processing
• Algorithmic trading in Financial markets
• Real-time Bidding for Ads
• Fraud detection for the in-flight transactions
• Personalized user experience in E-commerce

41. 41
Typical scenarios of Low-Latency Processing
• Algorithmic trading in Financial markets
• Real-time Bidding for Ads
• Fraud detection for the in-flight transactions
• Personalized user experience in E-commerce
• Complex Event Processing

42. 42
What brings the latency in Serverless

43. 43
What brings the latency in Serverless
Lambda Function Lifecycle

44. 44
What brings the latency in Serverless
Lambda Function Lifecycle

45. 45
What brings the latency in Serverless
Lambda Function Lifecycle

46. 46
What brings the latency in Serverless
Lambda Function Lifecycle

47. 47
What brings the latency in Serverless
Lambda Function Lifecycle

48. 48
What brings the latency in Serverless
Lambda Function Lifecycle

49. 49
What brings the latency in Serverless
Lambda Function Lifecycle

50. 50
What brings the latency in Serverless
Lambda Function Lifecycle

51. 51
Approaches to optimize Serverless Computing

52. 52
Approaches to optimize Serverless Computing
Making periodic requests to the Functions to keep them “Warm”

53. 53
Approaches to optimize Serverless Computing
Making periodic requests to the Functions to keep them “Warm”

54. 54
Approaches to optimize Serverless Computing
Pre-Allocating memory for CPU-bound tasks

55. 55
Approaches to optimize Serverless Computing
Pre-Allocating memory for CPU-bound tasks

56. 56
Approaches to optimize Serverless Computing
Using co-located services

57. 57
Approaches to optimize Serverless Computing
Using co-located services

58. 58
Approaches to optimize Serverless Computing
Using co-located services

59. 59
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data

60. 60
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data

61. 61
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data

62. 62
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data

63. 63
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data
Read 1 MB sequentially
from disk
1 ms
Latency Numbers Every Programmer Should Know
https://people.eecs.berkeley.edu/~rcs/research/interactive_latency.html

64. 64
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data
Read 1 MB sequentially
from disk
1 ms
Read 1 MB sequentially
from SSD
78 μs
Latency Numbers Every Programmer Should Know
https://people.eecs.berkeley.edu/~rcs/research/interactive_latency.html

65. 65
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data
Read 1 MB sequentially
from disk
1 ms
Read 1 MB sequentially
from SSD
78 μs
Read 1 MB sequentially
from memory
5 μs
Latency Numbers Every Programmer Should Know
https://people.eecs.berkeley.edu/~rcs/research/interactive_latency.html

66. 66
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data

67. 67
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data

68. 68
Approaches to optimize Serverless Computing
Choosing external data store to cache “HOT” data

69. 69
Demo Time
The Serverless Fraud Detection

70. 70
The Serverless Fraud Detection
The Fraud Detection Problem

71. 71
The Serverless Fraud Detection
The Fraud Detection Problem

72. 72
The Serverless Fraud Detection
The Fraud Detection Problem

73. 73
The Serverless Fraud Detection
Serverless Solution Design
https://github.com/ncherkas/hazelcast-cloud-demo

74. 74
The Serverless Fraud Detection
Why Hazelcast Cloud

75. 75
The Serverless Fraud Detection
Why Hazelcast Cloud
• Managed Service for the Hazelcast IMDG – a full-featured In-
Memory Data Grid

76. 76
The Serverless Fraud Detection
Why Hazelcast Cloud
• Managed Service for the Hazelcast IMDG – a full-featured In-
Memory Data Grid
• Co-located Hazelcast IMDG cluster can transform and ingest data
in microseconds (see https://hazelcast.com/resources-
type/?type=Benchmark)

77. 77
The Serverless Fraud Detection
Why Hazelcast Cloud
• Managed Service for the Hazelcast IMDG – a full-featured In-
Memory Data Grid
• Co-located Hazelcast IMDG cluster can transform and ingest data
in microseconds (see https://hazelcast.com/resources-
type/?type=Benchmark)
• Comes with the Enterprise-grade Security

78. 78
The Serverless Fraud Detection
Why Hazelcast Cloud
• Managed Service for the Hazelcast IMDG – a full-featured In-
Memory Data Grid
• Co-located Hazelcast IMDG cluster can transform and ingest data
in microseconds (see https://hazelcast.com/resources-
type/?type=Benchmark)
• Comes with the Enterprise-grade Security
• Simple to Deploy and Use

79. 79
The Serverless Fraud Detection
Why Hazelcast Cloud
• Managed Service for the Hazelcast IMDG – a full-featured In-
Memory Data Grid
• Co-located Hazelcast IMDG cluster can transform and ingest data
in microseconds (see https://hazelcast.com/resources-
type/?type=Benchmark)
• Comes with the Enterprise-grade Security
• Simple to Deploy and Use
• AWS Lambda-ready

80. 80
The Serverless Fraud Detection
DEMO

81. 81
Summary

82. 82
Summary
• Serverless is a perfect match when you want to move fast

83. 83
Summary
• Serverless is a perfect match when you want to move fast
• You can do Low-Latency Processing in Serverless but be aware
of the common pitfalls

84. 84
Summary
• Serverless is a perfect match when you want to move fast
• You can do Low-Latency Processing in Serverless but be aware
of the common pitfalls
• Think about latency and H/A when you choose the data storage

85. 85
Summary
• Serverless is a perfect match when you want to move fast
• You can do Low-Latency Processing in Serverless but be aware
of the common pitfalls
• Think about latency and H/A when you choose the data storage
• In-Memory computing is a natural and logical choice when it
comes to the Low-Latency Processing

86. 86
Summary
• Serverless is a perfect match when you want to move fast
• You can do Low-Latency Processing in Serverless but be aware
of the common pitfalls
• Think about latency and H/A when you choose the data storage
• In-Memory computing is a natural and logical choice when it
comes to the Low-Latency Processing
• KEEP CALM and apply for Beta at https://console.hazelcast.cloud

87. 87
Questions?
https://jet.hazelcast.org/https://hazelcast.org/