Quick Introduction to Flink as a distributed stream processing engine.

1. 1
Aljoscha Krettek
@aljoscha
December 8, 2016
Google Singapore
Apache Flink™
A Stream Processing Engine

2. 2
Original creators of Apache
Flink®
Providers of the
dA Platform, a supported
Flink distribution

3. What is Apache Flink?
3
Distributed Deployment
Stateful Stream Processing
DataStream API, Windows
Table API
Building Block
Core API
Declarative DSL
Basis

4. Stream Processing
4
Data Stream Data Stream
Your
code

5. Stateful Stream Processing
5
State
Data Stream Data Stream
Your
code

6. Stateful Steam Processing
6
Source
Filter /
Transform
State
read/write
Sink

7. Stateful Steam Processing
7
Scalable embedded state
Access at memory speed &
scales with parallel operators

8. Stateful Steam Processing
8
Re-load state
Reset positions
in input streams
Rolling back computation
Re-processing

9. Stateful Steam Processing
9
Restore to different
programs
Bugfixes, Upgrades, A/B testing, etc

10. Beam/Flink Interactions
10
Dataflow/
MillWheel influenced
runs on

11. Code Example!
11
Based on http://data-artisans.com/robust-stream-processing-flink-walkthrough/

12. 1
Thank you!
@aljoscha
@ApacheFlink
@dataArtisans
http://flink.apache.org

13. Appendix
13

14. We are hiring!
data-artisans.com/careers

15. 15
Flink Forward 2017
San Francisco Berlin
• April 10-11, 2017
• The first Flink Forward event
outside of Berlin
• Register at sf.flink-forward.org/
• September 11-13
• Over 350 attendees at the
last event
• Registration opening soon!