Mais conteúdo relacionado
Semelhante a Presto Bangalore Meetup1 Event Listeners@qubole (20)
Mais de Shubham Tagra (10)
Presto Bangalore Meetup1 Event Listeners@qubole
- 2. 00Copyright 2017 © Qubole
Goal
● What is an event listener
● How to leverage it for analysis
- 6. 00Copyright 2017 © Qubole
What is an event listener
● Mechanism to get notified at trigger points: events
● Events:
● Query creation
● Query completion
● Split completion
● Query/Task stats, session info
- 9. 00Copyright 2017 © Qubole
Setup
● TPC DS scale 1000
● Master r3.2xlarge
● 3 Slave r3.4xlarge
● 19 perf queries ran multiple times
- 10. 00Copyright 2017 © Qubole
Use Cases
● Resource Accounting
● Configure alarms on system state
○ Query completion rate
○ Queue size
○ Average data read
● Cluster configuration analysis
● Post execution hooks
- 11. 00Copyright 2017 © Qubole
Limitations
● Triggers only at event boundaries
● Does not provide with a overall system state
● Not suitable for proactive analysis