My presentation at The 2nd Portugal|UT Austin summer school in systems and networking and EMJD-DC spring event 2016 June 3, 2016. Costa da Caparica, Portugal describing my thesis work

1. Software-Defined Approach for
QoS and Data Quality in
Multi-Tenant Clouds
The 2nd Portugal|UT Austin summer school in systems and networking and
EMJD-DC spring event 2016
June 3, 2016. Costa da Caparica, Portugal.
Pradeeban Kathiravelu+x*
, Luís Veiga+x
x
Distributed Systems Group, INESC-ID Lisboa
+
Instituto Superior Técnico, Universidade de Lisboa, Portugal
*
Emory University, Atlanta, GA, USA.
1

2. ❖ Tenants assume various roles in the enterprise
data center networks.
➢ Differentiated Quality of Service (QoS).
➢ Data quality assurance.
➢ Isolation guarantees. 2Introduction

3. ❖ Efficiency and Accuracy
3

4. WARNING: Work-in-Progress
4

5. WARNING: Work-in-Progress
PhD Start: September, 2014
Expected Defence: September, 2018
5

6. ❖ Data storage and execution
6

7. ❖ Distributed
vs.
❖ Centralized
7

8. ❖ Distributed
Horizontal scalability
8

9. ❖ Centralized
Management efficiency.
Accuracy.
9

10. ❖ Distributed
Software-Defined Networking
❖ Centralized
10

11. Software-Defined Networking
System
s
11

12. ❖ Global view of the entire data center network
❖ A logically centralized controller
12

13. 13

14. Our Approach
❖ Software-Defined Networking (SDN)
❖ SDN Northbound - Message-Oriented Middleware
❖ Scalable and Very Large Scale Data and Deployments
❖ Modular Architecture -> Reusable
14

15. 15

16. 1. Distributed Execution: QoS and Data Quality
2. SDN Systems: SDN with Message-Oriented Middleware
3. SDN Simulations and Emulations
16
Contributions &
Research Directions =>

17. 1. Distributed Execution: QoS and Data Quality
2. SDN Systems: SDN with Message-Oriented Middleware
3. SDN Simulations and Emulations 17
Contributions &
Research Directions =>

18. 18
∂u∂u Multi-Tenanted Framework:
Distributed Near Duplicate Detection for Big Data
23rd International Conference on Cooperative Information Systems (CoopIS 2015)
28-30 October 2015, Rhodes, Greece.
CoopIS 2015
Pradeeban Kathiravelu, Helena Galhardas, Luís Veiga
INESC-ID / Instituto Superior Técnico, Universidade de Lisboa, Portugal
[1.1]

19. 19

20. 20

21. 21
MEDIator: A Data Sharing Synchronization Platform for
Heterogeneous Medical Image Archives
[1.2]

22. 1. Distributed Execution: QoS and Data Quality
2. SDN Systems: SDN with Message-Oriented
Middleware
3. SDN Simulations and Emulations 22
Contributions & Research Directions =>

23. 23
CHIEF: Controller Farm for Clouds of
Software-Defined Community Networks
[2.1]

24. 24
Building Blocks of Mayan:
Componentizing the
eScience Workflows Through
Software-Defined Service Composition
23rd IEEE International Conference on Web Services
June 27 - July 2, 2016, San Francisco, USA
IEEE ICWS 2016
Pradeeban Kathiravelu+
, Tihana Galinac Grbac*
, Luís Veiga+
+
INESC-ID / Instituto Superior Técnico, Universidade de Lisboa, Portugal
*
University of Rijeka, Croatia
[2.2]

25. ❖ Adaptive execution of scientific workflows
❖ More efficient and diverse service composition
❖ Very large-scale and reliable.
➢ Find and consume the current best-fit
➢ Among the multiple implementations or
deployments of the same service. 25

26. ❖ Each execution component in the workflow:
Building Block of Mayan
26

27. 27

28. 28

29. 29

30. <Service3,(<Service1, Input1>, <Service2, Input2>)>
30

31. Speed up of a data warehousing workflow:
❖ Near duplicate detection ->
Data cleaning ->
Write to the warehouse
❖ Data sets from TCIA* and synthetic data
* Clark K, Vendt B, Smith K, Freymann J, Kirby J, Koppel P, Moore S, Phillips S, Maffitt D, Pringle M, Tarbox L, Prior F. The Cancer
Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository, Journal of Digital Imaging, Volume 26,
Number 6, December, 2013, pp 1045-1057. 31

32. 32

33. 33
Cassowary: Middleware Platform for Context-Aware
Smart Buildings with Software-Defined Sensor Networks
[2.3]

34. 1. Distributed Execution: QoS and Data Quality
2. SDN Systems: SDN with Message-Oriented Middleware
3. SDN Simulations and Emulations
34
Contributions & Research Directions =>

35. 35
SENDIM for Incremental Development of Cloud Networks:
Simulation, Emulation & Deployment Integration Middleware
[3.1]

36. Summary
❖ SDN and Message-Oriented Middleware
❖ Quality of Service and Data Quality
❖ Modular Architecture -> Reusability
❖ Building Blocks of Mayan
36

37. Conclusion
❖ We can scale smarter
37

38. Conclusion
❖ We can scale smarter
❖ We can manage better
38

39. Conclusion
❖ We can scale smarter
❖ We can manage better
❖ We can do more
39

40. Recent Publications
40

41. [1] Distributed Execution: QoS and Data Quality
1. Kathiravelu, P., Galhardas, H., & Veiga, L. (2015). ∂u∂u Multi-Tenanted Framework: Distributed Near Duplicate
Detection for Big Data. In 23 rd International Conference on Cooperative Information Systems (CoopIS 2015)
(Acceptance Rate: 20%). On the Move to Meaningful Internet Systems: OTM 2015 Conferences, pp. 237-256.
Springer International Publishing, Oct. 2015. http://doi.org/10.1007/978-3-319-26148-5_14
2. Kathiravelu, P. & Sharma, A. (2015). MEDIator: A Data Sharing Synchronization Platform for Heterogeneous
Medical Image Archives. In Workshop on Connected Health at Big Data Era (BigCHat'15) , co-located with 21 st
ACM SIGKDD Conference on Knowledge Discovery and Data Mining (KDD 2015). Aug. 2015. ACM. 6 pages. http:
//doi.org/10.13140/RG.2.1.3709.4248 41

42. [2] SDN Systems: SDN with Message-Oriented Middleware
1. Kathiravelu, P., Grbac, T.G., & Veiga, L. (2016). Building Blocks of Mayan: Componentizing the eScience
Workflows Through Software-Defined Service Composition. In 23rd IEEE International Conference on Web
Services (ICWS 2016). June 2016. 8 pages. To appear.
2. Kathiravelu, P. & Veiga, L. (2016). CHIEF: Controller Farm for Clouds of Software-Defined Community
Networks. In 3rd IEEE International Symposium on Software Defined Systems (SDS-2016). Apr. 2016. pp. 1 – 6.
42

43. 3. Kathiravelu, P., Sharifi, L., & Veiga, L. (2015). Cassowary: Middleware Platform for Context-Aware Smart
Buildings with Software-Defined Sensor Networks. In 2nd Workshop on Middleware for Context-Aware
Applications in the IoT (M4IOT 2015), co-located with ACM/USENIX/IFIP Middleware 2015. Dec. 2015. ACM.
pp. 1 – 6. http://doi.org/10.1145/2836127.2836132
4. Kathiravelu, P., Grbac, T.G, & Veiga, L. (2016). A FIRM Approach to Software-Defined Service Composition. In
MIPRO 2016 - 39th International Convention on Telecommunications & Information (CTI).
43

44. [3] SDN Simulations and Emulations
1. Kathiravelu, P. & Veiga, L. (2016). SENDIM for Incremental Development of Cloud Networks: Simulation,
Emulation & Deployment Integration Middleware. In IEEE International Conference on Cloud Engineering
(IC2E 2016). Apr. 2016. pp. 143 – 146.
44

45. Doctoral Symposiums
1. Kathiravelu, P. (2016). Software-Defined Networking-Based Enhancements to Data Quality and QoS in Multi-
Tenanted Data Center Clouds. In IEEE International Conference on Cloud Engineering (IC2E 2016) Doctoral
Symposium. Apr. 2016. pp. 201 – 203.
45

46. Acknowledgements
❖ Erasmus Mundus Joint Doctorate in Distributed Computing (EMJD-DC)
❖ Google Summer of Code
❖ Prof. Ashish Sharma, Emory University, USA
❖ Prof. Helena Galhardas, IST, Portugal
❖ Prof. Tihana Galinac Grbac, University of Rijeka, Croatia
❖ COST action 1304 Autonomous Control for a Reliable Internet of Services (ACROSS)
❖ The OpenDaylight Foundation
❖ Ed Warnicke, Cisco, OpenDaylight TSC 46

47. Thank you!
47

48. To discuss more about OpenDaylight:
OpenDaylight Lisboa Meetups. :)
http://www.meetup.com/OpenDaylight-Lisbon/
48
Announcement ;)

49. Questions?
❖ We can scale smarter
❖ We can manage better
❖ We can do more
kk.pradeeban@gmail.com
49