Ivan Ermilov describes the architecture of the Big Data Europe Integrator platform

1. Architecture of BDE Integrator
Platform
Ivan Ermilov
iermilov@informatik.uni-leipzig.de
03/05/2017

2. Platform Architecture
2

3. Platform Goals
◎Opensource
◎Simple to get started with Big Data
◎Support a variety of use cases
◎Simple integration with custom components
◎Embrace emerging Big Data technologies
3

4. User categories
◎Developers
◎DevOps
◎Big Data Experts
◎Cluster Administrators
4

5. BDI Component Lifecycle
App templates
Ready-made
components, best
practices
BDI Stack
Builder
BDI Support
Components,
Instructions
Swarm UI,
docker-compose
Pipeline
Monitor

6. Developing with BDE & Docker
network:
docker network create spark-net
spark:
docker-compose -f docker-compose-minimal.yml up -d
down:
docker-compose -f docker-compose-minimal.yml down
docker-compose -f docker-compose-spark-app.yml down
docker network rm spark-net
spark-app:
docker-compose -f docker-compose-spark-app.yml build
docker-compose -f docker-compose-spark-app.yml up
6
https://www.big-data-europe.eu/developing-spark-applications-with-docker-and-bde/

7. UI Integrator Application
7
https://www.big-data-europe.eu/user-interface-integration-in-bdi-platform-integrator-ui-application/

8. Reverse Proxy/CSSWrapper
◎Simple injection of custom CSS
strabon:
image: bde2020/strabon
links:
- csswrapper
expose:
- "8080"
environment:
VIRTUAL_HOST: "strabon.big-data-europe.aksw.org"
VIRTUAL_PORT: "8080"
CSS_SOURCE: "strabon"
8
https://www.big-data-europe.eu/using-reverse-proxy-inside-bde-platform-jwildernginx-setup-for-
docker-swarm/
https://github.com/big-data-europe/demo-integrator-ui

9. Demo: Overview
◎Docker version: 17.03.0-ce
◎Swarm version: 1.2.6
9

10. Demo (8 mins)
10
https://github.com/big-data-europe/demo-release-webinar-platform

11. Big Data Europe Integrator Platform Launch
Wednesday 3 May @ 15:00 CEST
Please type your questions at any time. Q&A will follow the presentations