Slides from BGOUG 2019 - "Building free, open-source, PL/SQL products in the cloud for FREE"

1. Jacek Gębal
twitter: @GebalJacek
mail: jgebal@gmail.com
blog: oraclethoughts.com
Principal Software Engineer
@Fidelity Investments - Ireland
co-author & maintainer of: utPLSQL
Building open-source
with Oracle Database
in the cloud
for FREE!

2. About me
● Software engineer since ~2000 - mainly Oracle database
● Infected with testing and automation since ~2013
● Key contributor, author and maintainer of utPLSQL v3
● Active developer, learner, testing advocate

3. Why this talk
● What I’ve learned with
○ Global, remote, transparent collaboration
○ Great tools available for free for open-source
○ Building maintainable software project
○ Sustainability and long-livity of the project

4. Sharing
source-code
The “good” old days

5. Sharing
source-code
The cloud era

6. How does git work?
https://www.quora.com/What-is-the-difference-between-Jenkins-and-Git

7. working with
git & github

8. How do you know that my code works?
● Trust the author
● Trust documentation
● Trust other users
● Read & understand all of the code
● Try it
● Try it even more more in depth

9. ● Test all logic (SQL & PL/SQL)
● Automate test execution
● Test early, often, continuously
● Use test language closest to tested language
Testing database code
http://utplsql.org/
https://github.com/utPLSQL/utPLSQL

10. ● What is continuous integration?
● Why it is important?
● Dev-Ops
● Continuous Testing as part of CI
Continuous Integration

11. Why Travis for open-source?
● simple to use
● easy setup and integration with github
● up to 5 concurrent build servers
● 18-40 GB of disk space for your builds
● 4-8 GB RAM
● 2 cores
https://docs.travis-ci.com/user/reference/overview/
Continuous Integration

12. For each configured event on github tavi will
● Initiate a build
● Spin up a new server(s)
● Execute all the steps from .travis.yml file on server(s)
● Verify build status
● Report back build status to github
https://docs.travis-ci.com/user/customizing-the-build/
Travis.org - how it works

13. travis showcase

14. https://github.com/utPLSQL/utPLSQL-demo-project/blob/develop/.travis.yml
Travis - automatic builds Project built
successfully
Executed on 4 servers in parallel

15. https://github.com/utPLSQL/utPLSQL-demo-project/blob/develop/.travis.yml
Travis - feedback to github
Two builds executed:
● one for the branch
● one for the pull request

16. ● login to travis & enable integration with github
● add .travis.yml file in your project
● put steps into .travis.yml file
https://docs.travis-ci.com/user/tutorial/
Travis setup

17. https://github.com/utPLSQL/utPLSQL-demo-project/blob/develop/.travis.yml
.travis.yml Setup the build server:
- download SQLcl - to work with DB
- download utPLSQL - for testing
- download and start Docker Oracle DB
- install utPLSQL
Install the project:
- Create DB account (user)
- deploy project code
- deploy test code
Verify the project
- Run all tests with utPLSQL
- Run Sonar code analysis

18. ● How to keep your database in a predictable state?
● Using Oracle Always Free Cloud Database as an option?
Consistency is key

19. ● images
● containers
● docker-hub
https://docker-curriculum.com/
https://hub.docker.com/
Docker

20. - read-only image of a machine
- create once - use many times
- images cannot be changed
- change to image = new image
Scripts for Oracle DB Images:
https://github.com/oracle/docker-images
https://github.com/utPLSQL/docker-scripts
Docker Image

21. - a running “machine” started from image
- can be stopped and restarted
- when removed - all the container-specific data is “gone”
- new image can be created
from a running/stopped container
Docker Container

22. - New CI server started on each build
- Docker image of Oracle DB downloaded
- Clean container started
- Code deployed & tested with utPLSQL
CI with Travis & Docker

23. Measuring Code Quality
● Can code quality be measured?
● Preventing security holes
● Preventing potential risks

24. https://www.sonarsource.com/products/codeanalyzers/sonarplsql.html#_
SonarCloud

25. Using Docker locally
Install Docker:
- Toolbox - https://docs.docker.com/toolbox/toolbox_install_windows/
- Desktop - https://docs.docker.com/docker-for-windows/install/
- Four basic commands to control your containers

26. http://utplsql.org/documentation/
https://github.com/utPLSQL/utPLSQL/releases
● Free
● Pure PL/SQL
● community-driven, open-source
● Easy to use
● Expressive & readable expectations
● Compares cursor / object / nested table / varray
● Human-readable reports
● Integrates with CI/CD servers & Sonar
● SQLDeveloper extension
● Integrated with TOAD 13.2 +
●
utPLSQL

27. In the cloud

28. Locally

29. Summary
● Free hosting & versioning of your code
● SDLC, bugtracking, Wiki, Pages
● Continuous Integration servers
● Hosting for Docker images
● Code analysis
● Testing frameworks
● multiple IDEs
All you need to do is put all the pieces of puzzle together

31. ● git - https://git-scm.com/download/win
○ https://www.youtube.com/playlist?list=PL25b72h8A54cRytndfLG8LAFXnw-9X6Lk
○ https://www.atlassian.com/git/tutorials
● docker - https://docs.docker.com/docker-for-windows/
○ https://github.com/wsargent/docker-cheat-sheet
● oracle DB on docker - https://www.oracle.com/technetwork/database/enterprise-edition/downloads/index.html
○ https://github.com/oracle/docker-images/tree/master/OracleDatabase
● IntelliJ community edition - https://www.jetbrains.com/idea/download/
○ https://www.shortcutfoo.com/app/dojos/intellij-idea-win/cheatsheet
○ https://blog.jetbrains.com/idea/category/tutorials/
● SQLDeveloper - https://www.oracle.com/technetwork/developer-tools/sql-developer/downloads/index.html
○ https://www.youtube.com/watch?v=EguMf4HbPU8&t=6s
● sonarlint
○ https://www.sonarlint.org/
○ https://rollout.io/blog/getting-started-sonarqube-sonarlint/
Downloading & learning

32. ● utPLSQL - https://github.com/utPLSQL/utPLSQL/releases
○ http://utplsql.org/
○ https://www.youtube.com/playlist?list=PL25b72h8A54fbucEfvH3C2Q1yMqGhc15o
○ https://vimeo.com/261135676
● github - https://github.com/
○ https://guides.github.com/activities/hello-world/
● dockerhub https://hub.docker.com/
○ https://docs.docker.com/docker-hub/
● travis
○ https://docs.travis-ci.com/
○ https://docs.travis-ci.com/user/tutorial/
○ https://github.com/utPLSQL/utPLSQL-demo-project
● SonarCloud - https://sonarcloud.io
○ https://sonarcloud.io/documentation/integrations/github/
Learning

33. ● Readme - intro/getiting started guide
● License - if you want others to take you seriously
● Contributing guide - if you want others to help you
● Badges
So I’ve published my code - then what?
https://github.com/utPLSQL/utPLSQL