這次我主要會分享 bitbucket pipeline & gitlab-ci 的一些設定和操作流程，以及我自己和同事在踩雷時的一些心得分享。 bitbucket pipeline & gitlab-ci 這兩款都算是相對知名的 CI/CD Tools，雖然一般來說大家可能比較常用類似 Jenkins & Travis CI 之類的產品。但其實我個人覺得，以小團隊的使用情境來說 bitbucket & gitlab 是相當不錯的，建議大家都可以去玩玩看。 另外，這場分享中間可能也會穿插一些使用 Elastic 的 logstash 做 monitor 碰到的一些雷區和解法，基本上就看時間夠不夠講嘍～敬請期待！

1. DevOps Taiwan Meetup #19 - 那些年
我們踩的 CI 坑
Len Chang, December 14 2018

2. Outline
● Me
● Issues Discussion
○ CI / CD of gitlab
○ CI / CD of bitbucket
○ logstash of Elastic
● Advertisement time !!

3. Me
Fear is a choice ~
https://www.linkedin.com/in/huailunchang/

4. Issues Discussion-CI / CD of gitlab

5. Q: How to deploy
gitLab-runner ?
Key word
● CI/CD of GitLab
● GitLab-runner

6. Q: How to deploy gitLab-runner ?
Step 1.
● open GitLab
Server and follow
the steps

7. Q: How to deploy gitLab-runner ?
Step 2.
● Set up gitlab-runner
● Set parameters

8. Q: How to deploy gitLab-runner ?
Step 3.
● Config setting

9. Q: How to deploy
gitLab-runner ?
Something you need to care about….
● permission is important !!!

10. Q: How to clean
gitLab-runner ?
Key word
● NULL

11. Q: How to clean gitLab-runner ?

12. Q: How to clean gitLab-runner ?
gitlab-runner verify --delete. It will delete runners that got removed from GitLab.
Reference

13. Q: How to clean
gitLab-runner ?
Something you need to care about….
● Still .. NULL

14. CI / CD of bitbucket

15. Q: How to deploy
app in Google App
Engine by Bitbucket
Pipelines ?
Key word
● Google App Engine
● Bitbucket Pipelines

16. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 1.
● Apply GCP / Bitbucket account
● Make sure your app can run on local and
match Google App Engine Environment
Step 2.
● Get auth. key from GCP

17. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 3.
● Bitbucket Setting
a. Enable your settings

18. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 4.
● Bitbucket Setting
a. Set repository variables

19. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 5.
● Bitbucket Setting
a. write pipelines.yaml

20. Q: How to deploy
app in Google App
Engine by Bitbucket
Pipelines ?
Something you need to care about….
● Limitations of Bitbucket Pipelines
○ Free 50 minutes
● Something will break down forever….

21. Q: How to deploy
web (Angular)
in Google Cloud
Storage by
Bitbucket Pipelines
?
Key word
● Google Cloud Storage
○ https://cloud.google.com/storage/
● Angular
○ https://angular.io/

22. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 1.
● Apply GCP / Bitbucket account
● Make sure your angular app can run on local
Step 2.
● Get auth. key from GCP

23. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 3.
● Let google know we own the domain
"test123.com" if it's not done before (do this
on Google Search Console)

24. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 4.
● Create a new bucket named
"whatever.test123.com" and upload bundled
webapp
Step 5.
● Assign member named "allUsers" as the
"Storage Object Viewer" of the bucket

25. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 6.
● Set index.html as main page and 404 page

26. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 7.
● Bitbucket Setting
a. Enable your settings

27. Q: How to deploy web (Angular) in Google
Cloud Storage by Bitbucket Pipelines ?
Step 8.
● Bitbucket Setting
a. Set repository variables

28. Q: How to deploy app in Google App Engine by
Bitbucket Pipelines ?
Step 9.
● Bitbucket Setting
a. write pipelines.yaml

29. Q: How to deploy
app in Google App
Engine by Bitbucket
Pipelines ?
Something you need to care about….
● gsutil -m rm gs://aaa.test1234.com/**
○ You need to push data into bucket first otherwise
you will get exception

30. logstash of Elastic

31. How to use logstash
to read log files
created by rsyslog?
Key word
● logstash
● rsyslog

32. How to use logstash to read log files created by
rsyslog?
Q: logstash can’t read log files which “permission
deny…..”

33. How to use logstash to read log files created by
rsyslog?
Q: logstash can’t read log files which “permission
deny…..”
/etc/syslog.conf (default value)
● $FileCreateMode 0644
● $umask 0077
○ Update to $umask 0022

34. How to use logstash
to read log files
created by rsyslog?
Summary
● Permission is important….

35. logstash -
Persistent Queues
Key
- Queue

36. logstash - Persistent Queues
queue.type
● default: memory
● persisted
○ Info

37. logstash -
Persistent Queues
Summary
- set queue.type is “persisted”

38. Advertisement time !!
https://tw.yardian.com/
https://us.yardian.com/