1. One Click Deployment with Jenkins
Thorsten Rinne I 12th October 201 Mainz, Germany
1,
© 201 Mayflower GmbH
1

2. Team Lead / Scrum Master
Head of Open Source Labs
@ThorstenRinne Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 2

3. Who are you?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 3

4. Developers?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 4

5. Administrators?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 5

6. DevOps?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 6

7. Continuous Integration?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 7

8. How much time do you
need for a release?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 8

9. More than a year?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 9

10. 6 - 12 months?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 10

11. 1 - 6 months?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 11

12. 2 - 4 weeks?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 12

13. 1 - 14 days?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 13

14. 1 - 24 hours?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 14

15. Less than 15 minutes?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 15

16. 15 Minutes!
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 16

17. Why One Click
Deployment?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 17

18. Everything is getting faster.
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 18

19. Faster feedback from
your customer / user
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 19

20. Faster ROI
(return on invest)
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 20

21. Faster response
if the market changes
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 21

22. Developers are lazy.
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 22

23. Basic requirements
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 23

24. Agile software
development
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 24

25. Scrum or Kanban
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 25

26. Test Driven Development
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 26

27. Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 27

28. Continuous Integration
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 28

29. Continuous Inspection
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 29

30. Refactoring
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 30

31. Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 31

32. Scrum
Kanban
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 31

33. Scrum Continuous
Kanban Integration
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 31

34. Scrum Continuous Continuous
Kanban Integration Inspection
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 31

35. Scrum Continuous Continuous
Kanban Integration Inspection
Continuous Deployment
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 31

36. Things you don‘t want.
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 32

37. Having your SVN repo in
your webserver‘s docroot.
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 33

38. Using SSH and vi and your
root account on the live
server. Never.
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 34

39. Who‘s still doing this? :-)
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 35

40. Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 36

41. What do we need?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 37

42. First: a central build server
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 38

43. Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 39

44. Continous Testing with
PHPUnit
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 40

45. Advantages
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 41

46. Test results at one central
page
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 42

47. Software metrics at one
central page
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 43

48. Errors can be identified
fast and then fixed
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 44

49. Awareness
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 45

50. Awareness!
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 46

51. Continuous Integration in
PHP projects
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 47

52. PHPUnit
DocBlox
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 48

53. Continuous Inspection in
PHP projects
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 49

54. PHPCS
PHP Depend
PHPMD
phpcpd
jslint
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 50

55. jslint?
yes!
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 51

56. Infrastructure
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 52

57. http://www.flickr.com/photos/nirak/644337888/
Building a Cloud-based social network I Mayflower GmbH I 1 October 201 I 53
1th 1

58. One Ubuntu package to
rule them all.
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 54

59. Development VMs
Jenkins CI Server
Selenium Server
Monitoring Server
Testing Server
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 55

60. http://www.flickr.com/photos/nirak/644337888/
Only on production:
Frontend Nodes 11.04
Backend Nodes 10.04 LTS
Building a Cloud-based social network I Mayflower GmbH I 1 October 201 I 56
1th 1

61. http://www.flickr.com/photos/nirak/644337888/
Mayflower DMZ
amazon AWS
Eucalyptus Cloud
Building a Cloud-based social network I Mayflower GmbH I 1 October 201 I 57
1th 1

62. http://www.flickr.com/photos/nirak/644337888/
Mayflower DMZ
Developer Laptopamazon AWS
with Ubuntu VM
(Git repo + complete
Eucalyptus Cloud
software stack)
Building a Cloud-based social network I Mayflower GmbH I 1 October 201 I 58
1th 1

63. http://www.flickr.com/photos/nirak/644337888/
Mayflower DMZ
Gitorious Server amazon AWS
Jenkins CI Server
Puppet Master
Eucalyptus Cloud
Selenium Server
Building a Cloud-based social network I Mayflower GmbH I 1 October 201 I 59
1th 1

64. http://www.flickr.com/photos/nirak/644337888/
2 Frontnodes
3 Backendnodes
Mayflower DMZ
Development Monitor
Staging Monitor
amazon AWS
Eucalyptus Cloud
Building a Cloud-based social network I Mayflower GmbH I 1 October 201 I 60
1th 1

65. http://www.flickr.com/photos/nirak/644337888/
Mayflower DMZ
2 Frontnodes amazon AWS
2 Backendnodes
Drupal Cloud
Eucalyptus
Live Monitor
Building a Cloud-based social network I Mayflower GmbH I 1 October 201 I 61
1th 1

66. http://www.flickr.com/photos/nirak/644337888/
Configuration
Management done with
Building a Cloud-based social network I Mayflower GmbH I 1 October 201 I 62
1th 1

67. http://www.flickr.com/photos/nirak/644337888/
Configuration changes are
on every VM in 5 Minutes.
#WIN
Building a Cloud-based social network I Mayflower GmbH I 1 October 201 I 63
1th 1

68. Frontnode 1 Frontnode 2
Varnish Varnish
nginx nginx
PHP 5.3 PHP 5.3
Backendnode 1 Backendnode 2
Backendnode 3
MySQL Master MySQL Slave
RabbitMQ
MogileFS MogileFS
Apache Solr
Memcached Memcached
PHP 5.3
PHP 5.3 PHP 5.3
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 64

69. Development workflow
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 65

70. 1. git workflow
$ git add Foo.php
$ git commit -m ″Bar″
$ ant jslint
$ ant phpunit
...
$ git push
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 66

71. 2. Post commit hook
Build triggered on Jenkins
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 67

72. Jenkins build checks
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 68

73. 1. PHPUnit Build:
Unittests
Controller Tests (Zend_Test)
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 69

74. 2. Debian Package Build
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 70

75. 3. Deploy to staging
4. Deploy staging to live
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 71

76. At midnight:
DocBlox
Static code analysis
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 72

77. What is a build process?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 73

78. ant sync
ant clean
ant db-update
parallelTasks:
ant phpunit
ant phpcb
ant deb
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 74

79. ant phpunit
<target
name="phpunit"
depends="db-test"
description="Run all tests">
<exec executable="phpunit"
failonerror="true">
<arg line="--configuration $
{basedir}/tests/phpunit-verbose.xml $
{basedir}/tests/AllTests.php" />
</exec>
</target>
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 75

80. parallelTasks:
php_depend
phpmd
phpunit
phpcpd
phpcs
jslint
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 76

81. Build Debian Package
ant autoloader
ant phpunit
ant clean
ant compilejs
ant compilecss
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 77

82. ant deb (I)
<target
name="deb"
depends="autoloader,phpunit-
coverage,clean,autoloader,compilejs,compi
lecss"
description="Generate Debian package">
<exec executable="gpg">
<arg value="--armor" />
<arg value="--import" />
<arg value="scripts/build/deb/
mapolis.mayflower.de.pgp" />
</exec>
<buildnumber />
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 78

83. ant deb (II)
<exec executable="git"
outputproperty="githash">
<arg value="describe" />
<arg value="--always" />
<arg value="--match" />
<arg value="" />
</exec>
<touch file="debian/changelog" />
<move file="debian/changelog"
tofile="debian/changelog.old" />
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 79

84. ant deb (III)
<exec executable="git"
output="debian/changelog.new">
<arg value="log" />
<arg value="-n" />
<arg value="1" />
<arg value='--format=format:mapolis-
web (${build.number}-${githash})
unstable; urgency=low%n%n * %s%n%n --
%an &lt;%ae&gt; %aD%n%n' />
</exec>
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 80

85. ant deb (IV)
<concat destfile="debian/changelog">
<fileset
file="debian/changelog.new" />
<fileset
file="debian/changelog.old" />
</concat>
<delete file="debian/changelog.new" />
<delete file="debian/changelog.old" />
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 81

86. ant deb (V)
<exec executable="dpkg-buildpackage">
<arg value="-b" />
<arg value="-v${build.number}-$
{githash}" />
<arg value="-Zlzma" />
<arg value="-z9" />
<arg value="-k78532445" />
<arg value="-pgpg" />
<arg value="-sgpg" />
<arg value="-mMayflower Mapolis Team
&lt;mapolis@mayflower.de&gt;" />
</exec>
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 82

87. ant deb (VI)
<move todir="build/deb/">
<fileset dir="${basedir}/../">
<include name="mapolis*.deb" />
<include name="mapolis*.changes" />
</fileset>
</move>
<exec executable="dpkg-buildpackage">
<arg value="-Tclean" />
</exec>
</target>
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 83

88. Deploy Staging
ant clean
ant deb-sign
ant db-staging-up
scp to all hosts
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 84

89. Deploy Staging to live
scp to all hosts
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 85

90. Disadvantages and
problems
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 86

91. Build time
15 min on harddisk
massive disk i/o
4 min on ramdisk :-)
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 87

92. Complexity beginning such
a infrastructure
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 88

93. Jenkins:
Single point of failure!
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 89

94. Cool stuff
which is now possible
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 90

95. Deploy by customer. :-)
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 91

96. Jenkins Chuck Norris Plugin
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 92

97. git bisect start
$BAD $GOOD
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 93

98. Minimum time from
bugreport to deploy:
30 minutes
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 94

99. $ git branch hotfix-2011-08-22
$ git checkout hotfix-2011-08-22
$ git reset --hard "last stable sha-1"
$ git cherry-pick "hotfix sha-1"
$ echo build.number=23 > build.number
$ ant deb
$ scp build/deb/*.deb xyz.amazonaws.com:/
opt/repository/
$ git checkout master
$ git push origin hotfix-2011-08-10
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 95

100. Live
Demo

101. Questions?
Continuous Improvement in PHP Projects I Mayflower GmbH I 25th February I 97

102. Thank you very much for your attention!
Please rate me @ http://joind.in/talk/view/3904
Contact Thorsten Rinne
thorsten.rinne@mayflower.de
+49 89 242054-31
Mayflower GmbH
Mannhardtstr. 6
80538 München
Germany
© 201 Mayflower GmbH
1