Slides of my presentation at the Inspiring Flow conference (http://www.inspiring-flow.de) in Kolbermoor on April 20th, 2013.

1. Scalable

2. Deployment

3. Architectures
with

4. TYPO3

5. Surf,

6. Git

7. and

8. Jenkins
Inspiring

9. FLOW

10. Conference,

12. April

13. 20th

14. 2013
Martin

15. Helmich,

16. Mittwald

17. CM

18. Service
m.helmich@mittwald.de

19. YOUR SPEAKER
Martin

20. Helmich
Software

21. Developer/Architect
at

22. Mittwald
TYPO3

23. addicted

24. since

25. 2004
Caffeine

26. addicted

27. since

28. 2007

29. LAST

30. YEAR‘S
FLOW3

31. EXPERIENCE
http://www.flickr.com/photos/techdivision/7038633581

32. Software

33. deployment

34. is

35. all

36. of

37. the

38. activities

39.
that

40. make

41. a

42. software

43. system

44. available

45. for

46. use.
„
http://en.wikipedia.org/wiki/Software_deployment

47. Manual

48. Deployment,

49. Take

50. #1
CLICK
DROP
DRAG

51. COMMON

52. PITFALLS
What

53. if...
you

54. don‘t

55. know

56. (or

57. have

58. forgotten)
which

59. files

60. have

61. changed

62. since

63. the

64.
last

65. deployment?
you

66. want

67. to

68. roll

69. back

70. to

71. a

72. previous

73.
version?
you

74. want

75. to

76. know

77. which

78. version

79. you

80.
are

81. currently

82. running?
Manual

83. Deployment,

84. Take

85. #1
?
?
?

86. martin@mybox:~ ssh myserver.de
martin@myserver:~ cd my_app
martin@myserver:~/my_app git fetch origin
martin@myserver:~/my_app git reset --hard origin/master
martin@myserver:~/my_app git submodule update --init
martin@myserver:~/my_app ./flow doctrine:migrate
martin@myserver:~/my_app ./flow cache:flush
Manual

87. Deployment,

88. Take

89. #2

90. martin@mybox:~ ssh myserver.de
martin@myserver:~ cd my_app
martin@myserver:~/my_app git fetch origin
martin@myserver:~/my_app git reset --hard origin/master
martin@myserver:~/my_app git submodule update --init
martin@myserver:~/my_app ./flow doctrine:migrate
martin@myserver:~/my_app ./flow cache:flush
VERSION

91. CONTROL is

92. great!

93. But

94. what

95. if...
you

96. forget

97. one

98. of

99. these

100. steps?
there

101. are

102. ten

103. servers

104. (or

105. 100)
instead

106. of

107. one?
?
Manual

108. Deployment,

109. Take

110. #2
?

111. HERE:

112. USING

113. APACHE

114. ANT
Automated

115. Deployment

116. HERE:

117. USING

118. APACHE

119. ANT
Automated

120. Deployment
project name=“my-app“ default=“deploy“
!-- ... --
target name=“git-fetch“
exec executable=“git“
arg line=“fetch origin“ /
/exec
exec executable=“git“
arg line=“reset --hard origin/master“ /
/exec
/target
target name=“migrate“ depends=“git-fetch“
flow-migrate /
flow-cache-flush /
/target
/project
SEE

121. https://github.com/martin-helmich/ant-typo3flow

122. TYPO3

123. Surf

124. TYPO3

125. Surf
WHAT

126. DOES

127. IT

128. DO?
├── cache
│ └── localgitclone
├── releases
│ ├── 20130324175345
│ └── current - ./20130324175345
└── shared
BEFORE

129. ├── cache
│ └── localgitclone
├── releases
│ ├── 20130324175345
│ └── current - ./20130324175345
└── shared
BEFORE
├── cache
│ └── localgitclone
├── releases
│ ├── 20130324175345
│ ├── 20130329184503
│ ├── previous - ./20130324175345
│ └── current - ./20130329184503
└── shared
AFTER
TYPO3

130. Surf
WHAT

131. DOES

132. IT

133. DO?

134. TYPO3

135. Surf
├── cache
│ └── localgitclone
├── releases
│ ├── 20130324175345
│ ├── 20130329184503
│ ├── previous - ./20130324175345
│ └── current - ./20130329184503
└── shared
Point

136. your

137. document

138. root

139. HERE.
Something

140. goes

141. wrong

142. badly,

143. simply

144. RESET

145. THE

146. SYMLINK

147.
to

148. the

149. previous

150. target.
WHAT

151. DOES

152. IT

153. DO?

154. Install

155. using

156. GIT:
git clone git://git.typo3.org/FLOW3/Packages/TYPO3.Surf.git
Packages/Application/TYPO3.Surf
./flow package:activate TYPO3.Surf
Install

157. using

158. Composer:
./composer.phar require typo3/surf=dev-master
./flow package:activate TYPO3.Surf

159. INITIALIZE
UPDATE
MIGRATE
FINALIZE
TEST
SWITCH
CLEANUP
SURF

160. DEFAULT
WORKFLOW
This

161. is

162. just

163. the

164. default

165.
workflow

166. (called

167.
„SimpleWorkflow“).
You

168. can

169. customize

170. it

171.
as

172. you

173. like

174. or

175. even

176.
define

177. entirely

178. new

179.
workflows.

180. Use

181. Jenkins

182. to

183. optimize
your

184. TYPO3

185. Surf

186. deployments
#1:

187. AUTOMATE

188. JENKINS Main
Build
Deployment
Build
Auxiliary
Build
TYPO3

189. Surf
calls
GIT
triggers
notifies

190. via
post-receive
hook
git

191. pull
Developer
pushes

192. to

193. git
Update

194. submodules
Compile/Transpile
Run

195. tests
Packetize
Generate

196. documentation
Generate

197. code

198. metrics

199. Use

200. Jenkins

201. to

202. optimize
your

203. TYPO3

204. Surf

205. deployments
#2:

206. PARALLELIZE

207. INITIALIZE

209. UPDATE

210. NODES

211. N1..Nn SWITCH
time
N1 N2 N3 N4

212. N2 N3 N4N1
N2
N3
N4
INIT

213.
UPDATE
SWITCH
time
WOW!

214. That‘s

215. so

216. much

217. faster!
But

218. where

219. is

220. the

221. catch

222. in

223. this...?

224. Execute

225. deployments

226. in

227. parallel

228. using
Jenkin‘s

229. multi-configuration

230. builds.

233. ?php
/** @var $deployment TYPO3SurfDomainModelDeployment */
$workflow = new TYPO3SurfDomainModelSimpleWorkflow();
$application = new TYPO3SurfApplicationBaseApplication('MyApplication');
// ...
$deployment-setWorkflow($workflow);
$deployment-addApplication($application);
if (getenv('BUILD_TARGET') !== FALSE) {
$node = new TYPO3SurfDomainModelNode('node-' . getenv('BUILD_TARGET'));
$node-setHostname(getenv('BUILD_TARGET'));
$node-setOptions(array(
'username' = 'surf'
));
$application-addNode($node);
} else {
foreach (array('www01','www02','www03') as $node) {
$node = new TYPO3SurfDomainModelNode('node-' . $node);
$node-setHostname($node);
$node-setOptions(array(
'username' = 'surf'
));
$application-addNode($node);
}
}

234. ?php
/** @var $deployment TYPO3SurfDomainModelDeployment */
$workflow = new TYPO3SurfDomainModelSimpleWorkflow();
$application = new TYPO3SurfApplicationBaseApplication('MyApplication');
// ...
$deployment-setWorkflow($workflow);
$deployment-addApplication($application);
if (getenv('BUILD_TARGET') !== FALSE) {
$node = new TYPO3SurfDomainModelNode('node-' . getenv('BUILD_TARGET'));
$node-setHostname(getenv('BUILD_TARGET'));
$node-setOptions(array(
'username' = 'surf'
));
$application-addNode($node);
} else {
foreach (array('www01','www02','www03') as $node) {
$node = new TYPO3SurfDomainModelNode('node-' . $node);
$node-setHostname($node);
$node-setOptions(array(
'username' = 'surf'
));
$application-addNode($node);
}
}

235. ?php
/** @var $deployment TYPO3SurfDomainModelDeployment */
$workflow = new TYPO3SurfDomainModelSimpleWorkflow();
$application = new TYPO3SurfApplicationBaseApplication('MyApplication');
// ...
$deployment-setWorkflow($workflow);
$deployment-addApplication($application);
if (getenv('BUILD_TARGET') !== FALSE) {
$node = new TYPO3SurfDomainModelNode('node-' . getenv('BUILD_TARGET'));
$node-setHostname(getenv('BUILD_TARGET'));
$node-setOptions(array(
'username' = 'surf'
));
$application-addNode($node);
} else {
foreach (array('www01','www02','www03') as $node) {
$node = new TYPO3SurfDomainModelNode('node-' . $node);
$node-setHostname($node);
$node-setOptions(array(
'username' = 'surf'
));
$application-addNode($node);
}
}

236. Deployment
Build
Deploy

237. to
Node

238. N2
Deploy

239. to
Node

240. N3
Deploy

241. to
Node

242. N4
Deploy

243. to
Node

244. N1
What

245. happens

246. when

247. an

248. error
occurs

249. on

250. a

251. specific

252. node?

253. Deployment
Build
Deploy

254. to
Node

255. N2
Deploy

256. to
Node

257. N3
Deploy

258. to
Node

259. N4
Deploy

260. to
Node

261. N1
Build
FAIL
The

262. deployment

263. build
fails,

264. but

265. there

266. is

267. no

268.
rollback

269. on

270. the

271. other

272.
nodes!

273. „Update“
Build
N1
N2
N3
N4
ON

274. FAILURE
„Switch“
Build
POSSIBLE

275. SOLUTION

276. (?)
Split

277. the

278. deployment

279. stages

280. into

281.
two

282. separate

283. deployments

284. with

285.
separate

286. builds.
ON

287. SUCCESS
„Rollback“
Build
You‘ll

288. need

289. the

290. Build

291. Result

292. Trigger

293.
plugin

294. for

295. this.

296. Use

297. Jenkins

298. to

299. optimize
your

300. TYPO3

301. Surf

302. deployments
#3:

303. FEEDBACK

304. Use

305. glowing

306. bears

307. to

308. inform

309. you

310.
about

311. your

312. build

313. and

314.
deployment

315. status.
https://wiki.jenkins-ci.org/pages/viewpage.action?pageId=20250625

316. Use

317. glowing

318. bears

319. to

320. inform

321. you

322.
about

323. your

324. build

325. and

326.
deployment

327. status.
https://wiki.jenkins-ci.org/pages/viewpage.action?pageId=20250625
(If

328. you

329. don‘t

330. have

331. any

332. glowing

333. bears,

334. you

335.
can

336. use

337. plugins

338. like

339. the

340. Extreme

341. Feedback

342.
plugin).
https://wiki.jenkins-ci.org/display/JENKINS/eXtreme+Feedback+Panel+Plugin

343. GIT
PRIMARY
GIT
2NDARY
GERRIT
JENKINS
MASTER-1
JENKINS
MASTER-2
BUILD
NODES
BUILD
NODES
DEVDEVINT
DEVDEVQA
DEVDEVLIVE
TYPO3
SURF
TYPO3
SURF
Deployment

344. architecture
at

345. MittwaldSVN
THE
WORLD
DEVDEVDEV

346. TYPO3

347. Surf

348. is

349. optimized

350. for

351. the

352. deployment

353. of

354.
TYPO3

355. {FLOW,Neos}

356. applications,

357. TYPO3

358. Surf

359. is

360. optimized

361. for

362. the

363. deployment

364. of

365.
TYPO3

366. {FLOW,Neos}

367. applications,
BUT

368. TYPO3

369. Surf

370. is

371. optimized

372. for

373. the

374. deployment

375. of

376.
TYPO3

377. {FLOW,Neos}

378. applications,
BUT
You

379. can

380. use

381. it

382. for

383. virtually

384. anything:
TYPO3

385. CMS
Wordpress
Anything

386. that

387. fits

388. into

389. a

390. Git

391. repository
And

392. maybe

393. even

394. Joomla!

395. USEFUL

396. JENKINS/HUDSON

397.
PLUGINS
GIT

398. Plugin
https://wiki.jenkins-ci.org/display/JENKINS/Git+Plugin
Gerrit

399. Trigger
https://wiki.jenkins-ci.org/display/JENKINS/Gerrit+Trigger
Build

400. Result

401. Trigger
https://wiki.jenkins-ci.org/display/JENKINS/BuildResultTrigger+Plugin
TYPO3

402. Surf

403. Builder
https://github.com/martin-helmich/jenkins-typo3flow-plugin
HIGHLY

404. EXPERIMENTAL!
Use

405. at

406. own

407. risk!

408. •http://jenkins-ci.org
•http://forge.typo3.org/projects/package-typo3-surf
•http://git-scm.org
•https://github.com/martin-helmich/ant-typo3flow
•https://github.com/martin-helmich/jenkins-typo3surf-
plugin
•http://etobi.de/blog/2012/05/deployment-setup-typo3-surf/
•http://de.slideshare.net/etobide/t3con12-flow-and-typo3-
deployment-with-surf
•https://git.typo3.org/FLOW3/Packages/TYPO3.Surf.git/blob/
master:/Documentation/Guide/Index.rst
•Duvall,

409. Paul

410. M:

411. Continous

412. Integration,

413. published

414. by

415. Addison-
Wesley
•Wiest,

416. Simon:

417. Continuous

418. Integration

419. mit

420. Hudson/Jenkins,

421.
published

422. by

423. dpunkt.
•http://nvie.com/posts/a-successful-git-branching-model/

426. READING
Useful

427. Resources
SOFTWARE

431. Questions?

432. Image

433. Sources
Hani

434. Amir
http://www.flickr.com/photos/haniamir/2377822286/
Yaniv

435. Golan
http://www.flickr.com/photos/yanivg/131377774/
David

436. Tomic
http://www.flickr.com/photos/young_einstein/138800557/
http://commons.wikimedia.org/wiki/File:CD_stack.jpg
http://www.flickr.com/photos/j1x4r/4313734090/
Pedro

437. Szekely
http://commons.wikimedia.org/wiki/
File:Huntington_Beach_US_Surfing_Open_(6095230893).jpg
Kenny

438. Louie
http://en.wikipedia.org/wiki/
File:Highway_401_Night_Lapse_Busy.jpg
http://commons.wikimedia.org/wiki/File:Arc-welding.jpg?
uselang=de

439. Image

440. Sources,

441. #2
Horia

442. Varlan
http://www.flickr.com/photos/horiavarlan/4747872021/