With MongoDB, you usually use the mongodump and mongorestore utility to dump and restore a new node, and optionally you can use the --oplog option to do the point-in-time snapshotting. However, with high volume data typically running in to TBs, the dump and restore activity every-time can be quite time-consuming. Another approach is to do rsync of the db filesystem, but here subsequent backups can cause the data on disk to grow quickly. This is where the incremental back-ups can help. One can then use any of the above approaches to initially seed the database and subsequently back-up data in an incremental fashion using a tool.

1. An Incremental Backup and
Restore Tool
for
Tayra

2. Smart Hoarding Capabilities

3. 27019
27018
27017
27022
27025
Target
Mongo
Secured Replica
Set
Backup Restore
Features

4. 27019
27018
27017
27022
27025
Target
Mongo
Secured Replica
Set
Backup Restore
• Rotating Backup Files
Features

5. 27019
27018
27017
27022
27025
Target
Mongo
Secured Replica
Set
Backup Restore
• Rotating Backup Files
• Selective Backup
Features

6. 27019
27018
27017
27022
27025
Target
Mongo
Secured Replica
Set
Backup Restore
• Rotating Backup Files
• Selective Backup
• Selective Restore
Features

7. 27019
27018
27017
27022
27025
Target
Mongo
Secured Replica
Set
Backup Restore
• Rotating Backup Files
• Selective Backup
• Selective Restore
• Survive Node Crash
Features

8. 27019
27018
27017
27022
27025
Target
Mongo
Secured Replica
Set
Backup Restore
Survive Master Crash

9. 27019
27018
27017
27022
27025
Target
Mongo
Secured Replica
Set
Backup Restore
Survive Master Crash

10. Replay Performance
Tayra

11. -2
0
2
5
7
9
1GB 2GB 4GB 8GB 16GB 32GB
0.36 0.51
1.02
2.20
4.52
8.78
Tayra Replay Performance
ReplayTime(Hrs)
Backup File Size
Fixed Buffer Size = 8 MB

12. 0
18
35
53
70
4KB 8KB 32KB 64KB 256KB 1MB 2MB 4MB 8MB
61.12 61.30 60.57 60.67
62.28
64.08
62.25 62.78
60.83
31.40 31.57 30.80
39.02
50.35
35.32 34.53
33.42
35.72
20.73
17.50
15.28 15.72
17.45 17.15
14.82 14.60 14.67
Tayra Replay Performance using Custom Buffer Size
Time(Mins)
Buffer Size
FileSize: 1GB Trend 1 FileSize: 2GB Trend 2 FileSize: 4GB Trend 3

13. Tayra
What we used?

14. Codebase
spock
Tests Build
fit.c2.com

15. How we Deliver?
Tayra

16. Continuous Delivery

17. Continuous Delivery
•Test Driven Development

18. Continuous Delivery
•Test Driven Development
•Acceptance Tests using FIT

19. Tayra
Design Overview

20. Key Abstractions

21. Notifiers & Listeners

22. Anuja Dongoankar
Bhagyashree Mandora
Dhaval Dalal
Sameer Soni
Samridhi Gupta
Swanand Pethe
Vivek Dhapola
The Team

23. github.com/EqualExperts/Tayra
Thank-You