SlideShare a Scribd company logo
1 of 37
Download to read offline
backups



using rsync and duplicity
Who needs to backup?
There are 2 kinds of people in this world:
1. Those who keep backups.
2. Those who lose their data.
What is a backup?
The copying and archiving of computer data to
assist in recovering from a data loss event.
What causes data loss?
●   Failure
●   Disaster
●   Crime
●   Intentional action
●   Unintentional action
Why keep a backup?
●   Keeps important files safe
●   Helps us recover from stupid mistakes
●   Helps recover from malicious attacks
●   CYA ( Cover Your Ass )
Types of backups
● RAID!?
RAID?!
RAID is not a backup!


ಠ_ಠ
Types of backups
● RAID!?
● Unstructured
Types of backups
●   RAID!?
●   Unstructured
●   Differential
●   Incremental
Rsync
● extremely efficient file transfer protocol for Unix
● open source (GNU license)
● written by Andrew Tridgell and Paul Mackerras at the
  Australian National University in 1996
Rsync
We can backup to either local or remote server


LOCAL
Go to external disk for local backup. Backing up to same
hard drive is not sufficient for a comprehensive backup
solution!

EXTERNAL
Goes to rsync daemon (can be standalone or started from
rsync client by inetd). Route through SSH shell for security.
Rsync
Local locations:
~/docs/important


Remote locations:
Remote Shell
[user@]server.com:~/docs/important

Rsync Daemon
[user@]server.com::~/docs/important
rsync://[user@]server.com/~/docs/important
Rsync
common flags:
  ● -v : verbose
Rsync
common flags:
  ● -v : verbose
  ● -a : archive
Rsync
common flags:
  ● -v : verbose
  ● -a : archive
  ● -z : compress
Rsync
common flags:
  ● -v : verbose
  ● -a : archive
  ● -z : compress
  ● --rsh=/usr/bin/ssh
Rsync
common flags:
  ● -v : verbose
  ● -a : archive
  ● -z : compress
  ● --rsh=/usr/bin/ssh
  ● --delete : delete extraneous files
Rsync
common flags:
  ● -v : verbose
  ● -a : archive
  ● -z : compress
  ● --rsh=/usr/bin/ssh
  ● --delete : delete extraneous files
  ● --link-dest : create hard links (incremental backup)
Incremental backups with Rsync
Hard links allow us to create extra nodes for
our files so we can make sure at least one copy
exists without using extra space.
Advantages of Rsync over cp
●   Mirroring data
●   Transmitting lots of data
●   Only copy what is needed
●   Use with --link-dest to create hard links for
    incremental backups
Duplicity
● First developed in 2002.
● Current version is 0.6.19 released in May
  2012
● GNU licensed
● Written in Python & C
● Leverages Rsync algorithm
● Available via package managers, or via
  RPM, binaries, or source downloadable from
  http://duplicity.nongnu.org/
Duplicity
Produces tar-format volumes on local or remote
servers
Duplicity files
● Backup
● Manifest
● Signature
Duplicity filesystems
Local File Storage, scp/SSH, Rsync, FTP, HSI,
WebDAV, Tahoe-LAFS, Amazon S3, with
others easily added
Duplicity
Remote locations are specified using URIs:
● ftp://[user@]archive.business.com/backups
● rsync://[user@]newspeak.marketing.biz/outside_box/
● s3+http://awesometown-socool
Using Duplicity
By default, Duplicity doesn't need any
command line options to make encrypted,
incremental backups to a local or remote
location. However, for a sane backup strategy
we should:

● Perform periodic full (snapshot) backups
● Delete old backups
● Ignore certain files
Using Duplicity
● --full-if-older-than
Using Duplicity
● --full-if-older-than
● remove-all-but-n-full
Using Duplicity
● --full-if-older-than
● remove-all-but-n-full
● --include/exclude-globbing-filelist
Using Duplicity
●   --full-if-older-than
●   remove-all-but-n-full
●   --include/exclude-globbing-filelist
●   PASSPHRASE environment variable
Moar Duplicity
Also used to verify backups and restore backups

Verify:
duplicity verify [backup] [source]
can also be used to determine changes since backup
Moar Duplicity
Also used to verify backups and restore backups

Verify:
duplicity verify [backup] [source]
can also be used to determine changes since backup

Restore:
duplicity restore [backup] [destination]
Can use --file-to-restore and --time flags to specify more
precise restoration
Why use Duplicity over Rsync?
● Encrypted and signed archives
● Built in incremental backup
● Ability to use a wide range of local and
  remote filesystems
Best Practices
●   Trust, but verify
●   Use strong passphrase
●   Backup to multiple locations
●   Automate
Automation
For the best backup strategy, we take the
human out of the equation.

● write a Bash script and cron it
● Use a GUI
Related Links
Jamie Zawinski on backups
http://www.jwz.org/doc/backups.html
Snapshot Backups with Rsync by Mike Ruebel
http://www.mikerubel.org/computers/rsync_snapshots/
Epydocs for Duplicity
http://duplicity.nongnu.org/epydoc/index.html
Duplicity to Amazon S3 Bash Script
http://blog.damontimm.com/bash-script-incremental-encrypted-backups-
duplicity-amazon-s3/
RTFM!
http://linux.die.net/man/1/rsync
http://duplicity.nongnu.org/duplicity.1.html
Lots of Horror Stories about not Backing Up
http://reddit.com/r/talesfromtechsupport

More Related Content

What's hot

What's hot (20)

vbsd2013
vbsd2013vbsd2013
vbsd2013
 
Introduction to Docker
Introduction to DockerIntroduction to Docker
Introduction to Docker
 
Tech talk Introduction to containers
Tech talk Introduction to containersTech talk Introduction to containers
Tech talk Introduction to containers
 
LUG - Install Fest 2008
LUG - Install Fest 2008LUG - Install Fest 2008
LUG - Install Fest 2008
 
System administration
System administrationSystem administration
System administration
 
Dockerの準備
Dockerの準備Dockerの準備
Dockerの準備
 
Backup with Bareos and ZFS - by Christian Reiß
Backup with Bareos and ZFS - by Christian ReißBackup with Bareos and ZFS - by Christian Reiß
Backup with Bareos and ZFS - by Christian Reiß
 
Docker 1.9 release party - Docker Ha Noi
Docker 1.9 release party - Docker Ha NoiDocker 1.9 release party - Docker Ha Noi
Docker 1.9 release party - Docker Ha Noi
 
MongoDB Shard Cluster
MongoDB Shard ClusterMongoDB Shard Cluster
MongoDB Shard Cluster
 
Optimization_of_Virtual_Machines_for_High_Performance
Optimization_of_Virtual_Machines_for_High_PerformanceOptimization_of_Virtual_Machines_for_High_Performance
Optimization_of_Virtual_Machines_for_High_Performance
 
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vos
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vosOSBConf 2015 | Scale out backups with bareos and gluster by niels de vos
OSBConf 2015 | Scale out backups with bareos and gluster by niels de vos
 
Arbiter volumes in gluster
Arbiter volumes in glusterArbiter volumes in gluster
Arbiter volumes in gluster
 
Docker Insight
Docker InsightDocker Insight
Docker Insight
 
DEF CON 23 - Shawn webb - hardenedBSD internals
DEF CON 23 - Shawn webb - hardenedBSD internalsDEF CON 23 - Shawn webb - hardenedBSD internals
DEF CON 23 - Shawn webb - hardenedBSD internals
 
Deploying And Scaling Rails
Deploying And Scaling RailsDeploying And Scaling Rails
Deploying And Scaling Rails
 
Linux fundamental - Chap 12 Hardware Management
Linux fundamental - Chap 12 Hardware ManagementLinux fundamental - Chap 12 Hardware Management
Linux fundamental - Chap 12 Hardware Management
 
Talk on PHP Day Uruguay about Docker
Talk on PHP Day Uruguay about DockerTalk on PHP Day Uruguay about Docker
Talk on PHP Day Uruguay about Docker
 
Linux fundamental - Chap 04 archive
Linux fundamental - Chap 04 archiveLinux fundamental - Chap 04 archive
Linux fundamental - Chap 04 archive
 
Can I write to a read only file ?
Can I write to a read only file ?Can I write to a read only file ?
Can I write to a read only file ?
 
Redis fundamental
Redis fundamentalRedis fundamental
Redis fundamental
 

Viewers also liked

Inventory management system
Inventory management systemInventory management system
Inventory management system
copo7475
 
Cyber crime and security ppt
Cyber crime and security pptCyber crime and security ppt
Cyber crime and security ppt
Lipsita Behera
 

Viewers also liked (13)

Financial Communications Society - BDI 11/06 The Future of Financial Services...
Financial Communications Society - BDI 11/06 The Future of Financial Services...Financial Communications Society - BDI 11/06 The Future of Financial Services...
Financial Communications Society - BDI 11/06 The Future of Financial Services...
 
Building Communities of “Trust”
 Building Communities of “Trust” Building Communities of “Trust”
Building Communities of “Trust”
 
CrypTag: Building Encrypted, Taggable, Searchable Zero-knowledge Systems
CrypTag: Building Encrypted, Taggable, Searchable Zero-knowledge SystemsCrypTag: Building Encrypted, Taggable, Searchable Zero-knowledge Systems
CrypTag: Building Encrypted, Taggable, Searchable Zero-knowledge Systems
 
EtherCalc: Multiplayer Spreadsheet
EtherCalc: Multiplayer SpreadsheetEtherCalc: Multiplayer Spreadsheet
EtherCalc: Multiplayer Spreadsheet
 
Inventory management system
Inventory management systemInventory management system
Inventory management system
 
Cost Accounting
Cost AccountingCost Accounting
Cost Accounting
 
Cyber crime and security ppt
Cyber crime and security pptCyber crime and security ppt
Cyber crime and security ppt
 
Financial Accounting
Financial AccountingFinancial Accounting
Financial Accounting
 
Basics of accounting
Basics of accountingBasics of accounting
Basics of accounting
 
Big Data - 25 Amazing Facts Everyone Should Know
Big Data - 25 Amazing Facts Everyone Should KnowBig Data - 25 Amazing Facts Everyone Should Know
Big Data - 25 Amazing Facts Everyone Should Know
 
Introduction of Cloud computing
Introduction of Cloud computingIntroduction of Cloud computing
Introduction of Cloud computing
 
24 Time Management Hacks to Develop for Increased Productivity
24 Time Management Hacks to Develop for Increased Productivity24 Time Management Hacks to Develop for Increased Productivity
24 Time Management Hacks to Develop for Increased Productivity
 
How Google Works
How Google WorksHow Google Works
How Google Works
 

Similar to Backup UUASC 9/6/12

Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Opersys inc.
 
Lightweight Virtualization with Linux Containers and Docker I YaC 2013
Lightweight Virtualization with Linux Containers and Docker I YaC 2013Lightweight Virtualization with Linux Containers and Docker I YaC 2013
Lightweight Virtualization with Linux Containers and Docker I YaC 2013
Docker, Inc.
 
Perfect Linux Desktop - OpenSuSE 12.2
Perfect Linux Desktop - OpenSuSE 12.2Perfect Linux Desktop - OpenSuSE 12.2
Perfect Linux Desktop - OpenSuSE 12.2
Davor Guttierrez
 

Similar to Backup UUASC 9/6/12 (20)

Backing up Wikipedia Databases
Backing up Wikipedia DatabasesBacking up Wikipedia Databases
Backing up Wikipedia Databases
 
Repositories as Code
Repositories as CodeRepositories as Code
Repositories as Code
 
linuxtl04.pptx
linuxtl04.pptxlinuxtl04.pptx
linuxtl04.pptx
 
OSBConf 2015 | Backups with rdiff backup and rsnapshot by christoph mitasch &...
OSBConf 2015 | Backups with rdiff backup and rsnapshot by christoph mitasch &...OSBConf 2015 | Backups with rdiff backup and rsnapshot by christoph mitasch &...
OSBConf 2015 | Backups with rdiff backup and rsnapshot by christoph mitasch &...
 
OpenNebulaConf 2016 - Storage Hands-on Workshop by Javier Fontán, OpenNebula
OpenNebulaConf 2016 - Storage Hands-on Workshop by Javier Fontán, OpenNebulaOpenNebulaConf 2016 - Storage Hands-on Workshop by Javier Fontán, OpenNebula
OpenNebulaConf 2016 - Storage Hands-on Workshop by Javier Fontán, OpenNebula
 
Docker in production: problems, fixes and beyond
Docker in production: problems, fixes and beyondDocker in production: problems, fixes and beyond
Docker in production: problems, fixes and beyond
 
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
Native Android Userspace part of the Embedded Android Workshop at Linaro Conn...
 
Introduction to Docker at SF Peninsula Software Development Meetup @Guidewire
Introduction to Docker at SF Peninsula Software Development Meetup @GuidewireIntroduction to Docker at SF Peninsula Software Development Meetup @Guidewire
Introduction to Docker at SF Peninsula Software Development Meetup @Guidewire
 
Nagios Conference 2014 - Andy Brist - Nagios XI Failover and HA Solutions
Nagios Conference 2014 - Andy Brist - Nagios XI Failover and HA SolutionsNagios Conference 2014 - Andy Brist - Nagios XI Failover and HA Solutions
Nagios Conference 2014 - Andy Brist - Nagios XI Failover and HA Solutions
 
Lightweight Virtualization with Linux Containers and Docker | YaC 2013
Lightweight Virtualization with Linux Containers and Docker | YaC 2013Lightweight Virtualization with Linux Containers and Docker | YaC 2013
Lightweight Virtualization with Linux Containers and Docker | YaC 2013
 
Lightweight Virtualization with Linux Containers and Docker I YaC 2013
Lightweight Virtualization with Linux Containers and Docker I YaC 2013Lightweight Virtualization with Linux Containers and Docker I YaC 2013
Lightweight Virtualization with Linux Containers and Docker I YaC 2013
 
Linux
LinuxLinux
Linux
 
Adhocr T-dose 2012
Adhocr T-dose 2012Adhocr T-dose 2012
Adhocr T-dose 2012
 
Archivematica Technical Training Diagnostics Guide (September 2018)
Archivematica Technical Training Diagnostics Guide (September 2018)Archivematica Technical Training Diagnostics Guide (September 2018)
Archivematica Technical Training Diagnostics Guide (September 2018)
 
Perfect Linux Desktop - OpenSuSE 12.2
Perfect Linux Desktop - OpenSuSE 12.2Perfect Linux Desktop - OpenSuSE 12.2
Perfect Linux Desktop - OpenSuSE 12.2
 
Snap - the universal packaging format for linux distros
Snap - the universal packaging format for linux distrosSnap - the universal packaging format for linux distros
Snap - the universal packaging format for linux distros
 
Docker 0.11 at MaxCDN meetup in Los Angeles
Docker 0.11 at MaxCDN meetup in Los AngelesDocker 0.11 at MaxCDN meetup in Los Angeles
Docker 0.11 at MaxCDN meetup in Los Angeles
 
Backups
BackupsBackups
Backups
 
Ilf2013
Ilf2013Ilf2013
Ilf2013
 
Backup, Restore, and Disaster Recovery
Backup, Restore, and Disaster RecoveryBackup, Restore, and Disaster Recovery
Backup, Restore, and Disaster Recovery
 

Recently uploaded

Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
panagenda
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
?#DUbAI#??##{{(☎️+971_581248768%)**%*]'#abortion pills for sale in dubai@
 

Recently uploaded (20)

Strategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a FresherStrategies for Landing an Oracle DBA Job as a Fresher
Strategies for Landing an Oracle DBA Job as a Fresher
 
MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024MINDCTI Revenue Release Quarter One 2024
MINDCTI Revenue Release Quarter One 2024
 
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu SubbuApidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
Apidays Singapore 2024 - Modernizing Securities Finance by Madhu Subbu
 
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
Web Form Automation for Bonterra Impact Management (fka Social Solutions Apri...
 
AWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of TerraformAWS Community Day CPH - Three problems of Terraform
AWS Community Day CPH - Three problems of Terraform
 
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
Connector Corner: Accelerate revenue generation using UiPath API-centric busi...
 
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
Apidays New York 2024 - Accelerating FinTech Innovation by Vasa Krishnan, Fin...
 
Corporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptxCorporate and higher education May webinar.pptx
Corporate and higher education May webinar.pptx
 
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
Mastering MySQL Database Architecture: Deep Dive into MySQL Shell and MySQL R...
 
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
Strategies for Unlocking Knowledge Management in Microsoft 365 in the Copilot...
 
Why Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire businessWhy Teams call analytics are critical to your entire business
Why Teams call analytics are critical to your entire business
 
MS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectorsMS Copilot expands with MS Graph connectors
MS Copilot expands with MS Graph connectors
 
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWEREMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
EMPOWERMENT TECHNOLOGY GRADE 11 QUARTER 2 REVIEWER
 
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
+971581248768>> SAFE AND ORIGINAL ABORTION PILLS FOR SALE IN DUBAI AND ABUDHA...
 
presentation ICT roal in 21st century education
presentation ICT roal in 21st century educationpresentation ICT roal in 21st century education
presentation ICT roal in 21st century education
 
Boost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdfBoost Fertility New Invention Ups Success Rates.pdf
Boost Fertility New Invention Ups Success Rates.pdf
 
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data DiscoveryTrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
TrustArc Webinar - Unlock the Power of AI-Driven Data Discovery
 
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, AdobeApidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
Apidays New York 2024 - Scaling API-first by Ian Reasor and Radu Cotescu, Adobe
 
2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...2024: Domino Containers - The Next Step. News from the Domino Container commu...
2024: Domino Containers - The Next Step. News from the Domino Container commu...
 
DBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor PresentationDBX First Quarter 2024 Investor Presentation
DBX First Quarter 2024 Investor Presentation
 

Backup UUASC 9/6/12

  • 2. Who needs to backup? There are 2 kinds of people in this world: 1. Those who keep backups. 2. Those who lose their data.
  • 3. What is a backup? The copying and archiving of computer data to assist in recovering from a data loss event.
  • 4. What causes data loss? ● Failure ● Disaster ● Crime ● Intentional action ● Unintentional action
  • 5.
  • 6. Why keep a backup? ● Keeps important files safe ● Helps us recover from stupid mistakes ● Helps recover from malicious attacks ● CYA ( Cover Your Ass )
  • 8. RAID?! RAID is not a backup! ಠ_ಠ
  • 9. Types of backups ● RAID!? ● Unstructured
  • 10. Types of backups ● RAID!? ● Unstructured ● Differential ● Incremental
  • 11. Rsync ● extremely efficient file transfer protocol for Unix ● open source (GNU license) ● written by Andrew Tridgell and Paul Mackerras at the Australian National University in 1996
  • 12. Rsync We can backup to either local or remote server LOCAL Go to external disk for local backup. Backing up to same hard drive is not sufficient for a comprehensive backup solution! EXTERNAL Goes to rsync daemon (can be standalone or started from rsync client by inetd). Route through SSH shell for security.
  • 13. Rsync Local locations: ~/docs/important Remote locations: Remote Shell [user@]server.com:~/docs/important Rsync Daemon [user@]server.com::~/docs/important rsync://[user@]server.com/~/docs/important
  • 14. Rsync common flags: ● -v : verbose
  • 15. Rsync common flags: ● -v : verbose ● -a : archive
  • 16. Rsync common flags: ● -v : verbose ● -a : archive ● -z : compress
  • 17. Rsync common flags: ● -v : verbose ● -a : archive ● -z : compress ● --rsh=/usr/bin/ssh
  • 18. Rsync common flags: ● -v : verbose ● -a : archive ● -z : compress ● --rsh=/usr/bin/ssh ● --delete : delete extraneous files
  • 19. Rsync common flags: ● -v : verbose ● -a : archive ● -z : compress ● --rsh=/usr/bin/ssh ● --delete : delete extraneous files ● --link-dest : create hard links (incremental backup)
  • 20. Incremental backups with Rsync Hard links allow us to create extra nodes for our files so we can make sure at least one copy exists without using extra space.
  • 21. Advantages of Rsync over cp ● Mirroring data ● Transmitting lots of data ● Only copy what is needed ● Use with --link-dest to create hard links for incremental backups
  • 22. Duplicity ● First developed in 2002. ● Current version is 0.6.19 released in May 2012 ● GNU licensed ● Written in Python & C ● Leverages Rsync algorithm ● Available via package managers, or via RPM, binaries, or source downloadable from http://duplicity.nongnu.org/
  • 23. Duplicity Produces tar-format volumes on local or remote servers
  • 24. Duplicity files ● Backup ● Manifest ● Signature
  • 25. Duplicity filesystems Local File Storage, scp/SSH, Rsync, FTP, HSI, WebDAV, Tahoe-LAFS, Amazon S3, with others easily added
  • 26. Duplicity Remote locations are specified using URIs: ● ftp://[user@]archive.business.com/backups ● rsync://[user@]newspeak.marketing.biz/outside_box/ ● s3+http://awesometown-socool
  • 27. Using Duplicity By default, Duplicity doesn't need any command line options to make encrypted, incremental backups to a local or remote location. However, for a sane backup strategy we should: ● Perform periodic full (snapshot) backups ● Delete old backups ● Ignore certain files
  • 30. Using Duplicity ● --full-if-older-than ● remove-all-but-n-full ● --include/exclude-globbing-filelist
  • 31. Using Duplicity ● --full-if-older-than ● remove-all-but-n-full ● --include/exclude-globbing-filelist ● PASSPHRASE environment variable
  • 32. Moar Duplicity Also used to verify backups and restore backups Verify: duplicity verify [backup] [source] can also be used to determine changes since backup
  • 33. Moar Duplicity Also used to verify backups and restore backups Verify: duplicity verify [backup] [source] can also be used to determine changes since backup Restore: duplicity restore [backup] [destination] Can use --file-to-restore and --time flags to specify more precise restoration
  • 34. Why use Duplicity over Rsync? ● Encrypted and signed archives ● Built in incremental backup ● Ability to use a wide range of local and remote filesystems
  • 35. Best Practices ● Trust, but verify ● Use strong passphrase ● Backup to multiple locations ● Automate
  • 36. Automation For the best backup strategy, we take the human out of the equation. ● write a Bash script and cron it ● Use a GUI
  • 37. Related Links Jamie Zawinski on backups http://www.jwz.org/doc/backups.html Snapshot Backups with Rsync by Mike Ruebel http://www.mikerubel.org/computers/rsync_snapshots/ Epydocs for Duplicity http://duplicity.nongnu.org/epydoc/index.html Duplicity to Amazon S3 Bash Script http://blog.damontimm.com/bash-script-incremental-encrypted-backups- duplicity-amazon-s3/ RTFM! http://linux.die.net/man/1/rsync http://duplicity.nongnu.org/duplicity.1.html Lots of Horror Stories about not Backing Up http://reddit.com/r/talesfromtechsupport