grandeduc - Fotolia

Q
Evaluate Weigh the pros and cons of technologies, products and projects you are considering.

How do incremental backups on Amazon EBS work?

Looking for the best way to back up Amazon EBS? Expert Chris Moyer clarifies how incremental backups work.

We're currently working on an automated mechanism, so our Amazon EBS volumes will be backed up on a daily basis. We know how to create snapshots, but we're concerned about the size of some of them. If we have a ton of data, we'll have a significant increase in the invoice for each backup (since we will be charged on the size). But here's our question: If our backup is incremental and we're only uploading the modified data, where's our original data?

I think the confusion here is how incremental backups work. Typical backup schedules involve something like one full backup per week, and daily backups in between. Amazon EBS does block-level backups, including for incremental backups, so here's how that works.

  1. Your first backup must be a full one, which stores all blocks in a compressed format in Amazon Simple Storage Service (S3).
  2. Your next backup can be incremental, which just stores any changed blocks of data, also stored in S3.
  3. Another backup may be made that's also incremental, which again just stores changed blocks from the previous incremental backup.

Let's say now you restore your third backup. It first has to load your last full backup (Backup 1), then load the changes from Backup 2, then from Backup 3 to push all of the changes on top of the last full backup. This is identical to how most version control systems operate: storing the original and then just incremental changes each time a new commit is created.

The advantage to incremental backups like this is that if you have a system that does not change very much, only the things which are changed need to be stored again, and those changes are usually small and require significantly less disk space and time to upload.

The disadvantage of incremental backups is that the restore time will almost always be longer, as it has to re-build the full backup from your batches of changes.

I strongly recommend that you adjust your Amazon EBS backup policy, and keep at least one full backup per month, and keep your daily backups as incremental backups. You can also make sure to clean out and remove all but one backup for each prior month to help trim down the amount of storage you need to keep long term.

Next Steps

Why enterprises are moving to private storage clouds

This was last published in August 2015

Dig Deeper on Cloud data integration and application integration

PRO+

Content

Find more PRO+ content and other member only offers, here.

Have a question for an expert?

Please add a title for your question

Get answers from a TechTarget expert on whatever's puzzling you.

You will be able to add details on the next page.

Join the conversation

2 comments

Send me notifications when other members comment.

By submitting you agree to receive email from TechTarget and its partners. If you reside outside of the United States, you consent to having your personal data transferred to and processed in the United States. Privacy

Please create a username to comment.

What has been your experience with incremental backups?
Cancel
This is my main storage strategy. So far it's worked fine, but I keep a larger number of incremental backups rotating all the time. I have indicated that my move will be toward a more secure solution in the future if I can determine what this is with some definite assurances. I think DVDs might be one solution for archives and I think SSDs will soon be my main solution for incremental backups. Right now I'm using HDDs for both of these.
Cancel

-ADS BY GOOGLE

SearchAWS

TheServerSide.com

SearchFinancialApplications

SearchBusinessAnalytics

SearchCRM

SearchSalesforce

DevOpsAgenda

Close