Amazon Glacier Improvements


Amazon has pushed out a couple of important updates related to Glacier recently. The most notable is a new S3 feature to automatically migrate data from S3 to Glacier based on certain rules like age and organization structure. The other update deals with partitioned retrieves of large data sizes; for instance restoring a large file in multiple operations to keep restore costs under control.

Now, as much as I love the idea that S3 based structures can be automatically archived or migrated to Glacier, I would really prefer a storage client that offer intelligent use and configuration of these services. These two services offer very different price points and usage patterns, and a healthy combination would probably make sense for most backup scenarios. One example is that read/write data like a backup manifest or database would need a service like S3 whereas stable data like photos and videos would benefit from Glacier storage. Data used in sync scenarios would probably need to be on S3.

Browsing through various developer forums it is obvious that a lot of them are trying to find a reasonable user interaction model to deal with both the recovery delay and recovery throttling needed for Glacier. There is little doubt in my mind that there is ample room for a good Amazon AWS client in the backup and sync space. I would really like to have my entire backup on this platform, and the ability to offer certain parts of it for instant file sync and other parts of it for slow file sync. Within the current Glacier pricing model, keeping file history around for a long time becomes very appealing – so good purge options would also make a lot of sense. Even better if the purge options were respectful of the Glacier early delete penalty model.

In short, all I need now is a great client – and if that is not available then at least a decent one.

Comments

Post a Comment

Popular posts from this blog

No more Google Apps for Families

It is sad that Google won’t be accepting more people for its free Google Apps offering. I know quite a few people who use this service as individuals or families to take advantage of centralized management of accounts and personal domains. Being able to provide support for these services to your parents and children was a killer feature, be it password resets or other typical small business tasks. The official recommendation is to create personal Google Accounts. This might have been fine if features like custom domains and some account oversight or management was available. I hope that Google will come to its senses and come up with a Google Personal Premium service that will offer some essential family features. I would be happy to pay a few dollars, but the current cost of Google Apps Premium is hardly family friendly. Luckily, existing users can continue using Google Apps for free, but it is obvious that we may be left behind moving forward. After all Google is citing that ...
Read more

Adventures in Cloud Backup Land

I have usually tried to keep my critical data down to a reasonable size, and with a reasonable level of redundancy. In what I suspect can be referred to as the old days in computer time, I used to backup to external hard drives – or more recently popularized and modernized as a NAS device. While this remains an almost as popular approach as no backup at all, we are living in a cloud backup era and it is a good idea to find a backup option in this domain – and I suppose a lot of us have; knowingly or not. That said, I still like my local backup. So what does one do? Well, I did what I thought was sensible at the time. I when to my local backup supplier and found a cloud option – a no brainer one might think. It seemed to have all the bells and whistles to suit my somewhat skeptical mind. Well, my cloud experience with Acronis was short lived. For such a crucial player in the local backup and imaging marked, I have little positive feedback for their cloud service. Reminded me of when ...
Read more