Showing posts with label Glacier. Show all posts
Showing posts with label Glacier. Show all posts

Wednesday, July 9, 2014

Utilizing Amazon Glacier to store archived data Part 4

So this is update 4 to the whole idea of utilizing Amazon Glacier for long term storage of archived data.  Tip #1, which is the most important tip I can give anyone.. internets, internets, internets.  I cannot place enough importance on upload throughput.  I started this massive (relatively) upload job back around 6/17 and here it is.. first week of July and the job still has 165gb and @7 days remaining.

I am planning to totally saturate their connection tonight after COB.. hopefully that will help knock a chunk out of the remaining data.

If asked about Glacier itself... I have no complaints.  it's doing exactly what it's supposed to so far.

Wednesday, June 18, 2014

Utilizing Amazon Glacier to store archived data Part 3

After upgrading to the Pro version of FastGlacier it now averages 8 threads when uploading data, much, MUCH faster now.

WOOT!

Tuesday, June 17, 2014

Utilizing Amazon Glacier to store archived data Part 2

Finally got managerial approval and signed up for it yesterday.  Here in MI at my site we have a 6x6mb internet pipe, I was able to upload 1.2gb in roughly 1.5hours.  I chose to use FastGlacier, the free version.  Honestly the speed I think could be much better, it seems the free version is locked to only two threads and any large upload is broken up into 16mb chunks.

Now our MS site has a much lower upload, I believe they're hovering around 2mb on the upswing and since they have the vast majority of the data to upload I am about to purchase the full FastGlacier and I'll report back on the performance differences.

But aside from the performance, which yes is obviously one of the most important aspects of the application.  The gui itself is very nice.. easy to navigate and understand.  Being able to add multiple accounts, view all vaults and manipulate your vaulted data is very well laid out and accessible.  I really like this program so far!

Tuesday, June 3, 2014

Utilizing Amazon Glacier to store archived data on an Enterprise level.

In my environment here, like many other businesses I'm sure, we save terminated employees data indefinitely.  I have a process where we move the User folder, then export the mailbox into a PST and move both into a file share.  Well that folder has grown to a little over 600GB so far and it's very rarely accessed.
Glacier, I believe, would be the perfect home for this data.  Freeing up that much space on a file server for under $10 per month is WELL worth it to me.

My biggest question is the upload time... I've read horror stories on how slow the upload can be.  Granted there are a thousand different variables that can and will affect that time.  All we can do is try it out and see.

I'd love to hear any stories from others.. please feel free to comment.