Scobleizer - Latest Comments in No, I didn’t take down Amazon

Re: No, I didn’t take down Amazon

Blagovest — Mon, 25 Feb 2008 16:09:14 -0000

There is a very important question you have to ask yourself before deciding whether to use S3: what are you really looking for - remote storage, content delivery, or both. These are crucial to distinguish.

What I observe is that most people treat Amazon S3 as a content delivery service. While this is not inherently wrong, one has to notice that S3 was especially designed to be a STORAGE service. S3 does not claim to be a CDN.

The point is, since terabyte hard drives are affordable nowadays and internet traffic grows steadily, the stress goes much more on content delivery and network infrastructure rather than on storage. If you are not concerned about using remote storage, there are much better services especially suited for content delivery.

SteadyOffload.com provides an innovative, subtle and convenient way to offload static content. The whole mechanism there is quite different from Amazon S3. Instead of permanently uploading your files to a third-party host, their cachebot crawls your site and mirrors the content in a temporary cache on their servers. Content remains stored on your server while it is being delivered from the SteadyOffload cache. The URL of the cached object on their server is dynamically generated at page loading time, very scrambled and is changing often, so you don’t have to worry about hotlinking. This means that there is an almost non-existent chance that the cached content gets exposed outside of your web application.

It’s definitely worth trying because it’s not a storage service like S3 but exactly a service for offloading static content.

Watch that:
http://video.google.com/vid... (the video shows integration with WordPress, but it is integrable with any other webpage)
http://www.steadyoffload.com/
http://codex.wordpress.org/...

Cost of bandwidth comes under $0.2 per GB - affordable, efficient and convenient. Looks like a startup but lures me very much. Definitely simpler and safer than Amazon S3.

Re: No, I didn’t take down Amazon

Wreck — Fri, 15 Feb 2008 22:49:40 -0000

Server redundancy does not mean good security. They still have to worry about being victims of a major DDoS attack. Almost nothing can stand up to a massive DDoS, even if the router security people do blackhole routing -- the connection is simply just overrun with gazilliions of packets.

The smart thing to do is have your data made redundant by hosting at multiple sites with immediate failover. That's what the pros do. Hosting at a single site, even with redundancy at that one site is nuts.

Re: No, I didn’t take down Amazon

mkrigsman — Fri, 15 Feb 2008 19:54:56 -0000

Yes, yes, it was Twitter's fault. Where ever twitter goes to host, they immediately fail. Some of sort of voodoo hex or spell. I suggest exorcism.

Re: No, I didn’t take down Amazon

Rob Bazinet — Fri, 15 Feb 2008 19:36:10 -0000

Amazon plans to provide critical services to businesses, they can't have this sort of thing happening. I agree with @Orville, be more like Google.

I have some thoughts at my blog if anyone is interested - http://rbazinet.wordpress.c...

Re: No, I didn’t take down Amazon

Orville Chomer — Fri, 15 Feb 2008 16:29:25 -0000

Amazon needs to work at having an infrastructure like Google.

Server goes down? No problem! Another one kicks in with the user unaware of the issue. After all, they are famous for their network/database redundancy.

Perhaps Google should get in this business!

On another note: It is strange that I just signed up for an Amazon web service just a couple days ago! I don't think about ten sample calls to it would bring it down though! :)

Re: No, I didn’t take down Amazon

Jon Henshaw — Fri, 15 Feb 2008 16:07:23 -0000

@Scott, now you're just making me hungry for eggs.

Re: No, I didn’t take down Amazon

Krish — Fri, 15 Feb 2008 13:52:04 -0000

When I saw the news today, the first thing that came into my mind was Valleywag linking your visit to the S3 downtime. Good you came out before they could switch on their imaginations :-)

Re: No, I didn’t take down Amazon

Khürt L. Williams — Fri, 15 Feb 2008 13:14:24 -0000

Oh crap!! I just convinced some coworkers to take a look at Amazon S3 for backing up their media librarires based on the single argument that IT DOES NOT GO DOWN! Sigh!

Re: No, I didn’t take down Amazon

Rob — Fri, 15 Feb 2008 12:58:08 -0000

An online bookstore gets gigantic and suddenly everyone expects them to be Akamai?

Re: No, I didn’t take down Amazon

smoothspan — Fri, 15 Feb 2008 12:54:12 -0000

We've gotten so good at reducing adoption friction, that we'll see a lot of this kind of thing. It just isn't possible to plan for it.

Re: No, I didn’t take down Amazon

Kin Lane — Fri, 15 Feb 2008 12:48:36 -0000

I'm spreading the rumor it was Robert that took it down.

Re: No, I didn’t take down Amazon

Scott — Fri, 15 Feb 2008 12:31:55 -0000

Exactly why storage in the cloud is a ways off. Even if they fix the problem, it's a mental setback to people that make the decisions.

@Jon Henshaw, about all the eggs in one basket. Yes, for any given app, having S3 go down is no different than having your DB server go down. Except that:
- You control your DB server and your redundancy options and you very likely can get *your* data back up quickly.
- Your DB server going down does not cause my DB server to be unavailable, but S3 going down takes down many subscribers data.

"All the eggs" doesn't necessarily mean all of "your" eggs, but all of "everybody's" eggs.

Re: No, I didn’t take down Amazon

Michael — Fri, 15 Feb 2008 11:55:39 -0000

Woot uses Amazon S3, there is a Woot Off today. Can't be a coincidence.

Re: No, I didn’t take down Amazon

mike ashworth — Fri, 15 Feb 2008 11:50:38 -0000

Interesting, perhaps lots more people signed up to use it after your original article.

Following on from my comment on your original story where I posed a couple of questions with regard to Disaster Recovery and Business Continuity plans. It looks like they have some, but it looks very patchy indeed. When they say its back, and then that maybe its a bit spotty doesn't fill an enterprise, who perhaps have business critical data residing on those servers, with confidence.

To answer your question from yesterday, you wouldn't be allowed access to primary and back-up site as you have no need to know where they are situated and I wouldn't either as I am not conducting a Physical Site review.

I hope that Companies considering placing data on any box consider some of the risks and appraise correctly.

Mike Ashworth
Business Coaching and Consultancy
Brighton and Hove, Sussex, UK

Re: No, I didn’t take down Amazon

Jon Henshaw — Fri, 15 Feb 2008 11:48:19 -0000

@Wreck, I hope to one day be lucky enough to own two baskets, then if one basket breaks, I will still have 1/2 a website...that is 1/2 of a useless, broken website. There's no difference between using S3 or any other hosting provider. They are all susceptible to going down. If you break a few eggs or piss on your basket, the result is still usually the same. Of all the services, S3 up to this point has been a very reliable and affordable service – and I think they still are.

Re: No, I didn’t take down Amazon

Jon Henshaw — Fri, 15 Feb 2008 11:42:26 -0000

My theory is that it's all related to Twitter. Wherever Twitter goes, hosting environments fall! :P

Re: No, I didn’t take down Amazon

Wreck — Fri, 15 Feb 2008 11:41:54 -0000

All of your eggs in one basket is dangerous.

Re: No, I didn’t take down Amazon

allen stern — Fri, 15 Feb 2008 11:32:10 -0000

Thanks Robert - what's funny is that I was just about to put my article online about S3 on CN and how we use it -- and then it died. Now I must adjust my article accordingly.