A Decade of Innovation

A Decade of Innovation

March 14, 2006 was the beginning of a new era in computing. That was the day that Amazon Web Services released the Simple Storage Service (S3). Technically, Simple Queuing Services was released earlier but it was the release of S3 that really ...

More
Volkswagen Emissions Fiasco

Volkswagen Emissions Fiasco

I’m an avid reader of engineering disasters since one of my primary roles in my day job is to avoid them. And, away from work, we are taking a small boat around the world with only two people on board and that too needs to be done with care ...

More
VPC_NAT_Gateway

VPC NAT gateways : transactional uniqueness at scale

This is a guest blog post on Perspectives from Colm MacCarthaigh, a senior engineer on the Amazon Web Services team that designed and built the new VPC Network Address Translation Gateway service that just went live yesterday. Over the last 25 ...

More
Amazon Fowler Ridge

Greenpeace, Renewable Energy, and Data Centers

Greenpeace has focused on many issues of great import over the years. I like whales, don’t like shark finning, and it’s hard to be a huge fan of testing nuclear weapons on South Pacific islands. Much good work has been done and continues to be ...

More
Zynga

The Return to the Cloud

Zynga is often in the news because gaming is hot and Zynga has been, and continues to be, a successful gaming company. What’s different here is the story isn’t about gaming nor is it really about Zynga itself. The San Francisco ...

More
AWS_reInvent

AWS re:Invent Conference

In the Amazon Web Services world, this has always been a busy time of the year. Busy, because, although we aim for a fairly even pace of new service announcements and new feature releases all year, invariably, somewhat more happens towards the ...

More
Challenges in Designing at Scale: Formal Methods in Building Robust Distributed Systems

Challenges in Designing at Scale: Formal Methods in Building Robust Distributed Systems

We all know that when designing and operating applications at scale, it is persistent state management that brings the most difficult challenges. Delivering state-free applications has always been (fairly) easy. But most interesting commercial ...

More
Energy Efficiency of Cloud Computing

Energy Efficiency of Cloud Computing

Most agree that cloud computing is inherently more efficient that on premise computing in each of several dimensions. Last November, I went after two of the easiest to argue gains: utilization and the ability to sell excess capacity (Datacenter ...

More
The Cloud: Fastest Industry Transition Ever

The Cloud: Fastest Industry Transition Ever

It’s not often I’m enthused about spending time in Las Vegas but this year’s AWS re:Invent conference was a good reason to be there. It’s exciting getting a chance to meet with customers who have committed their business to the cloud or are ...

More
FacebookIowa

Datacenter Renewable Power Done Right

Facebook Iowa Data Center In 2007, the EPA released a study on datacenter power consumption at the request of the US Congress (EPA Report to Congress on Server and Data Center Efficiency). The report estimated that the power consumption of ...

More
Counting Servers is Hard

Counting Servers is Hard

At the Microsoft World-Wide Partners Conference, Microsoft CEO Steve Ballmer announced that “We have something over a million servers in our data center infrastructure. Google is bigger than we are. Amazon is a little bit smaller. You get Yahoo! ...

More
Customer Trust

Customer Trust

In the cloud there is nothing more important than customer trust. Without customer trust, a cloud business can’t succeed. When you are taking care of someone else’s assets, you have to treat those assets as more important than your own. Security ...

More
Redshift: Data Warehousing at Scale in the Cloud

Redshift: Data Warehousing at Scale in the Cloud

I’ve worked in or near the database engine world for more than 25 years. And, ironically, every company I’ve ever worked at has been working on a massive-scale, parallel, clustered RDBMS system. The earliest variant was IBM DB2 Parallel Edition ...

More
Amazon Event in Palo Alto (10/11@5pm)

Amazon Event in Palo Alto (10/11@5pm)

The last few weeks have been busy and it has been way too long since I have blogged. I’m currently thinking through the server tax and what’s wrong with the current server hardware ecosystem but don’t have anything yet ready to go on that just ...

More
Glacier: Engineering for Cold Data Storage in the Cloud

Glacier: Engineering for Cold Data Storage in the Cloud

Earlier today Amazon Web Services announced Glacier, a low-cost, cloud-hosted, cold storage solution. Cold storage is a class of storage that is discussed infrequently and yet it is by far the largest storage class of them all. Ironically, the ...

More
EBS Provisioned IOPS & Optimized Instance Types

EBS Provisioned IOPS & Optimized Instance Types

In I/O Performance (no longer) Sucks in the Cloud, I said Many workloads have high I/O rate data stores at the core. The success of the entire application is dependent upon a few servers running MySQL, Oracle, SQL Server, MongoDB, Cassandra, or ...

More