Two weeks ago I wrote about "The Need for Speed" in cloud computing, and
asked "Who is going to build the low-latency cloud for enterprise
customers?". Today Werner Vogels and his team at Amazon announced their
Cluster Compute Instances offering.
This is a very important step forward towards the kind of realtime, high
performance cloud that customers such as Cloudscale require to deliver the
next generation of cloud services. In our case, it means we now have three
distinct alternatives for deployment of our massively parallel realtime data
warehouse architecture: standard public cloud (EC2+S3+...), in-house cluster
(Eucalyptus or native), and now high-performance public cloud cluster.
As a former parallel supercomputing researcher, turned realtime analytics
guy, I'm excited and impressed by what Werner and his team are opening up
today. Just as commodity clusters hav... (more)
Big data is creating a massive disruption for the IT industry. Faced with
exponentially growing data volumes in every area of business and the web,
companies around the world are looking beyond their current databases and
data warehouses for new ways to handle this data deluge.
Taking a lead from Google, a number of organizations have been exploring the
potential of MapReduce, and its open source clone Hadoop, for big data
processing. The MapReduce/Hadoop approach is based around the idea that
what's needed is not database processing with SQL queries, but rather
dataflow computin... (more)
The future of enterprise software is the platform. No software company has
all the smart people in the world on its payroll. Apple recognized this and
created the App Store. Google are now doing the same. These new cloud
platforms will unleash unprecedented innovation and creativity throughout all
areas of business and the web, with thousands of new apps being created that
will revolutionize IT.
Enterprise software has always been unpopular - it has always been expensive,
slow, complex and clunky. The only people who actually like it are the
software vendors who sell it, and the... (more)
Cloud Data Analytics on Ulitzer
Cloud analytics is hot. Gartner's top two strategic technologies for the
enterprise in 2010 are cloud computing and advanced analytics. In their words
"Technologies you can't afford to ignore".
Venture capitalist Ann Winblad, in a recent video, points out that the coming
era of realtime cloud analytics will have a revolutionary impact on the
enterprise, creating a radically new "innovation palette" for businesses of
Business analytics is, of course, a major established sector of the IT
industry, but it's one that's ripe for disruption. T... (more)
In big data computing, and more generally in all commercial highly parallel
software systems, speed matters more than just about anything else. The
reason is straightforward, and has been known for decades.
Put very simply, when it comes to massively parallel software of the kind
need to handle big data, fast is both better AND cheaper. Faster means lower
latency AND lower cost.
At first this may seem counterintuitive. A high-end sports car will be much
faster than a standard family sedan, but the family sedan may be much
cheaper. Cheaper to buy, and cheaper to run. But massively ... (more)