Storagebod Rotating Header Image

Cloud

Cloud==Death of Visio!

Everyone else appears to be having a go at defining what 'Cloud Computing' is; is it a thing, is it a movement, is it an illusion, is it new or is it just old concepts rehashed?

Now having worked as an Infrastructure Architect in the past, I am quite happy with drawing clouds to represent 'something where magic' happens; most often it was the network, it was something which was commonly outsourced and certainly when my traffic ended up in the WAN, I didn't really care what happened as long as it came back out again meeting all my SLAs.

SLAs covered things such as performance, availability, security etc; so extending this idea to the actual compute and storage is not especially scarey. It is certainly going to make drawing diagrams alot easier; no-more incredibly detailed Visio diagrams, just a cloud and a label saying 'Magic Happens'.

So there you go, 'Cloud Computing' is where magic happens to data and it is the death of Visio! And I am sure that is a definition that we can all sign up to!

Living in the Cloud

I'm a big fan of Dropbox in general and use it extensively to share files between my various machines; it's especially useful when I'm at work with my MacBook and I need documents from the desktop at home.

But there is one issue which is irritating; that is no selective sync and I really didn't want to sync my whole personal Dropbox with my work laptop; actually, my work laptop's hard drive is so small that my Dropbox account would fill it.

I recently P2Ved my work-laptop so that I could run a virtual instance of it at home on my big desktop and my MacBook; makes working at home much more comfortable and I don't actually have to lug my work-laptop around any more but this gave me an issue. I keep all my work-documents on my laptop and I didn't want to have to rely on flash-drives to carry my documents around on.

After a bit of googling and a plea on Twitter; I got my solution. Set-up a second free Dropbox account and share a folder between that and my personal account; it works great. So I now have all my documents in sync without having to lug my clunky work-laptop around.

And then the Twitter document leak story broke; how to cope with security in the cloud? Oh, easy; I just used TrueCrypt to create an encrypted file-container to store my documents in and moved that to my Dropbox folder. TrueCrypt is a great piece of free software, if you haven't got a copy; you should have!

I still wish that Dropbox had selective sync but with a tiny bit of fiddling about, I have a secure and robust way of sharing my stuff. This cloud stuff is great and with a little bit of thought; you can ensure that your files are safe.

Of course, you should also be ensuring you use strong passwords to try and prevent people gaining access to your accounts but people like Google could make life tougher for the hackers and certainly make password reclaim a lot more secure.

Flexible Thinking

I think that there is some interesting discussion to be had from Hu's latest blog in response to my own comments and thoughts about whether storage virtualisation as demonstrated by the external storage virtualisation devices has a long-term future.

The response is not really to do with virtualisation at all; it is all about aligning IT and Business. He talks about an all too familiar case where storage decisions are made locally by the Business Units and the procurement strategy does not take account of the long-term health of the group; ongoing OpEx costs are not born by individual business units and become the problem of the IT department. The concept and value of shared infrastructure was not really understood by the Business.

But I suspect that these very same Business Units will be happy to use Cloud-based services, Infrastructure as a Service etc, concepts which are built on multi-tenanted shared external infrastructure. Why? Because they can deploy rapidly and flexibly; they don't need to engage the slow and cumbersome IT department and they feel that they are masters of their own destiny.

Storage virtualisation won't bring these Business Units back but storage virtualisation may enable IT to put together a flexible and responsive service catalogue. CIOs need to engage with their customers and understand what they want but they need the support of vendors to clearly demonstrate cost to their customers and to their boards.

The service must be something that the customer wants, customers do not understand why it takes weeks to provision servers, storage and networks. They can go down to PC World and the likes and pick things off the shelf *NOW*.

The more savvy customer knows that they can enter a credit card number into a cloud provider and can provision dozens of servers much quicker than the IT department can and what's more, they can turn them off again equally quickly and not be stuck with kit that they do not need and do not want.

Customers want dynamic, flexible infrastructures which can rapidly respond to their needs; Corporate IT departments along with their vendors have been pretty poor at providing these. Virtualisation and abstracted infrastructures are enabling technologies but Hu's right in that people and processes are key…

As for external storage virtualisation devices, I still wonder if they are the future? They are not necessary to provide the service and if I was building a green-field data centre with no legacy to deal with, I am not sure I would deploy them.

Infrastructure provision is at an interesting inflection point; if you don't understand this and your customers do, you have got a problem.

With Apologies….

"I'm just a little Blue Tin Cloud
Hovering under the money tree
I'm only a little Blue Tin Cloud
Pay mo' attention to little me
Everyone knows that a Tin cloud
Never costs money, no, not a bit
I'm just floating around over the ground
Wondering where I will fit?"

With IBM's announcement of a Cloud in Can! (And I've been a bit unfair, it's not just tin, it comes with a raft of management software as well) I now have an adequate definition of what Cloud is!!

It's a little bear hanging from a blue balloon, having rolled himself in mud and trying to fool the bees whilst he steals all their money, I mean honey!

Stuff Happens!

Somewhere in the world, there are a bunch of sys-admins, DBAs, application specialists, storage specialists, incident managers, service managers, network specialists and probably a whole bunch of other people running round trying to recover service after a data-centre outage.

How much running around, panic, chaos, shouting and headless chicken mode depends on how much planning, practice and preparedness they have for the event. You might not even notice even if you are using the service because if they have done their work properly, you shouldn't.

Outages happen; big horrible nasty outages happen. In a career which now spans over twenty years, I've been involved with probably half a dozen; from PDUs catching fire due to overload to failed air-conditioning to wrong application of the EPO*. I have been involved in numerous tests; failing over services and whole data-centres on a regular basis and for most of these tests, the end-user would not have been aware anything was happening.

So when Amazon loose a data-centre in their cloud, this should not be news! It will happen, it may be a whole data centre, it may be a partial loss. This not a failure of the Cloud as a concept; it is not even a failure of the public Cloud; there are thousands of companies who host their IT at hosting companies and it's not that different.

What it is a failure of is those companies who are using the Cloud without considering all the normal disciplines. Yes, deploying to the Cloud is quick, easy and often cheap but if you do it without thought, without planning, it will end up as expensive as any traditional IT deployment. Deploying in the Cloud removes much of the grunt-work but it doesn't remove the need for thought!

Shit happens, deal with it and plan for it!

* Emergency Power Off switches should always be protected by a shield and should never be able to be mistaken for a door opening button! But the momentary silence is bliss!

Questioning the Weatherman…

I seem to be doing a lot of thinking about clouds, dynamic data centres and what it all means. I do believe that the architectures of the future will become increasingly dynamic and virtualised. I was playing with EC2 and AWS at the weekend and I can see a time that I won't bother the ridiculous amount of hardware that I have at home for playing with virtual appliances and 'stuff' * And I can see that it makes increasing amount of sense for a lot of the things we do at work but….I have some questions/thoughts about storage in the public cloud and to a certain extent, the private cloud.

1) All the pricing is per gig, this is a very simplistic model. I know that people will argue that you wouldn't put your highest performing apps in the cloud but you do need some kind of performance guarantees. Anyone want to benchmark Amazon's Storage Cloud, an SPC for Cloud?

2) Replication between private-public clouds; public-public clouds i.e between cloud providers. Or is this simply done at an application level? As anyone tried using database replication between applications running in different clouds?

3) Related to the above, redundancy in the cloud? We provision network links from diverse suppliers to try to protect ourselves from a castrophic outage taking out an entire supplier; do you do the same in the cloud or is it enough to have DR between different clouds from the same supplier.

4) Dedupe in the cloud? Can you dedupe cloud storage? Have people considered writing dedupe appliances to run in the cloud? For example, would Ocarina run as a virtual appliance in the cloud?

5) Backup in the cloud? How do we back our cloud storage up when running in a public cloud? Would you back-up to a different cloud?

6) A virtual array? Before you think I'm mad, it might be interesting to be able to prepurchase a storage pool which can be allocated to virtual servers. This storage pool could be thin-provisioned, over-committed etc as per traditional thin-provisioning.

Just my thoughts, any answers? Any questions of your own?

*This is a blatant lie, I have ridiculous amounts of hardware because I enjoy fiddling and hacking about with it. Pretending it is for research is just an excuse I give myself, my wife is aware of the real truth but she humours me!

Amazon – The World’s Bookshop and IT Supplier?

How did a online bookseller become potentially the most important IT Supplier in the world?

Were their employees not simply selling books but also devouring them to solve their own internal problems? And without Amazon beginning to scare the beejesus out of the traditional IT suppliers, would we have cloud? 

People talk about UCS being Cisco's reaction to HP stepping over the line in the sand. And this may be true! But it is Amazon who people should be scared about; a company which understands global markets, logistics on a massive scale, flexibility and agility. These are all core to a company which has become synomymous with Online Retail. An IT infrastructure which has proved itself to scale very quickly and allows small start-ups run Enterprise class infrastructure without huge capital outlay.

With the exception of the EC2 cloud, Amazon are offering interesting and thought provoking services which could change the way that applications are developed. But I'm not especially interested in these as an infrastructure bod in the here and now.

The EC2 cloud is more interesting, not because it is especially exciting or innovative; it's not really but it is more applicable to the here and now. And I had initially dismissed it as just a mere so-what hosting exercise and to a limited extent it is but it might well turn out to be as important as VMWare and it is this which I suspect is beginning to frighten people.

Lets for example, take an Enterprise which is running all of its core systems on Solaris systems; with the current travails of Sun, merger rumours and a general push to reduce costs, a decision might be made to replatform the core applications to run on Linux.

But do I really want to install a large Linux infrastructure initially? That'll take time and more importantly money; I might not have enough space in my data-centre, I might not yet have decided on my corporate Linux infrastructure standards. As the head of development, I probably don't want to wait for my Infrastructure teams to get their acts together; I want something *now* and I want it quickly.

Step-up the Amazon EC2 cloud; quickly and easily, without jumping through the hoops that the Infrastructure teams want me to jump through, probably without a huge amount of IT process such as change management, I can have a scalable and pretty robust Linux infrastructure.

Yes, I could have done it with other companies but Amazon is the company which appears to have the vision and strategy to take this forward. External clouds buy me the one thing that I cannot really buy, time.

So I start hosting my development environments in the Cloud and because my internal IT infrastructure teams are too slow, I put them in the external Cloud. Sure for the time being, I'll probably keep my production workloads in-house but in the same way that production work-loads started to move to VMware, how long before I'm experimenting with production workloads?

And that is without Amazon's more interesting services which could really change things. It makes you wonder about some of the other non-traditional IT companies, what have they got hidden away? There's some interesting stuff been done by some of the games companies for instance which may well have wider application.

Clouds are fuzzy things and boundaries will become blurred. May we live in interesting times.