Archive for the ‘Cloud’ Category

What next for Open Government Data?

Monday, February 1st, 2010

Data_gov_uk-in-preview-001 It’s been an interesting few weeks for Open Data in the UK, first the launch of London’s data store, and then, with much fanfare, the unveiling of data.gov.uk. Overall, this is a pretty good time to be a data activist.

But whilst the increasing exposure is beginning to help some people "get it" it sees we are approaching the "end of the beginning" for open data in government, but we are struggling to see where we go from here.

Data.gov.uk is a fantastic achievement and could perhaps be one of the most significant turning points in our relationship as citizens with the state, however it is currently not much more than an experiment – simply, proof that it can be done.

Against the context of the full potential that data.gov.uk offers, the current solution is neither sustainable nor scalable – and both points are well understood by the team that created it. Their challenge now is to take the fantastic work they have done and turn it into something that has it’s own momentum within both government and our society.

The technology side of this story is the easy part, making the platform scalable and sustainable is relatively straightforward and there are many (both within and outside government) that can help with that. The real challenge (and this will be no surprise) is how we change the culture of both ourselves and the government to a) openly share what should be shared, b) consume the data with respect and responsibility.

This is no easy task, but I do think there are some relatively simple steps that we can all take to help ease this journey.

  1. More real examples
    Now, more than ever, we need to continue to show shining examples of the power of open data, Sir Tim Berners Lee has made an open appeal for examples – if you have one, he’d like to hear from you. If possible, we need them to come from more than just the "data activist" community, an excellent bunch of people who have already invested so much time and energy just to get us this far but need our support to take the crusade even further.
  2. Open by design
    Those of us engaged in providing technology solutions in the Public Sector need to start building in the principles of open data into everything we do, all of our solutions need to at least consider how the data (where appropriate) would be made public and the linkage with data.gov.uk could be made.
  3. Learn from others
    The public sector is not the only group grappling with opening up data in this way. There is much we can learn from others (both within IT and outside), we should be seeking to share our experiences for greater collective achievement.
  4. Bridging the cultural chasm
    Last but by no means least, we need to be pushing the relevance of sharing data in this way to everyone, there is a big cultural void that we need to span (between those that get it, and those that don’t) it is up to us to create the link, and plant the seed of change across every aspect of our relationship with our government.

These four things alone will not make for an open government but if we are able to work together to drive these core messages, I think we can go a long way to making this a scalable, sustainable part of our relationship with the state.

Rise of the Pro-Ams

Sunday, January 17th, 2010
What ever next?

What ever next?

Experience and tenure are at stake, we are starting to see an army of amateurs falling out of the clouds (pun intended), and the new heroes are the underdogs, the unknowns and the every day Jo’s. We see it everywhere, from television atrocities such as X-Factor, where you can become a hero just as quick as becoming a loser. But there are important success stories to consider, such as the Cuban blogger, Yoani Sanchez who through political persecution spread the words around the world of the real experiences of those living in Cuba, to which she was awarded the prestigious ‘Maria Moors Cabot’ journalism award.

Leadbeater and Miller describe professional amateurs, or ‘Pro-Ams’ as “Innovative, committed and networked amateurs working to professional standard. This emerging group, the ‘Pro-Ams’ could have a huge influence on the shape of society in the next two decades”. I certainly wouldn’t disagree…But it’s also not a new thing, take Richard Branson and Bill Gates as examples, Pro-Ams in their own right back in the hay day, but I think what Leadbeater and Miller are getting at is the opportunity that the Internet, and more importantly the Web has created. In the past 15 years we have seen a proliferation of more multi-million dollar organizations than ever before, just to name-check a few: Google, Twitter, eBay, Facebook, MySpace, YouTube, PayPal (etc) and these are not just fads, each organization in their own right has changed intricate details of society, and out of nowhere they were sprung by Pro-Ams. So what does this all mean? It means opportunity for those less fortunate, innovation enthusiasts and entrepreneurs.

Looking back over the past decade, the Internet and the Web have advanced and become pervasive commodities, and looking five years ahead it’s possible to see it becoming a mere service that we WILL take for granted, like many of our developed world pleasures. However, unlike the ‘real-world’ in the cyber-world your voice can be heard if you shout loud enough. Fede Alverez, a keen amateur film maker uploaded a video project that he’d been working on, it was a 4 minute sci-fi spectacle depicting giant robots destroying the capital city of Uruguay…not too dissimilar to Michael Bay’s blockbuster hit Transformers 2, but unlike Bay’s $50million flop, Alvarez’s powerful short film was made for free, instead opting to use his own skills behind the camera, creating his own CGI robots and getting his friends involved. Within a few days, Alvarez was contacted by many Hollywood studios and has now signed a $30million deal to shoot a film for Sam Raimi (Famed for his Spider-Man remake, and Evil Dead trilogy).

These are stories of glory, and maybe your next-door neighbour isn’t going to become the next James Cameron, but one thing is for certain, there are millions of people around the world being discovered for their fresh and new ideas. Talent is easier to spot than ever before, don’t be blind-sided by experience and tenure, because originality and passion will never become passé.

Cloud Computing – 2010

Friday, January 8th, 2010

cloudbin Just came across a good article on the future of Cloud Computing for 2010 – it’s a great summary and indicator of how fast things are progressing, you can read the full article here, but in summary, the following (in my opinion) are the three key areas to watch:

The year of the platform – after years of working through Infrastructure as a Service (IAAS) and Software as a Service (SAAS)the coming of Platform as a Service (PAAS) marks the beginning of the realisation of the full benefit that the cloud approach has to offer.

Here Come Private Clouds – specially pertinent in the Public Sector, the information assurance requirements of governments and nations are driving an approach that sees the adoption of “national cloud” infrastructure.  This will challenge many of the cloud providers as issues around data sovereignty and legislation such as the US Patriot Act will force them to offer geographically local solutions (which is kind of counter intuitive to the purists architectural vision for cloud computing).

Security – What a surprise, the growth of cloud computing has lead to a new frontier to defend and secure.  whether it’s new concerns like Differential Privacy, or old “friends” moving to new platforms (the first cloud based bot-nets have recently been discovered).

Cloud Computing – What’s the Point?

Tuesday, October 27th, 2009

http://www.podtrac.com/pts/redirect.flv/www.theenvisioners.com/wp-content/uploads/podcasts/Episode4.flv

Back in the Summer, Matt Deacon asked if I’d like to give a presentation on the subject of Cloud Computing to an Architect forum he was planning in the UK for September. I said “yes” immediately because I was getting increasingly frustrated with all the hyperbole about Cloud Computing being “the Future of IT” when all that was really being said was about cost containment and greater agility and frankly I wanted to prove that there really was more to it than that.

So, several weeks passed, the deadline loomed, and I set out to prove my theory that Cloud Computing would enable some significant outcomes that would transform society’s use of technology. Take a look to see how I got on…

You can download the webcast here (right click and “save as”) or click here to subscribe to the Envisioners podcasts on iTunes.

This presentation uses the superb Productivity Future Vision video generated by Microsoft’s Office Labs team. You can find this video (and get the background and more detail) here…

Finally, you can also download the slides I used here – like everything on this site, they’re available for use under Creative Commons license, so feel free use them if they’re helpful to you, but please respect the copyright of the image authors (see last slide in the deck) and ensure you are licensed properly for their use.

Differential Privacy

Friday, October 9th, 2009

PrivacyEarlier this week I blogged about the growing evidence of governments opening up their public data at both a national and local level. While this in itself represents a great leap forward it brings with it a new set of challenges the we will need to address. One in particular stands out and it is around the evolution of some of the very real challenges we’re going to face around Privacy in a Web/Gov 2.0 world.

Earlier this month I was chatting to Stuart Aston (one of our security advisors – you know the type, smarter than your average bear and very switched on to the evolution of the security principles we will face in an increasingly connected world) and he introduced me to the concept of “Differential Privacy“. He left me with a few white papers and a smile and a few hours later, with my head pounding and eyes bleeding (trust me you want to try and read this stuff) I finally got my head around the concept and what it’s going to mean to us as citizens.

Differential privacy is essentially, the ability to make very specific conclusions (with incredible accuracy) about the identity of an individual when provided with two disparate sets of anonymised data on a similar topic.

The example given uses NetFlix’s recent competition to improve their recommendation system as the backdrop…

DiffPriv

NetFlix published an anonymised data set of around 500,000 records in order to help developers come up with a solution to improve their recommendation system. Some bright sparks took this data and a similar export from the IMDB and by applying some fairly hairy maths, they were able to identify specific individuals with a shocking 96% accuracy rate.

This is mind blowing, not just because of the maths involved, but because of what it means in a world of growing public data, the old bastions of Privacy that we have relied upon thus far may no longer be enough.

Governments and organisations are going to need to take this seriously as it will present some difficult challenges about liability and the duty of care to keep their citizens/customers identity and data private.

In particular, think about the duty of care element. As an organisation, you have a legal requirement to look after the privacy of the data you hold on an individual or organisation – with differential privacy, how far does this duty of care extend? If you keep your data anonymised but others can compromise that privacy (albeit with hairy maths and more public data) who is actually liable or legally responsible for the breach?

There are some tough answers to be found here and undoubtedly some more legislation will be required – in the meantime though, it’s a concept we need to understand more so we can build appropriate responses that don’t restrict the overall movement towards making public data more readily accessible . We cannot afford to let this (and other similar issues) stop the democratisation of data, but we do need to go into this with our eyes open.

Cloud Architect Forum – Slides Now Available

Tuesday, October 6th, 2009

Matt’s just posted all the slides from the Cloud Architect forum on September 25th.

There’s some great content here and some good food for thought (especially from Neil Ward-Dutton - who presented the best high level summary of “just what exactly _is_ the cloud” that I’ve seen to date).

I’ll be turning my session into this month’s podcast so keep a look out for that.

UK Broadband not fit for purpose

Thursday, October 1st, 2009

Network DownA recent Cisco report shows the UK ranking 25th out of 66 countries in regards to quality of their networks

OK, so maybe not fit for purpose is a bit strong, but it does go to show that our ability to achieve some of the things we’ve talked about (especially cloud based solutions) is going to face some pretty difficult challenges.

Bandwidth is the unspoken barrier to the cloud, we assume it to be there but in reality it isn’t consistent enough (yet) for us to rely on it providing the necessary connection to all the great things we want to achieve.

Application architects and solution providers will need to think creatively about how we build applications that take this into account.

Cloud Architect Forum

Friday, August 28th, 2009

dataMatt recently invited me to provide a session for the Cloud Architect Session he is going to run in London on September 25th.

He’s already got some great speakers lined up – Neil Ward-Dutton from MW Advisors, Simon Guest, Senior Director, DPE (Microsoft) and Andrew Jones, Practice Director from CSC.

Attendance is free (limited to first come, first served) and you can register here.

FWIW – this was the overview I gave Matt for my talk:

“Cloud Computing is being positioned as the future of the IT Industry, yet we collectively seem to be unsure on what it actually is and, more importantly, how to get from here to there. This session will attempt to reconnect us all with the longer term reasons on why the cloud is not just important but fundamental to the kind of transformation we are looking technology to provide the way we live, work and play.”

All I need to do now is come up with the slides to match…