IT as Obstacle

Getting the re-tweeting rounds today, an article on why business are moving to the cloud. The answer? To avoid their own IT departments.

Their top reasons for going around IT? The need to respond quickly to changes in the market, self-sufficiency of their IT-savvy workforce, and the easy availability of top-quality it services that can be bought without long implementation or testing (cloud and SAAs apps, primarily).

Watch out, the natives are restless.

Update: Check out the comment thread in the slashdot.org posting of this article for the good, bad and ugly of IT reaction to being sidelined. Ranges from “stupid users” to some thoughtful comments on the nature of organizations.

Outsourcing in BC

Every year, in a fit of morbid curiousity, I cruise the detailed schedule of payments in the BC Public Accounts as a way of keeping tabs on the local IT industry. Who is up? Who is down? Who is gone?

One of the certainties, year after year, is that IBM’s take just keeps getting bigger. I thought it was pretty impressive when they were doing $30M / year, but last year they cracked $100M.

Another trend has been the slow squeeze of the market place from one with a mix of companies, ranging from 10-person consultancies to 100-person regional integrators to the big international firms, to a market dominated almost completely by the internationals. The mid-size companies were largely bought up, and the small ones squeezed out. Deal sizes have kept growing, making it hard for smaller companies to compete, while the migration of infrastructure roles to outsourcing companies has given those same companies an built-in edge in competing for systems work. Even long-time regional heavy-weight Sierra Systems is getting beaten down.

There are many big mistakes being made by government as this process goes on, but perhaps the biggest is the long-term sole-source outsourcing agreement. The fantasy that costs can be managed in a single vendor environment, that the contract just needs the right review clauses and penalties, continues to suck in government outsourcers. There’s no true competition in a system where a vendor only needs to compete every 5-10 years (and even then, from the position of the incumbent). Expecting market efficiencies to work in your favour in such as situation is folly.

Postscript: In 2009/2010, HP and IBM combined to bill the BC government over $200M, mostly in services. IBM’s 2010 annual report indicates 34.7% gross margin for IBM Global Services. The HP annual report shows a similar margin for services. The implication is, of the $200M we are spending with HP and IBM, $70M is going to profit, not to providing service. Put another way, if the government chose to provide those services internally, it could pay all the staff at HP/IBM salary rates and still afford to employ 50% more people to do the work.

Superstar CIOs

The superstar CIO is necessarily going to be a bit of a flimflam artist. He has to be, because in order to get into the position, he’s had to dazzle his non-technical superiors. That means eye-candy, first and foremost, delivered fast. Delivered fast, you say, how can he do that with his sclerotic organization? Easy, he contracts off to the side or builds a private skunk-works.

So, from Vivek Kundra (US Federal CIO) on the one hand we have the flimflam of data.gov, and various high level dashboard trackers (recovery.gov anyone?), tossed up quickly by a tiger team. Not indicative of transformation, but rather the opposite: in order to get anything completed quickly the CIO has to actually route around his existing organization. But there is also some substance.

Some of the substance is pure management, like the review of failing projects. Some is technological silver-bullet-worship (of a sort I can appreciate, being a long-time silver bullet lover) like the move to government use of cloud infrastructure (both external and self-managed). (Because the answer is always another layer of abstraction!)

But one thing comes through clearly watching Mr. Kundra: it’s a really big organization and he’s just one guy. The culture will out-live him. The men in grey suits will win. In some ways a full-on flimflam artist would be better, because at least then I wouldn’t be disappointed when nothing changes.

Postscript: Kundra did manage to change some things but many of his marquee initiatives were separately funded initiatives that Congress is now de-funding for political reasons. And the news today is that he’s leaving his post for academe to take a well-earned break. Did he push the culture in the right direction? Probably so!

IT Revolution

Back when I first started working in the British Columbia government, in 1993, there existed a Crown Corporation called “BC Systems Corporation”, BCSC. Through the 1980s, major pieces of government operations (timber tenuring, financial tracking, health insurance) had been computerized using the finest technology of the era (mostly mainframes) and BCSC had grown up as the central IT branch of the government.

They ran the big machines, the terminals that accessed them and were taking on the newfangled PCs increasingly showing up on the desks of drones like me (I answered correspondence, there still being a brisk trade in “mail” at the time).

The extent to which BCSC was wedded to the technology of the previous era can best be understood by noting that one of their last major accomplishments was writing a web browser, Charlotte, for the 3270 green-screen terminal.

Being stocked full of the finest minds in computerdom, BCSC briskly alienated pretty much all the folks it was supposed to be serving. It’s services were too expensive, the old mainframe systems too inflexible, the response times too long. Shortly after I left government to finish my graduate degree, BCSC was blown up and its functions distributed to IT departments in the Ministries themselves.

And so the process began anew. Just as BCSC had stitched together systems from multiple ministries into a centralized empire over a decade, so too did the centralizing imperative begin to work immediately once again. First e-mail. Then major data centre needs. First by choice, then by fiat, gradually the Ministry IT departments were stripped of line responsibility for their systems and left with a residue of business analysts and managers.

A new wrinkle was added this time around though, in that rather than centralizing entirely to another agency, many of the services were centralized and then bundled off to outside companies. So desktop support was re-centralized and taken over by IBM. The result has been service just as poor as the old days (worse, in fact! back in the BCSC days there was a PC tech co-located right on our office floor, a luxury most government workers could hardly imagine now) with prices just as high.

BCSC was blown up when Ministries realized that they could provide the same services for themselves that BCSC did using PCs, and started doing so. Once the mainframe boys weren’t necessary any more, they were dispensed with, joyfully. Ministries wanted to Get Things Done, and the main role of BCSC was to say You Can’t Do That.

Today we have another round of folks saying You Can’t Do That. The desktop outsource vendor says you can’t have a new computer, and if you do get one, you can’t install any software on it. The server outsource vendor says you can’t afford a system to run your code on. Or if you can, then you need to go through a three month process to get the server first. And the CIO’s office says you can’t run that programming language because it’s not government standard.

And here comes the cloud. Just as the PC freed the Ministries from the mainframe boys, the cloud is going to free folks from IT once again. Need a web site? Need a small system? Maybe an App Engine deployment. Need some data processing? Maybe an EC2 server will do the trick. It’s all well under credit card spending limits. (My first government supervisor, bless her heart, bought me a copy of MS Access on her department credit card so I could avoid the All Databases Must Be Oracle directive and actually Get Some Work Done On My Computer).

The revolution is coming, it’ll start quiet, but it’ll get ugly. Hopefully soon.

Postscript: Michael Weisman, in a comment on my last post points to an article in the Washington Post about superstar CIO Vivek Kundra (coincidentally, the topic of another upcoming post of mine). Says Mr. Kundra, “People have better access to information technology at their homes than they do at work, and that’s especially true in the public sector”. And another great quote from the article: Asked what he typically hears from workers about gov­ernment- or corporate-provided technology, Kundra said, “It’s not a question of whether they don’t like it. They despise it.”

Kundra seems to have hit upon a winning formula: stop saying “no” and start saying “yes”. The career risk of saying “no” is now higher than the risk of saying “yes”. Welcome to the new conservatism. Give the people what they want, or things will get… unpleasant.

Broken Enterprise IT

For as long as I have been doing technology, I have watched enterprise IT and said to myself “this seems incredibly broken, why do people put up with this?” This includes the period when I was doing consulting and running teams that specifically had to mould their reporting and processes to fit into the requirements of government (enterprise) IT. Actually doing it didn’t make it seem any more sane.

At this point, I should explain what seemed wrong. The processes around IT actions in the enterprise environment (and my experience was in government, but my glancing exposure to Fortune 500 environments didn’t uncover any great differences there) all seemed geared towards slowing down progress. The many layers of approvals and plans, the disconnection between operations and development, the migration of core technical decisions upwards to non-technical management staff.

Compare the outputs of a start-up company, turning out an aesthetically pleasing piece of software usable by ordinary folks within a timeline of a few months to that of an enterprise system building team that may or may not deliver something ugly and slow in a couple years. What’s different? The people are generally of the similar capability and intelligence. But the culture and processes they are embedded in are radically different.

As a 25-year-old smart-ass I was always pretty sure a team of 5 working outside the enterprise IT structure could produce a better system faster than a team of any size working within it. As a 40-year-old smart ass, for some reason I still haven’t altered that conception. I do, however, have more sympathy for the folks working within the system. As a 25-year-old I naturally assumed they were just stupid. As a 40-year-old I now see them as trapped. Very smart, capable people, stuck within a system that seems built to frustrate and block them from actually Making Their Computers Do Useful Things for Other People.

The genesis of the enterprise IT homunculus seems semi-explainable. If you put a large collection of detail oriented control freaks (hello, computer people) into a single organization, the need of the (detail oriented, control freak) management to avoid non-linearity in their organization will naturally lead to layer upon layer of process and reporting. Otherwise, how can the CIO sleep at night?

But even if the genesis is explainable, that still doesn’t make the result good, or the end state desirable. This is still a system wasting the potential of the greater number of its participants. The non-technical masters of these organizations (CEOs, other upper managers) see clearly that they are broken (they manifestly cannot deliver), but the fixes only seem to make things worse: my organization is broken, so I’ll outsource to another organization; my organization is broken, so I’ll bring in consultants (who carry the same organizational biases); my organization is broken, so I’ll go ISO9000 (embrace the disfunction!).

The British Columbia government seems to be in the middle of the outsourcing “fix” right now. The remains of the central IT department are being reviewed for their incredibly high internal pricing, and meanwhile major server and network infrastructure is being outsourced to HP and shipped out of province. The irony is that, should the central IT department be found to be “too inefficient” the “solution” will be another round of outsourcing to a contractor who will end up being (contractually) largely immune to any review.

I think we are only a few years from a serious IT revolution in the provincial government, and by revolution I mean the peasants are going to take up their pitchforks and torches and storm the keep. More on that tomorrow.

In the meanwhile, I am collecting stories of IT transformations that have actually worked. It seems like there are very few if any stories out there. The super-star CIOs seem to rely on various combinations of smoke and mirrors to burnish their reputations, very few seem to have attacked the root of the IT cultures in their organizations. But I would love to hear some stories about those who did and succeeded (or failed).