Foreword

Why isn’t it better? That is the question which sooner or later hits every student of British government between the eyes with the force of a well-swung halibut. Here is one of the oldest and best-established parliamentary democracies in the world, comparatively rich and stable, whose state and municipal bureaucracy has been the subject of waves of reforms from Victorian times to the present day, led by bright, well-educated, diligent and uncorrupted public servants… yet the prisons are more often than not overcrowded and dangerous, the public housing is too meagre and squalid to accommodate decently those who need it, the schools struggle to attain standards expected across the rest of Europe, and the National Health Service — that recipient of vast public affection and vaster still tax-levied income — cannot satisfy demand. Whose fault is this?

At Westminster, covered daily by a special squad of full-time journalists, the elected political classes blame each other and recommend new legislation to improve things. The public is sold a model of the world in which the NHS, for example, would be a gleaming national success story were it not for the callous and ignorant high-handedness of market-obsessed Conservatives or, alternatively, the sentimental Stalinism of unreformed socialists. ‘Government’ is reduced to a hatchet-duel of received opinions in the House of Commons, where success is measured by votes won and bills passed, not by the daily reality of well-administered services in distant suburbs. And much the same happens at local level, except that there the relative lack of power and accountability has produced such apathy that any reporting is meagre.

In recent years most reform-minded observers have concluded that the essence of the problem is an over-centralized, over-interventionist state apparatus, and that the best way of improving public services is radically to devolve power back to the very same boroughs, counties, hospital areas and schools from whence it was sucked during the twentieth century. Only then, perhaps, might we see again the practical transformations in education, town planning, hospital building and amenities that the Victorians of Chamberlain’s Birmingham or the Edwardians of LCC-dominated London came to take for granted. After more than a decade of New Labour government, and after the centralizing changes of the Conservative administrations of Margaret Thatcher and John Major, this is the mood of the times. It is heard from David Cameron’s opposition and it echoes inside Whitehall, too. Right at the end of this monumental and revelatory history, Duncan Campbell-Smith launches the Audit Commission in the same direction.

Yet his book is in itself another kind of answer to that question — why isn’t it better? He plunges deep in tracing the recent history of that greater part of the job of government which is rarely talked about at Westminster and barely mentioned in the media, yet which is utterly essential to well-organized modern life. What happens after the legislation has passed, the dust has settled and the politicians have moved on? How do you actually make a council, or a health authority, improve in the hundred small ways which, to the rest of us, may make the difference between a successful minor operation and a life-threatening infection, or living in a clean housing estate as opposed to a dangerous, damp-infested modern slum? After the crisp-sounding headlines and the rousing political prose, where are the levers, inducements, measurements and encouragement that translate aspiration into achievement, in offices, streets, police stations and so on? In short, after you’ve spoken, how do you do? Here we find the seven-eighths of the iceberg that doesn’t gleam brightly but tends to sink the ship.

There are titanic tales in this book, ranging from the struggle to bring to account the ‘Loony Left’ councils of the 1980s and Shirley Porter’s Westminster regime, selling off cemeteries for pennies and attempting to use housing policy as a form of gerrymandering, through to the fascinating (and new to me) story of how apolitical auditors, aghast at the proposed poll tax, tried to rescue Margaret Thatcher from herself, and failed. Some of the individual episodes recounted here are less familiar today but were potentially devastating in their time, notably the rescue of Hammersmith council from its incredibly dangerous entanglements with the global derivatives markets. In these pages, you will find some very well-known characters, from Michael Heseltine, the true originator of the Audit Commission, to Michael Lyons, now chairman of the BBC Trust and recently inquirer-in-chief for Gordon Brown. Alongside them is a range of strong characters running the Audit Commission itself, from the outspoken and publicity-minded John Banham, through the politically well-connected, colourful and radical Howard Davies, to later characters, less colourful but highly effective, such as Andrew Foster. This being, in essence, an institutional history, there is plenty of office politics too, culminating in what the author calls the Audit Commission’s ‘annus horribilis’ and the emergence in 2000 of inspectors to work in parallel with time-honoured auditors.

But the essence of the story of the Commission is really a 25-year debate about the meaning of audit, and how to achieve better government for the country. It takes us from the early days of painstaking box-ticking and column-counting by the copperplate nib-wielding accountants of old, to the growing idea that audit should involve looking at the effectiveness of systems and policies. If this seems obvious now, it was much resented in the early days of the Audit Commission and, as Duncan Campbell-Smith points out, has made councils subject to far more invasive and independent appraisals than most companies listed on the stock market would tolerate. The difference between councils and companies, to quote perhaps the best epigram in this book, is that ‘Private businesses do something with a view to making money; but public bodies spend money with a view to doing something.’ As the meaning of audit widened, individuals from some distinctly non-municipal backgrounds — and especially from the McKinsey culture — spread their influence and the range of the Audit Commission grew apace. On the way, plenty of mistakes were made and there were moments when the future of the Commission seemed to hang by a thread. Yet, enjoying (if that is the word) a higher profile than its central-government sister, the National Audit Office, the Commission established itself as one of the most trusted and enthusiastically exploited weapons in the armoury of intelligent ministers.

This caused problems, of course. Under New Labour, the command-and-control enthusiasms of ministers embroiled the Audit Commission in what became a mind-dazzlingly complex array of targets. This culminated in the ‘Best Value’ comedy, when inspectors were scurrying round the country measuring ludicrously small things at inordinate length — everything from pest-control services to public toilets in Scarborough. As a caricature of an overweening centre which had become deluded into thinking it could run everything, this takes some beating.

But this is much more than a morality tale for localists. Not only did the Commission survive the excesses imposed by its political masters, and thrive, but it built up an impressive range of real achievements to look back on. This is not just a story about budgets, waste, the law, or the behaviour of freeloading councillors in Doncaster. It is also about the attempt to use numbers and comparisons to improve the lives of everyone from rough sleepers and victims of crime to prosperous but frightened heart-attack victims. Duncan Campbell Smith has shone a light on a major part of the story of modern British governance that has been almost completely ignored by political writers. By its nature, it is not a light, easy read but this is an important subject, not an easy one. Thanks to this painstaking, comprehensive account, nobody will ever again be able to answer that question – ‘Why isn’t it better?’ –without addressing the achievements and failures of the Audit Commission.

Andrew Marr