Analysis Reading the Climategate archive is a bit like discovering that Professional Wrestling is rigged. You mean, it is? Really?
The archive - a carefully curated 160MB collection of source code, emails and other documents from the internal network of the Climatic Research Unit at the University of East Anglia - provides grim confirmation for critics of climate science. But it also raises far more troubling questions.
Perhaps the real scandal is the dependence of media and politicians on their academics' work - an ask-no-questions approach that saw them surrender much of their power, and ultimately authority. This doesn't absolve the CRU crew of the charges, but might put it into a better context.
After a week of scrutiny of the emails, attention is now turning to the programming source code. Three quarters of the material released is the work of the academics, much of which they had jealously guarded. This includes a version of the world's most cited and respected temperature record - HADCRUT - and a number of surveys which featured prominently in the reports of the UN's climate change panel, the IPCC. The actors here shaped the UN reports, and ultimately - because no politician dare contradict the 'science' - shaped global policy.
The allegations over the past week are fourfold: that climate scientists controlled the publishing process to discredit opposing views and further their own theory; they manipulated data to make recent temperature trends look anomalous; they withheld and destroyed data they should have released as good scientific practice, and they were generally beastly about people who criticised their work. (You’ll note that one of these is far less serious than the others.)
But why should this be a surprise?
The secretive Jones is no secret
The secretive approach of CRU director Jones and his colleagues, particularly in the paleoclimatology field, is not a secret. Distinguished scientists have testified to this throughout from the early 1990s onwards. A report specifically commissioned four years ago by Congress, the Wegman Report, identified many of the failings discussed in the past week.
Failings are understandable, climatology is in its infancy, and the man-made greenhouse gas theory is a recent development. However no action was taken. A little like Goldman Sachs, the group that includes the CRU Crew was deemed to be too important to fail - or even have the semblance of fallibility.
A lightning recap of what CRU is, and what role it plays, helps bring the puzzle out of the shadows.
CRU was founded in 1972 by the 'Father of Climatology', former Met Office meteorologist Hubert Lamb. Until around 1980, solar modulation was believed to be the driving factor in climatic variation. A not unreasonable idea, you might think, since our energy (unless you live by a volcano vent) is derived from the sun. Without a better understanding of the sun, climatology may be reasonably be called "speculative meteorology".
But CRU's increasing influence, according to its own history
, stemmed from politicians taking an interest. "The UK Government became a strong supporter of climate research in the mid-1980s, following a meeting between Prime Minister Mrs Thatcher and a small number of climate researchers, which included Tom Wigley, the CRU director at the time. This and other meetings eventually led to the setting up of the Hadley Centre for Climate Prediction and Research, within the Met Office," the CRU notes.
Lamb (who died in 1997), however remained sceptical of the greenhouse gas hypothesis to the end.
In addition to inheriting all the problems of climatology, the greenhouse gas hypothesis has several unique issues of its own, and addressing them is a challenge for the most scrupulous researcher. How CRU addressed them was to define climatology for two decades - and ultimately defined the public debate and policy, too.
The gas theory is based on an elegant 'energy budget' model, but it leans heavily on positive feedbacks resulting from greenhouse gases such as CO2 in order to produce the warming CO2 cannot do by itself. Yet no simple empirical laboratory tests are of use here. Nor is there a ‘fingerprint’ or tell-tale signal that anthropogenically produced gases are the primary forcing factor. Hence climatology's increasing reliance, since 1980, on a range of anecdotal evidence and computer modelling.
In a fiercely contested field, both methods were fiercely guarded. The result of this was the blurring of the line between correlation and causation, and hindcasting and forecasting. Slowly, but surely, an "assertion" was becoming "proof".
The first IPCC report in 1990 used the established temperature record created by Lamb. It's very different to the one we're familiar with today - and that's the work of CRU director Phil Jones, CRU's pioneer dendrochronologist Keith Briffa, and their colleagues in (mainly) US institutions.
You can see the difference here.
Lamb's temperature graph, featured in the first IPCC report in 1990
Without the error bars (grey), the Medieval Warm Period disappears Source: IPCC TAR 2001
Although Lamb's version is supported by historical accounts, archaeology, geology and even contemporary literature, two key differences are the decreased significance of the Medieval Warming Period (CRU and its allies prefer the term 'MCA', or "Medieval Climate Anomaly") and a radically warmer modern period.
Jones and his team began to produce work that contradicted the established picture in 1990 - and CRU was able to do so from both ends. By creating new temperature recreations, it could create a new account of history. By issuing a monthly gridded temperature set while making raw station data unavailable for inspection, it defined contemporary data. So CRU controlled two important narratives: the "then", and the "now".
In the FOIA.ZIP archive, we find Jones unambiguous in an email: "We will be rewriting people's perceived wisdom about the course of temperature change over the past millennium," he wrote.
In text books co-authored with Ray Bradley (1992 and 1996) and a landmark paper with Ben Santer (1996), Jones described artificial reconstructions that questioned the established historical record. Jones and Briffa were both co-authors of a 1995 Paper
for Nature - Unusual Twentieth-century Summer Warmth in a 1,000-year Temperature Record from Siberia - that used a tree ring reconstruction from the Urals to claim that the mean 20th Century temperature is higher than any period since 914. Sympathetic researchers in the US produced similar graphs, again emphasising that modern warming (0.7C in the 20th Century), was anomalous.
Since these scientists declined to document their methodology and the raw sample, they were difficult to dispute. By 2001, with the IPCC's Third Assessment Report or TAR, the new version of history was the established one. The 'Hockey Stick' controversy only broke three years subsequently.
Click source to read more from Andrew Orlowski