On Historians and Futurists
My esteemed blogfriend of longstanding, Sir Younghusband of Coming Anarchy, took issue with my remarks in the previous post and commented ( seconded by ubiwar):
“Historians and futurists use complementary methodologies …”In my experience futurists and historians are at one another’s throats over methodology. I would like to compare these methodologies in more detail. Can you elaborate on what you mean?
There is a clash of professional cultures and perspectives between academic historians and futurists, no argument. That’s why I used the term “complementary” in the previous post – the respective methodologies are divergent enough to remediate the weaknesses of the other for those thinkers open to broadening their analytical horizons. Not everyone has the comfort zone demonstratedby Niall Ferguson and Peter Schwartz; methodologically conservative “old school” historians who disdain the skill-sets of even cognate social science fields and highly speculative futurists are quite likely to talk past one another. A shame, in my view.
To begin, it’s an epistemological error to confuse either field with physics. Futurism has strongly imaginative, insight-generative and generally “fuzzy” aspects even when rarefied computer modeling, prediction markets or mathematically advanced techniques for making probabilistic estimates are being employed (none of which I am qualified to comment upon in depth) and as a field, it is still in the pioneering stage. History has a longer intellectual pedigree, stretching back to Herodotus and Thucydides with the advent of modern historical techniques beginning with Leopold von Ranke and the professionalization of academia by the German university system that became the model for the Western world, particularly the noveau-riche United States of the late 19th century. Historical methodology is accepted by historians as a yardstick to measure one another’s work and is the basis for much of the nitpicking “gotcha” nature of historiagrahical criticism. Alternative methods are viewed with suspicion; it took decades for academic historians to begin giving any credence whatsoever to oral history, for example.
Ideally, historians approach a question with skepticism and attempt to fnd an explain causation within an accurate context by working backwards toward the point of origin. “Primary source” documents are privileged as evidence by which they mean certain kinds of documents, preferably government records and memoranda, alongside private papers, scrutinized with great care. These are supplemented by authoritative secondary material that helps the historian understand the primary sources within the accurate context of the time rather than anachronistically. These discrete facts and clues are then reinterpreted by the historian in the form of a comprehensible narrative that does not deviate from the evidentiary trail. History is a craft, not a science.
Naturally, historical methodology, which seeks to demonstrate the verifiable, is an approach with the potential for generating enormous lacunae. Government officials do not always put their most sensitive discussions or actions on paper or destroy such documents after the fact (ex.- both Beria and Khrushchev ransacked Stalin’s private archive after the dictator’s death). Even when such papers exist, they are seldom readily accessible or are written in euphemistic, elusive, terminology or bureaucratic jargon. The unofficial, personal, relationships upon which many decisions hinge are often entirely absent from the “official” paper record as are often the human circumstances of the “deciders”. It takes superhuman detective work to fill in these kinds of blanks and a tolerance for sources of uncertain reliability ( this is a job for…a biographer! See Ron Chernow, Robert Caro etc.).
Futurists, as the term implies, look forward, rather than back. They begin with intuitive assumptions and engage in a variety of means of extrapolation ranging from ( among many) logical-philosophical thought experiments mapped out as decision trees to the construction of imaginative but complex scenarios for “free play” exercises to building models of great mathematical rigor. Futurists scan widely for potential variables and patterns. Imagination and synthesis play a significant role in framing the initial starting point for analytical extrapolation. Futurists are t panoramic vision to the historian’s telescope ( or at times, microscope).
The problem with futurists is that their predictions are all too frequently in error, generally suffering from a bias toward dystopian outcomes, overestimation of the linear downstream effect of favored variables relative to the effects of the variable’s interaction with all other variables along with overestimating of the synchronicity of all variables (most variables are asynchronous – otherwise the human race would be in a near-constant state of catastrophe. The “perfect storm” rarely comes together). Their scenarios, in other words, lack the level of “friction” present in historical case studies, much less that of real life.
Futurists can inject a far greater range of possibilities to consider for causation for historians while historians can help bring greater realism to futurist scenarios. The two fields, both of which must deal with uncertainty, are ready-made for collaboration
May 4th, 2008 at 2:40 pm
Zenpundit, Great post. First off I would like to qualify my original comment and emphasize that I did notice your use of the term “complementary.” I wasn’t challenging your conclusions but was trying to draw a distinction between your wish of how things should be (one that I share, I might add) and how things actually are (at least with respect to my personal experience.) I share the sense that the methodologies are complementary. What my comment called for was an analytical comparison of the various methodologies to establish if any actual functional compatibility exists. I went through your post and pulled out some methodological keywords that you use to describe futurism and history. I separated them further into two categories: quantitative and qualitative. This may be considered “heuristic bias,” but I would like to use this dichotomy as I think it is the faultline between historians and social scientists. Futurism Quantitative computer modeling prediction markets mathematics extrapolation* Qualitative decision trees scenario-building extrapolation* Historical Quantitative nil Qualitative causal explanation context primary/secondary material “discrete facts” A brief glance shows a gap in the qualitative area reflected in your comment that “History is a craft, not a science.” However, futurism is also about the “craft” of qualitative analysis as well, so the two are not necessary diametric. One common aspect of both fields is the philosophic, specifically the epistimelogical consequences (once again I would like to do a double-take at the term “discrete facts”) and the eternal quest to pare down bias. This is an area that I think could be explored more. If you know any good journal articles about this let me know. Moving on, I would like to challenge one of your statements: “The problem with futurists is that their predictions are all too frequently in error.” Error denotes precision. Futurists are in the forecasting business not the prediction business. If a futurist constructs a number of variant scenarios, none of which exactly fit the present conditions, but are able to be used to inform decision-making, where is the error? The fact that the scenarios could be drawn upon for guidance makes the futurist a success. Qualifying uncertainty is a key aspect of forecasting, one that is often overlooked by the public. Hey, we all can’t be fans of Sherman Kent.
May 4th, 2008 at 2:41 pm
Your comment field looks to have eaten my HTML.
May 4th, 2008 at 2:45 pm
I reposted my comment here which might be a little easier to read.
May 8th, 2008 at 11:36 am
[…] finally, Zenpundit’s been busy, and has replied to a recent challenge, On Historians and Futurists. Excellent post, and I really must […]
August 28th, 2009 at 2:41 pm
[…] in ubiwar After my recent post, Zenpundit’s subsequent comments and his discussion with Younghusband on the issue, the .mp3 of the Long Now Foundation debate between Niall Ferguson and Peter Schwartz […]