zenpundit.com

The Afghanistan Analyst – the one stop shop. Check out their mighty Afghanospheric blogroll!

An amazing resource. Hat tip to Ian Taylor.

This is the great thing about blogging – the times when other people pick up where you had left off and turbocharge the conversation with their own posts. Some of the best kind of P2P feedback around. Here Younghusband and Lexington Green carry the ball downfield in two different threads. Both posts should be read in full but here are snippets and links:

Coming Anarchy -“History vs. the Future”

….A brief glance shows a gap in the qualitative area reflected in your comment that “History is a craft, not a science.” However, futurism is also about the “craft” of qualitative analysis as well, so the two are not necessary diametric. One common aspect of both fields is the philosophic, specifically the epistimelogical consequences (once again I would like to do a double-take at the term “discrete facts”) and the eternal quest to pare down bias. This is an area that I think could be explored more. If you know any good journal articles about this let me know.

Moving on, I would like to challenge one of your statements: “The problem with futurists is that their predictions are all too frequently in error.”

Error denotes precision. Futurists are in the forecasting business not the prediction business. If a futurist constructs a number of variant scenarios, none of which exactly fit the present conditions, but are able to be used to inform decision-making, where is the error? The fact that the scenarios could be drawn upon for guidance makes the futurist a success. Qualifying uncertainty is a key aspect of forecasting, one that is often overlooked by the public. Hey, we all can’t be fans of Sherman Kent

Younghusband is right – the best Futurism involves forecasting and work with intriguing scenarios of reasonable internal validity and the attempt to nail down hard predictions ( frequently demanded by journalists and politicians) often fails because the greater attempt at precision increases the probability of error. Scenarios are tools for guidance, they reduce our “surprise” through mental rehearsals and the extension of our anticipation of possibilities ( Taleb would say turning some black swans into gray ones).

Regarding “discrete facts”, it would have been more accurate for me to have written to say “primary source documentary evidence that is generally regarded as factual support for the narrative itself” by historians as opposed to “speculation” regarding motivations, plausibility, nuances inferred from the documents by the historian. Note that the content of the documents themselves may be decidedly non-factual or fantastic but for historians, what matters in terms of “fact” is that  they represent evidence of what was considered at the time.

Chicago Boyz – “Academia’s Jihad Against Military History: Further Thoughts”

A good recent piece on this issue which Zen did not link to is Military Histories Old and New: A Reintroduction by the excellent military historian Robert M. Citino. Citino’s essay was published in the American Historical Review, the flagship journal of the American Historical Association, which modestly describes itself as the major historical journal in the United States. Hence, Citino’s article is a case for the defense, made by a very qualified military historian, in the main forum of the profession.

….Citino concludes his essay by virtually imploring the rest of the profession:

Despite these problems, which no doubt promise to be contentious, military historians today are doing enough good work, based on exciting and innovative approaches, to re-engage the attention of historians in any number of areas. My final advice to my professional colleagues and friends in the broader discipline? Try something genuinely daring, even countercultural, in terms of today’s academy. Read some military history.

There is something grotesquely wrong when the author of many numerous top-quality works feels he has to grovel before his peers. Unfortunately for him, he has to live and function in a shark-tank of political correctness and ideological hostility. I wish him well.

I wish Citino well too, however it’s a quest that I fear is straight out of Cervantes and this example cited by Lex demonstrates how parlous the state of affairs for military history in academia has become. More effectively than my post had done. Lex’s post has stirred some excellent feedback as well as a possible solution from Smitten Eagle in the comments section.

My esteemed blogfriend of longstanding, Sir Younghusband of Coming Anarchy, took issue with my remarks in the previous post and commented ( seconded by ubiwar):

“Historians and futurists use complementary methodologies …”In my experience futurists and historians are at one another’s throats over methodology. I would like to compare these methodologies in more detail. Can you elaborate on what you mean?

There is a clash of professional cultures and perspectives between academic historians and futurists, no argument. That’s why I used the term “complementary” in the previous post – the respective methodologies are divergent enough to remediate the weaknesses of the other for those thinkers open to broadening their analytical horizons. Not everyone has the comfort zone demonstratedby Niall Ferguson and Peter Schwartz; methodologically conservative “old school” historians who disdain the skill-sets of even cognate social science fields and highly speculative futurists are quite likely to talk past one another. A shame, in my view.

To begin, it’s an epistemological error to confuse either field with physics. Futurism has strongly imaginative, insight-generative and generally “fuzzy” aspects even when rarefied computer modeling, prediction markets or mathematically advanced techniques for making probabilistic estimates are being employed  (none of which I am qualified to comment upon in depth) and as a field, it is still in the pioneering stage.  History has a longer intellectual pedigree, stretching back to Herodotus and Thucydides with the advent of modern historical techniques beginning with Leopold von Ranke and the professionalization of academia by the German university system that became the model for the Western world, particularly the noveau-riche United States of the late 19th century. Historical methodology is accepted by historians as a yardstick to measure one another’s work and is the basis for much of the nitpicking “gotcha” nature of historiagrahical criticism. Alternative methods are viewed with suspicion; it took decades for academic historians to begin giving any credence whatsoever to oral history, for example.

Ideally, historians approach a question with skepticism and attempt to fnd an explain causation within an accurate context by working backwards toward the point of origin. “Primary source” documents are privileged as evidence by which they mean certain kinds of documents, preferably government records and memoranda, alongside private papers, scrutinized with great care. These are supplemented by authoritative secondary material that helps the historian understand the primary sources within the accurate context of the time rather than anachronistically. These discrete facts and clues are then reinterpreted by the historian in the form of a comprehensible narrative that does not deviate from the evidentiary trail. History is a craft, not a science.

Naturally, historical methodology, which seeks to demonstrate the verifiable, is an approach with the potential for generating enormous lacunae. Government officials do not always put their most sensitive discussions or actions on paper or destroy such documents after the fact (ex.- both Beria and Khrushchev ransacked Stalin’s private archive after the dictator’s death). Even when such papers exist, they are seldom readily accessible or are written in euphemistic, elusive, terminology or bureaucratic jargon. The unofficial, personal, relationships upon which many decisions hinge are often entirely absent from the “official” paper record as are often the human circumstances of the “deciders”. It takes superhuman detective work to fill in these kinds of blanks and a tolerance for sources of uncertain reliability ( this is a job for…a biographer! See Ron Chernow, Robert Caro etc.).

Futurists, as the term implies, look forward, rather than back. They begin with intuitive assumptions and engage in a variety of means of extrapolation ranging from ( among many)  logical-philosophical thought experiments mapped out as decision trees to the construction of imaginative but complex scenarios for “free play” exercises to building models of great mathematical rigor. Futurists scan widely for potential variables and patterns. Imagination and synthesis play a significant role in framing the initial starting point for analytical extrapolation. Futurists are t panoramic vision to the historian’s telescope ( or at times, microscope).

The problem with futurists is that their predictions are all too frequently in error, generally suffering from a bias toward dystopian outcomes, overestimation of the linear downstream effect of favored variables relative to the effects of the variable’s interaction with all other variables along with overestimating of the synchronicity of all variables (most variables are asynchronous – otherwise the human race would be in a near-constant state of catastrophe. The “perfect storm” rarely comes together). Their scenarios, in other  words,  lack the level of “friction” present in historical case studies, much less that of real life.

Futurists can inject a far greater range of possibilities to consider for causation for historians while historians can help bring greater realism to futurist scenarios. The two fields, both of which must deal with uncertainty, are ready-made for collaboration

ubiwar points to an excellent post at The Long Now summarizing a debate-discussion between historian Niall Ferguson and futurist Peter Schwartz:

….Ferguson ended with a critique of Schwartz’s book on scenario planning, THE ART OF THE LONG VIEW, which he thought showed signs of “heuristic bias.” When Schwartz asked Ferguson to expand on that idea, Ferguson pointed out there was a whole chapter in the book about “The Global Teenager,” which seemed spurious. It merely reflected Schwartz’s personal experience: “You were a teenager when teenagers mattered. “

Historians also have heuristic biases, Ferguson added, such as their expectation that “great events should have great causes.” Historians have much to learn from complexity theory and evolution, he said. His own work with “counter-factual history” helps expose critical moments in history and provides a way to “think about what didn’t happen.” The counter-factual technique is an application of scenario thinking to the past.

In Schwartz’s opening remarks, he said that his plans to write a book titled THE CASE FOR OPTIMISM were derailed by reading Ferguson’s WAR OF THE WORLD. He’s been grappling with the issues Ferguson raised for 18 months. “You do alternative pasts, I do alternative futures. Where historians commune with the dead, futurists have imaginary friends.”

Historians and futurists use complementary methodologies that can enrich and inspire each other’s work.

Historians, accustomed to analytical searches for causation, are excellent at vetting the plausibility of imagineered, hypothetical scenarios and can inform through historical analogies. Futurists, in turn, are analytically attuned to alternatives and points of divergence and can help unearth what Nassim Nicholas Taleb calls “silent evidence” lurking in the often excessively linear and simplified causation explanations of historical narratives.

I’ve come to greatly appreciate the intellectual depth and range of Charles Cameron ever since having been “introduced” to him (in the online sense) by my seagoing friend, Web 2.0 visioneer Critt Jarvis. Today, Charles pointed me to a veritable archive of writings by Michael Wilson, a futurist, scholar and former member of the IC. Some of the ideas and conclusions that I have been working toward on this blog these past few years were literally being advocated by Wilson well over a decade ago.

I’ve only just begun to look at these and I’m posting them here for those readers whose interests gravitate toward issues of intel analysis and futurism:

7Pillars Partners – Papers by Michael Wilson

Continual & Complete Intelligence: A 21st Century Approach

Addendum:

Charles Cameron is cordially invited to expand on the subject of Mr. Wilson and I will happily publish such remarks here.