zenpundit.com

[by Lynn C. Rees, with points from John Boyd]

Earlier this year, Scott kindly shared a PDF index of the John Boyd Papers (see tail end of PDF here). While PDFs are good for preserving document layout, they’re poor at storing clean text data. Since I wanted the index in a spreadsheet to facilitate searching and sorting, this was a issue. Data extraction into machine readable formats remains painful. Data extraction from PDFs remains even more painful: the priority of PDFs is prettiness for the human eye not prettiness for the machine.

Fortunately, pdftotext can extract the text data to plain text. But, even then, the John Boyd index text was misaligned and out of order due to its formatting in the original document. It also needed to be broken down into useful chunks that could be mapped to spreadsheet cells. I decided to use Freeplane to reformat the text into a form appropriate for piping into a spreadsheet since it has elements of asynchronous text editing.

I don’t know if a true asynchronous text editor exists. I’m not sure I know what one would look like. But I have some notion of what it isn’t. Most text editors and word processors are good at sequential editing of text. They only sort of approach asynchronous text editing where text is moved around and reordered freely without copy and pasting. Asynchronous text editing was what I wanted and Freeplane kind of does it.

I pasted the plain text into Freeplane and started breaking it down. Progress was slow. A lot of awkward and time-consuming cutting and pasting was required and this  was annoying. I had to create additional text manipulation tools for Freeplane. Then things moved along nicely.

Due to intervening time constraints, the Boyd Papers index hasn’t made it to spreadsheet form yet. However, it is broken down in Freeplane. Though mind maps are most commonly used as a brainstorming tool, they are also useful for rearranging existing text data in a hierarchy. Since the John Boyd index mind map is a useful example of this, here’s what’s done so far:

• the index as an image (5.9 MB in size, require some magnification within the browser)
• original Freeplane mindmap (536.7 KB in size) 

[ by Charles Cameron -- bemused again, "jihad" (the word) in the news, "big data" too, plus Google expecting Mahdi ]
.

I suppose I should be glad — or should I? — that the word jihad is now in the news.

It’s about time. Jihad (the word, the concept, the interpretations) should have been in the news at least since 9/11, don’t you think? or since the World Trade Center bombing in February 26, 1993, perhaps? or at least since Osama bin Laden’s Declaration of Jihad Against the Americans Occupying the Land of the Two Holy Mosques of September 2, 1996?

In any case, the word finally seems to have arrived, if the entry from the National Geographic site last month (upper panel, above) can be trusted:

And Big Data (lower panel)?

President Obama launched his Big Data Initiative on March 29, 2012, but I’m not sure how long the term has been in active use. I’m told there’s no “big data” listing in the 2009 Oxford English Dictionary on CD-ROM, I have the sense that three days ago’s Foreign Policy is far more up to date than last month’s National Geographic in any case — and just a month or two ago the CTO of CIA, Ira “Gus” Hunt, situated Big Data somewhere between “the cloud” and right now, telling his audience at GigaOM:

Big Data was so last year, right, all those breathless articles and all the front page covers — I was expecting BD to be Time’s Man of the Year, right. This year what we’re really talking about is how do we get value out of the stuff?

That quote, of course, is so “two months ago”…

**

So what does National Geographic tell us about jihad?

The Boston marathon bombing has focused attention on the word “jihad.”

Vice President Biden characterized the alleged bombers as knockoff jihadis.” The Associated Press reported that the elder brother had “vaguely discussed jihad” with his mother over the phone in 2011.

Origins

“Jihad” is derived from the Arabic word juhd (meaning effort, exertion, or power) and literally translates to “struggle” or “resistance” for the sake of a goal. Used 30 times and in multiple contexts in the Koran, jihad most often denotes a struggle against external enemies, the devil, or one’s self. One example from the Koran (49.15) is: “The believers are those who believe in Allah and His Messenger … and jahadu (do jihad) with their properties and selves in the way of Allah.”

Mark Wilks, an early 19th-century British author, introduced jihad into the English lexicon, defining it as a Muslim “holy war,” in his Historical Sketches of the South of India. It’s retained that meaning in English; the Oxford English Dictionary defines jihad as “a religious war of Muslims against unbelievers.”

History

Because of its roots and context in the Koran, jihad has a positive meaning to Muslims. Whatever form jihad may take, the struggle is always noble. When the term is evoked against external enemies, it can be used only during just or defensive wars.

I’m sorry, but that last para beginning “Because of its roots and context in the Koran, jihad has a positive meaning to Muslims” isn’t terribly clear. When al-Zawahiri talks about jihad, for instance, does the writer imagine all Muslim readers imagine he’s talking about something noble? I fear there are some subtleties being missed her that not everyone who reads National Geographic may understand.

**

And what does Foreign Policy want to tell us about Big Data?

The promoters of big data would like us to believe that behind the lines of code and vast databases lie objective and universal insights into patterns of human behavior, be it consumer spending, criminal or terrorist acts, healthy habits, or employee productivity. But many big-data evangelists avoid taking a hard look at the weaknesses. Numbers can’t speak for themselves, and data sets — no matter their scale — are still objects of human design. The tools of big-data science, such as the Apache Hadoop software framework, do not immunize us from skews, gaps, and faulty assumptions. Those factors are particularly significant when big data tries to reflect the social world we live in, yet we can often be fooled into thinking that the results are somehow more objective than human opinions. Biases and blind spots exist in big data as much as they do in individual perceptions and experiences. Yet there is a problematic belief that bigger data is always better data and that correlation is as good as causation.

**

Mr Orange had something to say about the word “jihad” in his War Tracker blog the other day, under the title What’s in the names of terrorist groups (1): Jabhah al-Nusrah li-Ahl al-Shâm min Mujâhidî al-Shâm fi Sahât al Jihâd:

… they still use a religious term in their name: One that is quite negatively understood in the West but not so in the Arab and Muslim world namely Jihâd.

They are Mujâhidîn – those who do Jihâd (religious struggle – in this case fighting) – on the fields of Jihâd. Mujâhidîn has a positive, religiously legitimizing ring to it – see here is someone who struggles for the religion – and is furthermore including. Whether you are with the FSA (even one of the rather secular parts of that group mind you) or with an independent Islamist group or with Jabhah al-Nusrah all do use the term Mujâhîd and all may be identified by that term (Granted there was a time when Thuwâr (revolutionaries) was en vogue but no longer so).

That, IMO, gets us a lot closer to understanding a term that has a range of meanings, a range of users, and a range of audiences — from something along the lines of divinely obligated warfare to something akin to conscience (or what Rilke calls “being defeated, decisively, by constantly greater beings”) , and from those who use it for glorious self-identification to those for whom it is a euphemism for terrorist (irhabi), and from those itching for a fight to those longing, praying and working devotedly for peace…

**

So — since we’re talking big data and jihad, here’s a tiny snippet of jihad-related skew from Google, one of the giants of big data…

I came across it via SelfScholar, who posted a very interesting response re the Iranian nuclear fatwa issue here a few days ago, in a post titled Google Translate’s Khomeini Problem.

It appears that Google Translate has a distinctly unsecular view when it comes to major figures in Shi’ite theology — specifically, it adds religious honorifics to their names when translating from English into Farsi. As you might imagine, I wanted to know how they dealt with the Mahdi — and behold, my prayer was answered:

So Google awaits his blessed return?

It seems pretty clear that SelfScholar would be skeptical about that. He ends his blog post, in fact, with an indication that he neither awaits nor expects it — choosing for his final example “to highlight the inanity of it all, just one for the road…”:

**

Prof. Dr. Muhammad-Reza Fakhr-Rohani has an interesting piece titled Rendering Islamic Politeness Markers into English, which he concludes thus:

There remain some Desiderata to be dealt with. First, the Arabic pre-nominal honorifics as well as post-nominal honorific-cum-optative sentences must be re-translated with a view to remove the items which make the language sound odd, and perhaps ungrammatical. Secondly, appropriate abbreviations must be devised for them. Finally, they must find their ways into English dictionaries, hence registered as part of the language.

Makers: The New Industrial Revolution by Chris Anderson 

This is a fun book  by the former editor-in-chief of WIRED , author of The Long Tail and the co-founder of 3D Robotics, Chris Anderson. Part pop culture, part tech-optimist futurism and all DIY business book, Anderson is preaching a revolution, one brought about by the intersection of 3D printing and open source “Maker movement” culture, that he believes will be bigger and more transformative to society than was the Web. One with the potential to change the “race to the bottom” economic logic of globalization by allowing manufacturing entrepreneurs to be smart, small, nimble and global by sharing bits and selling atoms.

Anderson writes:

Here’s the history of two decades of innovation in two sentences: The past ten years have been about discovering new ways to create, invent, and work together on the Web. The next ten years will be about applying those lessons to the real world.

This book is about the next ten years.

….Why? Because making things has gone digital: physical objects now begin as designs on screens, and those designs can be shared online as files…..once an industry goes digital in changes in profound ways, as we’ve seen in everything from retail to publishing. The biggest transformation, but in who’s doing it. Once things can be done on regular computers, they can be done by anyone. And that’s exactly what we’re seeing happening in manufacturing.

…..In short, the Maker Movement shares three characteristics,  all of which I’d argue are transformative:

1. People using digital desktop tools to create designs for new products and prototype them (“digital DIY”)

2. A cultural norm to share those designs and collaborate with others in online communities.

3. The use of common design file standards that allow anyone, if they desire, to send their designs to commercial manufacturing services to be produced in any number, just as easily as they can fabricate them on their desktop. This radically foreshortens the path from idea to entrepreneurship, just as the Web did in software, information, and content.

Nations whose entire strategy rests upon being the provider of cheapest labor per unit cost on all scales are going to be in jeopardy if local can innovate, customize and manufacture in near-real time response to customer demand. Creativity of designers and stigmergic /stochastic collaboration of communities rise in economic value relative to top-down, hierarchical production systems with long development lags and capital tied up betting on having large production runs.

Interesting, with potentially profound implications.

[ by Charles Cameron -- I thought it might be timely to consider trinary thinking in light of Zen's recent post featuring Clausewitz' Trinity ]
.

I know, it sounds inherently ridiculous, but what would happen if we thought in threes instead of twos? I mean, we tend to see things in terms of black and white, good and bad. Let’s set up a binary of our own — US President George W Bush vs the Aymara of the Andes and Altiploano:

Two into three won’t go, as they used to say in math class when I was a kid.

Hegel thought otherwise. Hegel thought two needed to move on into three, or we’d be stuck with binaries in stasis for ever. Hegel’s dialectic is about the possibility called three – which opens the otherwise static two up to various kinds of process…

**

We tend to view conflicts in binary terms: “who goes there, friend or foe?” is the challenge I was supposed to offer Mad Mitch the Axe Man if I ran across him as a CCF trainee in the grounds of my old school, Wellington College.

What is conflict is viewed in trinary?

Here is Chris Crawford, from his justly famous 1982 Art of Computer Game Design:

The advantage of asymmetric games lies in the ability to build nontransitive or triangular relationships into the game. Transitivity is a well-defined mathematical property. In the context of games it is best illustrated with the rock-scissors-paper game. Two players play this game; each secretly selects one of the three pieces; they simultaneously announce and compare their choices. If both made the same choice the result is a draw and the game is repeated. If they make different choices, then rock breaks scissors, scissors cut paper, and paper enfolds rock. This relationship, in which each component can defeat one other and can be defeated by one other, is a nontransitive relationship; the fact that rock beats scissors and scissors beat paper does not mean that rock beats paper.

We’re back in play…

**

Here, too, is a bit from m’friend Wm. Benzon, jazz-player, blogger, polymath:

Three against two is one of the most important rhythm ‘cells’ in all of music. What do I mean, three against two? You play three evenly spaced beats in one ‘stream’ in the same period of time you play two evenly spaced beats in another ‘stream.’ It sounds simple enough but, the problem is that three and two do not have a common divisor, making the ‘evenly spaced’ part of the formula a bit tricky. The two patterns coincide on the first beat, but the second and third beats of the three-beat stream happen at different times from the second beat of the two-beat stream. And if you think that’s a lot of verbiage for something that ought to be simple, when then you’re beginning to get the idea.

Noting that the brain has a hard time moving from two to three this way, Benzon quotes old-time piano virtuoso Joseph Hoffman:

In faster motion it is far better to practise at first each hand alone and with somewhat exaggerated accents of each group until the two relative speeds are well established in the mind. Then try to play the two hands together in a sort of semi-automatic way. Frequent correct repetition of the same figure will soon change your semi-automatic state into a a conscious one, and thus train your ear to listen to and control two different rhythms or groupings at the same time.

Those readers already familiar with my insistence on many-voiced (ie polyphonic) listening will quickly grasp that Hoffman is speaking of just that kind of broadening of our mental horizons — of our thinking capacities.

**

I’d like to close part 1 of this two part post within my “Numbers by the numbers” series, with a quote from LtGen Paul Van Riper (USMC Ret.), The Foundation of Strategic Thinking at Infinity Journal:

The United States and its allies need senior civilian officials and military officers who grasp the fundamental nature of systems, are adept at building shared mental models, comprehend the significance of Clausewitz’s paradoxical trinity, understand operational art and can connect strategic thinking with tactical actions through operational design. These are the true competencies of modern defense professionals.

As in conflict, as in Clausewitz, so in conflict resolution: we need to be able to think in trinary — in trinities — and beyond.

More on that — which interested me enough that I once designed a trinary game of my own, played with great splash and delight by three kids in a swimming pool — in the second part of this post.

[ by Charles Cameron -- visual thinking, graphical presentation, the magical number seven plus or minus two, human intelligence ]
.

Look:

click image to download pdf & see pp 12-13 for closer, full-size look

Got it? That’s part of a double-page spread from the University of Maryland’s START Program report for 2011:

The National Consortium for the Study of Terrorism and Responses to Terrorism—better known as START – is a university-based research center committed to the scientific study of the causes and human consequences of terrorism in the United States and around the world.

Looking through the rest of the report, I’m tempted to say a snazzier, jazzier magazine I’ve seldom seen!

**

I maintain that’s far nicer to look at, but no more comprehensible than, this gorgeous and justly infamous power point slide:

click image for a closer, full size look

Got that one, too? That was a slide used to help GEN McChrystal understand that war he was fighting.

**

Watson and Crick introduced their 1953 paper in Nature, A Structure for Deoxyribose Nucleic Acid, with these words:

We wish to suggest a structure for the salt of deoxyribose nucleic acid (D.N.A.). This structure has novel features which are of considerable biological interest.

No less witty is the opening of George A. Miller‘s only somewhat less celebrated paper three years later in The Psychological Review, The Magical Number Seven, Plus or Minus Two: Some Limits on Our Capacity for Processing Information:

My problem is that I have been persecuted by an integer. For seven years this number has followed me around, has intruded in my most private data, and has assaulted me from the pages of our most public journals. This number assumes a variety of disguises, being sometimes a little larger and sometimes a little smaller than usual, but never changing so much as to be unrecognizable. The persistence with which this number plagues me is far more than a random accident. There is, to quote a famous senator, a design behind it, some pattern governing its appearances. Either there really is something unusual about the number or else I am suffering from delusions of persecution.

The gist of Miller’s piece (and by gist I explicitly mean the always misleading broad strokes version) is that we can usually manage to hold five to nine chunks of thought in mind at any given time, but that if we want to understand more than that, we need to “chunk” our thoughts in such a way that we think of “seven plus or minus two” items (Miller’s “magical number”) but can peer into any one of them and see it divided into lesser portions which we can also comprehend, in what I’ll call a tree > trunk > limb > branch > twig > leaf arrangement — always remembering that a tree may be part of a forest, and that sometimes ee just can’t see the forest for the trees…

Miller explains chunking succinctly thus:

It seems probable that even memorization can be studied in these terms. The process of memorizing may be simply the formation of chunks, or groups of items that go together, until there are few enough chunks so that we can recall all the items.

Neat, hunh? And he concludes, with another pleasant touch of wit:

And finally, what about the magical number seven? What about the seven wonders of the world, the seven seas, the seven deadly sins, the seven daughters of Atlas in the Pleiades, the seven ages of man, the seven levels of hell, the seven primary colors, the seven notes of the musical scale, and the seven days of the week? What about the seven-point rating scale, the seven categories for absolute judgment, the seven objects in the span of attention, and the seven digits in the span of immediate memory? For the present I propose to withhold judgment. Perhaps there is something deep and profound behind all these sevens, something just calling out for us to discover it. But I suspect that it is only a pernicious, Pythagorean coincidence.

**

Of course there are high-node graphics programs like Starlight Analytics (from Future Point Systems via Battelle and the Pacific Northwest National Laboratory) which allow you to sample one of a cluster of very similar nodes, or to see where the outliers are and zero in on them…

or to focus in on only those nodes connected to one particular name or place on a map:

But can you find a file you’re looking for any faster by locating it somewhere in this graphic…

than by using your usual search methods?

So okay, high level analytics like Starlight may be useful for analysts who have the costly software and time to pinpoint and track and zoom and annotate and comprehend, become alarmed or calmed, and respond appropriately.

But people reading that glossy report from the START program? People trying to brief GEN McChrystal from a powerpoint slide?

Seven. Seven plus or minus is your number.

**

Once more, with feeling.

The moral of this tale is that graphical presentations of ideas to explain complexities should generally feature seven plus or minus two nodes, maximum, for eye and mind to consider at any one time, with perhaps an additional three or four that the eye can glide across to, forming a second chunk — thus delivering a maximum of 13 nodes without zooming in.

for the direct communication of major drivers in a complex situation — seven nodes plus or minus two is your optimal number.

**

Ah — but see, I forgot to show you the rest of that first image:

You can handle grasping the import of an image two parts, surely, can’t you?

Okay then — if you can, perhaps you can help me out…