Mismodeling Indo-European Origin and Expansion: Bouckaert, Atkinson, Wade and the Assault on Historical Linguistics
As GeoCurrents passed through its August slowdown, plans were made for a series on the Summer Olympics. Thanks to the efforts of Chris Kremer, we have gathered statistics—and made maps—relating Olympic medal count by country to population and GDP, both overall and in regard to specific categories of competition. The series, however, has been put on hold by the recent publication of two heralded articles on the history and geography of the Indo-European language family. On August 24, a short piece in Science—“Mapping the Origins and Expansion of the Indo-European Language Family”—made extravagant claims, purporting to overturn the most influential historical-linguistic account of the world’s most widespread language family. On the same day, Nicholas Wade, noted New York Times science reporter, wrote a half-page spread in the news section of the Times on the Science report, entitled “Family Tree of Languages Has Roots in Anatolia, Biologists Say.” Over the next few days, the story was picked up—and often twisted in the process—by assorted journalists. Within a few days, headlines appeared as preposterous as “English Language Originated in Turkey.”
As Wade’s title indicates, the Science article, written by Remco Bouckaert and eight others (most notably Quentin D. Atkinson), seeks to overturn the thesis that the Indo-European (I-E) family originated north of the Black and Caspian seas. It instead locates the I-E heartland in what is now Turkey, supporting the “Anatolian” thesis advanced a generation ago by archeologist Colin Renfrew. The Science team bases its claims on mathematical grounds, using techniques derived from evolutionary biology and epidemiology to draw linguistic family trees and model the geographical spread of language groups. According to Wade, the authors claim that their study does nothing less than “solve” a “long-standing problem in archaeology: the origin of the Indo-European family of languages.” (Strictly speaking, however, the problem is not an archaeological one, as excavations by themselves tell us nothing about the languages of non-literate peoples; it is rather a linguistic problem with major bearing on prehistory more generally.)
As GeoCurrents is deeply interested in the intersection of language, geography, and history, the two articles immediately grabbed our attention. Our initial response was one of profound skepticism, as it hardly seemed likely that a single mathematical study could “solve” one of the most carefully examined conundrums of the distant human past. Recent work in both linguistics and archeology, moreover, has tended against the Anatolian hypothesis, placing Indo-European origins in the steppe and parkland zone of what is now Ukraine, southwest Russia, and environs. The massive literature on the subject was exhaustively weighed as recently as 2007 by David W. Anthony in his magisterial study, The Horse, the Wheel, and Language: How Bronze-Age Riders from the Eurasian Steppes Shaped the Modern World. Could such a brief article as that of Bouckaert et al. really overturn Anthony’s profound syntheses so easily?
The more we examined the articles in question, the more our reservations deepened. In the Science piece, the painstaking work of generations of historical linguists who have rigorously examined Indo-European origins and expansion is shrugged off as if it were of no account, even though the study itself rests entirely on the taken-for-granted work of linguists in establishing relations among languages based on words of common descent (cognates). In Wade’s New York Times article, contending accounts and lines of evidence are mentioned, but in a casual and slipshod manner. More problematic are the graphics offered by Bouckaert and company. The linguistic family trees generated by their model are clearly wrong, as we shall see in forthcoming posts. And on the website that accompanies the article, an animated map (“movie,” according to its creators) of Indo-European expansion is so error-riddled as to be amusing, and the conventional map on the same site is almost as bad. Mathematically intricate though it may be, the model employed by the authors nonetheless churns out demonstrably false information.
Failing the most basic tests of verification, the Bouckaert article typifies the kind of undue reductionism that sometimes gives scientific excursions into human history and behavior a bad name, based on the belief that a few key concepts linked to clever techniques can allow one to side-step complexity, promising mathematically elegant short-cuts to knowledge. While purporting to offer a truly scientific* approach, Bouckaert et al. actually forward an example of scientism, or the inappropriate and overweening application of specific scientific techniques to problems that lie beyond their own purview.
The Science article lays its stake to scientific standing in a straightforward but unconvincing manner. The authors claim that as two theories of Indo-European (I-E) origin vie for acceptance, a geo-mathematical analysis based on established linguistic and historical data can show which one is correct. Actually, many theories of I-E origin have been proposed over the years, most of which—including the Anatolian hypothesis—have been rejected by most specialists on empirical grounds. Establishing the firm numerical base necessary for an all-encompassing mathematical analysis of splitting and spreading languages is, moreover, all but impossible. The list of basic cognates found among Indo-European languages is not settled, nor is the actual enumeration of separate I-E languages, and the timing of the branching of the linguistic tree remains controversial as well. As a result of such uncertainties, errors can easily accumulate and compound, undermining the approach.
The scientific failings of the Bouckaert et al. article, however, go much deeper than that of mere data uncertainty. The study rests on unexamined postulates about language spread, assuming that the process works through simple spatial diffusion in much the same way as a virus spreads from organism to organism. Such a hypothesis is intriguing, but must be regarded as a proposition rather than a given, as it does not rest on a foundation of evidence. The scientific method calls for all such assumptions to be put to the test. One can easily do so in this instance. One could, for example, mathematically model the hypothesized diffusion of Indo-European languages for historical periods in which we have firm linguistic-geographical information to see if the predicted patterns conform to those of the real world. If they do not, one could only conclude that the approach fails. Such failure could stem either from the fact that the data used are too incomplete and compromised to be of value (garbage in/garbage out), of from a more general collapse of the diffusional model. Either possibility would invalidate the Science article.
Such a study, it turns out, has been conducted—and by none other than Bouckaert et al. in the Science article in question. Their model not only looks back 8,500 years into the past, when the locations and relations of languages families are only conjectured, but also comes up to the near present (1974), when such matters are well known. Here a single glance at their maps reveals the failure of their entire project, as they depict eastern Ukraine and almost all of Russia as never having been occupied by Indo-European speakers. Are we to believe that Russian and Ukrainian are not I-E languages? Or perhaps that Russians and Ukrainian speakers do not actually live in Russia and Ukraine? By the same token, are we to conclude that the Scythian languages of antiquity were not I-E? Or perhaps that the Scythians did not actually live in Scythia? And these are by no means the only instances of the study invalidating itself, as we shall soon demonstrate. An honest scientific report would have admitted as much, yet that of Bouckaert et al. instead trumpets its own success. How could that possibly be?
One can only speculate as to why the authors proved incapable of noting the failure of their model to mirror reality. Did they neglect to look at their own maps, trusting that the underlying equations were so powerful that they would automatically deliver? Could their faith in their model trump their concern for empirical evidence? Or could it be that their knowledge of linguistic geography is so scanty that they do not grasp the distribution of the Russian language, much less that of Scythian? If so, they are not operating at an acceptable undergraduate level of geo-historical knowledge. Alternatively, the authors might be aware that their model generates nonsense, but prefer to pretend otherwise, hoping to buffalo the broader scholarly community. They seem, after all, to conceal their approach as much as possible, couching their “findings” in jargon-ridden prose that proves a challenge not just for lay readers but also for specialists in neighboring subfields. (Translations of such passages as “Contours on the map represent the 95% highest posterior density distribution for the range of Indo-European” will be forthcoming.)
Regardless of whether the authors are intentionally trying to mislead the public or have simply succeeded in fooling themselves, their work approaches scientific malpractice. Science ultimately demands empirical verification, and here the project fails miserably. If generating scads of false information does not falsify the model, what possibly could? Non-falsifiable claims are, of course, non-scientific claims. The end result is a grotesquely rationalistic and hence ultimately irrational approach to the human past. As such, examining the claims made by the Science team becomes an example of what my colleagues Robert Proctor and Londa Schiebinger have aptly deemed “agnotology,” or “the study of culturally induced ignorance or doubt, particularly the publication of inaccurate or misleading scientific data.”
As the critique we offer is harsh and encompassing, GeoCurrents will devote a number of posts to examining in detail the claims made and techniques employed by Bouckaert, Atkinson, and their colleagues. But before delving into the nitty-gritty, a few words are in order about what ultimately lies at stake. We are exercised about the Science article not merely because of our passion for the seemingly esoteric issue of Indo-European origins, but also because we fear for the future of historical linguistics—and history more generally. The Bouckaert study, coupled with the mass-media celebration of the misinformation that it presents, constitutes an assault on a field that has generated an extraordinary body of rigorously derived information about the human past. Such an attack occurs at an unfortunate moment, as historical linguistics is already in crisis. Linguistics departments have been cutting positions in historical inquiry for some time, creating an environment in which even the best young scholars in the field are often unable to obtain academic positions.
The devaluation of historical linguistics is merely one aspect of a much larger shift away from the study of the past. Subdisciplines such as historical geography and historical sociology have been diminishing for decades, and even the discipline of history faces declining enrollments and reduced faculty slots. Academic history itself, moreover, has been progressively shying away from the deeper reaches of the human past to focus on modern if not recent historical processes. Such developments do not bode well for the maintenance of an educated public. At the risk of descending into hyperbole, we do worry about the emergence of something approaching institutionally produced societal dementia. The past matters, and we care deeply for the preservation of its study.
*Make no mistake: we at GeoCurrents are strong supporters of the scientific method. Linguistics is itself a logically constituted, rigorous endeavor that counts as a science in the larger sense of the word, and I have myself co-edited a work defending science and reason against eco-radical and other far-left attacks (The Flight from Science and Reason, edited by Paul R. Gross, Norman Levitt, and Martin W. Lewis. 1997. New York Academy of Sciences).
« Geographical Illiteracy in Civilization V
Quentin Atkinson’s Nonsensical Maps of... »