Friday 9 July 2010

Too much (bad) research

Over at the Organizations and Markets blog Peter Klein writes
Bill McKelvey is one of the signatories to a controversial Chronicle piece that ran last month, “We Must Stop the Avalanche of Low-Quality Research.” The five authors, from a variety of academic disciplines, argue that “the amount of redundant, inconsequential, and outright poor research has swelled in recent decades, filling countless pages in journals and monographs.” As evidence they point to increases in the numbers of journals, journal pages, and authors and decreases in average citation rates.
[I]nstead of contributing to knowledge in various disciplines, the increasing number of low-cited publications only adds to the bulk of words and numbers to be reviewed. Even if read, many articles that are not cited by anyone would seem to contain little useful information. The avalanche of ignored research has a profoundly damaging effect on the enterprise as a whole. Not only does the uncited work itself require years of field and library or laboratory research. It also requires colleagues to read it and provide feedback, as well as reviewers to evaluate it formally for publication. Then, once it is published, it joins the multitudes of other, related publications that researchers must read and evaluate for relevance to their own work. Reviewer time and energy requirements multiply by the year. The impact strikes at the heart of academe.
These guys have a good point, there really is a lot of useless stuff being produced. But part of the problem is the way governments run our universities. Rankings of departments, and universities as a whole, promotion and tenure depends on the quantity of research, rather than the quality of research, as it is a lot easier to count publications than workout which are the best. And as Klein notes
The main problem is the vast increase in the scale and scope of the “scientific” enterprise itself, almost all of it due to public funding. There are simply too many universities and institutes, too many research faculty, too many granting agencies, too much research money. It’s a self-perpetuating process, almost exclusively driven by supply-side considerations (who on earth “demands” the output of most English departments?). Some of you will be shocked by the claim that there’s “too much” research money, particularly in today’s austere climate. But I mean too much relative to some social optimum, not too much relative to what university professors want.

1 comment:

Anonymous said...

Except in the hard sciences the titles of Dr and Professor are pretty much a joke. ie. unworthy of respect.