There are quite a few holy wars in the psychology of reasoning, the most famous of which was between mental rules and mental models. This has a negative affect on the community: researchers fight to support their own brand, even when the empirical evidence suggests that major revisions are needed (yes, the data offer challenges to theories, even in psychology!), and mistrust or ignore results interpreted using ideas from competing brands. It’s a problem even when just chatting with someone about results. For instance one day I tried, patiently, to explain an empirical result to someone, who got angry about the theoretical framework in which the result was interpreted, and thus refused to look at data which would have been relevant to (and actually supported, once you looked at the numbers) his brand.
Anyway, was nice to see relevant comments from two different corners of the literature lying on my desk. The first comes from a discussion of (using) the ACT-R theory (Anderson, 2007, p. 19):
“… this book is not about ACT-R; rather I am using ACT-R as a tool to describe the mind. [...] We may be proud of our ACT-R models and think they are better than others [...] but we try not to lose track of the fact that they are just a way of describing what is really of interest.”
Later (p. 239) Anderson cites Herbert Simon, who complained that
“‘brand names’ tend to make difficult the analysis and comparison of [...] mechanisms or the exchange of knowledge between research groups. [...] Physicists did not divide quantum mechanics into the Heisenberg Brand, the Schrodinger Brand, and the Dirac brand.”
Next example, from a book on social class (Wright, 1997, p. 34):
“Readers who are highly skeptical of the Marxist tradition for whatever reasons might feel that there is no point in struggling through the numbers and graphs in the rest of this book. If the conceptual justifications for the categories are unredeemably flawed, it might be thought, the empirical results generated with those categories will be worthless. This would be, I think, a mistake. The empirical categories themselves can be interpreted in a Weberian or hybrid manner. [...] As is usually the case in sociology, the empirical categories are underdetermined by the theoretical frameworks within which they are generated or interpreted.”
All commonsense, really. But this important faculty of reasoning appears to be lost in practice, due, I suspect, to the very competitive nature of research, e.g., the joys of peer-review, trying to look clever at conferences (and, maybe more importantly, to students), and how tricky it is to continue to appear credible when one changes one’s mind.
Solutions please?
References
Anderson, J. R. (2007). How can the human mind occur in the physical universe? Oxford University Press
Wright, E. O. (1997). Class counts: student edition. Cambridge University Press.