Neuroimaging Study of Neuroscientists' Reactions to Journal Impact Factors

Well, we seem to be getting a bit meta here...

A group of scientists has conducted a neuroimaging study of neuroscientists' reactions to journal impact factors.

Here is a short excerpt from the body of the paper: "Using functional magnetic resonance imaging, we examined the brain activity of N = 18 neuroscientists during the anticipation of their own publication."

And here is the paper's abstract:

The incentive structure of a scientist’s life is increasingly mimicking economic principles. While intensely criticized, the journal impact factor (JIF) has taken a role as the new currency for scientists. Successful goal-directed behavior in academia thus requires knowledge about the JIF. Using functional neuroimaging we examined how the JIF, as a powerful incentive in academia, has shaped the behavior of scientists and the reward signal in the striatum. We demonstrate that the reward signal in the nucleus accumbens increases with higher JIF during the anticipation of a publication and found a positive correlation with the personal publication record (pJIF) supporting the notion that scientists have incorporated the predominant reward principle of the scientific community in their reward system. The implications of this behavioral adaptation within the ecological niche of the scientist’s habitat remain unknown, but may also have effects which were not intended by the community.

Headline: Cambridge University Press Breaks Google Scholar

Congratulations, Cambridge University Press! You have broken Google Scholar. I noticed that a paper of mine (Wymbs et al., Neuron, 2012) suddenly went from 40 citations to 70 in one Google-Scholar update. No other paper jumped so crazily this time, so I ruled out an algorithm update. It turns out that there is a recent 'target article' in Behavioral and Brain Sciences that includes much invited 'open peer commentary'.

One comment cited us, but each comment/article has a separate DOI even though they all link to the same .pdf file. 30 instant citations.

Now I wonder how much BBS inflates their impact factor by doing this... (Important note: this effect can easily be an unintended byproduct. I am just pointing out that it does indeed appear to be such a byproduct of how the website has organized the article and its associated comments. I am making no comments whatsoever about anybody's intent, because I have no idea about that.)

I am amused. (Also horrified.)

Goodhart's Law

My new favorite law is Goodhart's Law: "When a measure becomes a target, it ceases to be a good measure."

Although I just read this in an article about impact factors, the fact that this law was named after comments on UK policy is something to note.

And as with all good laws, it was named after somebody who did not invent it.