DORA … are we getting there?

Yes, we probably all agree that we should evaluate research quality and not quantity. DORA works in that direction, but it avoids specifying what quality means. Perhaps we can even trust each other to identify ‘quality’ and ‘excellence’ just like that.

But consider the following guidelines:

  • “The total number of publications or the number of publications per year is not considered to be the only indicator of performance.”
  • “Each applicant may list up to 10 scientific publications.”

Both of these are attempts to put DORA into practice. In the former, the number of publications per year cannot be used as the sole indicator (“not the only indicator”). In the latter, we actually remove the possibility to do the former (unless we’re evaluating researchers with fewer than 10 outputs).

I don’t know… I’m not convinced we’re changing much other than how we structure CVs and what we highlight. And thinking about it prospectively (early career researchers; planning what research to focus on), can we even guess which research (output) will have a “big” impact on other researchers or society?

Reviewing activities on a 2-page CV

I’m a big fan of 2-page CV, but in the most recent template I have received from a funder, they also ask to list reviewing activities. On the one hand, I appreciate that they try to acknowledge reviewing activities, on the other hand, I wonder what selection criteria would be appropriate — listing everything would fill most of the 2 pages (and still not tell us much about the quality of the reviews); only listing activities for “prestigious” work kind of defeats the point of trying to acknowledge the less glorious parts of what we do.