not statistical

I wanted to share this gem:

There were no real statistical tests presented and discussed in the paper. We don’t know whether the differences are significant.

Did the reviewer mean no outdated p-values? Well spotted! That discussion of the substantive meaning of the coefficients and those credibility intervals — apparently not spotted.

Image: CC-by Chase Elliott Clark

SciFlow for Collaborative Writing

There are a few solutions out there for collaborative writing, and currently I like SciFlow best. The thing about collaborative writing platforms is that while there are many options out there, we’ll have to consider the least technical of the co-authors. Yes, we could use LaTeX (or perhaps better: Markdown because most journals want Word documents during submission) on GitHub, but in the social sciences this is often no realistic because many shy away from anything that doesn’t quite look like a word processor.

I guess a widely approach consists of a Word document that is either e-mailed around, or these days shared on Dropbox. It’s not too bad as long as one of the authors knows how to combine different versions of the same document, tracked changes are accepted from time to time, and someone is willing to clean up the messed-up formatting in the end.

In terms of collaboration, an online platform can be better: there is only one version — the latest one –, and all authors can write on the document at once. SciFlow offers a basic service for just this, and the “basic” part makes it just so suitable: the least technical of the co-authors is likely to handle it well. It offers all the necessary bits without distracting from the most important bit: writing.

It handles basic formatting, footnotes, references, figures, and equations. We are forced to use styles rather than direct formatting — something we should be doing in Word, too, but the least technical of the co-authors typically doesn’t do. Citations are built in (though not quite as nicely as in Authorea, where we can import references from the web, too!), and there are many templates to format the document and export it to PDF or Word documents as needed.

Another use for pre-registration plans (PAP): help yourself

Pre-registration plans (PAP) rightly become more common (they are still not common enough yet, I think), but here’s a reason to write up a PAP that I have never seen mentioned before: Pre-registration plans can be immensely useful for yourself!

So, you have come up with a clever analysis, and writing the PAP has helped sharpen your mind what exactly you are looking for. You then collect your data, finish off another project, and … what was it exactly I was going to do with these data? Did I need to recode the predictor variable? etc.? Yes it happens, and a pre-analysis plan would be an ideal reminder to get back into the project: PAP can be like a good lab journal or good documentation of the data and analysis we do — a reminder to our future selves.

More theory to make social sciences more interesting

Richard Swedberg urges us to theorize more to make social sciences more interesting. His recent article in BJS summarizes Swedberg’s 2014 book in a short and accessible manner. While we’re more used to seeing the article first followed by a longer book, I’m happy to see this article as Swedberg’s message deserves to be heard. Contrary to what I chose as the title of this post, Swedberg actually doesn’t call for more theory as such, but for more of the right kind of theory. Good theory isn’t abstract and empirically irrelevant (i.e. much of what passes as ‘theory’ today). Interestingly Swedberg focuses on observation and creativity, and not formal modelling as it is done in economics (which he regards as mechanistic).

Swedberg, Richard. 2016. ‘Before Theory Comes Theorizing or How to Make Social Science More Interesting’. The British Journal of Sociology, February. doi:10.1111/1468-4446.12184.

Swedberg, Richard. 2014. The Art of Social Theory. Princeton: Princeton University Press.