Estimating party positions on immigration: Assessing the reliability and validity of different methods

ppqa_23_3.coverIt’s been in the making for a long time, but I’m happy to announce that Laura Morales and my paper on estimating party positions on immigration is now available from Party Politics. In the paper we provide a systematic assessment of various methods to position political parties on immigration based on their electoral platforms. We do this for Austria, Belgium, France, Ireland, the Netherlands, Spain, Switzerland, and the UK, between 1993 and 2013. There high levels of consistency between expert positioning, manual sentence-by-sentence coding, and manual checklist coding; and poor or inconsistent results with the CMP/MARPOR, Wordscores, Wordfish, and the dictionary approach. An often-neglected method – manual coding using checklists – offers resource efficiency with no loss in validity or reliability. Now there is really no excuse any more for using old CMP data and pretend that they really were about immigration… (with the new subcodes in the most recent codebook things will probably improve for the CMP/MARPOR positions).

We’ve started this as an internal project for the SOM project (hence 7 of the 8 countries), simply because we (thought we) needed party positions on immigration over time. Wary of the time it takes to manually code party manifestos, we tried a few methods. There are two more we have tried but not pursued to the same extent, namely using a dictionary of keywords and Wordfish estimates on the entire text of the party platforms (i.e. without manually selecting the parts of the manifestos that are about immigration). These are not ‘dead’ yet, but we need further tests to ensure we know what they measure.

There’s an 102-page supplement available from the journal’s website.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

This site uses Akismet to reduce spam. Learn how your comment data is processed.

%d bloggers like this: