Home | Publications | Measuring participation or participating in measurement? the cautionary tale of an accidental experiment in survey accuracy
Measuring participation or participating in measurement? the cautionary tale of an accidental experiment in survey accuracy
July 4, 2017 | Book/Report Chapter
Authors: Pete Lunn Enhancing Participation in the Arts in the EU Challenges and Methods , edited by Victoria M. Ateca-Amestoy, Victor Ginsburgh, Isidoro Mazza, John O'Hagan, Juan Prieto-Rodriguez
While survey results are always subject to measurement error, it is generally assumed that surveys of cultural participation are no less accurate than surveys in other areas of social science. The present chapter casts doubt on this assumption via a cautionary tale of events that befell an established national survey in Ireland. An organisational change led the survey to be conducted via the same method but using a different set of interviewers. The result was a surprising and dramatic increase in the headline figures, which related to participation in sport, both active and social. Subsequent data pointed to a systematic relationship between the decision to participate in the different surveys and in the activity being measured. The implication is that surveys of cultural participation may be subject to a specific form of selection bias. Furthermore, the effect size reported here suggests that this bias may be discomfortingly large.
The ESRI works towards a national vision of ‘Informed policy for a better Ireland’. This means producing high-quality analysis to provide robust evidence for policymaking, with the goals of research excellence and policy impact.
The ESRI produces research that contributes to understanding economic and social change in the new international context and that informs public policymaking and civil society in Ireland.