Article Text

Download PDFPDF

Using natural experiments to evaluate population health interventions: new Medical Research Council guidance
Free
  1. Peter Craig1,
  2. Cyrus Cooper2,
  3. David Gunnell3,
  4. Sally Haw4,
  5. Kenny Lawson5,
  6. Sally Macintyre6,
  7. David Ogilvie7,
  8. Mark Petticrew8,
  9. Barney Reeves9,
  10. Matt Sutton10,
  11. Simon Thompson11
  1. 1MRC Population Health Sciences Research Network and Chief Scientist Office, Scottish Government Health Directorates, Edinburgh, UK
  2. 2MRC Lifecourse Epidemiology Unit, University of Southampton, Southampton, UK
  3. 3School of Social and Community Medicine, University of Bristol, Bristol, UK
  4. 4Centre for Public Health and Population Health Research, University of Stirling, Stirling, UK
  5. 5Institute of Health and Wellbeing, University of Glasgow, Glasgow, UK
  6. 6MRClCSO Social and Public Health Sciences Unit, University of Glasgow, Glasgow, UK
  7. 7MRC Epidemiology Unit and UKCRC Centre for Diet and Activity Research (CEDAR), Cambridge, UK
  8. 8Department of Social and Environmental Medicine, London School of Hygiene and Tropical Medicine, London, UK
  9. 9Clinical Trials and Evaluation Unit, University of Bristol, Bristol, UK
  10. 10Health Methodology Research Group, School of Community-based Medicine, University of Manchester, Manchester, UK
  11. 11Department of Public Health and Primary Care, University of Cambridge, Cambridge, UK
  1. Correspondence to Dr Peter Craig, MRC Population Health Sciences Research Network and Chief Scientist Office, Scottish Government Health Directorates, St Andrews House, Edinburgh EH1 3DG, UK; peter.craig{at}scotland.gsi.gov.uk

Abstract

Natural experimental studies are often recommended as a way of understanding the health impact of policies and other large scale interventions. Although they have certain advantages over planned experiments, and may be the only option when it is impossible to manipulate exposure to the intervention, natural experimental studies are more susceptible to bias. This paper introduces new guidance from the Medical Research Council to help researchers and users, funders and publishers of research evidence make the best use of natural experimental approaches to evaluating population health interventions. The guidance emphasises that natural experiments can provide convincing evidence of impact even when effects are small or take time to appear. However, a good understanding is needed of the process determining exposure to the intervention, and careful choice and combination of methods, testing of assumptions and transparent reporting is vital. More could be learnt from natural experiments in future as experience of promising but lesser used methods accumulates.

  • Public health
  • research methods
  • epidemiology
  • suicide
  • death certification
  • systematic reviews
  • public health policy

Statistics from Altmetric.com

Request Permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Supplementary materials

  • Supplementary Data

    This web only file has been produced by the BMJ Publishing Group from an electronic file supplied by the author(s) and has not been edited for content.

    Files in this Data Supplement:

Footnotes

  • Funding Preparation of this paper was supported by the MRC Population Health Sciences Research Network, and the MRC Methodology Research Panel.

  • Competing interests None.

  • Provenance and peer review Not commissioned; externally peer reviewed.

  • Data sharing statement Preparation of the paper did not involve the use of primary data.