Publication bias in qualitative research: what becomes of qualitative research presented at conferences?
- 1MRC Social and Public Health Sciences Unit, Glasgow, UK
- 2Development and Alumni Office, University of Glasgow, Glasgow, UK
- 3Child Health Research and Policy Unit, Institute of Health Sciences, City University, London, UK
- M Petticrew, Public and Environmental Health Research Unit, Department of Public Health and Policy, London School of Hygiene and Tropical Medicine, Keppel Street, London WCIE 7HT, UK;
- Accepted 26 June 2007
Background: Less than half of studies presented at conferences remain unpublished two years later, and these studies differ systematically from those that are published. In particular, the unpublished studies are less likely to report statistically significant findings, and this introduces publication bias. This has been well documented for quantitative studies, but has never been explored in relation to qualitative research.
Methods: We reviewed the abstracts of qualitative research presented at the 1998 (n = 110) and 1999 (n = 114) British Sociological Association (BSA) Medical Sociology meetings, and attempted to locate those studies in databases or by contacting authors. We also appraised the quality of reporting in each abstract.
Results: We found an overall publication rate for these qualitative studies of 44.2%. This is nearly identical to the publication rate for quantitative research. The quality of reporting of study methods and findings in the abstract was positively related to the likelihood of publication.
Conclusion: Qualitative research is as likely to remain unpublished as quantitative research. Moreover, non-publication appears to be related to the quality of reporting of methodological information in the original abstract, perhaps because this is a proxy for a study with clear objectives and clear findings. This suggests a mechanism by which “qualitative publication bias” might work: qualitative studies that do not show clear, or striking, or easily described findings may simply disappear from view. One implication of this is that, as with quantitative research, systematic reviews of qualitative studies may be biased if they rely only on published papers.
Competing interests: None.
Funding: This study was unfunded. MP and HT are funded by the Chief Scientist Office of the Scottish Executive Department of Health.