|
|
||||||||||||||
|
|
|||||||||||||||
THEORY AND METHODS |
1 Effective Healthcare Australia, School of Population Health and Health Services Research, University of Sydney, Australia
2 Department of Community Health Sciences, University of Calgary, Canada and School of Public Health, LaTrobe University, Australia
Correspondence to:
Correspondence to:
Lucie Rychetnik, Effective Healthcare Australia, Victor Coppleson Building, DO2, University of Sydney, NSW 2006, Australia;
lucier{at}med.usyd.edu.au
Public health interventions tend to be complex, programmatic, and context dependent. The evidence for their effectiveness must be sufficiently comprehensive to encompass that complexity. This paper asks whether and to what extent evaluative research on public health interventions can be adequately appraised by applying well established criteria for judging the quality of evidence in clinical practice. It is adduced that these criteria are useful in evaluating some aspects of evidence. However, there are other important aspects of evidence on public health interventions that are not covered by the established criteria. The evaluation of evidence must distinguish between the fidelity of the evaluation process in detecting the success or failure of an intervention, and the success or failure of the intervention itself. Moreover, if an intervention is unsuccessful, the evidence should help to determine whether the intervention was inherently faulty (that is, failure of intervention concept or theory), or just badly delivered (failure of implementation). Furthermore, proper interpretation of the evidence depends upon the availability of descriptive information on the intervention and its context, so that the transferability of the evidence can be determined. Study design alone is an inadequate marker of evidence quality in public health intervention evaluation.
Keywords: public health intervention
This article has been cited by other articles:
![]() |
C Bambra, M Whitehead, A Sowden, J Akers, and M Petticrew "A hard day's night?" The effects of Compressed Working Week interventions on the health and work-life balance of shift workers: a systematic review J. Epidemiol. Community Health, September 1, 2008; 62(9): 764 - 777. [Abstract] [Full Text] [PDF] |
||||
![]() |
K-C Tang, B C K Choi, and R Beaglehole Grading of evidence of the effectiveness of health promotion interventions J. Epidemiol. Community Health, September 1, 2008; 62(9): 832 - 834. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Ramanathan, K. R. Allison, G. Faulkner, and J. J. M. Dwyer Challenges in assessing the implementation and effectiveness of physical activity and nutrition policy interventions as natural experiments Health Promot. Int., September 1, 2008; 23(3): 290 - 297. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. K. deWilde, A. Milman, Y. Flores, J. Salmeron, and I. Ray An integrated method for evaluating community-based safe water programmes and an application in rural Mexico Health Policy Plan., August 7, 2008; (2008) czn017v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
Y. Robitaille and L. Gauvin Fall prevention in older adults: towards an integrated population-based perspective Inj. Prev., June 1, 2008; 14(3): 147 - 148. [Full Text] [PDF] |
||||
![]() |
M. Slade, L. Gask, M. Leese, P. McCrone, C. Montana, R. Powell, M. Stewart, and C. Chew-Graham Failure to improve appropriateness of referrals to adult community mental health services--lessons from a multi-site cluster randomized controlled trial Fam. Pract., June 1, 2008; 25(3): 181 - 190. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Spencer, U. Broesskamp-Stone, B. Ruckstuhl, G. Ackermann, A. Spoerri, and B. Cloetta Modelling the results of health promotion activities in Switzerland: development of the Swiss Model for Outcome Classification in Health Promotion and Prevention Health Promot. Int., March 1, 2008; 23(1): 86 - 97. [Abstract] [Full Text] [PDF] |
||||
![]() |
C. Bambra, M. Egan, S. Thomas, M. Petticrew, and M. Whitehead The psychosocial and health effects of workplace reorganisation. 2. A systematic review of task restructuring interventions J. Epidemiol. Community Health, December 1, 2007; 61(12): 1028 - 1037. [Abstract] [Full Text] [PDF] |
||||
![]() |
J. Adams, K. Witten, and K. Conway Community development as health promotion: evaluating a complex locality-based project in New Zealand Community Dev. J., November 16, 2007; (2007) bsm049v1. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Egan, C. Bambra, S. Thomas, M. Petticrew, M. Whitehead, and H. Thomson The psychosocial and health effects of workplace reorganisation. 1. A systematic review of organisational-level interventions that aim to increase employee control J. Epidemiol. Community Health, November 1, 2007; 61(11): 945 - 954. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Waters, N. Priest, R. Armstrong, S. Oliver, P. Baker, D. McQueen, C. Summerbell, M. P. Kelly, and B. Swinburn The role of a Prospective Public Health Intervention Study Register in building public health evidence: proposal for content and use J. Public Health Med., September 1, 2007; 29(3): 322 - 327. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. L. James, C. Fraser, K. Anderson, and F. Judd Use of research by the Australian health promotion workforce Health Educ. Res., August 1, 2007; 22(4): 576 - 587. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. McLaren, L. M. Ghali, D. Lorenzetti, and M. Rock Out of context? Translating evidence from the North Karelia project over place and time Health Educ. Res., June 1, 2007; 22(3): 414 - 424. [Abstract] [Full Text] [PDF] |
||||
![]() |
P J Nicholson How to undertake a systematic review in an occupational setting Occup. Environ. Med., May 1, 2007; 64(5): 353 - 358. [Full Text] [PDF] |
||||
![]() |
M. J. Verhoef, L. C. Vanderheyden, and V. Fonnebo A whole systems research approach to cancer care: why do we need it and how do we get started? Integr Cancer Ther, December 1, 2006; 5(4): 287 - 292. [Abstract] [PDF] |
||||
![]() |
R S. Kovats and L E. Kristie Heatwaves and public health in Europe Eur J Public Health, December 1, 2006; 16(6): 592 - 599. [Abstract] [Full Text] [PDF] |
||||
![]() |
S Mallonee, C Fowler, and G R Istre Bridging the gap between research and practice: a continuing challenge Inj. Prev., December 1, 2006; 12(6): 357 - 359. [Full Text] [PDF] |
||||
![]() |
K. Whittaker, C. Sutton, and C. Burton Pragmatic randomised controlled trials in parenting research: the issue of intention to treat. J. Epidemiol. Community Health, October 1, 2006; 60(10): 858 - 864. [Abstract] [Full Text] [PDF] |
||||
![]() |
K. Stronks and J. P. Mackenbach Evaluating the effect of policies and interventions to address inequalities in health: lessons from a Dutch programme Eur J Public Health, August 1, 2006; 16(4): 346 - 353. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. Waters, J. Doyle, N. Jackson, F. Howes, G. Brunton, and A. Oakley Evaluating the effectiveness of public health interventions: the role and activities of the Cochrane Collaboration. J. Epidemiol. Community Health, April 1, 2006; 60(4): 285 - 289. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. Wang, J. R. Moss, and J. E. Hiller Applicability and transferability of interventions in evidence-based public health Health Promot. Int., March 1, 2006; 21(1): 76 - 83. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Dooris Healthy settings: challenges to generating evidence of effectiveness Health Promot. Int., March 1, 2006; 21(1): 55 - 65. [Abstract] [Full Text] [PDF] |
||||
![]() |
A. Oakley, V. Strange, C. Bonell, E. Allen, J. Stephenson, and RIPPLE Study Team Process evaluation in randomised controlled trials of complex interventions. BMJ, February 18, 2006; 332(7538): 413 - 416. [Full Text] [PDF] |
||||
![]() |
H. Thomson, R. Atkinson, M. Petticrew, and A. Kearns Do urban regeneration programmes improve public health and reduce health inequalities? A synthesis of the evidence from UK policy and practice (1980-2004) J. Epidemiol. Community Health, February 1, 2006; 60(2): 108 - 115. [Abstract] [Full Text] [PDF] |
||||
![]() |
N. Jackson, E. Waters, and for the Guidelines for Systematic Reviews in Healt Criteria for the systematic review of health promotion and public health interventions Health Promot. Int., December 1, 2005; 20(4): 367 - 374. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Ogilvie, M. Egan, V. Hamilton, and M. Petticrew Systematic reviews of health effects of social interventions: 2. Best available evidence: how low should you go? J. Epidemiol. Community Health, October 1, 2005; 59(10): 886 - 892. [Abstract] [Full Text] [PDF] |
||||
![]() |
T Y Wong Cataract surgery programmes in Africa Br. J. Ophthalmol., October 1, 2005; 89(10): 1231 - 1232. [Full Text] [PDF] |
||||
![]() |
D. Ogilvie, V. Hamilton, M. Egan, and M. Petticrew Systematic reviews of health effects of social interventions: 1. Finding the evidence: how far should you go? J. Epidemiol. Community Health, September 1, 2005; 59(9): 804 - 808. [Abstract] [Full Text] [PDF] |
||||
![]() |
S. M Aoun and L. J Kristjanson Challenging the framework for evidence in palliative care research Palliative Medicine, September 1, 2005; 19(6): 461 - 465. [Abstract] [PDF] |
||||
![]() |
L. Tooth, R. Ware, C. Bain, D. M. Purdie, and A. Dobson Quality of Reporting of Observational Longitudinal Research Am. J. Epidemiol., February 1, 2005; 161(3): 280 - 288. [Abstract] [Full Text] [PDF] |
||||
![]() |
D Ogilvie Hospital based alternatives to acute paediatric admission: a systematic review Arch. Dis. Child., February 1, 2005; 90(2): 138 - 142. [Abstract] [Full Text] [PDF] |
||||
![]() |
B. Rush, A. Shiell, and P. Hawe A census of economic evaluations in health promotion Health Educ. Res., December 1, 2004; 19(6): 707 - 719. [Abstract] [Full Text] [PDF] |
||||
![]() |
D. Ogilvie, M. Egan, V. Hamilton, and M. Petticrew Promoting walking and cycling as an alternative to using cars: systematic review BMJ, October 2, 2004; 329(7469): 763. [Abstract] [Full Text] [PDF] |
||||
![]() |
M. Petticrew, M. Whitehead, S. J Macintyre, H. Graham, and M. Egan Evidence for public health policy on inequalities: 1: The reality according to policymakers J. Epidemiol. Community Health, October 1, 2004; 58(10): 811 - 816. [Abstract] [Full Text] [PDF] |
||||
![]() |
R. Power, L. F. Langhaug, T. Nyamurera, D. Wilson, M. T. Bassett, and F. M. Cowan Developing complex interventions for rigorous evaluation--a case study from rural Zimbabwe Health Educ. Res., October 1, 2004; 19(5): 570 - 575. [Abstract] [Full Text] [PDF] |
||||
![]() |
P. Hawe, A. Shiell, T. Riley, and L. Gold Methods for exploring implementation variation and local context within a cluster randomised community intervention trial J. Epidemiol. Community Health, September 1, 2004; 58(9): 788 - 793. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Rychetnik, P. Hawe, E. Waters, A. Barratt, and M. Frommer A glossary for evidence based public health J. Epidemiol. Community Health, July 1, 2004; 58(7): 538 - 545. [Abstract] [Full Text] [PDF] |
||||
![]() |
A Adily and J Ward Evidence based practice in population health: a regional survey to inform workforce development and organisational change J. Epidemiol. Community Health, June 1, 2004; 58(6): 455 - 460. [Abstract] [Full Text] [PDF] |
||||
![]() |
E. A. Abbema, P. Van Assema, G. J. Kok, E. De Leeuw, and N. K. De Vries Effect evaluation of a comprehensive community intervention aimed at reducing socioeconomic health inequalities in the Netherlands Health Promot. Int., June 1, 2004; 19(2): 141 - 156. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Rychetnik and M. Wise Advocating evidence-based health promotion: reflections and a way forward Health Promot. Int., June 1, 2004; 19(2): 247 - 257. [Abstract] [Full Text] [PDF] |
||||
![]() |
L. Jack Jr., L. Liburd, T. Spencer, and C. O. Airhihenbuwa Understanding the Environmental Issues in Diabetes Self-Management Education Research: A Reexamination of 8 Studies in Community-Based Settings Ann Intern Med, June 1, 2004; 140(11): 964 - 971. [Abstract] [Full Text] [PDF] |
||||
![]() |
H Roberts, K Curtis, K Liabo, D Rowland, C DiGuiseppi, and I Roberts Putting public health evidence into practice: increasing the prevalence of working smoke alarms in disadvantaged inner city housing J. Epidemiol. Community Health, April 1, 2004; 58(4): 280 - 285. [Abstract] [Full Text] [PDF] |
||||
![]() |
H. Thomson, R. Hoskins, M. Petticrew, D. Ogilvie, N. Craig, T. Quinn, and G. Lindsay Evaluating the health effects of social interventions BMJ, January 31, 2004; 328(7434): 282 - 285. [Full Text] [PDF] |
||||
![]() |
K C Tang, J P Ehsani, and D V McQueen Evidence based health promotion: recollections, reflections, and reconsiderations J. Epidemiol. Community Health, November 1, 2003; 57(11): 841 - 843. [Full Text] [PDF] |
||||
![]() |
S. S. Bull, C. Gillette, R. E. Glasgow, and P. Estabrooks Work Site Health Promotion Research: To what Extent can we Generalize the Results and what is Needed to Translate Research to Practice? Health Educ Behav, October 1, 2003; 30(5): 537 - 549. [Abstract] [PDF] |
||||
![]() |
M Petticrew and H Roberts Evidence, hierarchies, and typologies: horses for courses J. Epidemiol. Community Health, July 1, 2003; 57(7): 527 - 529. [Abstract] [Full Text] [PDF] |
||||
![]() |
D V McQueen The evidence debate J. Epidemiol. Community Health, February 1, 2002; 56(2): 83 - 84. [Full Text] [PDF] |
||||
| HOME | HELP | FEEDBACK | SUBSCRIPTIONS | ARCHIVE | SEARCH | TABLE OF CONTENTS | REGISTER |