Article Text

PDF

Putting public health evidence into practice: increasing the prevalence of working smoke alarms in disadvantaged inner city housing
  1. H Roberts1,
  2. K Curtis1,
  3. K Liabo1,
  4. D Rowland2,
  5. C DiGuiseppi3,
  6. I Roberts2
  1. 1Child Health Research and Policy Unit, City University, London, UK
  2. 2Public Health Intervention Research Unit, Department of Epidemiology and Population Health, London School of Hygiene and Tropical Medicine, London, UK
  3. 3Department of Preventive Medicine and Biometrics, University of Colorado Health Sciences Center, USA
  1. Correspondence to:
 Ms K Curtis
 Child Health Research and Policy Unit, Institute of Health Sciences, City University, 20 Bartholomew Close, London EC1A 7QN, UK; k.curtiscity.ac.uk

Abstract

Study objectives: The UK government recommends that local authorities install battery operated smoke alarms to prevent fire related injury. However, a randomised controlled trial of smoke alarm installation in local authority housing found a low level of working alarms at follow up. Qualitative work, which accompanied the trial explored barriers and levers to the use of this public health intervention.

Design: Semi-structured group and individual interviews were conducted with a sample of the adult participants in a randomised controlled trial of free smoke alarm installation. Group interviews and ”draw and write” exercises were conducted with children at a local primary school.

Participants: A sample of trial participants and primary school children in the trial neighbourhood.

Setting: An inner city housing estate in central London.

Main results: The main barrier to smoke alarm use was the distress caused by false alarms. Although trial participants considered themselves to be at high risk for fires and would recommend smoke alarms to others, respondents’ reports on the distress caused by false alarms suggest that people balance immediate and longer term risks to their health and wellbeing when they disable alarms.

Conclusions: This study identified some of the reasons for the low level of functioning smoke alarms, and problems experienced with alarms. The results have implications for the implementation of this public health intervention. The effectiveness of smoke alarm installation could be improved if alarm manufacturers and those responsible for implementation programmes considered ways of tackling the issues raised in this study.

  • public health implementation
  • smoke alarms

Statistics from Altmetric.com

“Smoke alarms save lives” appears on banners outside London fire stations. A footnote should add that they are more likely to do so if they are working. Eighty one per cent of British households reported having an alarm in 1999.1 However, in two deprived inner London boroughs only 16% of homes were found to have working alarms.2 Studies have begun to identify some of the barriers to continued use, for example batteries may be removed or disconnected because of persistent low battery warning signals or to false alarms from cooking or cigarette smoke.2–4 However, several different types of smoke alarm are available. There is a lack of evidence on which type is most likely to remain working after initial installation.

To investigate this, a randomised controlled trial was conducted.5 One of five different combinations of alarm and battery types was installed in 2145 households. A key finding was that when alarms were tested 15 months later only 51% and an even smaller proportion in smokers’ households, were working. Households with ionisation sensor alarms, with lithium battery and pause button, were most likely to have any working alarm (69%) and a working study alarm (66%). Households with optical alarms, with zinc battery, were least likely to have any working alarm (41%) or a working study alarm (36%). Differences by alarm type were significant, after adjustment for type of floor plan, household composition, presence of young or elderly, and ethnicity (see Rowland et al for full details5). This success rate may seem acceptable or even impressive given that the uptake of safety practices promoted by clinicians is often in the order of 10% after intense behavioural change strategies.6 However, at the time follow up began, 100% of the alarms were installed and functional, meaning that nearly half became non-functional after 15 months. An editorial accompanying publication of the trial results suggested that this should lead us to consider the difference between an efficacy trial (what works in perfect conditions) and an effectiveness trial (what works in the real world).7

Public health interventions, like clinical ones, can have both beneficial and adverse effects, and those on the receiving end can provide important insights into why some interventions may be less effective than anticipated.8,9

Rychetnick et al point out that interpretation of the evidence in public health depends on the availability of a range of types of data, and that the appraisal of evidence about public health interventions should encompass not only the credibility of evidence, but also its completeness and its transferability.10 By focusing on some of the non-trial data from a particular intervention, this paper adds to the literature on the kinds of evidence needed to promote the use of research findings in “real life” settings.

This paper reports the results of a qualitative study carried out with participants in the randomised controlled trial of smoke alarms,5 and children in the trial neighbourhood. It identifies barriers to the continued use of smoke alarms, and illustrates how qualitative work can inform the design of randomised controlled trials of preventive interventions and provide information for policy at local and national levels.

METHODS

This study was conducted on a local authority housing estate in London between November 1999 and March 2002. The estate is materially deprived and 23% of residents speak primary languages other than English. The location was selected as one likely to reflect features associated with a high risk of house fires—that is, low income areas, deprived council estates, and housing in poor physical condition.11 There is a steep social class gradient in the likelihood of fire related mortality and morbidity.12,13

Purposive samples were derived for the qualitative work.14 Using data collected from participants at trial enrolment, we identified households across a range of ethnicities, ages, disability, household formations, housing types, housing tenure, and incorporating all five alarm types used in the trial, as well as households that had been randomised but ultimately refused or otherwise did not receive the intervention (6.6% of trial sample). Recruitment ensured that people with infants under 4 years and people aged over 65 were sampled. On the basis of resources available, contact was planned with around 50 adults and 50 children through group and one to one approaches. Our analyses suggest that data saturation was reached with these numbers.15 Discussions were also held with trial recruiters and alarm installers to gather information on reasons for refusing participation in the trial.

Adult occupants of identified households taking part in the trial who had supplied a telephone number (88% of all participants) were telephoned to invite them to take part in the qualitative work, and a follow up confirmation letter sent. Group interviews took place in a local community centre. Evening interviews were held for those at work during the day. If people were unable to leave the house, we offered to meet them at home. Those contacted who were not fluent in English were asked whether they would like an interpreter. Children, aged 7–11, from the local primary school were also invited to take part and the interviews took place in class groups in the school. We used an opt out approach to parental consent. Children’s own consent was also sought.

We collected data using a range of qualitative methods. These included individual and group interviews with adults, and group interviews, questionnaires and “draw and write” techniques with children. Questions were based around a topic guide, with follow up prompts. Critical incidents were explored in more depth with interviewees. These included two cases where alarms would not stop; one of a fire in a next door flat; one where the participant smashed her alarm; one where the participant felt suspicious of staff who introduced the project; and one where a participant had a fire at home and was alerted by the alarm.

The topic guide included perceptions of fire risk, benefits and problems of living with a smoke alarm, and reflections on participation in a trial. We asked whether having a smoke alarm would influence the decision to recommend alarms to others. To avoid compromising the dynamics of the groups by introducing what might be seen as a matter of right or wrong, we did not ask participants to indicate whether their alarm was currently functioning. Finally, there was an opportunity for feedback on topics of importance to participants that we had not covered. Children were invited to talk with us about a similar range of topics, and were given a “work book” to complete, which encouraged drawings and written responses. We wanted to know whether they recognised smoke alarms, whether they knew how they were supposed to operate, and what happened if they went off (or on, as one child corrected us).

Gender was recorded by the researchers facilitating the session. We asked adult participants to describe themselves in terms of age and ethnicity. We met with whole classes of children, so the ethnic make up is likely to be representative of their year group. Work conducted in 1997 among children at this primary school, as part of a larger survey,16 indicated that 69% were Asian (63% Bangladeshi), 16% white, 5% black, and 10% other/unknown.

Two researchers facilitated all group sessions. For individual interviews with housebound participants, and those who did not speak English (for whom we used interpreters), interviews took place in the participant’s home, with one researcher. Telephone interviews were carried out with those who had been randomised but did not receive the intervention. All interviews were recorded and transcribed. Researchers read the data independently for key themes, and differences in interpretation were resolved through discussion. In this particular study, where the themes and issues raised were comparatively straightforward, simple discussion between the primary fieldworkers (KC and KL) and HR was sufficient to resolve differences.

The Institute of Child Health Research Ethics Committee approved the study protocol.

RESULTS

Over the one year study period, we interviewed a total of 58 adults. Ten group interviews involved a total of 39 participants with group sizes ranging from three to nine people and we conducted nine individual interviews, three with housebound participants and six with non-English speakers. We interviewed 10 people who had been randomised to the intervention but had not received it. Table 1 shows self identified ages, ethnicities, and other characteristics. About one in five adults agreed to take part in the study when initially approached, and about half of those who expressed initial interest attended discussion groups or agreed to a home interview. Four group interviews were conducted with a total of 41 children. Detailed results from the child participants will be reported elsewhere.

Table 1

Participants in the study

Based on trial data, 63% of participants in the qualitative study had a working smoke alarm at the end of the 15 month trial. Levers to continued alarm use included early warning in the event of fire, and as a result, an increased sense of security. Those who refused installation of an alarm said that they already had one (in two cases participants revealed at follow up that this was not yet installed), expressed concern at receiving an intervention that entailed a stranger coming into their home, or were suspicious of an intervention provided free. Some potential participants perceived themselves to be “too old to be worth spending money on.”

Among those who accepted an alarm, there was a sense of being at high risk for fire. The intervention should, they felt, be recommended to others. However, they identified a range of barriers to continuing use after installation. These cast light on the low level of alarm functioning at follow up.

Alarms as a source of stress

Participants described important adverse effects of smoke alarms including the stress of false alarms:

It is an incredible noise and I don’t get panicked ... but when that came on I was just like ‘Oh!’ It’s such a pitch you just really want to stop it, and in your own home. It’s a really calm safe environment and suddenly you’ve got this, you know, it’s screaming at you... you feel completely powerless and that’s a horrible feeling in your home, it’s something you can’t control. Mother, white (1)* It only went off once, when I burnt something in the kitchen. By that time it had been up for about 8 months. I have a very high ceiling in the hallway and I’d forgotten how to turn it off. I have a three-year-old daughter, it frightened her so much, she started screaming at me. And I didn’t know how to turn this thing off. Mother, white (2) Unfortunately with the alarm we have, I don’t know what’s wrong with it, but it’s gone crazy. It just keeps going on and on... there was no smoke around at all, just something happened. Father, black

The participants who reported these problems had all eventually disabled the alarm by taking out the batteries or taking it down from the ceiling.

The researchers received a number of telephone messages and a letter asking for help (“could you please send someone around after Wednesday 4 July”). The letter made clear the distress caused by the smoke alarm:

I’m sorry but it really stressed me out, what with the heat and climbing up ladders to try and stop it. ... It went off Wednesday after the cooking of dinner and despite fanning with towels and other things it just kept going. In desperation I put my electric fan on but it kept going on for an hour. There was no build up of smoke to start it off, just a slight cooking haze. Letter from woman, over 65 years, white

Problems with maintenance

Difficulties were reported in silencing the alarm, and reaching the alarm, for instance to change the battery or press the “pause” or “test” button (a particular problem for elderly and disabled participants). Some participants found it difficult to release the cover of the alarm to change the battery. In some cases alarms were irreparably damaged, or knocked off the ceiling, in an attempt to stop the noise. The mother above whose 3 year old had been frightened by the alarm finished her story:

So I grabbed a broom and I thought, I’ve got to hit that thing up there. So I started banging it with the broom... and it broke and smashed around me and that was it, that was the end of the smoke alarm. Mother, white So I tell [the installers] you must be joking. Me change that battery! ... It’s very high for me on my own ... I have a bad leg, and I’m a diabetic and I wouldn’t like to do anything that is out of the way now ... It’s a very bad story for anyone with a bad leg or old people to do that ... Man, over 65 years, black

As a result of learning of these problems in early interviews, later participants were asked directly about testing their alarm regularly. Several were unclear about this, and three described using a flame or cigarette. Thirteen were unclear about how to recognise a low battery signal and six described confusion arising from this.

We weren’t aware of [the low battery signal], so we took the battery off [to stop the bleeping], but last week somebody came round, they told us [what the bleeping was]. Woman, Bangladeshi With the batteries running out, they make a noise and it goes on and on and you think it’s the phone... I woke up one night and I thought ‘What’s that noise?’ I could hear every two or three seconds ‘beep, beep’ and I thought ‘What on earth’s that?’ I never thought of the smoke alarm at the time. Woman, over 65 years, white

Few participants reported dusting their alarms to clean the sensor. Four participants indicated a feeling of unease about the device and their lack of ability to control it:

[I] didn’t [test] it, [I’m] too scared to try. Woman, over 65 years, ethnicity “other”

Over a quarter of participants described giving or receiving help to family or neighbours as a result of these type of problems, and others described using a broom or umbrella to reach the “pause” or “test” button.

Alarm sensitivity

Of the 48 adult recipients interviewed, a third felt that their alarm was very sensitive, and a large number of children reported that the alarm invariably sounds when someone is cooking:

When [I] cook steam comes out [and sets off the alarm]. Woman, Bangladeshi If your parents are cooking something - mostly the smoke alarm goes on when a parent’s cooking something. Child, 10–11 yearsThe man next door, every time he grills just a bit of bacon... then it starts the alarm off. Woman, over 65 years, white In a Chinese family we always fry things and sometimes if I fry too much the alarm goes off warning me... even my little boy says, ‘too much oil!’ Father, Chinese When my mum cooks anything yeah, it makes a noise. Child 10–11 years

Key points

  • Although trial participants consider themselves to be at high risk for fires and would recommend smoke alarms to others, the distress caused by false alarms is a major barrier to use.

  • Respondents’ reports on the distress caused by false alarms suggests that people balance immediate and longer term risks to their health and wellbeing when they disable alarms.

Three participants (two in Bangladeshi households) described taking the battery out of the alarm to stop it sounding while they were cooking. Several children also suggested this as an option.

Three participants raised concerns about the disturbance that the sounding alarm could cause neighbours:

I worried about my neighbours. Opposite to me there’s an old lady and she can’t sleep much and sometimes she sleeps during the day and [the alarm] will bother her ... Mother, white

Alarms as nuisance

Alarms going off when there was no fire resulted in their being ignored as a nuisance (much like car alarms), or disabled by removing the batteries or the alarm.

Residents, including children, no longer associated frequently sounding alarms with emergencies:

When the smoke alarm goes off, I have to turn up the television. Child, 8 years Sometimes it’s a bit annoying, cos last time I was asleep and my mum was cooking something and then it went on and it was so loud I had to wake up. Child aged 10–11 years

Older participants suggested that the alarms that frequently sounded would be ineffective, as no one would respond:

The alarm make noise. What are you going to do? People are working. People don’t want to help, leaving people dying in their room...’ Man, over 65 years, ethnicity “other”

DISCUSSION

Principal findings

The reasons why some participants refused installation of alarms and others stopped use after installation—as well as the reasons why others continued use throughout the trial—are important for this and future work. Levers to continued alarm use included early warning in the event of fire and an increased sense of security. Those who refused alarm installation said they already had one, or were concerned at receiving an intervention that entailed giving a stranger access to their homes. Those who received alarms but stopped use cited a range of adverse effects including problems with maintenance and alarm sensitivity, leading to nuisance alarms and stress. This provides an explanation for the low level of functioning smoke alarms 15 months after installation.5 Although trial participants, including children (see fig 1) considered themselves at high risk for fires and would recommend smoke alarms to others, respondents’ reports on the distress caused by false alarms, and problems with maintenance, suggest that by disabling alarms, people are making rational decisions about their immediate health and wellbeing. In a population already managing a range of health risks, a public health intervention that makes mealtimes more, rather than less, stressful, and where noise can threaten leisure or relationships with fellow occupants, alarms could pose a threat to immediate wellbeing.

Figure 1

Example of a child’s drawing.

Strengths and weaknesses of the study

The strengths of qualitative work in a trial context include its potential to draw on the expertise of users, improve trial recruitment,17 and the opportunity it offers to identify questions that are important to people receiving interventions. In this study the qualitative work followed trial recruitment. While a potential weakness includes bias introduced through the over-representation of “compliers” in the qualitative work, we were also able to recruit a sample of people who had been randomised but then withdrew before receiving a smoke alarm. Without research of this kind, false assumptions may be made about why some families forgo smoke alarms. After publication of the trial results in the BMJ,5 one reader asked: “What is ... one to make of six pages devoted to the hardly surprising fact that feckless families do not bother to use smoke alarms.”18 As our findings show, there is more to disabling smoke alarms than fecklessness.

Policy implications

For smoke alarm manufacturers

  • Many smoke alarms are disabled because of over-sensitivity. Moreover changing the battery can be a problem and may entail hazardous manoeuvres, and maintenance instructions are frequently unclear. Improved design may lead to more consistent use.

For regulatory authorities

  • Increasing incentives to manufacturers of smoke alarms to produce alarms that meet the needs of users should be considered.

For researchers

  • Qualitative work is not a means of identifying how reluctant service users can be persuaded to accept interventions. Listening to end point users can help us identify problems and qualitative work embedded in a trial design can help identify levers and barriers to effective implementation.

For funders

  • Encouraging research designs where different methods are appropriately staged may lead to better outcomes in real world implementation.

For editors

  • Publishing the qualitative and trial results simultaneously can provide useful material for service planners and practitioners.

Implications of the study

Policy development within and beyond medicine in the UK in the past decade has given increasing prominence to questions of effectiveness.19 A number of research initiatives, including the UK Economic and Social Research Council’s Evidence Network20 and the Campbell Collaboration21—a “sister” to the Cochrane Collaboration, working on social care, education and criminal justice—have been established. Despite critiques from the social sciences of preventive activities22 and the notion that “prevention” should be exempt from critical scrutiny,9,23 the “D” aspect of the R&D needed to underpin public health interventions remains undeveloped, and is an area where there are questions around implementation, relevance, cost effectiveness, and acceptability to those on the receiving end.

This work resonates with other studies in which health knowledge and health behaviours may be at odds. Studies of women smoking, for instance, have shown that they are well aware of the risks, but preventive or health promotion efforts may be ineffective so long as women experience short term health gains, such as creating a little space for themselves (“I’ll be with you when I’ve had this cigarette”).22 Smoke alarms may be seen as a potential health benefit, but the stressful effect of an alarm going off in overcrowded or noisy accommodation may make them less than attractive interventions.

In a successful implementation programme, effective maintenance support, as well as installation of the alarm type found in the trial to be the most likely to be working after 15 months may be associated with higher rates of smoke alarm functioning. Manufacturers may need to explore other ways of ensuring that smoke alarm users can feel in better control of the alarms in their home.

Unanswered questions and future research

While the findings of the trial5 suggest a clear “best buy” in terms of the battery operated smoke alarm most likely to be functioning 15 months after installation in this population, the comparatively low levels of functioning indicate that there is a good deal more to be done in finding acceptable smoke alarms, and addressing a health risk with important implications for reducing inequalities.

Developing appropriate methodologies linking trial and qualitative work may lead to better outcomes in real world implementation.24 Further work also needs to be done on methodological triage.25 It may well be that a more appropriate design would have started with qualitative work, improving take up and maintenance instructions.

Acknowledgments

Those living on the council estate and the children at its local primary school are in a sense co-authors of this work, and we thank them, and the staff of the primary school, for their help. Jo Dearlove, Anna Downie, and Catherine Godward assisted with data collection from children. Angela Wade, Mark Sculpher, and Maggie Barker made helpful observations in the course of the study design and subsequently. We are grateful to the three peer reviewers who looked at this paper, Danny Dorling, Ian Graham, and an unnamed referee for their useful comments.

REFERENCES

View Abstract

Footnotes

  • * Overall ages, ethnicities, and other characteristics are provided in table 1. We asked those we interviewed to describe themselves, and some declined to provide age or ethnicity data. For this reason, not all respondents are described in the same way.

  • Funding: The UK Medical Research Council (ISRCTN 47572799); Camden and Islington Health Action Zone, the West Euston Partnership; and the Joan Dawkins Fund

  • Conflicts of interest: none declared.

Request permissions

If you wish to reuse any or all of this article please use the link below which will take you to the Copyright Clearance Center’s RightsLink service. You will be able to get a quick price and instant permission to reuse the content in many different ways.

Linked Articles

  • In this issue
    C Alvarez-Dardet J R Ashton