Effects of a free school breakfast programme on children's attendance, academic achievement and short-term hunger: results from a stepped-wedge, cluster randomised controlled trial
- Cliona Ni Mhurchu1,
- Delvina Gorton1,
- Maria Turley1,
- Yannan Jiang1,
- Jo Michie1,
- Ralph Maddison1,
- John Hattie2
- 1Clinical Trials Research Unit, School of Population Health, University of Auckland, Auckland, New Zealand
- 2Teaching Learning and Development, Faculty of Education, University of Auckland, Auckland, New Zealand
- Correspondence to Associate Professor Cliona Ni Mhurchu, Clinical Trials Research Unit, School of Population Health, University of Auckland, Private Bag 92019, Auckland Mail Centre, Auckland 1142, New Zealand;
Contributors Principal responsibility for study design was assumed by DG, YJ, RM and CNM. DG, JM and MT developed the study protocol and materials. DG was the principal investigator from July to October 2009. MT was the principal investigator from November 2009 to August 2010. JH had substantial input into study design and oversight. JM was responsible for day-to-day study management. YJ was responsible for all aspects of statistical design and analysis. CNM was the principal investigator from August 2009 onwards and drafted the study manuscript integrating contributions from all coauthors. All authors approved the final manuscript. CNM had full access to all data in the study and takes responsibility for integrity of the data and the accuracy of the data analysis.
- Accepted 11 August 2012
- Published Online First 6 October 2012
Background Free school breakfast programmes (SBPs) exist in a number of high-income countries, but their effects on educational outcomes have rarely been evaluated in randomised controlled trials.
Methods A 1-year stepped-wedge, cluster randomised controlled trial was undertaken in 14 New Zealand schools in low socioeconomic resource areas. Participants were 424 children, mean age 9±2 years, 53% female. The intervention was a free daily SBP. The primary outcome was children's school attendance. Secondary outcomes were academic achievement, self-reported grades, sense of belonging at school, behaviour, short-term hunger, breakfast habits and food security.
Results There was no statistically significant effect of the breakfast programme on children's school attendance. The odds of children achieving an attendance rate <95% was 0.76 (95% CI 0.56 to 1.02) during the intervention phase and 0.93 (95% CI 0.67 to 1.31) during the control phase, giving an OR of 0.81 (95% CI 0.59 to 1.11), p=0.19. There was a significant decrease in children's self-reported short-term hunger during the intervention phase compared with the control phase, demonstrated by an increase of 8.6 units on the Freddy satiety scale (95% CI 3.4 to 13.7, p=0.001). There were no effects of the intervention on any other outcome.
Conclusions A free SBP did not have a significant effect on children's school attendance or academic achievement but had significant positive effects on children's short-term satiety ratings. More frequent programme attendance may be required to influence school attendance and academic achievement.
Trial registration Australian New Zealand Clinical Trials Registry (ANZCTR)—ACTRN12609000854235.
- randomised controlled trial
- child health
- public health
- randomised trials
Good nutrition, particularly in the early years of life, is fundamental to health and an important component of comprehensive action to achieve health equity.1 While much resource in high-income countries is directed towards tackling obesity and other diet-related non-communicable diseases, there remains a substantial number of people in such countries who do not have sufficient nutritious food to eat and are classified as food insecure.2
Food insecurity is an issue for 20%–22% of New Zealand households with children, with higher rates among Pacific peoples and Māori (indigenous New Zealanders).3 In 2002, over half of Pacific and more than one-third of Māori households with children could not always afford to eat properly.3 Living in a food insecure household impacts adversely on children's nutrition4 and has repercussions for growth, development and long-term health. Food insecure children are more likely to miss meals,5 and 17% of New Zealand children do not eat breakfast at home before school.3
School feeding programmes are intended to alleviate short-term hunger, improve nutrition and educational attainment of children and transfer income to families.6 There is evidence that such feeding programmes have positive effects on children's nutrition, health and school attendance for disadvantaged children7 and those in developing countries.6 However, the evidence is less conclusive regarding their impact on academic achievement, particularly in high-income countries.
The primary aim of this stepped-wedge, cluster randomised controlled trial was to investigate the effects of a free school breakfast programme (SBP) in New Zealand on children's school attendance. Secondary aims were examination of the impact of the breakfast programme on children's academic achievement, self-reported grades, sense of belonging at school, behaviour, short-term hunger, breakfast habits and food security.
The study protocol and methods have been described in detail previously.8 A summary is provided below.
All New Zealand schools are assigned a decile rating, which indicates the extent to which they draw their students from a range of socioeconomic areas. Decile 1 schools are the 10% of schools with the highest proportion of students from low socioeconomic resource areas, and decile 10 schools are those with the highest proportion of students from high socioeconomic areas. There are no national government-funded school meal programmes, and while most primary schools provide some form of food service for purchase, only approximately 15% have purpose-built canteen facilities.9 Our study was undertaken in deciles 1–4 primary schools (students aged 5–13 years) located in three geographical regions (Auckland, Waikato and Wellington) during the 2010 school year (February to December). Ethical approval for the trial was received from the Northern Y Regional Ethics Committee (Reference: NTY/09/09/084). Written informed assent was obtained from all participating children as well as parental consent. Only children who provided both assent and parental consent were eligible to take part.
The study was a 1-year stepped-wedge, cluster randomised controlled trial10 ,11 in which participating schools (clusters) crossed over from control to intervention phase (ie, one-way switch over) in different terms through the school year. The order of switch over (‘sequence’) for each cluster was determined randomly, and all received the breakfast programme intervention by the end of study (figure 1). Each school entered the trial at the same time point (February 2010) and acted as a control until such time as they were randomised to crossover from control to intervention.8
Participants and recruitment
Eligible schools were deciles 1–4 primary schools, which did not have an existing breakfast programme and agreed to start one in the 2010 school year. Schools needed to be of sufficient size that they estimated at least 25 students would attend a breakfast programme each day. Eligible participants were children aged 5–13 years who planned to attend the SBP and did not have a diagnosed food allergy. Only one child per household could take part. Non-participation in the study did not preclude attendance at the breakfast programme.
Randomisation and blinding
Eligible schools were randomly assigned to one of the four sequences (3–4 schools per sequence) for time of crossover from control to intervention using a computer-generated list of random numbers. The allocation sequence was overseen by the study statistician (YJ). Due to the nature of the intervention, it was not possible to blind participants, breakfast providers or outcome assessors. However, the primary study outcome was objectively measured (school attendance data provided by schools).
The intervention was a free daily SBP, either the Red Cross Breakfast in Schools programme or one provided by the private sector. In New Zealand, there are no national standards relating to the composition of foods provided by such programmes, which is reflected in the diversity of foods provided. Food for the Red Cross breakfast programme was provided free of charge by local supermarkets. Schools selected from a list of foods that included breakfast cereal (Weet-Bix), low-fat milk, bread, spreads (margarine, jam, honey, Marmite), Milo (chocolate flavoured drink powder), milk powder and sugar. Food for the private sector breakfast programme was provided by food industry partners and consisted of low-fat milk and breakfast cereal (Weet-Bix). In accordance with pragmatic trial design, no attempts were made to standardise the intervention or its delivery in schools, other than requesting that the programme be available 5 days/week.
Outcomes and data collection
The primary outcome was children's school attendance defined as achievement of a school attendance rate of 95% or higher, which equated to students missing fewer than 2–3 days per term. School attendance rate (%) was calculated as the total number of half-days a student was present at school divided by the total number of half-days the student was expected to be present. Attendance data were recorded by schools in the usual way and provided to the study team at the end of each term.
Secondary outcomes were academic achievement assessed using numeracy and literacy data collected by schools using standardised tests administered to all New Zealand students twice yearly; children's perceived academic competence measured by asking students to make a realistic assessment of their reading ability in comparison to other students in their year at school with five responses ranging from 1 (not very well) to 5 (very well)12; self-reported sense of belonging measured using the PISA 2000 Student Engagement Questionnaire, which assesses whether students feel comfortable and as if they belong at school, and their relationship with other students13; students' behaviour, emotions and relationships assessed by teachers using the Strengths and Difficulties Questionnaire14 ,15; self-reported short-term hunger assessed using a modified version of ‘Freddy’, an analogue scale1–15 for measuring satiety in children16; breakfast habits over the past week reported by parents (how often their children ate breakfast, where they ate breakfast and where they sourced food for breakfast)3 ,17 and food security status using the CCHIP Scale, which assesses both household and child food security.18 ,19 All assessments were administered once each term at or around the scheduled study assessment visit (towards the end of each term) other than numeracy and literacy (standard assessments undertaken by the schools in term 2 and term 4) and attendance data (collected continuously by schools).
Sample size and statistical analysis
The target sample size was 16 schools (four per sequence) and an average of 25 students per school, that is, 400 participants. Assuming an intra-cluster correlation coefficient of 0.05, this would provide at least 85% power, with a two-sided significance level of α=0.05, to detect a 10% absolute change in the proportion of students with a school attendance rate of 95% or higher. Power calculations were undertaken using methods recommended for stepped-wedge trials.11
Statistical analysis was based on the principle of intention to treat. A generalised linear mixed model was used for categorical outcomes, and a linear mixed model was used for continuous outcomes, adjusting for age, gender, ethnicity and school terms (ie, secular trend). Adjustment for confounding was undertaken to limit bias due to these individual-level characteristics because the unit of randomisation was at the school (cluster) level meaning only limited school-level characteristics would be balanced by randomisation. The cluster effect by school and correlation between repeated measurements on the same child over time were taken into account in the multilevel analysis. Random-effect mixed models were fitted to account for missing data based on the assumption that data were missing at random. Statistical analyses were performed using SAS V.9.2, 2009 (SAS Institute Inc.), and R V.2.12.0, 2010 (R Foundation for Statistical Computing).
Recruitment and participant characteristics
Fourteen of 154 (9%) deciles 1–4 schools in the targeted geographic regions that did not already have a SBP agreed to take part in the trial and were randomly allocated to one of the four sequences. Schools in sequence 1 started the intervention in term 1 and continued until the end of study; schools in sequence 2 switched from control to intervention in term 2, and schools in sequences 3 and 4 switched from control to intervention in terms 3 and 4, respectively. By the end of the school year, all schools had commenced the breakfast programme. Nine schools were in Auckland, three in Wellington and two in Waikato, with a reasonable spread across deciles (table 1). The two decile 1 study schools received the Red Cross Breakfast in Schools programme, and the remainder received the breakfast programme provided by the private sector.
A total of 4252 students were enrolled in the 14 schools of whom 424 (10%) met eligibility criteria and agreed to participate in the trial, with an average of 30 students per school. Randomised participants were similar to overall school profiles in terms of age, sex and ethnicity. At baseline, participants were aged 9.4±2 years on average, and 53% were female (table 1). One hundred and forty-six of the 424 participants were in schools that started the intervention in term 1, 108 started in term 2, 69 started in term 3 and 101 started in term 4 (figure 2). Fifteen students (3.5%) withdrew from the trial and 34 (8%) were lost to follow-up, in all cases due to their moving schools.
Breakfast programme attendance
Data on programme attendance were collected from school breakfast rolls (table 2). The number of days programmes were operational compared with total number of days schools were open ranged from 36% (school F in term 2) to 100% (school D in term 3); however, by term 4, all schools were offering the breakfast programme at least 64% of days they were open for teaching. Students' breakfast attendance was defined as average weekly attendance rate (%) (ie, number of days students attended the programme divided by total number of days the programme was open during a week and averaged per school term). In term 4 when all breakfast programmes were operational, student attendance ranged from 4% to 38%.
Attendance rates at all schools declined gradually over the school year. In schools randomised to start the breakfast programme in term 1 (sequence 1), the proportion of children achieving a school attendance rate ≥95% ranged from 65% in term 1 to 45% in term 4 (table 3). For those randomised to start in term 2 (sequence 2), the proportion of children achieving an attendance rate ≥95% ranged from 65% in term 1 to 58% in term 4. A similar pattern was seen for schools in sequences 3 and 4.
There was no statistically significant effect of the free breakfast programme intervention on children's school attendance. The odds of children achieving an attendance rate <95% was 0.76 (95% CI 0.56 to 1.02) during the intervention phase and 0.93 (95% CI 0.67 to 1.31) during the control phase, giving an OR of 0.81 (95% CI 0.59 to 1.11, p value 0.19) (table 4).
There was a significant decrease in children's self-reported short-term hunger during the intervention phase compared with the control phase, demonstrated by an increase of 8.6 units on the Freddy satiety scale (95% CI 3.4 to 13.7, p=0.001). However, there were no effects of the SBP on any other secondary outcomes measured (table 5).
Over the 2010 school year, average improvements at school level in children's reading (0.48±0.43), writing (0.47±0.16) and numeracy (0.56±0.39) were in line with expected achievements over time.20 A random-effect mixed model demonstrated no consistent significant effect of the intervention on academic outcomes (data available on request).
While the proportion of children who ate breakfast everyday did not change over the course of the trial, the proportion eating breakfast at home dropped as schools began the breakfast programme. Figure 3 demonstrates that as new schools started the breakfast programme each term, there was an increase in the proportion of children eating breakfast at school and a corresponding decrease in the proportion of children eating breakfast at home most days. This suggests that many children who previously ate breakfast at home replaced this with breakfast at school.
School breakfast roll data and parents' feedback on children's breakfast habits suggested that attendance at the breakfast programme was irregular, and it is possible that the effect of the breakfast programme on study outcomes was diluted by low attendance at the programme. Therefore, we conducted sensitivity analyses of the effects of the free SBP on the primary study outcome, school attendance, in a subgroup of the population who attended the programme more frequently, that is, 50% or more of the time. The odds of these children achieving a school attendance rate <95% was 0.58 (95% CI 0.40 to 0.83) during the intervention phase and 0.89 (95% CI 0.60 to 1.33) during the control phase, giving an OR of 0.64 (95% CI 0.42 to 0.99, p value 0.047). School attendance rate (a continuous outcome) was on average 93.9% (SE 0.57) for the intervention phase and 92.3% (SE 0.61) for the control phase, with a difference of 1.6% points (SE 0.65), which was statistically significant (p value 0.016).
In this stepped-wedge, cluster randomised controlled trial, a free SBP did not have a significant effect on children's school attendance, academic achievement, self-reported grades, sense of belonging at school, behaviour or food security. However, the programme had significant positive effects on children's short-term hunger ratings. Although most schools offered the breakfast programme 5 days per week, recorded weekly student attendance ranged from 4% to 38% of days. Sensitivity analyses conducted with children who attended the programme more frequently (at least 50% of the time it was available) demonstrated a significant effect of the breakfast programme on school attendance among this subgroup.
The strengths of this trial include its large sample size, high follow-up rates (88% of randomised children), use of objective measures of school attendance and academic achievement, and pragmatic design, which allowed evaluation of the effects of a breakfast programme as implemented in routine practice.21 The population was diverse, drawn from low socioeconomic resource areas and included substantially higher proportions of Māori (34%) and Pacific (42%) children than would be expected on the basis of their representation in the population (24% and 12%, respectively).22
Study limitations include potential selection bias, whereby the children who entered the trial may have been different in important ways from average deciles 1–4 school populations. While our study population was not substantially different from overall school rolls in terms of age, gender and ethnicity, they may have differed in other unmeasured socio-demographic factors, for example, household income or parental education level. It is possible that the programme could produce more positive effects among children at greater need of a school feeding programme not enrolled in the trial.
Variable breakfast composition (cereal and milk in some schools and cereal, bread, milk and chocolate flavoured drinks in others) and reduced availability of the breakfast programme in some schools (fewer than 5 days/week) may also have limited the impact of the intervention. Data on breakfast programme attendance rates were missing for four schools in term 4. These schools did not complete breakfast rolls because they reported that the number of registered study participants attending the programme was low (less than five registered students per day per school). However, this was a pragmatic trial and the main trial effects observed likely reflect those of a real-life breakfast programme.
Finally, the relatively low attendance rates by study participants at the breakfast programme and the likelihood that many, rather than increasing breakfast consumption, simply replaced breakfast at home with breakfast at school almost certainly influenced the absence of effect on study outcomes. In combination, these factors could explain the lack of observed effect of the breakfast programme on the range of outcomes assessed; both have previously been identified as reasons why school feeding programmes may not be effective.23 Our sensitivity analysis supports the hypothesis that breakfast programme attendance rates influenced study outcomes because there was a significant positive effect on school attendance for children who attended the programme more regularly. Low attendance at the breakfast programme most likely reflects the typical ‘healthy volunteer’ selection bias seen in many trials. Families who consented to participate in the study and completed questionnaires are likely to have been those least in need of a free breakfast programme.
In the UK, government-funded school feeding programmes date back to the early 20th century.24 Recently, an interesting natural experiment took place when British chef, Jamie Oliver, undertook a campaign to improve nutritional standards in schools. Evaluation of the campaign found that educational outcomes improved significantly in intervention schools and school absences fell by 14%.25 Although the evaluation was conducted with careful matching of control schools, it was not a prospective randomised controlled trial and, as such, confounding cannot be ruled out. An alternative explanation, however, may relate to frequency of consumption of school meals. About 45% of British schoolchildren eat school dinners every day,25 whereas children in our trial, only attended the breakfast programme 4%–38% of the time it was open. Thus, it is possible that frequent regular consumption of healthy school meals is necessary to impact on attendance and academic achievement.
In 2004, a large, cluster randomised controlled trial was undertaken of a Welsh government-funded free breakfast programme for primary schools.26 Primary outcomes were breakfast skipping, episodic memory and breakfast diet.27 Attendance at the Welsh breakfast programme was relatively low, and there was no evidence of an effect on breakfast skipping, episodic memory or class behaviour, although students reported consuming significantly higher numbers of healthy food items at breakfast.27 Similar to our trial, there was a move from home to school-based breakfast eating among children.
The US Department of Agriculture subsidises the SBP.28 While a number of evaluations indicate that the SBP contributes to improved nutrition among programme participants,29 ,30 few have examined effects on aspects of school performance. A small study (n=133 children) suggested higher rates of participation in the SBP were associated with improved psychosocial and academic functioning.31 However, there was no comparative control group. Another non-randomised study found evidence of improved academic performance in children participating in the SBP but was also small (n=97 students) and findings were based on subgroup analysis.18
Thus, most research on the impact of SBPs on children's health and educational outcomes in high-income countries has taken the form of evaluations and cannot exclude the effects of confounding. Robust randomised controlled trials have not found an effect of SBPs on school attendance, academic achievement, memory or behaviour.27 However, relatively low breakfast programme attendance and moves from home to school-based breakfast consumption may account for lack of observed effects.
This research demonstrated that a non-standardised free SBP in New Zealand alleviated children's short-term hunger but did not impact on children's school attendance, academic achievement or behaviour. More frequent programme attendance may be required to influence school attendance and academic achievement.
What is already known on this subject
School feeding programmes are intended to alleviate short-term hunger, improve nutrition and educational attainment of children, and transfer income to families. There is evidence that such programmes have positive effects on children's nutrition, health and school attendance for disadvantaged children and those in developing countries. However, the evidence is less conclusive regarding impact on academic achievement, particularly in high-income countries.
What this study adds
A free SBP did not have a significant effect on New Zealand children's school attendance, academic achievement, self-reported grades, sense of belonging at school, behaviour or food security. However, the programme had significant positive effects on children's short-term hunger ratings. More frequent programme attendance may be required to influence school attendance and academic achievement.
We thank the schools, children and families who took part in the study and the providers of the breakfast programmes: the New Zealand Red Cross, Progressive Enterprises (Countdown supermarkets), Fonterra Co-operative Group Limited and Sanitarium Health Food Company. We are grateful for the input and assistance of our steering committee members (Sara Williams, Kate Kember, Tia Wylie, Christine McKerchar, Leonie Matoe), research assistants (Denise Miller, Oliver Allen), data manager (Vanessa Singh), data analyst (Joy Jiang) and CTRU IT and operations staff.
Funding The study was funded by the Health Research Council of New Zealand (09/337). CNM holds the National Heart Foundation Senior Fellowship (grant 1380). The Health Research Council and the Heart Foundation played no role in design and conduct of the study; collection, management, analysis and interpretation of the data; or preparation, review or approval of the manuscript. Food for the Red Cross Breakfast in Schools programme was provided free of charge by Countdown supermarkets (Progressive Enterprises Ltd). Fonterra Co-operative Group Limited and Sanitarium Health Food Company supplemented provision of foods for the private sector programme. The Red Cross, Countdown, Fonterra and Sanitarium played no role in design and conduct of the study; collection, management, analysis and interpretation of the data; and preparation or approval of the manuscript.
Competing interests None.
Patient consent Both child assent and parental consent were obtained for each participant.
Ethics approval The ethics approval was provided by the Northern Y Regional Ethics Committee (Reference: NTY/09/09/084).
Provenance and peer review Not commissioned; externally peer reviewed.
Data sharing statement Any additional unpublished data can be made available to academic researchers on request.
This is an open-access article distributed under the terms of the Creative Commons Attribution Non-commercial License, which permits use, distribution, and reproduction in any medium, provided the original work is properly cited, the use is non commercial and is otherwise in compliance with the license. See: http://creativecommons.org/licenses/by-nc/3.0/ and http://creativecommons.org/licenses/by-nc/3.0/legalcode