Within the ToyBox-study, a kindergarten-based, family-involved intervention was developed to prevent overweight and obesity in European preschoolers, targeting four key behaviours related to early childhood obesity, including water consumption. The present study aimed to examine the effect of the ToyBox-intervention (cluster randomized controlled trial) on water intake and beverage consumption in European preschoolers and to investigate if the intervention effects differed by implementation score of kindergartens and parents/caregivers.
A sample of 4964 preschoolers (4.7±0.4 years; 51.5% boys) from six European countries (Belgium, Bulgaria, Germany, Greece, Poland, Spain) was included in the data analyses. A standardized protocol was used and parents/caregivers filled in socio-demographic data and a food-frequency questionnaire. To assess intervention effects, multilevel repeated measures analyses were conducted for the total sample and for the six country-specific samples. Based on the process evaluation questionnaire of teachers and parents/caregivers, an implementation score was constructed. To assess differences in water intake and beverage consumption by implementation score in the total sample, multilevel repeated measures analyses were performed.
Limited intervention effects on water intake from beverages and overall beverage consumption were found. However, important results were found on prepacked fruit juice consumption, with a larger decrease in the intervention group compared to the control group. However, also a decline in plain milk consumption was found. Implementation scores were rather low in both kindergartens and parents/caregivers. Nevertheless, more favorable effects on beverage choices were found in preschoolers whose parents/caregivers and kindergarten teachers had higher implementation scores compared to those with lower implementation scores.
Citation: Pinket A-S, Van Lippevelde W, De Bourdeaudhuij I, Deforche B, Cardon G, Androutsos O, et al. (2016) Effect and Process Evaluation of a Cluster Randomized Control Trial on Water Intake and Beverage Consumption in Preschoolers from Six European Countries: The ToyBox-Study. PLoS ONE 11(4): e0152928. https://doi.org/10.1371/journal.pone.0152928
Editor: Paulina Nowicka, Karolinska Institutet, SWEDEN
Received: December 16, 2015; Accepted: March 20, 2016; Published: April 11, 2016
Copyright: © 2016 Pinket et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The ToyBox-study is funded by the Seventh Framework Programme (CORDIS FP7) of the European Commission under grant agreement n° 245200. The sponsor had no role in the design or conduct of the study, the collection, management, analysis or interpretation of the data, or the preparation, review and approval of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
European preschoolers do not meet the water standards [1–2]. However, water is a vital nutrient in life, since the optimal functioning of human body requires a good hydration level [3–4]. Even mild dehydration can lead to significant consequences, such as headache, lethargy, impaired concentration and decrease of cognitive performance [5–9]. Moreover, children are more vulnerable to dehydration . Water can be extracted from plain water, but also from other beverages and food [10–11]. As only 20% of total water intake comes from food, water intake through beverages (i.e., plain water and other beverages) is the most important water source . In addition, many preschoolers consume excessive amounts of sugared beverages [1,12–15]. A recent European study showed that nearly a quarter of total water intake from beverages was derived from sweetened beverages (such as fruit juices, soft drinks and sugared milk) and only slightly more than half of water intake from beverages was derived from plain water . An excessive intake of added sugars, e.g., through soft drinks, can lead to energy imbalance and thus to overweight [16–17]. Since both quality and quantity of water intake may be a problem already at preschool age, interventions targeting water intake in preschoolers gain importance .
Parents play a fundamental role in developing a home environment that stimulates healthy eating habits among children through general parenting styles and parenting practices including availability and accessibility, role-modeling, monitoring, pressuring, restricting and rewarding regarding eating behaviours . Parenting practices also influence the intake of soft drinks . It is expected that also in preschoolers’ water intake and other beverage choices parents play an important role, but research is currently lacking. In addition, preschoolers also spend a lot of time at kindergartens. Healthy behaviours are promoted by stimulating and encouraging environments in which children live and play, such as kindergartens . A kindergarten is the ideal place to promote water consumption and healthy beverage choices [20–21]. Interventions combining high levels of parental involvement and interactive school-based learning appeared to be highly effective in tackling obesity in preschoolers . To our knowledge, interventions targeting water intake and beverage choices in preschoolers are scarce. Most interventions targeted older children and were aimed at reducing the intake of sugar-sweetened beverages rather than promoting water intake and healthy beverage choices.
One of the targeted key behaviours related to early childhood obesity in European preschoolers in the ToyBox-intervention was water consumption, next to snacking, physical activity and sedentary behaviour. The ToyBox-study (multifactorial evidence-based approach using behavioural models in understanding and promoting fun, healthy food, play and policy for the prevention of obesity in early childhood) was an EU-funded large-scale study in preschoolers (3.5–5.5 years old) and their families from six European countries (Belgium, Bulgaria, Germany, Greece, Poland, and Spain) . Within the ToyBox-study, a kindergarten-based, family-involved intervention was developed, implemented and tested. The first purpose of this study was to examine the effects of the ToyBox-intervention on the water intake and beverage consumption in European preschoolers, including a large sample of preschoolers. A cross-European study may be more valuable than a study with a regional focus. The intervention effects were investigated in the total sample and in all six countries.
Research on process evaluation is a valuable addition to studying the effect evaluation. As interventions are not always implemented as intended, process evaluation can help to better understand the effects of a health promoting intervention . Process evaluation can throw light on the mechanisms and processes responsible for the results and variation in results in the target group . Knowing which aspects of the intervention were delivered and how well they were conducted is essential to make an accurate interpretation of outcomes. Next to kindergarten implementation results, obtaining insight into how parents perceived the intervention is important as involving parents in kindergarten-based interventions remains challenging . Therefore, the second aim of this study was to investigate if the effects of the intervention differed by implementation score of the intervention at the kindergartens and at home.
The ToyBox-intervention was developed following the PRECEDE-PROCEDE model and the Intervention Mapping protocol . The study had a randomized cluster design and consisted of a pre- and posttest design with intervention and control schools in all six European countries. The ToyBox-study (www.toybox-study.eu) is registered with the clinical trials registry clinical_trials.gov, ID: NCT02116296. The ToyBox-study was approved by Ethical Committees in all six European countries, in line with national regulations (i.e., the Ethical Committee of Ghent University Hospital (Belgium), Committee for the Ethics of the Scientific Studies (KENI) at the Medical University of Varna (Bulgaria), Ethikkommission der Ludwig-Maximilians-Universität München (Germany), the Ethics Committee of Harokopio University of Athens (Greece), Ethical Committee of Children’s Memorial Health Institute (Poland), and CEICA (Comité Ético de Investigación Clínica de Aragón (Spain)) . Parents/caregivers were asked for written informed consent for the participation of their child in the study. A minimum sample of 800 children and their families and 20 kindergartens per country, resulting in a total sample of 4,800 children and their families and 120 kindergartens, was initially targeted. However, in order to account for an estimated dropout rate of about 30%, a minimum total number of about 6,500 children and their families were aimed to be recruited in the six participating countries. Detailed power calculations are described elsewhere . The preschool children and their families were recruited at kindergartens, daycare centers or preschool settings, depending on the country regulations and legislation . Precisely, in Germany, Bulgaria, Spain and Poland children/families were recruited from kindergartens, in Greece from kindergartens and daycare centers and in Belgium from preschool settings. In order to avoid confusion for the reader, all these settings (kindergartens, daycare centers, preschool settings) will be referred to as "kindergartens" in this paper. Kindergartens were recruited from different socio-demographic backgrounds within each of the provinces in the different countries. Lists of all municipalities that exist within the selected provinces were created with information on the socio-economic status (SES) variables of the municipalities. Tertiles including three different socio-demographic groups were created based on the selected SES variables, and each country randomly selected approximately five municipalities per SES status (low, medium and high SES). Then, kindergartens within these randomly chosen municipalities were randomly selected (with the exclusion of the lowest 20% of the kindergartens with the smallest number of pupils) . The selected kindergartens were visited by researchers to inform the kindergarten staff about the ToyBox-study. After kindergartens agreed to participate in the study, preschoolers received an information letter to take home with information on the study for parents/caregivers. Subsequently, municipalities were randomly assigned to the intervention or the control condition (2:1) . Kindergartens of the ToyBox-intervention group received the intervention, while kindergartens of the control group were asked to continue the normal kindergarten routine.
The ToyBox-intervention: water-component
As mentioned previously, the ToyBox-intervention targeted four key behaviours related to early childhood obesity: water consumption, snacking behaviour, physical activity and sedentary behaviour. The timeplan of the ToyBox-intervention was designed so as to account for country-specific differences with regard to the opening and closing dates of the kindergartens and the duration and timing of national holidays. Recruitment of participants started in February 2012 and baseline data was collected between May and June 2012. The entire ToyBox-intervention lasted from September 2012 until March 2013 for 24 weeks in the school year 2012–2013, with the drinking behaviour module implemented in weeks 1 to 4 and a repetition period in weeks 17 and 18. However, some environmental changes, such as water stations, were implemented during the whole school year. Follow-up evaluation was performed between May and June 2013 .
Prior to the intervention, teachers were invited to two teacher training sessions in which researchers explained the ToyBox-intervention and the materials. A third teacher training session was planned before the repetition period [27–28]. The participation of the teachers in the training sessions was not compulsory. Nevertheless, the participation of all intervention teachers was aimed for. However, to ensure representation of all intervention classes, it was aimed that at least one teacher per class attended each training session. In case none of the teachers of one class was able to attend a session, they were invited again on one of the following days when the session they missed was repeated. Teachers were not tested, but researchers provided certificates of attendance to the teachers as incentives. No teachers were excluded from the intervention because of absence during the training sessions, they could still deliver the intervention based on the provided ToyBox-manuals.
A box including the ToyBox-intervention material was provided to teachers of the intervention group to implement the intervention. Since this study focuses on water consumption, the description of the intervention materials will also focus on this component. Information on the other components of the intervention are described elsewhere . The box contained a teacher’s guide with general information on the ToyBox-intervention and the importance of water consumption, a classroom activity guide on water consumption and a kangaroo hand puppet. The classroom activity guide regarding water consumption consisted of three sections: setting environmental changes in the classroom (installing a water drinking station), preschoolers implementing the actual behaviour (e.g. drinking water regularly) and teachers implementing fun classroom activities (3 kangaroo stories, 3 sensory perception games, 2 experiments and 3 excursions) aiming at total class participation. The environmental changes were conducted before the start of the intervention and retained throughout the whole school year, while the implementation of the actual behaviour was also performed throughout the whole school year.
Parents/caregivers were also involved in the intervention. Therefore, preschoolers received two newsletters and two tip-cards and a poster to take home, all containing information and tips regarding preschoolers’ water consumption. The first newsletter and tip-card focused on drinking enough water, while the second newsletter and tip-card focused on making healthy beverage choices.
Water intake and beverage consumption.
Both in the baseline and follow-up measurements, parents/caregivers were asked to describe the child’s usual food and beverage habits over the last 12 months in a food frequency questionnaire (FFQ) for young children, which was developed based on a previously validated FFQ by Huybrechts et al. . Results of the validation of the FFQ by Huybrechts and colleagues showed moderate to good reproducibility (ICC ranged from 0.62 to 0.79) and good relative validity (Spearman correlation ranged from 0.56 to 0.65) for beverage intake . Only the items about beverage consumption were used in this study. These items were plain water, soft drinks, light soft drinks, home-made and freshly squeezed fruit juice, pre-packed/bottled fruit juice, tea, smoothies (all kinds), plain milk and sugared or chocolate milk. For each of these beverages, the frequency of consumption was asked. Response categories were: “never or less than once per month”, “1–3 days per month”, “1 day per week”, “2–4 days per week”, “5–6 days per week” and “every day”. Next, the average consumption per day was asked. The response categories were “100ml or less”, “100–200ml”, “200–300ml”, “300–400ml”, “400–500ml”, “500–600ml”, “600–700ml”, “700–800ml”, “800–900ml”, “900–1000ml” and “1000ml or more”. From these data, the average amount of the different beverages in ml per day was calculated by multiplication of number of days per week and amount per day in ml (using the midpoint) divided by 7 (total number of days in a full week). The water intake from these beverages was calculated based on the Dutch food composition database , by multiplication of the average intake in ml a day and the amount of water per ml of each beverage.
Sex and date of birth were reported by one of the parents/caregivers of the preschoolers in the primary caregivers questionnaire. Preschool children’s age was computed based on the date of birth and the date when the questionnaire was completed. Education of the parents/caregivers was self-reported in the primary caregivers questionnaire. The education level of the mother was used as SES indicator. Education level has been identified as an important indicator for SES . Education level was dichotomized into lower (14 or fewer years of education) and high (more than 14 years of education) SES, which distinguishes families with a mother who has completed medium or higher education, college or university training from other families .
Both teachers and parents/caregivers of the intervention group were asked to complete a process evaluation questionnaire, to get insight in the role of these two main implementers. Teachers received six monthly logbooks and parents/caregivers were asked to complete an implementation questionnaire at the end of the intervention . The process evaluation has been performed according to the model of Saunders et al. which targets process evaluation of health promoting interventions . The model contains several key elements: fidelity, reach, dose delivered, dose received—exposure, and dose received—satisfaction . These key elements can be found in Figs 1 and 2 (for teachers) and Fig 3 (for parents/caregivers). For each element, questions of the process evaluation questionnaire are displayed with the information on the coding process. The internal consistency of the key elements of the process evaluation score for parents/caregivers was moderate to good (Cronbach’s α dose delivered = 0.94 and Cronbach’s α satisfaction = 0.61), while the internal consistency of the key elements of the process evaluation score of teachers ranged from borderline acceptable to good (Cronbach’s α fidelity = 0.42; Cronbach’s α reach = 0.51; Cronbach’s α dose delivered = 0.66; Cronbach’s α exposure = 0.40 and Cronbach’s α satisfaction = 0.86). All specific questions were scored 0 or 1 depending on the answers of the parents/teachers . A total implementation score was computed for both teachers and parents/caregivers, with a minimum score of 0 and a maximum score of 30 for teachers and 18 for parents/caregivers. A minimum score of 0 indicated that the process evaluation questionnaire was not filled in, as ‘reach’ was scored 1 if the questionnaire was received from the teachers or parents/caregivers, leading to a minimum score of 1 if the questionnaire was completed. Preschoolers with an implementation score of 0 were deleted from the process evaluation analysis. The total implementation score represents the level of implementation of the intervention in the kindergarten classes and at home. For each kindergarten, a mean score was computed from the different teacher scores as to achieve one score for each kindergarten.
A higher score represents a higher level of intervention implementation. Based on the median of the implementation score of the parents/caregivers and kindergartens, preschoolers were divided into two groups: a low and high level of implementation. Next, a combined implementation score was constructed, creating four groups: preschoolers with a low kindergarten/low parental implementation score (n = 1514), high kindergarten/low parental implementation score (n = 1584), low kindergarten/high parental implementation score (n = 1343) and high kindergarten/high parental implementation score (n = 1080). A significant correlation between parent/caregiver and school implementation scores was found, however the association was very small (r = -0.06, p<0.001).
Only preschoolers with both parental and kindergarten implementation scores were included in the analyses. Preschoolers of the control group were added as a fifth group (n = 3428) to investigate the effect of implementation level on water intake and beverage consumption.
Descriptive statistics were performed using IBM SPSS Statistics for Windows, version 21.0 (Amonk, NY: IBM Corp). Analysis of variance (ANOVA) was used to assess country differences in implementation scores.
Multilevel repeated measures analyses were performed using MLWiN, version 2.30 (Centre for Multilevel Modelling, University of Bristol, UK) to assess the effectiveness of the intervention on water intake and beverage consumption. To take clustering of baseline and follow-up measurements of preschool children in kindergarten classes in kindergartens into account, multilevel modeling was used. Four levels were used: time, preschooler, kindergarten class and kindergarten. A three-way interaction between time, group and country was performed and significant differences by country were found. So, intervention effects were tested in the total sample and by country. To perform analysis in the total sample a fifth level was added (i.e., country). The analyses were adjusted for age, sex and SES. To correct for multiple testing the significance level was set at p<0.01
To assess the differences in water intake and beverage consumption by implementation score, multilevel repeated measures analyses were performed. The differences were tested in the total sample and five levels (time, preschooler, kindergarten class, kindergarten and country) were used to take clustering into account. The analysis was adjusted for age, sex and SES. To correct for multiple testing the significance level was set at p<0.01
The total and country-specific population characteristics are presented in Table 1. The total sample included 4964 preschoolers (mean age 4.7 ± 0.4 years, 51.5% boys), 38.5% had a mother with a lower level of education (≤ 14 years of education). Significant differences in SES were found between the different countries (F = 53.31; p<0.001). The Polish sample counted the lowest percentage of preschoolers of lower SES mothers (20.7%), the Greek sample the highest (51.4%).
Intervention effects on water intake and beverage consumption
Results obtained from the multilevel repeated measures analyses for the total water intake and beverage consumption in the total sample are shown in Table 2. Only for prepacked fruit juice (p<0.001) significant intervention effects were found in the total sample. In both the intervention and control group the prepacked fruit juice consumption decreased, with a larger decrease in the intervention group (mean difference: -33ml) compared to the control group (mean difference: -10ml).
Results obtained from the multilevel repeated measures analyses for the total water intake and beverage consumption in the six country-specific samples are shown in Tables 3 and 4. In Belgian preschoolers, significant intervention effects for plain milk consumption were found (p<0.001). In both the intervention and control group a decrease of plain milk consumption was found. However, a larger decrease was seen in the intervention group (mean difference: -49ml) than in the control group (mean difference: -1ml). No other significant intervention effects were found in Belgian preschoolers.
In German preschoolers, only for prepacked fruit juice consumption a significant intervention effect was found (p<0.001). In the intervention group, a decrease of prepacked fruit juice intake was found from baseline tot follow-up (mean difference: -45ml). In the control group, an increase of prepacked fruit juice consumption was seen from baseline to follow-up measurements (mean difference: +2ml).
In the Spanish sample, a significant intervention effect was found for pure fruit juice (p = 0.008). An increase of pure fruit juice intake was seen in preschoolers of the control group (mean difference: +13ml), while no difference was found in the intervention group. No other significant intervention effects were found for Spanish preschool children.
In the Bulgarian, Greek and Polish sample, no significant intervention effects were found.
Process evaluation results
The mean implementation score for kindergartens was 16.3±5.4 on a total of 30. A significant difference was found by country (F = 768.40, p<0.001). The mean implementation scores of the country-specific samples are presented in Table 1. A low implementation score for kindergartens, based on the median, ranged from 1.0 to 17.0, a high score ranged from 17.1 to 30.0.
The mean implementation score for parents/caregivers was 9.5±5.3 on a total of 18. A significant difference was found by country (F = 195.07, p<0.001). The mean implementation scores of the country-specific samples are presented in Table 1. A low parental implementation score, based on the median, ranged from 1.0 to 11.0, a high score ranged from 11.1 to 18.0.
Fig 4 shows the most important results on the differences in water intake and beverage consumption from baseline to follow-up by implementation score in the total sample. The findings are discussed below.
Regarding plain water (Fig 4A), a significant interaction effect was found. In both preschoolers with a high kindergarten/low parental and low kindergarten/high parental implementation score and preschoolers of the control group a significant increase in plain water consumption was found. A larger increase was found in preschoolers with a high kindergarten/low parental (β = 60.51, p<0.001, mean difference: +61ml) and low kindergarten/high parental (β = 61.04, p<0.001, mean difference: +58ml) implementation score compared to preschoolers from the control group (β = 22.22, p = 0.006, mean difference: +22ml).
For soft drinks (Fig 4B), significant interaction effects were found. Preschoolers with a high kindergarten/low parental implementation score significantly decreased their soft drink consumption (β = -33.46, p<0.001, mean difference: -34ml), while no significant change was found in preschoolers with a low kindergarten/low parental implementation score, low kindergarten/high parental implementation score, and high kindergarten/high parental implementation score. Also, in both preschoolers from the control group and preschoolers with a high kindergarten/low parental implementation score a significant decrease in soft drinks consumption was found, with a larger decrease in preschoolers with a high kindergarten/low parental implementation score (β = -33.46, p<0.001, mean difference: -34ml) compared to preschoolers from the control group (β = -8.45, p = 0.006, mean difference: -9ml).
Regarding prepacked fruit juice (Fig 4C), significant interaction effects were found. In preschoolers with a high implementation score for kindergarten, parents or both and preschoolers from the control group, a significant decrease in prepacked fruit juice consumption was found, with a higher decrease in preschoolers with a high implementation score for kindergartens (β = -38.91, p<0.001, mean difference: -39ml), parents (β = -28.28, p<0.001, mean difference: -28ml) or both (β = -38.26, p<0.001, mean difference: -38ml) compared to the control group (β = -9.93, p = 0.006, mean difference: -10ml). Also, in preschool children with a high kindergarten/low parental and a high kindergarten/high parental implementation score and preschoolers with low kindergarten/low parental implementation scores, a decrease of prepacked fruit juice intake was seen, with a higher decrease in preschoolers with a high kindergarten/low parental (β = -38.91, p<0.001, mean difference: -39ml) or high kindergarten/high parental implementation score (β = -38.26, p<0.001, mean difference: -38ml) compared to preschoolers with both low kindergarten and parental implementation scores (β = -19.53, p<0.001, mean difference: -20ml).
For plain milk (Fig 4D), significant interaction effects were found. Preschoolers with a low kindergarten/high parental implementation score had a significant decrease in plain milk consumption (β = -34.34, p<0.001, mean difference: -34ml), while no significant change in plain milk consumption was found in preschoolers with a high kindergarten/low parental implementation score. Also, preschoolers with a low kindergarten/high parental implementation score had a significant decrease in plain milk consumption (β = -34.34, p<0.001, mean difference: -34ml), while no significant change in plain milk consumption was found in preschoolers with high kindergarten/high parental implementation scores.
The aim of this study was to examine the effect of the ToyBox-intervention on water intake and beverage consumption in European preschoolers and to investigate if the effect of the intervention differed by implementation score of parents/caregivers and kindergartens. The Toybox-intervention was implemented in kindergartens, but also parents/caregivers were involved. It was expected that the intervention would increase the intake of water from beverages and plain water and decrease the consumption of sugared beverages (such as soft drinks, fruit juices and sugared milk). However, no intervention effects were found on plain water consumption and total water intake from beverages. For plain milk consumption, negative intervention effects were found in Belgian preschoolers, with a steeper decrease in plain milk consumption in preschoolers of the intervention group compared to the control group. A possible explanation for this might be that the ToyBox-intervention was not implemented as intended in Belgium, given the rather low results on parental implementation scores and the very low scores on kindergarten implementation score in the Belgian sample. Schools (including preschools) in Flanders already for many years implement health promotion strategies, so teachers might be less motivated to implement addition programs. Also similar findings were seen regarding differences in beverage consumption from baseline to follow-up by implementation score of parents/caregivers and kindergartens. Plain water consumption increased from baseline to follow-up in preschool children with high parental or high kindergarten implementation scores, while plain milk consumption decreased in preschoolers with a high parental implementation score. Parents/caregivers might have misunderstood the message on beverage consumption. However, preschoolers should consume 500ml milk a day to reach their recommended calcium intake. This norm also includes yoghurt and derivatives . So milk should be a major source of water intake in this age group, in addition to plain water . As was done in the ToyBox-study, messages to parents should make clear that it is not only important to make healthy beverage choices, but also that the quantity of total water intake from beverages should be kept in mind. Moreover, during the implementation of an intervention on water intake and beverage choices, special attention should be given to increase the total intake of healthy beverages instead of replacing one healthy beverage by another.
Also limited intervention effects were found on the consumption of sugared beverages. The intervention did not induce a significant decrease in soft drinks and sugared milk consumption. However, some positive intervention effects were found. Pre-packed/bottled fruit juice intake decreased more in the intervention group compared to the control group. These results were found in the total and in the German sample. In addition, the most important results on differences in beverage consumption from baseline to follow-up by the combined implementation level in kindergartens and parents/caregivers were seen for soft drinks and especially prepacked fruit juices. Regarding soft drinks, especially high kindergarten implementation scores seemed to be important to obtain a reduction in soft drink consumption. Regarding prepacked fruit juice, the consumption decreased in preschool children with a high parental implementation score, a high kindergarten implementation score and high scores on both compared to preschoolers with low scores or from the control group. This is an important finding, since a study on water intake and beverage consumption in European preschoolers using the baseline data of the ToyBox-study found that soft drink consumption of preschoolers appeared to be more limited than expected, while fruit juices appeared to be a larger problem than expected . Fruit juices also contain a lot of sugar. Although these are mainly fruit sugars instead of artificially added sugars, fruit juices are not recommended as healthy water sources given the extra calories they supply . It might be that more parents are already aware of the adverse health effects of soft drinks but still have insufficient knowledge about the high sugar content of fruit juices . This finding was also reported in a study with focus group discussions with preschoolers’ parents in different European countries, where parents seemed to have a misconception about whether or not fruit juices are a healthy choice . Therefore, a decrease in prepacked fruit juice consumption due to the ToyBox-intervention is definitely a positive finding. A study of Rader and colleagues (2014) also indicated that future interventions should not only focus on sugar-sweetened beverages to reduce calorie intake form beverage consumption, but also on fruit juices, since these are important contributors of caloric intake from beverages, especially in young children .
Overall, the process evaluation showed poor implementation scores. For instance, not all planned activities were performed in the kindergartens and a large part of the parents/caregivers did not read the newsletters and tip-cards or they did not implement the suggested activities of the newsletters and tip-cards. This could be a possible explanation for the limited intervention effects that were found. A previous review, based on results from over 500 studies, indicated that expecting perfect implementation is unrealistic . An implementation level of 60% was already considered a positive result and only few studies attained implementation levels greater than 80% . In the present study, the overall implementation in both kindergartens and households was lower than 60% (mean implementation score divided through maximum score). In three out of six countries kindergartens obtained 60% of the intended implementation, while in four out of six countries this level was obtained at the home environment. So, the level of implementation was not that low compared to earlier intervention studies. Nevertheless, future interventions should definitely take this into account and create efficient or innovative implementation strategies to improve intervention effects. As highlighted before, parents play a fundamental role in developing a healthy home environment . As in a lot of previous interventions, in the present study parents/caregivers were only passively involved in the intervention through newsletters, tip-cards and posters via their child’s kindergarten [41–42]. Unfortunately, while the school or kindergarten area is a promising public health intervention setting, it has been found that parents are difficult to reach that way . The implementation results of this study for instance show that a large part of the parents/caregivers do not read the newsletters and tip-cards. This could also be a possible explanation for the limited intervention effects. However, despite the poor implementation scores, the current study showed better effects in preschoolers whose parents/caregivers had higher implementation scores compared low implementation scores. Actively involving parents might be a promising strategy and might lead to even better intervention effects . Studies show that modeling is an effective method to teach parents parenting skills, e.g. by providing videos with specific case studies about parenting skills towards drinking behaviour of young children . In addition, the ToyBox-intervention targeted four behaviours instead of only focusing on drinking behaviour of preschoolers. A recent study of Kunin-Batson and colleagues (2015) indicated that parents prefer to focus on only one healthy child behaviour instead of several health behaviours . Also, the intensity (a minimum of one hour a week) might have been too limited and the time spent on drinking behaviour (a total of six weeks) might have been too short. However, as highlighted before, the results on the process evaluation indicated that better implementation levels of the ToyBox-study in kindergartens and at home led to better results in plain water consumption, prepacked fruit juice consumption and soft drink intake. Therefore, the ToyBox-intervention can be used to target beverage consumption in preschoolers and high levels of implementation should be encouraged to create the best possible outcome. A possible explanation for country-differences in implementation levels could be found in the amount of existing health promotion activities prior to the ToyBox-intervention . The lowest implementation levels at kindergartens were found in countries with the most existing health promotion activities (Belgium, Germany and Spain) and the highest implementations scores were found in countries where no prior activities were conducted (Poland and Bulgaria). So, possibly, kindergartens in the countries with a higher health promotion burden were less motivated to collaborate in another new intervention. No clear explanations could be found for the differences in implementation results between kindergartens and parents. Future studies should also focus on finding the underlying mechanisms of implementation in different environments. As indicated in the review of Durlak and DuPre (2008), many factors can affect implementation, such as organizational functioning and the level of technical assistance . Future research on the influencing factors could yield interesting insights in understanding these underlying mechanisms of intervention implementation and would be useful for the planning of future intervention developers.
The current study holds some limitations that need to be acknowledged. We acknowledge that the ToyBox-sample is not a fully representative European sample, due to sampling in specific regions in each country. Samples included preschoolers of both low, medium and high SES backgrounds. The samples can give a fair approximation of the average situation in each country. The procedure of sampling in specific regions has also been used in several other European studies such as HELENA and ENERGY [48–49]. The process evaluation was measured by self-report. Participants may not be aware of intervention delivery or reception. More objective indicators of program delivery (e.g., observations), could be used in future interventions to avoid this limitation . Because of the large number of statistical tests used in this study, bias may have occurred. However, to correct for multiple testing the significance level was set at p<0.01. Strengths of the present study include the large sample of preschoolers from six European preschoolers and the cluster randomized pre- and posttest design including an intervention and control group.
The ToyBox-intervention had limited intervention effects on water intake and beverage consumption in preschoolers. However, the ToyBox-intervention induced a larger decrease in prepacked fruit juice consumption in the intervention group compared to the control group. Since excessive prepacked fruit juice consumption is a major problem in preschoolers, this is an important finding. However, a decline in plain milk consumption was also found. Implementation scores were both in kindergartens and parents/caregivers rather low. Nevertheless, the current study showed better effects in preschoolers whose parents/caregivers and kindergarten teachers had high implementation scores compared to preschoolers of low-implementers. The ToyBox-intervention can provide the basis for the development of more tailor-made interventions. New strategies to improve implementation of interventions should be created, such as participatory intervention development. In addition, the results of the process evaluation can also be used during future interventions to improve implementation.
The ToyBox-study is funded by the Seventh Framework Programme (CORDIS FP7) of the European Commission under grant agreement n° 245200. The content of this article reflects only the authors’ views and the European Community is not liable for any use that may be made of the information contained therein. The ToyBox-study group consists of: Co-ordinator: Yannis Manios; Steering Committee: Yannis Manios, Berthold Koletzko, Ilse De Bourdeaudhuij, Mai Chin A Paw, Luis Moreno, Carolyn Summerbell, Tim Lobstein, Lieven Annemans, Goof Buijs; External Advisors: John Reilly, Boyd Swinburn, Dianne Ward; Harokopio University (Greece): Yannis Manios, Odysseas Androutsos, Eva Grammatikaki, Christina Katsarou, Eftychia Apostolidou, Eirini Efstathopoulou, Paraskevi-Eirini Siatitska, Angeliki Giannopoulou, Effie Argyri, Konstantina Maragkopoulou, Athanasios Douligeris; Ludwig Maximilians Universitaet Muenchen (Germany): Berthold Koletzko, Kristin Duvinage, Sabine Ibrügger, Angelika Strauß, Birgit Herbert, Julia Birnbaum, Annette Payr, Christine Geyer; Ghent University (Belgium): Department of Movement and Sports Sciences: Ilse De Bourdeaudhuij, Greet Cardon, Marieke De Craemer, Ellen De Decker and Department of Public Health: Lieven Annemans, Stefaan De Henauw, Lea Maes, Carine Vereecken, Jo Van Assche, Lore Pil; VU University Medical Center EMGO Institute for Health and Care Research (the Netherlands): EMGO Institute for Health and Care Research: Mai Chin A Paw, Saskia te Velde; University of Zaragoza (Spain): Luis Moreno, Theodora Mouratidou, Juan Fernandez, Maribel Mesana, Pilar De Miguel-Etayo, Esther González, Luis Gracia-Marco, Beatriz Oves; Oslo and Akershus University College of Applied Sciences (Norway): Agneta Yngve, Susanna Kugelberg, Christel Lynch, Annhild Mosdøl; University of Durham (UK): Carolyn Summerbell, Helen Moore, Wayne Douthwaite, Catherine Nixon; State Institute of Early Childhood Research (Germany): Susanne Kreichauf, Andreas Wildgruber; Children’s Memorial Health Institute (Poland): Piotr Socha, Zbigniew Kulaga, Kamila Zych, Magdalena Góźdź, Beata Gurzkowska, Katarzyna Szott; Medical University of Varna (Bulgaria): Violeta Iotova, Mina Lateva, Natalya Usheva, Sonya Galcheva, Vanya Marinova, Zhaneta Radkova, Nevyana Feschieva; International Association for the Study of Obesity (UK): Tim Lobstein, Andrea Aikenhead; National Institute for Health Promotion and Disease Prevention (the Netherlands): Goof Buijs, Annemiek Dorgelo, Aviva Nethe, Jan Jansen; AOK- Verlag (Germany): Otto Gmeiner, Jutta Retterath, Julia Wildeis, Axel Günthersberger; Roehampton University (UK): Leigh Gibson; University of Luxembourg (Luxembourg): Claus Voegele.
Conceived and designed the experiments: IDB GC OA BK LAM PS VI YM MDC. Performed the experiments: IDB GC OA BK LAM PS VI YM MDC. Analyzed the data: AP. Wrote the paper: AP. Read, critically reviewed the manuscript and approved the final manuscript: AP WVL IDB BD GC OA BK LAM PS VI YM MDC.
- 1. Pinket A, De Craemer M, Maes L, De Bourdeaudhuij I, Cardon G, Androutsos O, et al. Water intake and beverage consumption of preschoolers from six European countries and associations with socio-economic status: the ToyBox-study. Public Health Nutr (in press)
- 2. Börnhorst C, Huybrechts I, Hebestreit A, Krogh V, De Decker A, Barba G et al. Usual energy and macronutrient intakes in 2-9-year-old European children. Int J Obes. 2014,38:115–123.
- 3. Popkin BM, D’Anci KE, Rosenberg IH. Water, hydration and health. Nutr Rev 2010,68,439–458. pmid:20646222
- 4. Panel on Dietary Reference Intakes for Electrolytes and Water. Dietary Reference Intakes for Water, Potassium, Sodium, Chloride, and Sulfate. Washington: The National Academies Press; 2005.
- 5. Jéquier E, Constant F. Water as an essential nutrient: the physiological basis of hydration. Eur J Clin Nutr. 2010;64:115–123. pmid:19724292
- 6. Kleiner SM. Water: an essential but overlooked nutrient. J Am Diet Assoc. 1999;99:200–206. pmid:9972188
- 7. Bar-David Y, Urkin J, Kozminsky E. The effect of voluntary dehydration on cognitive functions of elementary school children. Acta Paediatrica. 2005;94:1667–1673. pmid:16303708
- 8. Benton D.Dehydration influences mood and cognition: a plausible hypothesis? Nutrients. 2011;3:555–573. pmid:22254111
- 9. D'Anci KE, Constant F, Rosenberg IH. Hydration and cognitive function in children. Nutr Rev. 2006;64:457–64. pmid:17063927
- 10. Masento NA, Golightly M, Field DT, Butler LT, van Reekum CM. Effects of hydration status on cognitive performance and mood. Br J Nutr. 2014;111:1841–1852. pmid:24480458
- 11. Shirreffs SM, Merson SJ, Fraser SM, Archer DT. The effects of fluid restriction on hydration status and subjective feelings in man. Br J Nutr. 2004;91:951–958. pmid:15182398
- 12. Drewnowski A, Rehm CD, Constant F. Water and beverage consumption among children age 4–13y in the United States: analyses of 2005–2010 NHANES data. Nutr J. 2013;12: 85. pmid:23782914
- 13. Feferbaum R, de Abreu LC, Leone C. Fluid intake patterns: an epidemiological study among children and adolescents in Brazil. BMC Public Health. 2012;12:1005. pmid:23167254
- 14. LaRowe TL, Moeller SM, Adams AK. Beverage patterns, diet quality, and body mass index of US preschool and school-aged children. J Am Diet Assoc. 2007;107:1124–1133. pmid:17604741
- 15. Briefel RR, Wilson A, Cabili C, Hedley Dodd A. Reducing calories and added sugars by improving children’s beverages choices. J Acad Nutr Diet. 2013;113:269–675. pmid:23351631
- 16. DeBoer MD, Scharf RJ, Demmer RT. Sugar-sweetened beverages and weight gain in 2- to 5-year-old children. Pediatr. 2013;132:413–420.
- 17. De Ruyter JC, Olthof MR, Seidell JC, Katan MB. A trial of sugar-free or sugar-sweetened beverages and body weight in children. N Engl J Med. 2012;367:1397–1406. pmid:22998340
- 18. Vanhauwaert E. Water. In: De actieve voedingsdriehoek. Leuven: Acco; 2012. p. 37–41.
- 19. De Coen V, Vansteelandt S, Maes L, Huybrechts I, De Bourdeaudhuij I, Vereecken C. Parental socioeconomic status and soft drink consumption of the child. The mediating proportion of parenting practices. Appetite. 2012;59:76–80. pmid:22475631
- 20. Nethe A, Dorgelo A, Kugelberg S, van Assche J, Buijs G, Yngve A, et al. Existing policies, regulation, legislation and ongoing health promotion activities related to physical activity and nutrition in pre-primary education settings: an overview. Obes Rev. 2012;13:118–128. pmid:22309070
- 21. Nixon CA, Moore HJ, Douthwaite W, Gibson EL, Vogele C, Kreichauf S, et al. Identifying effective behavioural models and behaviour change strategies underpinning preschool- and school-based obesity prevention interventions aimed at 4-6-year-olds: a systematic review. Obes Rev. 2012;13:106–117.
- 22. Saunders RP, Evans MH, Joshi P. Developing a process-evaluation plan for assessing health promotion program implementation: a how-to guide. Health Promot Pract. 2005;6: 134–147. pmid:15855283
- 23. Hulscher M, Laurant M, Grol R. Process evaluation on quality improvement interventions. Qual Saf Health Care. 2003;12:40–46. pmid:12571344
- 24. Verloigne M, Ahrens W, De Henauw S, Verbestel V, Mårild S, Pigeotet I, et al. Process evaluation of the IDEFICS school intervention: putting the evaluation of the effect on children’s objectively measured physical activity and sedentary time in context. Obes rev. 2015;16: 89–102. pmid:26707019
- 25. Manios Y, Grammatikaki E, Androutsos O, Chinapaw MJ, Gibson EL, Buijs G, et al. A systematic approach for the development of a kindergarten-based intervention for the prevention of obesity in preschool age children: the ToyBox-study. Obes Rev. 2012;13 Suppl 1:3–12. pmid:22309061
- 26. Manios Y, Androutsos O, Katsarou C Iotova V, Socha P, Geyer C, et al. Designing and implementing a kindergarten-based, family-involved intervention to prevent obesity in early childhood: the ToyBox-study. Obes Rev. 2014;15 Suppl 3:5–13. pmid:25047374
- 27. Androutsos O, Katsarou C, Payr A, Birnbaum J, Geyer C, Wildgruber A, et al. Designing and implementing teachers' training sessions in a kindergarten-based, family-involved intervention to prevent obesity in early childhood. The ToyBox-study. Obes Rev. 2015;15 Suppl 3:48–52.
- 28. Payr A, Birnbaum J, Wildgruber A, Kreichauf S, Androutsos O, Lateva M, et al. Concepts and strategies on how to train and motivate teachers to implement a kindergarten-based, family-involved intervention to prevent obesity in early childhood. The ToyBox-study. Obes Rev. 2014;15:40–47.
- 29. Huybrechts I, De Backer G, De Bacquer D, Maes L, De Henauw S, et al. Relative validity and reproducibility of a food-frequency questionnaire for estimating food intakes among Flemish preschoolers. Int J Environ Res Public Health. 2009;6:382–399. pmid:19440290
- 30. National Institute for Public Health and the Environment. About NEVO-data. 2013. http://www.rivm.nl/en/Topics/D/Dutch_Food_Composition_Database/About_NEVO_datd. accessed March 2015.
- 31. Winkleby MA, Jatulis DE, Frank E, Fortmann SP. Socioeconomic status and health: how education, income, and occupation contribute to risk factors for cardiovascular disease. Am J Public Health. 1992;82:816–820. pmid:1585961
- 32. Brug J, van Stralen MM, te Velde SJ, Chinapaw MJ, De Bourdeaudhuij I, Lien N, et al. Differences in weight status and energy-balance related behaviors among schoolchildren across Europe: the ENERGY-project. PLoS One. 2012;7:e34742. pmid:22558098
- 33. Mouratidou T, Miguel ML, Androutsos O, Manios Y, De Bourdeaudhuij I, Cardon G, et al. Tools, harmonization and standardization procedures of the impact and outcome evaluation indices obtained during a kindergarten-based, family-involved intervention to prevent obesity in early childhood: the ToyBox-study. Obes Rev. 2014;15 Suppl 3:53–60. pmid:25047379
- 34. Androutsos O, Apostolidou E, Iotova V, Socha P, Birnbaum J, Moreno L, et al. Process evaluation design and tools used in a kindergarten-based, family-involved intervention to prevent obesity in early childhood. The ToyBox-study. Obes Rev. 2014;15 Suppl 13:74–80.
- 35. Food and Agriculture Organisation of the United Nations. Milk and dairy products as part of the diet. In: Muehlhoff E, Bennett A, McMahon D, editors. Milk and dairy products in human nutrition. Rome: FAO; 2013. p. 103–206.
- 36. Bellisle F, Thornton SN, Hébel P, Denizeau M, Tahiri M. A study of fluid intake from beverages in a sample of healthy French children, adolescents and adults. Eur J Clin Nutr. 2010;64:350–355. pmid:20160751
- 37. Ventura AK, Birch LL. Does parenting affect children’s eating and weight status? Int J of Behav Nutr Phys Act. 2008;5:15.
- 38. Rader RK, Mullen KB, Sterkel R, Strunk RC, Garbutt JM. Opportunities to reduce children's excessive consumption of calories from beverages. Clin Pediatr. 2014;53:1047–1054.
- 39. De Craemer M, De Decker E, De Bourdeaudhuij I, Deforche B, Vereecken C, Duvinage K, et al. Physical activity and beverage consumption in preschoolers: focus groups with parents and teachers. BMC Public Health. 2013;13:278. pmid:23537117
- 40. Durlak JA, DuPre EP. Implementation matters: a review of research on the influence of implementation on program outcomes and the factors affecting implementation. Am J Community Psychol. 2008;41: 327–50. pmid:18322790
- 41. Verloigne M, Bere E, Van Lippevelde W, Maes L, Lien N, Vik FN, et al. The effect of the UP4FUN pilot intervention on objectively measured sedentary time and physical activity in 10–12 year old children in Belgium: the ENERGY-project. BMC Public Health. 2012;12:805. pmid:22989231
- 42. Centis E, Marzocchi R, Di Luzio R, Moscatiello S, Salardi S, Villanova N, et al. A controlled, class based multicomponent intervention to promote healthy lifestyle and to reduce the burden of childhood obesity. Pediatr Obes. 2012;7:436–445. pmid:22911919
- 43. Gonzalez-Suarez C, Worley A, Grimmer-Somers K, Dones V. School-based interventions on childhood obesity: a meta-analysis. Am J Prev Med. 2009;37:418–427. pmid:19840696
- 44. Hingle MD, O'Connor TM, Dave JM, Baranowski T. Parental involvement in interventions to improve child dietary intake: a systematic review. Prev Med. 2010;51:103–111. pmid:20462509
- 45. Cunningham CE, Davis JR, Bremner R, Dunn KW, Rzasa T. Coping modeling problem solving versus mastery modeling: effects on adherence, in-session process, and skill acquisition in a residential parent-training program. J Consult Clin Psychol. 1993;61:871–877. pmid:8245284
- 46. Kunin-Batson AS, Seburg EM, Crain AL, Jaka MM, Langer SL, Levy RL, et al. Household factors, family behavior patterns, and adherence to dietary and physical activity guidelines among children at risk for obesity. J Nutr Educ Behav. 2015;47:206–215. pmid:25748634
- 47. Nethe A, Dorgelo A, Kugelberg S, van Assche J, Buijs G, et al. Existing policies, regulation, legislation and ongoing health promotion activities related to physical activity and nutrition in pre-primary education settings: an overview. Obes Rev. 2012;13: 118–28. pmid:22309070
- 48. Moreno LA, De Henauw S, González-Gross M, Kersting M, Molnár D, Gottrand F, et al. Design and implementation of the Healthy Lifestyle in Europe by Nutrition in Adolescence Cross-Sectional Study. Int J Obes. 2008;32:5–11.
- 49. van Stralen M, te Velde S, Singh A, De Bourdeaudhuij I, Martens MK, van der Sluis M, et al. EuropeaN Energy balance Research to prevent excessive weight Gain among Youth (ENERGY) project: Design and methodology of the ENERGY cross-sectional survey. BMC Public Health. 2011;11:65. pmid:21281466
- 50. Resnicow K, Davis M, Smith M, Lazarus-Yaroch A, Baranowski T, Baranowski J, et al. How best to measure implementation of school health curricula: a comparison of three measures. Health Educ Res. 1998;13:239–50. pmid:10181022