Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Promoting sleep and mental well-being in children: Protocol for a naturalistic pilot in-app study among users of the Aumio app

  • Nadja Ruckser,

    Roles Conceptualization, Investigation, Methodology, Project administration, Resources, Writing – original draft, Writing – review & editing

    Affiliations Department of Education and Psychology, Division of Clinical Psychological Intervention, Freie Universität Berlin, Berlin, Germany, Department of Psychiatry and Neurosciences, Campus Charité Mitte, Charité – Universitätsmedizin Berlin, Corporate Member of Freie Universität Berlin and Humboldt Universität zu Berlin, Berlin, Germany, German Centre for Mental Health (DZPG), Berlin-Potsdam, Germany

  • Melissa Röcken,

    Roles Conceptualization, Project administration, Resources

    Affiliation Aumio GmbH, Berlin, Germany

  • Jean Ochel,

    Roles Conceptualization, Project administration, Resources

    Affiliation Aumio GmbH, Berlin, Germany

  • Alfred Wiater,

    Roles Conceptualization, Investigation, Methodology, Writing – review & editing

    Affiliation Onlinepraxis für Kinderschlafmedizin, Bad Wiessee, Germany

  • Claudia Calvano

    Roles Conceptualization, Investigation, Methodology, Supervision, Writing – review & editing

    claudia.calvano@fu-berlin.de

    Affiliations German Centre for Mental Health (DZPG), Berlin-Potsdam, Germany, Department of Education and Psychology, Division of Clinical Child and Adolescent Psychology and Psychotherapy, Freie Universität Berlin, Berlin, Germany

Abstract

Sleep problems are widespread among children and can have a negative impact on their development, everyday functioning and pose an additional burden on the parents. While there are numerous apps designed to improve children’s sleep and help them fall asleep, little data are available regarding the feasibility, acceptability and efficacy. The purpose of this study is to conduct an initial analysis of the feasibility and acceptability of the Aumio app and an email psychoeducational module as well as preliminary efficacy on child’s sleep quality and the associated factors well-being and parental stress. This research project is designed as a single-group pre-post design for a sample of 456 guardian-child dyads, with children aged 6–12 years. Participants will be recruited through the Aumio app as well as through advertisements in pediatric clinics and online. During the 12-week intervention, participants will be provided with the Aumio app and the parent-centred email psychoeducation module. At the beginning of the intervention and before the first app use (T0), six weeks after the first app use (T1), and immediately following the conclusion of the 12-week intervention (T2), the feasibility, acceptability and preliminary efficacy on children’s sleep and health-related quality of life as well as parental stress will be examined. The study will examine the association between the intensity of the Aumio app use and the endpoints to improve feasibility and acceptability by synthesizing recommendations for use. This pilot study can provide important insights into an app targeting child’s sleep problems in naturalistic, uncontrolled settings. Through this study, the existing research gap regarding app-based interventions for improving infant sleep will be addressed. Results will stimulate further development and research in the area of evidence-based mobile health interventions for children and their parents.

Introduction

Sleep problems are widespread among children in Germany, affecting more than 20% of children of preschool and primary school age [1]. The most common sleep problems in this age group are difficulties with falling or staying asleep, which may persist and remain for extended periods [2]. Simultaneously, sleep plays a crucial role in child development and is closely linked to physical, cognitive, behavioural, and social-emotional functions that affect children’s learning, behaviour, and overall well-being [3]. Furthermore, sleep is crucial for the development of complex executive, verbal and non-verbal cognitive functions [3]. Consequently, childhood sleep problems are associated with a variety of secondary impairments [4]. According to a recent review [3], a variety of detrimental outcomes are associated with insufficient sleep duration in children: insufficient sleep duration increases the risk of overweight or obesity and related health conditions in children. Moreover, insufficient sleep may be a risk factor for later development of ADHD and may lead to an increased occurrence of externalising behaviours such as hyperactivity, impulsivity, irritability, and conduct problems [5]. Other effects include daytime sleepiness and impaired daytime functioning, short attention span, and negative behavioural responses and interactions with peers [3]. Additionally, insufficient sleep, inadequate sleep (i.e., a shorter sleep duration than required to maintain daytime wakefulness), poor sleep quality, and especially sleepiness during the day are associated with problems in children’s learning, memory, and academic performance [6].

Given that sleep problems in toddlers and school-aged children can also negatively affect parents’ sleep, health, and daytime functioning [7], addressing parental burden in this context is particularly relevant. A meta-analysis by Varma, Conduit, Junge, Lee, and Jackson [8] found associations between child sleep problems and poorer sleep quality on side of the parents, more severe insomnia symptoms, and increased arousal before parents go to sleep. In addition, poor child sleep has been negatively associated with the parents’ partnership quality and between parent and child relations [9]. Therefore, addressing parental burden within interventions for child’s sleeping problems is a promising approach, not only for the parents themselves, but also with respect to possible influences on children’s therapy processes and outcomes [10].

A meta-analysis conducted by Zhu, Xiao, and Tu [11] covering 15 studies demonstrated that technology-based interventions can contribute to the improvement of children’s sleep by increasing the total sleep time, sleep efficiency as well as decreasing the sleep onset latency and time span awake after sleep onset. Although the effect sizes were generally small to moderate, the studies demonstrated good overall quality. However, there was high heterogeneity in the data and the types of technology used. Additionally, the majority of technology-based interventions targeted children’s caregivers by providing sleep behavior management strategies and parental stress was not addressed. While the six uncontrolled pre-post studies demonstrated significant mean effect size in all outcome indicators, the eight randomized controlled trials only showed effects in wake after sleep onset. However, the trials conducted so far included 5 different intervention types. Up to now, there is limited research on audio-based mobile applications for improving children’s sleep quality [12].

To date, the Aumio app has been evaluated in a few unpublished master’s theses. However, this marks the first scientific study to assess the Aumio app using a large sample size, following a preregistered study protocol, with the intention of disseminating the findings. We aim to investigate the feasibility and acceptability of the Aumio app and the email psychoeducational module. As secondary user-centred outcomes, preliminary efficacy on child’s sleep quality and associated factors will be investigated. This current trial aims to fill a gap in research by being the first to investigate the feasibility and application of a German-language audio based app for improving children’s sleep quality with a large sample in a naturalistic setting. Additionally, the study examines preliminary’ efficacy of the Aumio app on child’s sleep quality, health related quality of life and parental stress as well as the concurrent application of a parent-centred email psychoeducation module.

Objectives

The aim of this pilot study is to test the feasibility, acceptability and preliminary efficacy of the Aumio app and the parent-centred email psychoeducation module. We aimed (1) to examine the feasibility and acceptability of the of the Aumio app and the parent-centred email psychoeducation module. We therefore aimed to conduct qualitative and quantitative data to gain comprehensive insights. In addition, we also aimed (2) to collect information for improvements of the Aumio app and the parent-centred email psychoeducation module from a user’s perspective. We furthermore aimed (3) to examine the preliminary efficacy of the Aumio app and the parent-centred email psychoeducation module. As secondary user-centred outcomes, we aimed to examine whether its use improves children’s sleep, covering a broad range of facets to adequately capture the multidimensional nature of sleep. Furthermore, preliminary efficacy on child’s health-related quality of life and effects on parental stress will be tested as secondary user-centred outcomes. In order to further improve the feasibility and to synthesize recommendations for use, it will be investigated (4) at which intensity of usage the Aumio app significantly affects the feasibility and satisfaction as well as the secondary user-centred outcomes. The intensity of usage will be analysed continuously as well as divided into 4 levels (12, 18, 24, and 30 uses during the study period) and included in the analyses.

The primary, feasibility hypothesis refers to the user’s subjective perspective on the Aumio app and the parent-centred email psychoeducation module, with the assessment time points 6 weeks after the start of the app use, at the midpoint of the 12-week parent-centred email psychoeducation module and again another 6 weeks after. We hypothesize that the Aumio app and the parent-centred email psychoeducation module is feasible. We also hypothesize Aumio app and the parent-centred email psychoeducation module is accepted among the users. We further hypothesize that the present study design is feasible to conduct a large scale trial on the effectiveness.

The secondary, user-centred hypothesis refer to comparisons of endpoint scores pre app use, at the same time points as the feasibility survey. We hypothesize that 6 weeks and 12 weeks after the start of the app use, children’s sleep quality will be significantly increased (secondary, child-centred endpoint) and health-related quality of life will be significantly higher (secondary, child-centred endpoint). Furthermore, we hypothesize that parenting stress will be significantly reduced 12 weeks after the start of the use of the email psychoeducational program (secondary, parent-centred endpoint). Exploratory analyses will also be conducted to determine to what extent usage behavior influences the effects on primary and secondary outcomes.

Methods

Ethics approval and consent to participate

Ethical approval and modification approval were granted by the Ethics Committee of the Department of Education and Psychology of Freie Universität Berlin on February 07, 2023, under reference number 047.2022.

Trial design and study setting and participant timeline

The present research project is designed as a one-group pre-post pilot study. As this trial is the first larger scale pilot trial on the feasibility and acceptability as well as the first trial on the preliminary efficacy of the app on sleep quality and the parent module, randomization, control groups, and blinding do not apply to the study design of this trial. The study is a single study conducted in the naturalistic setting of the app, meaning it was conducted exclusively in-app and within a German-speaking population. After consenting to participate in this study, the participants will be provided a 12-months free access to the Aumio app and receive the parent-centred email psychoeducation module at weekly intervals.

Once participants agree to the conditions of participation and meet the inclusion criteria, guardians are directed to the first assessment (T0). At T0, at the beginning of the intervention and before the first app use, data on sociodemographic characteristics and relevant covariates and the outcomes will be collected. After completing the first survey T0, participants are provided with free access to the Aumio app for one year and receive the parent-centred email psychoeducation module once a week. The intervention duration is set at twelve weeks. Six weeks after the intervention start and the first app use, the second measurement point (T1) takes place, where primary and secondary outcomes are assessed. Immediately following the conclusion of the 12-week intervention, the third measurement point (T2) is conducted, comparable to the T1 assessment (Fig 1).

thumbnail
Fig 1. SPIRIT schedule of enrolment.

CSHQ = Children’s Sleep Habits Questionnaire. SI-KJ = Sleep inventory for children (Schlafinventar für Kinder und Jugendliche), EBI = Parenting Stress Index (Eltern-Belastungs-Inventar).

https://doi.org/10.1371/journal.pone.0322302.g001

Eligibility criteria

In line with the naturalistic setting of the study, the age range was set according to the target population of the Aumio app. Participants are eligible if the children are between 6 and 12 years old. The following exclusion criteria will be collected, assessed, and applied at T0: (1) insufficient German reading and understanding language proficiency of the child or guardian, (2) impaired hearing ability of the child, (3) diagnosed intelligence impairment or other severe developmental disability of the child, and (4) diagnosed obstructive sleep apnea of the child.

Who will take informed consent?

The study participants (children and guardians) will receive written information about the purpose and procedure of the study and about possible advantages and disadvantages of participation. They will be informed that participation in the study is entirely voluntary, and that participation can be terminated at any time without giving reasons. Additionally, all participants will be informed about their rights regarding data storage, data protection and data deletion. Informed consent will be obtained from all guardians as well as children in child-friendly language prior to screening at T0. Only individuals who provide informed consent and child assent can participate in the study.

Intervention description

The intervention consists of two components: the Aumio app and the parent-centred email psychoeducation module. Both are made available to participants. Aumio is a smartphone application designed to provide easily accessible health interventions for children and to promote healthy sleep and strengthen children’s mental health. It focuses on children’s sleep, relaxation, concentration and emotions. In the sleep module, Aumio offers a variety of audio stories, fantasy journeys and sounds for falling asleep to make going to bed in the evening as relaxing as possible for children. In addition, psychoeducation and the playful learning of relaxation techniques by means of meditations and dream journeys are integrated into the Aumio app. The meditation techniques are taught in a child-friendly way and made easily accessible for children. The exercises and stories are based on cognitive-behavioral techniques such as autogenic training or progressive muscle relaxation. The meditations and dream journeys for falling asleep have a duration between 5 and 20 minutes. In the intervention, families are advised to use the Aumio app at least twice a week in the evening, before bedtime. However, participants are encouraged to integrate the Aumio app into their daily routine in a manner that is suitable for them.

In addition, the parent-centred email psychoeducation module accompanies the use of the Aumio app and is emailed to the guardians once a week. The course addresses various aspects of children’s sleep to provide guardians with an understanding of child sleep and associated challenges. Each week focuses on a specific topic that covers relevant aspects of children’s sleep and sleep habits. First, the importance of good sleep quality for child development is discussed. Then, falling asleep is addressed by teaching the creation and establishment of bedtime routines and highlighting the importance of a comfortable sleep environment. Potential obstacles are also addressed. The parents are also taught how to help their children fall asleep on their own and how to make the process of accompanying their child to sleep less stressful. The course then tackles issues with staying asleep and provides strategies to support the child in falling back asleep after a nighttime awakening. Last, the course discusses how the child’s daytime activities can influence their sleep. For each topic, practical tips for implementing the concepts in daily life are provided alongside the theoretical explanations. The knowledge learned can be tested weekly in a small quiz in the Aumio app. In addition, the most important content is compiled in a child-friendly way and sent as a playfully designed info sheet as an attachment to the e-mail.

Criteria for discontinuing or modifying allocated interventions

Participants can discontinue their use of the Aumio app, stop receiving the parent-centred email psychoeducation module, and consequently withdraw from the study at any time by uninstalling the app from their mobile devices and opting out of the email list. The intervention does not require contact with the study team.

Strategies to improve adherence to interventions

The use of Aumio is entirely app based, and the meditations and dream journeys last between 5 and 20 minutes. Thus, the effort required to engage with the app can be considered minimal. As the naturalistic context of the study is among users of the Aumio app, the app functions are not altered for the study. Consequently, no reminders of app use will be used.

Outcomes

Primary, feasibility outcome.

Feasibility will be assessed by the number of users, dropout rates, and usage patterns (e.g., number of audio content played). Usage behavior of the parent-centred email psychoeducation module will be assessed weekly using a content related quiz question in the Aumio app. The recruitment process will further be examined by analysing the study outreach method and its consequences on participant recruitment.

The acceptability of the Aumio app and the parent-centred email psychoeducation module will be assessed both quantitatively and qualitatively by examining the user’s satisfaction. The questions are derived from a study by Hiscock et al. [13], which examined the effects of a digital sleep intervention on child sleep and psychosocial outcomes of children and their caregivers. Satisfaction is assessed on 5-point Likert scale (1 = totally disagree/very unsatisfied, 5 = totally agree/very satisfied) generally and by specific factors, including satisfaction with the use of the product (“The app was easy to use”; “The e-mail course was understandable.”), the information provided (“The amount of information in the app was just right.”; “I was satisfied with the content provided by the app.”; “The amount of information in the e-mail course was just right.”; “I was pleased with the strategies the email course provided for my child’s sleep problem”; “I would have preferred to have a personal contact instead of the e-mail course to explain the strategies and their application.”), the feeling of safety (“I felt safe using the app.”; I felt safe participating in the email course.”), the subjective perception of improvement in the child’s sleep (“Using the app has helped my child to fall asleep.”; “Taking part in the e-mail course has helped my child to fall asleep better.”), and the intention to continue using the product in the future (“I would like to continue using the e-mail course in the future.; “I would like to use the app in the future.”). Likelyhood of recommendation to other parents (“How likely is it that you will recommend the Aumio app to other parents you know?”, “How likely is it that you will recommend the e-mail course to other parents you know?”) will be assessed using a 10-point Likert scale (1 = unlikely, 10 = highly likely). Quantitative data will be further supplemented by qualitative data on helpful content (“What has helped you and your child the most with the Aumio app?”, “What did you and your child find particularly helpful about the email course?”), ideas for improvement (“What would you change to improve the Aumio app?”, “What would you change to improve the email course?”), as well as moments when users experienced difficulty using the app (“When did you find it difficult to use the Aumio app?”). Additionally, we will assess changes in sleep duration (“Has your child’s sleep duration changed with the use of Aumio and the e-mail course?”) and whether parents sought advice from their local paediatrician regarding sleep problems (“While using the Aumio app and email course, did you contact your local paediatrician for more information on how to help your child sleep?”).

Secondary, user-centred outcomes.

For the assessment of child’s sleep quality, we used the Children’s Sleep Habits Questionnaire (CSHQ, 14]). The CSHQ is a retrospective screening instrument designed to examine children’s sleep [14]. It consists of 48 items, with 33 items distributed among various subscales, including bedtime problems, difficulties in falling asleep, sleep duration, anxiety, nighttime awakenings, parasomnias, breathing disorders, and daytime sleepiness. These subscales are utilized to calculate an overall score, providing a comprehensive evaluation of children’s sleep. Additionally, bedtime, the child’s average amount of sleep per day, duration of nocturnal wakefulness, and morning awakening time are recorded [14]. The German adaptation of Schlarb [15] is used, which was validated and normed by Schlarb, Schwerdtle, and Hautzinger [16] among a German norm sample consisting of 298 parents of 4–10-year-old children and 45 parents of children with sleep disorders.

To cover more aspects of sleep quality, we amended the CSHQ [1416] by the Sleep inventory for children (Schlafinventar für Kinder und Jugendliche, SI-KJ; [17]). The retrospective, 33-item screening instrument supplements the survey by assessing sleep hygiene and sleep environment characteristics as well as physical factors contributing to sleep problems [17]. The questionnaire contains the main scale sleep and daily behaviour and the subscales sleep onset and sleep through problems, vegetative symptoms, daytime sensitivity, and nocturnal events. Data on various characteristics of sleep hygiene and sleep environment as well as physical factors, e.g., health problems such as allergies or chronic diseases are assessed. The instrument has been validated and normed on a German norm sample of 5–11-year-old children and parents [17].

We used the German version of the KiddyKINDL and KidKINDL, retrospective 24-item instruments to assess the health-related quality of life [18,19]. The KiddyKINDL is administered to guardians of 6-year-old children, and the KidKINDL is administered to guardians of 7–12-year-old children. Contents of the questionnaires are the subscales physical well-being, psychological well-being, self-esteem, family, friends, and functioning in daily life (school or preschool/kindergarten), with 4 items each [18,19]. Both versions are publicly available, have been psychometrically tested [20] and German normative scores are available [21].

To assess parenting stress, we used the German version of Abidin’s Parenting Stress Index (Eltern-Belastungs-Inventar, EBI; [22,23]). According to the retrospective 48-item instrument, parenting stress occurs when there is a mismatch between the demands of the parenting role and the coping resources needed to meet them. The demands arise from different sources of stress (child-related, parent-related and context-related), which are assigned to the child domain and the parent domain within the questionnaire. The child domain includes 5 subscales to assess the characteristics and behaviors of the child that result in demands on the parents, with 4 items for each subscale. This includes specific behavioral dispositions of the child (distractibility/hyperactivity, adaptability, demandingness, and mood), as well as interactions between child and parental characteristics (parental acceptance). The parenting domain includes 7 subscales to assess limitations in parental functioning that affect the resources available to cope with the demands of parenting and caring for children, with 4 items per subscale. This includes specific behavioral dispositions of the parents (depression, parental competence and parental attachment), as well as their available resources (social isolation, partner relationship, health and personal limitations). The instrument has been validated on German samples of 0.5-21-year-old children and their parents and German normative scores for mothers aged between 20 and 53 years are available [23]. For this study, parenting stress will be explored using the total score. In an exploratory manner, the 5 subscales of the child domain and the 7 parental domains will be analysed separately as well.

Sociodemographic variables and covariates

At T0, sociodemographic characteristics and relevant covariates that have been identified in advance through a literature review are collected, including household size (“How many people live in your household all the time, including yourself?”, “Do other children live in your household besides the child with whom you are participating in our study?”; [24]), parental education (“What is your highest educational achievement?”; [24]), parental income (“Approximately what is the total average monthly net income of your household?”; [25]), relationship conflict between parents and parental separation (“Which marital status describes you best?”, “How would you describe your satisfaction with your relationship?”; [26,27]), sleeping together in the same bed (assessed through the SI-KJ; [28], child media use before bedtime (“How often does your child use electronic media before sleeping?”, “What electronic media does your child use before sleeping?”; [29]), and presence of media in the child’s sleep environment (“Is there electronic media in your child’s room?”, “What electronic media is in your child’s room?”; [30]). Covariates are assessed by categorial variables.

Sample size

With regard to the required sample size, two factors were considered in the present study: The Aumio app for the children and the parent training. For the parent training, we first considered effects on child outcomes as a basis for sample size calculation. An average effect size of parent training of d = 0.20 was found in a meta-analysis on the effectiveness of family-based prevention interventions [31]. An average effect size of d = 0.21 of universal prevention programs was found in a meta-analysis on German-language effectiveness research [32]. Based on these findings, with an assumed power of.90, an alpha error level of.05, and an effect size of.21, a required sample size of 196 was calculated using the software g*Power [33].

Considering the drop-out rate (DOR) observed in the unpublished master’s theses on the Aumio app, this was also considered for sample calculation. In one of the most recent master’s theses on the effectiveness of the Aumio app, a drop out of 57.14% was found in the treatment group. Based on an expected DOR of 0.57, the number of cases is multiplied by the correction factor 1/(1-DOR) [34]. If the previously calculated sample size is increased by the expected DOR, a final required sample size of 456 is needed.

Recruitment and treatment allocation

Participants are recruited and allocated consecutively. Study participants are mainly recruited through the Aumio app. After downloading the app in the app store, five percent of new users are offered the chance to enrol in the study before they start using the app for the first time. Recruitment will be augmented by advertisements in pediatric clinics and online, where a link to the website in the survey platform for informed consent is provided. If parents are interested in the study, they will be redirected to a dedicated page within the app. On this page, both children and guardians receive information about the opportunity to participate in the study. Participants are informed about the purpose and process of the survey, as well as possible advantages and disadvantages of participating. They will be informed that participation in the study is completely voluntary and that participation can be terminated at any time without giving reasons. Furthermore, participants will be informed about their rights regarding data storage, data protection and data deletion. Informed consent will be obtained from both guardians and children in child-friendly language.

Plans to promote participant retention and complete follow-up

In return for participating, participants will receive free access to the entire Aumio app for one year. They also receive a 30 euro shopping voucher for completing the last survey (T2).

Relevant concomitant care permitted or prohibited during the trial and Provisions for post-trial care

Participation in the current study does not affect any potential concomitant treatment during the study period. All participants will receive contact information of the study team and will be able to access evidence-based informational materials on infant sleep through the Aumio website at any time.

Data collection and management

Plans for assessment and collection of outcomes.

The collection of the questionnaire data will be done using the German server of Tivian GmbH (UniPark), which specialises in the secure collection of data in the field of research and is certified with ISO 27001 by the German Federal Office for Information Security.

Data management.

The data of the questionnaires and the data of the app are collected separately, and the assignment is only possible via an assignment list, which are exclusively encrypted and password-protected and stored locally in separate folders. The hard drive will be located at Freie Universität Berlin.

No sensitive, personal data is collected via the Aumio app, but only data that has a technical background (e.g., device identification and information, language, etc.) and represents user behaviour (e.g., number and duration of app use). Furthermore, the data is only collected under a pseudonym, which is created by the participants themselves at T0. The pseudonym consists of the first two letters of the participant’s first name, the last two digits of their current ZIP code, and the first two letters of the name of the participant’s first child.

Confidentiality.

The data is only accessible to the study team. In addition, the data from Unipark and the data from the survey are assigned via an assignment list. This is password-protected, encrypted and only accessible to the study team. The data obtained are merged and then analysed completely anonymously. It is not possible to draw conclusions about individual persons. The data are only evaluated as a whole. All data are only stored locally or on a hard disk (as a back-up) in a password-protected manner. The required password is only accessible to the study team. The study team agrees to maintain confidentiality about personal data and to comply with the Federal Data Protection Act. No personal data will be passed on to third parties or published.

Statistical methods

Statistical methods for primary and secondary outcomes.

Descriptive methods including the calculation of appropriate summary measures of the empirical distribution (mean, standard deviation, median, minimum and maximum for continuous variables, and frequency in percentages for categorical variables) and specification of missing observations are used to present socio demographic data, feasibility, acceptability (with the Aumio app and the email course) and data on app use. In addition to the quantitative analysis of feasibility and acceptability, open-ended responses will be examined for recurring themes and categorized in a structured manner to provide additional context and insight into user experiences.

Preliminary intervention effects on the outcomes are analyzed by repeated measures ANOVA. Furthermore, the study will explore the relationship between the intensity of use and the outcomes. This analysis will involve both app usage as continuous measure, and categorization of the intensity of use into four levels (e.g., 12, 18, 24, and 30 uses during the intervention period). We will assess whether significant effects on the outcomes are observed at different levels of app use. All statistical analyses will be performed using R.

Interim analyses.

No interim analyses on treatment effectiveness will be conducted

Methods for additional analyses

Additional analyses will be conducted to examine whether effects differ between groups with different sociodemographic characteristics, e.g., household size, parental education, parental income, relationship conflict between parents, parental separation, co-sleeping and media use. We will therefore evaluate the effects of including sociodemographic characteristics as covariates in an analysis of covariance (ANCOVA).

Methods in analysis to handle protocol non-adherence and any statistical methods to handle missing data

Multiple imputation methods are used to estimate missing data. The trial is supervised by the evaluation team, which is the contact for reporting of any adverse event.

Adverse event reporting and harms.

We expect no adverse events, as the interventions and assessment tools imply neither burden nor risks. However, in case of spontaneously reported adverse events like increased psychological burden, the families can contact the study team at any time and in case any adverse event is reported, it will be followed up and necessary steps will be taken.

Frequency and plans for auditing trial conduct.

No audits are planned

Plans for communicating important protocol amendments to relevant parties.

Any deviations from or changes to the protocol will be documented. Significant changes will be reported to the Ethics Committee of the Freie Universität Berlin and documented in the German Clinical Trials Registry.

Dissemination plans.

The results of the study will be submitted for publication in relevant journals and on the Aumio website.

Discussion

The aim of the present pilot study is to test the feasibility, acceptability and preliminary efficacy of a German-language audio-based app for improving child sleep quality in combination with a parent-centred email psychoeducation module. Results will inform a future randomized-controlled clinical trial and for future modifications of the interventions. The significance of the present study lies in the pressing need for research in the field of mhealth interventions targeting child sleeping problems. While there are a high number of apps available that claim to help children in falling asleep and improving their sleep, most only offer white noise or soothing music and do not specifically address sleep habits [35]. Moreover, there is a scarcity of evidence-based and app-based interventions for children in general. Many apps promote improved sleep onset, well-being, and sleep habit development without incorporating evidence-based behavioural strategies [35]. Filling this gap using a large sample is a strength of the present study.

A limitation of the study design is the way in which the secondary user-centred objectives are collected. These are exclusively collected retrospectively in the third-party report by one parent. In particular, children’s sleep quality is not recorded in self-report. This approach may overlook potential cases of sleep problems in children, as highlighted by Paavonen et al. [36], who suggest that one-third of such cases may go undetected if only parents are surveyed. Therefore, it would have been beneficial to include both children’s and guardians’ perspectives in assessing children’s sleep. Due to the target group of children aged 6–12 years, sufficient reading skills are not to be expected in a comparatively large number of cases until the age of 7 or 8 years. Another limitation is the use of subjective, parent reported methods for assessing children’s sleep, without incorporating objective measures. Subjective methods for data collection depend on self-reported information and may be influenced by biases or inaccuracies [37]. Objective methods that directly measure sleep and recovery function and thus provide indirect information about sleep quality were not used [37]. In particular, discrepancies in the recording of total sleep time and wake after sleep onset have been reported in several studies [38]. This inconsistency must be considered when interpreting the data and highlight the need for a comprehensive approach that combines subjective and objective measures to obtain a more accurate understanding of sleep. Future studies should consider incorporating children’s self-report and guardians report as well as objective measures of sleep to provide a more comprehensive assessment of sleep quality.

Lastly regarding the analysis of the preliminary efficacy, the study design of the present research project, the single-group pre-post design, must be considered critically in itself. The methodological weaknesses were summarised by Maier-Riehle and Zwingmann [39]. First, the effect sizes cannot be interpreted causally because the observed changes are not exclusively attributed to the intervention but also to other confounding causes. In addition, different calculation methods are proposed for determining effect sizes in the single-group pre-post design. As a result, effect sizes are not comparable among each other and lead to different patterns of results. Last, it should be noted that Cohen’s limits of interpretation cannot be invoked when interpreting effect sizes, as these are based on independent samples and provide an overly optimistic measure in designs without a control group. No alternative limit of interpretation for effect sizes in single-group pre-post designs has been established at this time [39]. Nevertheless, the inclusion of covariates which possibly influence the primary and secondary outcomes aims to provide a more detailed picture of the preliminary efficacy of the Aumio app and can further prepare a larger, RCT with the focus on testing the efficacy of the Aumio app.

Conclusion

In conclusion, the present pilot and feasibility study has the potential to address the existing research gap regarding app-based interventions for improving infant sleep. Through this study, insights into the feasibility and acceptability can be gained. Furthermore, initial insights on preliminary efficacy of such interventions in real life settings can be gained and a foundation for future work with more advanced and controlled study designs can be laid.

Acknowledgments

None.

Trial status

Protocol version number and date: 12.12.2024 version 3

The start date of the recruitment: 24.07.2023

Approximate date of recruitment completion: 31.12.2023

References

  1. 1. Lewien C, Genuneit J, Meigen C, Kiess W, Poulain T. Sleep-related difficulties in healthy children and adolescents. BMC Pediatr. 2021;21(1):82. pmid:33593333
  2. 2. Fricke-Oerkermann L, Lehmkuhl G. Schlafstörungen [Sleep disorders]. In: Schneider S, Margraf J, editors. Lehrbuch der Verhaltenstherapie [Textbook of behavioural therapy]. 3rd ed. Berlin, Heidelberg: Springer; 2019. pp. 785–808. https://doi.org/10.1007/978-3-662-57369-3_43
  3. 3. Schlieber M, Han J. The role of sleep in young children’s development: a review. J Genet Psychol. 2021;182(4):205–17. pmid:33825621
  4. 4. Armstrong JM, Ruttle PL, Klein MH, Essex MJ, Benca RM. Associations of child insomnia, sleep movement, and their persistence with mental health symptoms in childhood and adolescence. Sleep. 2014;37(5):901–9. pmid:24790268
  5. 5. Cassoff J, Wiebe ST, Gruber R. Sleep patterns and the risk for ADHD: a review. Nat Sci Sleep. 2012;4:73–80. pmid:23620680
  6. 6. Dewald JF, Meijer AM, Oort FJ, Kerkhof GA, Bögels SM. The influence of sleep quality, sleep duration and sleepiness on school performance in children and adolescents: a meta-analytic review. Sleep Med Rev. 2010;14(3):179–89. pmid:20093054
  7. 7. Meltzer LJ, Westin AML. Impact of child sleep disturbances on parent sleep and daytime functioning. In: El-Sheikh M, editor. Sleep and development: familial and socio-cultural considerations. Oxford: Oxford University Press; 2011. pp. 113–32. https://doi.org/10.1093/acprof:oso/9780195395754.003.0006
  8. 8. Varma P, Conduit R, Junge M, Lee VV, Jackson ML. A systematic review of sleep associations in parents and children. J Child Fam Stud. 2021;30(9):2276–88.
  9. 9. Coles L, Thorpe K, Smith S, Hewitt B, Ruppanner L, Bayliss O, et al. Children’s sleep and fathers’ health and wellbeing: a systematic review. Sleep Med Rev. 2022;61:101570. pmid:34896729
  10. 10. Möhler E, Simons M, Kölch M, Herpertz-Dahlmann B, Schulte-Markwort M, Fegert JM. Diagnosen und Behandlung (unbegleiteter) minderjähriger Flüchtlinge [Diagnosis and treatment of (unaccompanied) refugee minors]. Z Kinder Jugendpsychiatr Psychother. 2015;43(6):381–83. pmid:26602042
  11. 11. Zhu H, Xiao L, Tu A. Effectiveness of technology-based interventions for improving sleep among children: a systematic review and meta-analysis. Sleep Med. 2022;91:141–50. pmid:35305528
  12. 12. Chung A, Jin P, Kamboukos D, Robbins R, Blanc J, Jean-Louis G, et al. Out like a light: feasibility and acceptability study of an audio-based sleep aide for improving parent-child sleep health. Int J Environ Res Public Health. 2022;19(15):9416. pmid:35954773
  13. 13. Hiscock H, Ng O, Crossley L, Chow J, Rausa V, Hearps S. Sleep Well Be Well: pilot of a digital intervention to improve child behavioural sleep problems. J Paediatr Child Health. 2021;57(1):33–40. pmid:32770791
  14. 14. Owens JA, Spirito A, McGuinn M. The Children’s Sleep Habits Questionnaire (CSHQ): psychometric properties of a survey instrument for school-aged children. Sleep. 2000;23(8):1–9.
  15. 15. Schlarb A. Fragebogen zu kindlichen Schlafgewohnheiten Children Sleep Habits Questionnaire (CSHQ-DE) [Questionnaire on children’s sleep habits Children Sleep Habits Questionnaire (CSHQ-DE)]. In: Schulz H, Geisler P, Rodenbeck A, Deutsche Gesellschaft für Schlafforschung und Schlafmedizin, editors. Kompendium Schlafmedizin [Compendium of sleep medicine]. Landsberg/Lech: ecomed; 2016.
  16. 16. Schlarb AA, Schwerdtle B, Hautzinger M. Validation and psychometric properties of the German version of the Children’s Sleep Habits Questionnaire (CSHQ-DE). Somnologie. 2010;14(4):260–6.
  17. 17. Lehmkuhl G, Agache A, Alfer D, Fricke-Oerkermann L, Hentzel C, Mitschke A, et al. SI-KJ: Schlafinventar für Kinder und Jugendliche [SI-KJ: Sleep inventory for children and adolescents]. Manual. Göttingen: Hogrefe Verlag; 2015.
  18. 18. Ravens-Sieberer U, Bullinger M. Assessing health-related quality of life in chronically ill children with the German KINDL: first psychometric and content analytical results. Qual Life Res. 1998;7(5):399–407. pmid:9691720
  19. 19. Ravens-Sieberer U, Bullinger M. News from the KINDL-Questionnaire – A new version for adolescents. Qual Life Res. 1998; 7:653.
  20. 20. Ellert U, Ravens-Sieberer U, Erhart M, Kurth B-M. Determinants of agreement between self-reported and parent-assessed quality of life for children in Germany-results of the German Health Interview and Examination Survey for Children and Adolescents (KiGGS). Health Qual Life Outcomes. 2011;9:102. pmid:22111939
  21. 21. Ravens-Sieberer U, Ellert U, Erhart M. Gesundheitsbezogene Lebensqualität von Kindern und Jugendlichen in Deutschland [Health-related quality of life of children and adolescents in Germany]. Bundesgesundheitsbl. 2007; 50(5):810–8. doi: https://doi.org/10.1007/s00103-007-0244-4.
  22. 22. Abidin RR. Parenting Stress Index. 4th ed. Lutz, FL: PAR; 2012.
  23. 23. Tröster H. Eltern-Belastungs-Inventar (EBI). Deutsche Version des Parenting Stress Index (PSI) von R.R. Abidin [Parenting Stress Inventory (EBI). German version of the Parenting Stress Index (PSI) by R.R. Abidin]. Göttingen: Hogrefe Verlag; 2011.
  24. 24. Hill TD, Burdette AM, Hale L. Neighborhood disorder, sleep quality, and psychological distress: testing a model of structural amplification. Health Place. 2009;15(4):1006–13. pmid:19447667
  25. 25. McDowall PS, Galland BC, Campbell AJ, Elder DE. Parent knowledge of children’s sleep: a systematic review. Sleep Med Rev. 2017;31:39–47. pmid:26899741
  26. 26. El-Sheikh M, Sadeh A. I. Sleep and development: introduction to the monograph. Monogr Soc Res Child Dev. 2015;80(1):1–14. pmid:25704732
  27. 27. Rudd BN, Holtzworth-Munroe A, D’Onofrio BM, Waldron M. Parental relationship dissolution and child development: the role of child sleep quality. Sleep. 2019;42(2):zsy224. pmid:30452761
  28. 28. Peng X, Yuan G, Ma N. Cosleeping and sleep problems in children: a systematic review and meta-analysis. Sleep Biol Rhythms. 2019;17(4):367–78.
  29. 29. Falbe J, Davison KK, Franckle RL, Ganter C, Gortmaker SL, Smith L, et al. Sleep duration, restfulness, and screens in the sleep environment. Pediatrics. 2015;135(2):e367-75. pmid:25560435
  30. 30. Van den Bulck J. Media use and dreaming: the relationship among television viewing, computer game play, and nightmares or pleasant dreams. Dreaming. 2004;14(1):43–9.
  31. 31. Weiss M, Schmucker M, Lösel F. Meta-Analyse zur Wirkung familienbezogener Präventionsmaßnahmen in Deutschland [Meta-analysis of the impact of family-related prevention measures in Germany]. Z Klin Psychol Psychother. 2015;44:27–44. doi: https://doi.org/10.1026/1616-3443/a000298
  32. 32. Beelmann A, Pfost M, Schmitt C. Prävention und Gesundheitsförderung bei Kindern und Jugendlichen [Prevention and health promotion for children and adolescents]. Eur J Health Psychol. 2014;22:1–14.
  33. 33. Faul F, Erdfelder E, Buchner A, Lang A-G. Statistical power analyses using G*Power 3.1: tests for correlation and regression analyses. Behav Res Methods. 2009;41(4):1149–60. pmid:19897823
  34. 34. Hennig M. Fallzahladjustierung im Rahmen von klinischen Studien [Case number adjustment in the context of clinical studies]. Dissertation. Technische Universität Dortmund; 2002. https://doi.org/10.17877/DE290R-14909
  35. 35. Simon SL, Kaar JL, Talker I, Reich J. Evidence-based behavioral strategies in smartphone apps for children’s sleep: content analysis. JMIR Pediatr Parent. 2022;5(1):e32129. pmid:35238787
  36. 36. Paavonen EJ, Aronen ET, Moilanen I, Piha J, Räsänen E, Tamminen T, et al. Sleep problems of school-aged children: a complementary view. Acta Paediatr. 2000;89(2):223–8. pmid:10709895
  37. 37. Heitmann J, Cassel W, Ploch T, Canisius S, Kesper K, Apelt S. Messung von Schlafdauer und Schlafqualität [Measurement of sleep duration and sleep quality]. Bundesgesundheitsbl. 2011;54(12):1276–83. pmid:22116477
  38. 38. Tremaine RB, Dorrian J, Blunden S. Subjective and objective sleep in children and adolescents: measurement, age, and gender differences. Sleep Biol Rhythms. 2010;8(4):229–38.
  39. 39. Maier-Riehle B, Zwingmann C. Effektstärkevarianten beim Eingruppen-Prä-Post-Design: Eine kritische Betrachtung [Effect size variants in the one-group pre-post design: a critical review]. Rehabilitation. 2000;39(4):189–99. pmid:11008276