Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Using a Respectful Approach to Child-centred Healthcare (ReACH) in a paediatric clinical trial: A feasibility study

  • Analise Nicholl ,

    Contributed equally to this work with: Analise Nicholl, Kate Evelegh

    Roles Formal analysis, Investigation, Methodology, Writing – original draft, Writing – review & editing

    a.nicholl@ecu.edu.au, nicholl@bigpond.net.au

    Affiliation School of Medical and Health Sciences, Edith Cowan University, Joondalup, Perth, Western Australia, Australia

  • Kate Evelegh ,

    Contributed equally to this work with: Analise Nicholl, Kate Evelegh

    Roles Investigation, Methodology, Writing – original draft

    Affiliation School of Medical and Health Sciences, Edith Cowan University, Joondalup, Perth, Western Australia, Australia

  • Kane Evan Deering,

    Roles Investigation, Writing – review & editing

    Affiliation School of Medical and Health Sciences, Edith Cowan University, Joondalup, Perth, Western Australia, Australia

  • Kate Russell,

    Roles Conceptualization, Methodology, Writing – review & editing

    Affiliation Peaceful Parents, Confident Kids, Toowoomba, Queensland, Australia

  • David Lawrence,

    Roles Validation, Writing – review & editing

    Affiliation Faculty of Arts, Business, Law and Education, Graduate School of Education, University of Western Australia, Perth, Western Australia, Australia

  • Philippa Lyons-Wall,

    Roles Supervision, Writing – review & editing

    Affiliation School of Medical and Health Sciences, Edith Cowan University, Joondalup, Perth, Western Australia, Australia

  • Therese Anne O’Sullivan

    Roles Conceptualization, Methodology, Supervision, Writing – review & editing

    Affiliation School of Medical and Health Sciences, Edith Cowan University, Joondalup, Perth, Western Australia, Australia

Abstract

Background

There is a growing momentum in paediatric ethics to develop respectful research and healthcare protocols. We developed, tested and refined our ‘Respectful Approach to Child-centred Healthcare’ (ReACH), to underpin respectful participant interactions in a clinical trial.

Objective

To determine whether a ReACH-based approach is acceptable to children and parents, and effective in obtaining compliance with common healthcare assessments in a clinical trial of healthy 4-6-year-old children.

Methods

ReACH-based child assessments were evaluated at two baseline clinics and one post-intervention, using mixed methods. Children (n = 49; 46.9% female; mean age = 5.24±0.88 years at baseline) and their parents provided independent evaluation, via customised 5-point Likert scales and qualitative feedback. A dedicated child researcher evaluated adherence to the study ReACH principles.

Results

Children achieved compliance rates of 95% for body composition (BodPod) assessments; 89% for blood pressure measurements, and 92% (baseline) and 87% (post-intervention) for blood draws. Adherence to ReACH principles during clinic visits was positively associated with child compliance, significantly for baseline BodPod (p = 0.002) and blood test (p = 0.009) clinics. Satisfaction with BodPod protocols was positively associated with compliance, for children at baseline (p = 0.029) and for parents post-intervention (p <0.001). Parents rated the study itself very highly, with 91.7% satisfied at baseline and 100% post-intervention. Qualitative feedback reflected an enjoyable study experience for both parents and children.

Conclusions

Adherence to our emerging ReACH approach was associated with high child compliance rates for common healthcare assessments, although no causality can be inferred at this preliminary stage of development. Participants expressed satisfaction with all aspects of the study. Our use of child-centred methods throughout a research intervention appears feasible and acceptable to children and their parents.

Introduction

There is a growing momentum in paediatric ethics to develop respectful research and healthcare protocols, based on the rights of the child. Children are a vulnerable population, entitled to protection from unnecessary medical procedures, fear and pain, according to the United Nations Convention on the Rights of the Child [1]. However, societal concerns and parental emotional involvement can act to delay or prevent certain types of paediatric research [2], effectively denying sick children their entitlement to access evidence-based treatment [1].

According to the Declaration of Helsinki, all population groups should have equal access to appropriate participation in medical research [3]. However, treatments for children have often been adapted from those for adults, with limited testing [4] for their safety, efficacy or even acceptability to children, in effect creating ‘therapeutic and pharmaceutical orphans’ [5, 6]. In the USA, the National Institutes of Health prioritise child participation in clinical trials, as the developing bodies and brains of children respond to medicines and treatments differently to adults [7]. The field of child health needs more successful and well-designed clinical trials to grow the paediatric evidence-base [8]. Hence, the USA and Europe have legislated that children must be included in clinical and pharmacological trials [9, 10].

Despite legislation and growing international consensus that it is vital to include children of all ages in research [11], application has been limited. This may be in part because it has traditionally been easier and more economical to apply adult knowledge and treatments to children as though they were small adults [12]. Ethical issues such as questionable assent, physical and/or mental risk and discomfort can be particularly compromising for young children, especially if they do not directly benefit from the research [1316].

While due care needs to be given to children’s preferences in healthcare [8], depending on their competence [17], there are currently few practical solutions in the literature for optimising the child’s experience during common assessments. Of these, blood tests and needle procedures, in particular, can have lasting negative effects on children, with on-going consequences such as increased anxiety, distress and reduced healthcare follow up [18, 19]. Fear of needles or injections (trypanophobia) has been variously reported as 22–75% of the paediatric population, depending on age, health and frequency of needle-procedures [20]; needle fear can adversely affect both children and parents [20, 21], as we found in our own pre-trial community consultation [22]. Children can feel intimidated by unfamiliar faces as well as settings [23].

Child dissent is another factor that has to be considered. Dissent can be assumed if, for example, a child’s behaviour varies substantially from normal during a health procedure: this can include non-verbal cues such as exhibiting passivity, or refusing to make eye-contact with a healthcare worker or researcher [4, 24, 25]. Such workers may not be trained to recognise all signals of child distress in anticipation of, or participation in, such a procedure, and hence may not regard this as genuine dissent [15]. Overriding a child’s expressed preferences can affect their behaviour, and could result in psychological harm, but harm is less likely when the concept of dissent is considered in risk/benefit calculations [24].

Another ethical issue encountered in paediatric research is obtaining informed assent from the child, which differs from the informed consent legally required from parents. When the child gives an affirmative response, as opposed to failing to object, it is referred to as ‘assent’–asking for a formal signature is not required [24]. The ethical issue of appropriate developmental age for such assent is also controversial [7]. Currently, consent must be given on a child’s behalf by at least one legal guardian [3]. Such ‘surrogate’ or ‘proxy’ parental consent is challenging, as parents trying to act in the best interests of their children often worry their decisions may harm or disadvantage their child [2, 13, 26, 27], which can affect objective decision-making.

In practice and in policy, healthcare settings can benefit from active and respectful consideration of children’s preferences. However, there is limited information on how to include this kind of approach in research and healthcare protocols. We found little current evidence of community or stakeholder consultation [2830], of plans to maintain participant engagement [31], and of qualitative research to improve clinical trial design [32, 33], particularly in the paediatric setting.

Nursing models of care, such as patient-, family- and child-centred care, appeared a promising basis for improved child participation in the healthcare setting; however, relevant application of such models in specific paediatric research or healthcare settings was relatively rare at the time of our study, with translation from theory to practice noted to have unintentional consequences, such as providing barriers to child or family participation in the care process [17, 25, 30, 34, 35].

Although family-centred models of care operate with collaboration between health care professionals and parents [36], the focus can move away from the patient, and the child can be excluded from even a limited input into their own care [17]. Some children have expressed feeling marginalised by health professionals, researchers and their parents, noting in healthcare settings that these adults may talk around them, rather than to them, or offer ‘choices’ that are then disregarded [30, 34]. Such difficulties and controversies experienced in family-centred care have led to preferences for a more inclusive focus on the child as being central to the family unit of care: this emerging field, focus, framework or model is increasingly referred to as child-centred care [17, 25, 36].

As our preferred approach of child-centred care was more theoretical than practical, or even a model, when we began our research, we investigated a respectful model of child-centred care used in the practical child-care setting. Resources for Infant Educarers (RIE)TM was developed by child-care specialist Magda Gerber for parents and families of very young children in day-care, based on the work of Hungarian paediatrician Emmi Pikler in improving the care of institutionalised children by childcare professionals [3739]. This approach places emphasis on the caregiver developing a cooperative relationship with the child, rather than using authority or incentives. Three underlying principles appeared particularly relevant for child health interventions: using authentic communication, acknowledging emotions and inviting participation.

We consulted a childcare specialist who uses and teaches practical applications of this approach, to inform development of research strategies and assessments grounded in these principles. Our aim was to find practical ways to address several theoretical aspirations, such as how to validate the research experience for the child, and to provide a research environment conducive to play to help reduce anxiety and assist the child to feel in control [22, 23, 39]. With proper application, a child-focused approach could lead to increased acceptance of health assessments by children, improved research participation rates and greater interest in health and science from a young age. In light of current trends and legislation in paediatric ethics, improving child research methods could also help increase traditionally low rates of child participation in trials and increase their access to evidence-based healthcare [16].

We used the above considerations to develop, test and refine our own paediatric model, a Respectful Approach to Child-centred Healthcare (ReACH). In seeking to maintain the child participant as the centre of our focus, while allowing for full participatory partnership with their parents [17]—or child-centred care with positive aspects of family-centred care [35]—our model can be seen to be strongly influenced by Bronfenbrenner’s ecological model of child development [40, 41]. This model places the developing child at the centre of a nested range of settings, from the immediate family setting, through interactions with direct and indirect layers of family, social and cultural settings, and also considers the way changes in these larger settings over time can influence the developing child.

Our design of child-centred assessments also considered findings from our community consultation with parents [22] in developing appropriate procedures and resources for our clinical trial. We aimed to examine whether incorporating our emerging ReACH approach into a paediatric clinical trial would prove acceptable to child participants and their parents, with the secondary outcome of whether clinic ReACH adherence could be associated with child compliance with common health-related assessments. We believe our results from this feasibility study give preliminary support to the value of using a child-centred approach, but the approach needs further refinement and testing, in both the research and healthcare settings.

Materials and methods

The Milky Way Study is a double-blind randomised controlled trial (RCT) investigating the effects of dairy fat on cardiometabolic and gut health in young West Australian children. It was prospectively registered with the Australia New Zealand Clinical Trials Registry as ACTRN12616001642471 [https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=371803]. The clinical trial involved clinical assessments at two baseline clinic visits, a dairy intervention of three months and repeat assessments at one final clinic visit; follow-up procedures three months later were home-based. The Milky Way Study was approved by the Edith Cowan University (ECU) Human Research Ethics Committee (Project no. 14990), and any specific participant details or images included in this publication have complied with the following provision: ‘the individual in this manuscript, or their legal guardian, has given written informed consent (as outlined in PLOS consent form) to publish these case details’. Recruitment took place over the first nine months of 2017; all Milky Way Study clinic visits were held from January-December 2017. The CONSORT flow diagram for the clinical trial is represented in Fig 1.

thumbnail
Fig 1. Flow diagram for the Milky Way Study, detailing study participant recruitment, randomisation and retention pre- and post-intervention (intervention duration = three months).

https://doi.org/10.1371/journal.pone.0241764.g001

Subjects

Healthy children aged 4–6 years were eligible for recruitment into the Milky Way Study if they were daily consumers of whole fat dairy products, living within 20 km of the ECU Joondalup campus and able to attend three clinic visits on campus. Children were excluded for recent antibiotic use and having a body weight lower than 9.5 kg: guidelines for total blood volume that can safely be taken from children stipulate age-related body weights [42]. Forty-nine children met these criteria and were enrolled as participants in the clinical trial.

Study design

We used a mixed methods study design to evaluate our Respectful Approach to Child-centred Healthcare (ReACH) over all Milky Way Study clinic visits. A ReACH researcher rated adherence to the approach at each session. Participants and their parents were asked to provide independent evaluations of each clinic visit, scored via customised 5-point Likert scales. Qualitative feedback was recorded from structured discussions with children, open-ended questions in parent surveys and discussions with parents at study clinic visits.

The United Nations Convention on the Rights of the Child [1] has been a key influence on models of paediatric participation and care [17, 25, 35], including development of a Council of Europe model for child participation and associated Child Participation Assessment Tool [43]. Child-centred care appeared to offer us an improved focus on the child compared with a specifically family-centred model of care [17, 35, 36]. Initial development of our ReACH approach involved consultation with a childcare specialist on the practical application of three key principles from the Gerber-Pikler RIETM approach, as used and taught in the childcare setting [3739]. These were incorporated into the Milky Way Study clinical trial protocol as an aspirational base for applying a respectful child-centred approach throughout all child interactions and assessments. Development, application, evaluation and refinement of our ReACH model show strong influences of the Bronfenbrenner ecological model of child development [40], in which the perceptions and interactions of the developing child can be seen as affected by a range of environmental settings, including the family ecology, and their changes over time [41].

Recruitment

Parents who expressed interest in enrolling their child(ren) in the study were contacted by telephone to discuss the study in further detail. We designed all recruitment materials in accordance with the study ReACH principles. Study ReACH resources emailed to all enrolled families included information and education aimed both at the level of the child and of caregivers:

  • A Parent Information Leaflet and a copy of the Informed Consent form, to complement previous information, answer early questions and avoid study process misunderstandings [22, 27, 44]
  • A pictorial Child Information Leaflet, featuring all assessments, as part of our age-appropriate informed assent process [11, 45]
  • A link to a five-minute video on the Milky Way Study Facebook page [https://www.facebook.com/milkywaystudy/videos/402125510141202/], which used a guided tour to provide information about each clinic visit [45], including child discussion after procedures. This kind of approach has been recommended by both children and parents to inform multimedia websites that help children decide about clinical trial recruitment [28].

These materials helped prepare children to meet their child-focused clinic ReACH researcher and the research team; provided visual details of assessment rooms and equipment, and pointed out their personal contribution to research.

Informed consent and assent

To build familiarity and establish trust, we had the same two-person team of a child-focused ReACH researcher and a lead researcher present at all clinic visits with the same family wherever possible [16]. The rationale behind having the same ReACH child researcher present was to build and maintain a trusting relationship with each child, maintain child focus during all assessments and to advocate for them at all times. Caregivers [hereafter referred to as ‘parents’, as there was always at least one attending parent at clinics] were given time to ask questions before signing informed consent.

Australian ethical guidelines consider 4–6 year-olds too limited in understanding and capacity for discussion to give meaningful assent [7, 24]. We investigated whether application of our respectful approach might provide a pathway to informed assent by our participants, within the bounds of our study.

Incorporating ReACH principles into the Milky Way Study

Our ReACH philosophy and principles, as developed and refined over study clinical assessments, have been summarised in Box 1. Contributing sources are discussed and cited in the text, as appropriate.

Box 1. A Respectful Approach to Child-centred Healthcare (ReACH) principles and philosophy

Philosophy

  • Children have the same rights and needs to participate in research as adults, but with all the protections from exploitation that should be afforded any vulnerable group
  • Children have the right to direct informed assent to procedures and risks, to the extent of their developmental maturity rather than a specific age
  • Parents/caregivers are always to be respected as an authority on their own child

Principles

  • Use authentic communication
  • Acknowledge emotions
  • Invite participation

Application

  • Appropriate information and education should be provided in advance at the level of both the child and the caregivers
  • Avoid distracting children from understanding what is happening, or offering them incentives to participate in assessments
  • Paediatric healthcare workers should be trained to recognise verbal and non-verbal dissent, and researchers, in particular, should not continue if the child remains unwilling after a suitable pause to explore their understanding of the procedure

Recommendation

  • Healthcare and research institutions should have an appropriate, child-centred ethical model or code of practice that promotes these fundamental rights of the child

ReACH mission statement: Respect our young participants at all times

We embedded three key ReACH principles [38] into all our clinics:

  1. Use authentic communication (honest explanations about why a test is needed, and what to expect, can empower the child).
  2. Acknowledge emotions (acknowledge the child’s feelings are valid, including fear)
  3. Invite participation (young children can participate by conducting a similar test on a teddy bear or toy, or by helping set up machines or equipment where suitable).

Each clinic was run by a lead researcher, known to the parent from recruitment. In many instances parents brought in older and/or younger siblings, affecting researcher focus in each case. While our primary focus at all clinics was our child participants, it was also important to maintain parent engagement over the length of a study with considerable parental burden. This included advocating for a balance between acknowledging familiar parenting behaviour and authority [18, 23, 46], and study ReACH principles.

We developed a ReACH strategy to try to maintain ‘confident momentum’ following child assent. We defined this as allowing for individual engagement and comfort with the research experience, but keeping the overall experience moving forward at a reassuring pace, to minimise doubt and maintain confidence in the researchers.

In line with recommendations from our pre-trial community consultation focus groups, the study had a space-themed approach [22]. This was based on the appearance of our BodPod (see equipment and assessment details below), and aimed to boost participant engagement [31] by increasing the sense of fun of the experience.

Clinical assessments

To allow adequate time for familiarity, we split baseline assessments over two clinic visits. We ran a single follow-up clinic, as children had already performed all the assessments at baseline and therefore did not need additional time for awareness and understanding. Fuller details of development and incorporation of ReACH principles into Milky Way Study procedures are given in S2 File. At the start of each clinic visit, the child and their ReACH researcher had around 15–20 minutes of ‘settle-in’ playtime. This allowed the ReACH researcher time for sensitive observation of the child, and allowed the child time for familiarisation with the clinic setting and the day’s assessments [23]. Each clinic had a pictorial schedule of assessments, a chart with detachable photographs that could be pulled off and posted in a special post-box when each assessment was completed, as shown in Fig 2. (The legal guardian of the participant in this figure has given written informed consent (as outlined in PLOS consent form) to publish these details). This acted as a timeline for the session. We considered our combination of pre-education, playtime, familiarisation and invited participation to be a respectful and appropriate level of informed assent.

thumbnail
Fig 2. ReACH resource showing the sequence of tests at a trial clinic visit, with detachable photographs able to serve as a visual guide both to test procedures and to track progress over the visit: From left to right photographs present represent assessment of weight, waist measurement and BodPod body composition analysis (top row); blood pressure, strength, blood test and ‘graduation’ certificate awarded after all clinics completed (lower row, cut off).

(Written informed consent has been provided by the legal guardian on behalf of the individual in these photographs (as outlined in PLOS consent form) to publish these case details. Fig 2 has been reprinted from [22] under a CC BY license, with permission from MDPI, original copyright 2018).

https://doi.org/10.1371/journal.pone.0241764.g002

Baseline body composition assessments.

The first clinic visit involved collecting anthropometric measurements, including weight and height; neck and waist circumference, and determination of body fat mass and fat-free mass; we also determined blood pressure. Body composition was measured in the BodPod (COSMED, Rome, Italy), as indicated in Fig 3. The study BodPod had a paediatric option (BodPod Pediatric OptionTM GS model, COSMED USA Inc., San Francisco, CA), which included a seat for children less than 6 years.

thumbnail
Fig 3. Excerpts from the Milky Way Study Child Information Leaflet: Upper: Astronaut training in the Bod Pod.

The Bod Pod uses non-invasive air-displacement to measure body composition (lean mass and fat mass). Participants need to sit inside during testing, and there is a paediatric seat for children under six years of age. Lower: Having blood samples taken. (Pages reproduced from the Milky Way Study Child Information Leaflet. Fig 3 was previously published as two separate figures, and has been reprinted from [22] under a CC BY license, with permission from MDPI, original copyright 2018).

https://doi.org/10.1371/journal.pone.0241764.g003

Blood pressure measurements were taken in the BodPod after three to five minutes at rest, using a calibrated Dinamap ProCare 300 Monitor (GE Medical Systems, Tampa, Florida) with an appropriate paediatric cuff. We provided an authentic explanation for all procedures, with key examples provided in Box 2.

Box 2. ReACH-based explanations and basic strategies used in clinical assessments

After assessments, a choice of breakfast items was offered to all children, and the participant chose a small thank-you gift from a selection of items. The child was not aware of the thank you gift beforehand, to avoid this acting as an undue incentive.

Baseline blood test.

The second baseline clinic visit required a fasting blood test. Application of anaesthetic patches is recommended to prevent child needle fear [21, 23, 47], and this was endorsed by parents at our pre-trial community consultation [22]. However, we considered it respectful to give children an informed choice. EMLA (AstraZeneca, Sweden) numbing patches were optimally applied to both inner arms, to allow the phlebotomist a choice of the best venipuncture site. Package instructions and our own in-house tests established that a 50-60-minute wait was needed for local cutaneous absorption and optimal numbness. A potential disadvantage was that the EMLA active ingredients, lidocaine and prilocaine, may have a side-effect of vein-shrinkage.

After children complained about painful removals of the anaesthetic patches, we added an adhesive-removal solvent wipe to the process (Smith & Nephew REMOVE Adhesive remover, St-Laurent, Canada. Ingredients: isoparaffin, dipropylene glycol methyl ether, aloe extract, benzyl alcohol, fragrance). The EMLA anaesthetic patches were largely effective at eliminating pain, but not feelings of touch or needle insertion. We made this distinction clear to the children and their parents prior to the test [23].

We employed an experienced paediatric phlebotomist, following our community consultation finding that most parents considered this the best guarantee of a good child experience [22]. By minimising both physical and psychological harm, and keeping the child and their parent informed and involved in the moment, we hoped that the children would feel they were doing something worthwhile even if it meant some discomfort [15]. In order to empower children who expressed fear about the test, we acknowledged their feelings and reassured them that the ReACH researcher had a strategy previously used to help other study children, placing them in charge of their own feelings. Children were not held down, as was the current accepted practice in paediatric phlebotomy at the time of writing [23, 48], but given the option of sitting with their parent if they preferred (as described in Fig 3). Our ReACH strategy for blood tests hence incorporated a combination of pharmacological and psychological approaches, ongoing monitoring of the participant and invited participation of the child and their parent in the way we implemented the blood test [49].

Final body composition and blood test assessments.

The third clinic, held after three months of dairy intervention, incorporated all previous assessments. As per baseline procedures, we sent text and email reminders to help prepare the child and their family, and reviewed the day’s procedures at the start of the clinic [50], using the pictorial schedule shown in Fig 2.

Additional ReACH strategies and tools

Enablers and barriers.

Parents offering their children incentives to participate in assessments is ethically dubious. It may cause some children to believe there is something to fear about doing the assessments, thereby increasing the child’s anxiety and reducing the likelihood they will complete the assessment. Paediatric healthcare workers should be trained to recognise verbal and non-verbal dissent [15], and researchers, in particular, should not continue if the child remains clearly unwilling after a suitable pause to explore their understanding of the procedure [24]. Practical incorporation of ReACH principles into child assessments made us expand our ideas of incentives as ‘bribes’ or ‘distractions’, concepts often used interchangeably in the literature [23, 24], to incorporate the behavioural concepts of positive and negative reinforcement [51]. These were investigated for impact on our ReACH-based assessments.

We defined a bribe as a parent offering a form of positive reinforcement, such as a treat or reward for later (delayed gratification). Similarly, a distraction was defined as a parent offering any form of negative reinforcement that could break eye-contact with the researcher, trust and/or session momentum. Our ReACH approach was designed with the belief that distracting a child before they are fully ready for a procedure can result in a sudden awareness, such as finding a needle in their arm without warning, which could negate choice, validation of the experience and informed assent.

Study confident momentum tools included the age-appropriate explanations and basic strategies shown in Box 2. An iPad mini electronic touch screen tablet, programmed with space-themed and educational games, was initially used with the first 7% of children to undergo baseline assessments, particularly in the BodPod as the rocket ship ‘on-board computer’, to help keep children relaxed during the assessment [22, 52], but it proved too distracting.

ReACH Adherence Tool.

The ReACH researcher assessed adherence to the child-centred approach during each clinic visit. Seven key principles were used to develop the tool’s adherence categories for our study: mutual trust, respect, sensitive observation, quality care-giving, a prepared environment, time for uninterrupted play and consistency [23, 39]. The ReACH Adherence Tool comprises 13 questions, as shown in Box 3. Application enabled the ReACH researcher to maintain a consistent clinical schedule, while tailoring each clinic around the specific characteristics of the child [45].

Box 3. ReACH Adherence Tool for the child researcher to evaluate adherence to ReACH principles and the study protocol during each clinic visit. A score of 13 implies very high adherence

A Respectful Approach to Child-centred Healthcare (ReACH) Adherence Checklist

For application by ReACH Researcher at each child-centred clinic visit

TRUST

  1. Researcher’s trust in child’s competence to complete session using
    ReACH approach only Confident (1) Little/ no trust (0)
    Parent and child anxiety levels gauged on arrival and acknowledged by providing more time for introductions / play / session information as required
  2. Distraction from parent None (1) ≥ 1 distraction (0)
    E.g. ‘Don’t look’ when child is distressed/ offers video clip on mobile phone / holds child’s head to look away
  3. Bribe from parent None (1) ≥ 1 distraction (0)
    E.g. If you do this ‘I’ll take you to (restaurant)’ / ‘I’ll buy you
  4. Distraction from researcher None (1) ≥ 1 distraction (0)

AUTHENTICITY (Communication with child is honest, upfront and genuine)

  1. 5. Study information/ video shown to child before assessments Yes (1) No (0)
    Procedures explained via video / easy and engaging visual tools
  2. 6. Researcher honest about potential discomfort Yes (1) No (0)
    Explore visual and sensory explanations, e.g. ‘Some children say they feel some pressure, others say they don’t feel anything at all. Would you like me to show you on my arm? [If yes, Researcher applies pressure with fingernail onto own arm.] ‘You can try it on your arm, and tell me how it feels’
  3. 7. Researcher uses authentic language and tone Yes (1) No (0)
    Speaks authentically and explains procedures using simple photographic/ visual devices and open discussion (no baby talk, forced games or other placating examples)
  4. 8. Protocol went according to plan, as initially described to child Yes (1) No (0)
    Where protocol deviates, Researcher stops, acknowledges and explains the discrepancy before seeking child’s approval to continue

OBSERVATION (Sensitive observation for insight into child’s needs)

  1. 9. Researcher focus Yes (1) No (0)
    Researcher watches for and acknowledges distress cues, particularly when the child looks to the Researcher during explanations and procedures; maintains eye contact throughout procedures where has promised to do so
  2. 10. Researcher finds insights into child’s personality, to reach them on their level and make connection(s) Yes (1) No (0)
    During play time each child can form a unique connection with the Researcher. This develops and strengthens as the Researcher applies the ReACH approach, particularly if the child is interested in the research

ENVIRONMENT

  1. 11. Safe to express feelings Feelings not investigated (0) Feelings investigated / acknowledged (1)
  2. 12. Playtime allowed <15 mins (0) ≥15 min (1)
  3. 13. Control of play (child instigates) Researcher led (0) Child led (1)

Child Comfort Evaluation Tool.

The ReACH researcher developed a customised, laminated evaluation tool for each clinic visit, to assess child comfort (or satisfaction) with clinic procedures and assessments. This was derived from a combination of two tools validated for pre-assessment of dental anxiety in young children, the 7-faces Revised Smiley Faces Program, for computer application in children aged 4–11 years [53], and the recommended alternative for paper-based assessment, the 5-faces version of the Modified Child Dental Anxiety Scale, for children aged over five years [54]. Assessment and interpretation of pain in young children have traditionally been regarded as difficult [47], and there is as yet no validated scale for children less than six years to report acute pain, such as needle pain [55]. The study Child Comfort Evaluation Tool gave each child the opportunity to identify the appropriate face on a 5-faces Likert smiley-face assessment scale, placed opposite a colour photograph of each procedure in that clinic, as shown in Fig 4 (the legal guardian of the participant in this figure has given written informed consent (as outlined in PLOS consent form) to publish these details).

thumbnail
Fig 4. Child Comfort Evaluation Tool for self-evaluation of comfort and satisfaction with Milky Way Study clinic sessions and assessments.

This figure is similar but not identical to the original image used in the study and is provided for illustrative purposes only. (Written informed consent has been provided by the legal guardian on behalf of the individual in these photographs (as outlined in PLOS consent form) to publish these case details).

https://doi.org/10.1371/journal.pone.0241764.g004

Evaluation of how we operationalized ReACH principles into practice

We attempted to evaluate the feasibility and appropriateness of the developing ReACH approach at both study time points. The ReACH researcher used the ReACH Adherence Tool (Box 3) to rate trust, authenticity, observation and environment via a binary response to each question: 1 (yes) or 0 (no). All scores were added to form a total adherence score, where a value closer to 13 implied highly satisfactory adherence to study ReACH principles.

Additionally, we asked both child and parent to provide feedback after each clinic visit, using the Child Comfort Evaluation Tool (Fig 4) and parental evaluation forms, making it clear to the children that their views and experiences were valued [11]. To overcome early response bias, or social desirability bias, we refined the child evaluation process as a quiet colouring-in activity after breakfast, with the child and their parent engaged at separate tables. Children appeared to rate each activity and assessment with due consideration, offering reasoned feedback and practical improvements to the ReACH researcher afterwards. Children rated their feelings about each of the appropriate clinic visit procedures under the following headings: 1) Study information; 2) Application of EMLA patches; 3) Toys and playtime; 4) Warm-up activity (decorating a star for the Milky Way Study ‘Wall of Fame’ opposite the BodPod); 5) ‘Astronaut Training’ BodPod and blood pressure assessments; 6) Blood test; 7) Breakfast choices afterwards, and 8) Choosing a gift. Child scores were assessed as big smile = 5 to big frown = 1, with a straight mouth/ undecided = 3.

Quantitative components of parent evaluations were based on responses via a customised 5-point Likert scale (5 = strongly agree to 1 = strongly disagree, with 3 = undecided). Qualitative evaluation included parents noting potential improvements, comparisons with previous blood tests and general comments. Questions used in the relevant evaluation forms are shown in Box 4. To reduce potential feedback bias, unidentified evaluation questionnaires were presented to parents in a plain envelope that was sealed after completion.

Box 4. Parent evaluation forms for post-clinic assessment of Milky Way Study procedures and ReACH protocol (quantitative responses invited by ticking the appropriate response against a 5-point Likert scale (5 = strongly agree to 1 = strongly disagree, with 3 = undecided); qualitative responses to be written in the space provided)

BodPod Body Composition Initial and Final Clinics

  • Q1: The Research Team and pre-preparation helped me feel reasonably comfortable with my child’s blood test experience
  • Q2: My child felt comfortable with the BodPod assessment
  • Q3: Communication was honest and child-friendly
  • Q4: I knew what was expected of me and my child
  • Q5: My child was given sufficient opportunity to participate in the BodPod experience
  • Q6: My child’s feelings were taken into consideration during testing
  • Q7: We will be willing to consider another BodPod assessment in 3 months’ time, at study end OR We would recommend participation to other families
  • Q8: Can you suggest any improvements we could make to BodPod Astronaut Training procedure that would make it a better experience for your child and/or you?

Blood Test Initial and Final Clinics

  • Q1: The Research Team and pre-preparation helped me feel reasonably comfortable with my child’s blood test experience
  • Q2: My child was willing to consider participation in the blood test [even if they didn’t go ahead]
  • Q3: Communication was honest and child-friendly
  • Q4: I knew what was expected of me and my child
  • Q5: My child was adequately prepared for the blood sample
  • Q6: My child was given sufficient opportunity to help in the set-up for the test
  • Q7: My child’s feelings were taken into consideration during the testing
  • Q8: We will be willing to consider another blood test in 3 months’ time, at study end [Initial test only]
  • Q9: If your child has previously had a blood test, how did this blood test experience compare? OR If your child participated in the baseline blood test, how did this blood test experience compare?
  • Q10: Can you suggest any improvements we could make to the blood collection procedure that would make it a better experience for your child and/or you?

Milky Way Study Process after Initial and Final Clinics and Dairy Intervention

  • Q1: The study process overall so far has been acceptable to me
  • Q2: The study process overall so far has been acceptable to my child
  • Q3: I am willing to consider participating in these clinics again with my child, at study end [initial clinic] OR I would be willing to do this study again, or to recommend it to other parents [final clinic]
  • Q4: I am willing to recommend the Milky Way Study to other parents [Initial clinic only]
  • Q5: Can you suggest any improvements we could make to the study to make it a better experience for you and/or your child?
  • Q6: If we wanted to ask a focus group of parents about ways to improve this study, would you be willing to be contacted to be part of this group, sometime in the next few years? [Final clinic only]

Statistical analyses

IBM SPSS Statistics for Windows, Version 26.0 (Armonk, NY: IBM Corporation, released 2019) was used for all data analysis. As we did not use a control group as a comparison for our ReACH approach, we were not able to assess potential causality; however, we were interested in investigating whether our adherence to the ReACH-based procedures (as assessed by our adherence tool) was associated with subject compliance. Participant and family descriptive statistics have been presented as mean (± standard deviation) for continuous variables (all normally distributed), and as counts and percentages for frequencies. Child success and compliance rates with assessments were additionally stratified by sex.

The ReACH approach was applied to participants across each clinic visit; all clinics were assigned a score out of 13 using the ReACH Adherence Tool. Feedback and regular researcher discussion informed small process improvements; if successful, they became part of all subsequent clinic visits. Effects on outcomes due to familiarity with the Milky Way Study environment and procedures are suggested by changes in ReACH adherence scores and/or child compliance with tests as each child progressed through the study. At each time point we separately considered possible associations of ReACH adherence scores (all normally distributed) for those children who complied, and those who did not, using independent sample t-tests or one-way ANOVA, as appropriate.

Children evaluated procedural satisfaction with clinic assessments by marking the Child Comfort Evaluation Tool Likert faces scale, while parents separately used Likert scales to rate agreement with questions about the study child-centred procedures. Due to high overall evaluation ratings, we attempted to calculate comparable satisfaction scores using a binary cut-off classifications of 1 = satisfaction and 0 = qualified satisfaction/ uncertainty and/or a level of dissatisfaction, using a Likert score cut-off midway between agree (smile) and strongly agree (big smile). We used chi-squared tests to look for associations of child compliance with 1) parent and child satisfaction with assessments, and 2) parental offered bribes and/or distraction of their children during BodPod and blood tests. Cramer’s V was squared to obtain the effect size of significant associations.

Missing data, due to child withdrawal, instrument malfunction and blood test non-compliance are accounted for in table counts and footnotes. We requested evaluation of all clinics, key assessments and components, whether or not they were successful: we averaged parental scores to cover missing components for any clinics, and for children we consulted researcher clinic notes, to determine a suitable evaluation score for missing components from comments provided. However, where blood assessments were refused in advance, both children and parents did not evaluate that component of the clinic. A significance level of p < 0.05 was applied to all tests.

Results

Participant characteristics

Milky Way Study researchers recruited and randomised 49 children (46.9% female) into two dairy groups. All children participated in at least one set of clinic visit evaluations. Children ranged in age from 4.06 to 6.97 years at the first clinic, with a mean age of 5.24 (± 0.88) years: girls = 5.16 (± 0.77), boys = 5.31 (± 0.97) years. Three children (two girls) were withdrawn by their parents during the study (drop-out rate of 6%), due to refusal of key assessments (n = 1), perceived parent burden (n = 1) and child refusal to continue the dairy intervention (n = 1). Table 1 shows child and parent characteristics and family sociodemographics.

thumbnail
Table 1. Milky Way Study participant baseline characteristics (n = 49).

https://doi.org/10.1371/journal.pone.0241764.t002

Participant compliance with clinical assessments

Assessment success and compliance rates for our three major assessments have been reported in Table 2. Child assessment success refers to successful completion of a clinical assessment. Child compliance refers to child preparedness to try the test on the day, even if no result was achieved due to unexpected circumstances, e.g. equipment failure, unsuitable veins. We have used child compliance rates in all evaluation analysis of our ReACH approach.

thumbnail
Table 2. Participant success and compliance rates for body composition (BodPod), blood pressure and blood samples at baseline and final clinic visits (three-month intervention).

Compliance is regarded as being willing to attempt a clinic assessment on the day.

https://doi.org/10.1371/journal.pone.0241764.t003

In a combined total of four cases (4.3% of the 94 participant attendances at all blood test clinics), the parent and/or child refused blood tests prior to the clinic (one child prior to both clinics, two children prior to the second clinic). These form a separate category of participant non-compliance, pre-clinic refusal, as the ReACH protocol was abbreviated and neither parent nor child evaluated this aspect of these clinics. Several blood tests were unsuccessful despite child compliance: in 10 cases (11.9% of 84 instances of compliance, or 10.6% of the 94 clinic attendances) the paediatric phlebotomist reported issues with unsuitable veins, the vein rolling or collapsing. In two cases (2.4% of total compliance) she subsequently achieved a successful draw from the second arm. Four children (4.8% of total compliance) refused initial or further attempts at a blood draw while in the phlebotomy room, and parents offered to bring them back for a second, successful attempt. In two of these cases at baseline the ReACH researcher was unable to be present, as these were rescheduled at the parent’s convenience; hence, clinic evaluation forms were not updated to reflect effects of the ReACH protocol on compliance, or satisfaction with this success.

Evaluation of the ReACH approach and application in assessments

Researcher evaluation.

Out of a maximum value of 13, the mean (± standard deviation) researcher-assessed ReACH adherence score from clinic visit one (baseline BodPod and blood pressure; n = 49 evaluated) was 10.16 ± 2.01(78.2% adherence); from clinic visit two (baseline blood test; n = 48 evaluated) the mean was 9.77 ± 2.30 (75.6% adherence), and from clinic visit three (all tests; n = 44 evaluated) the mean increased to 10.35 ± 1.48 (79.6% adherence).

Table 3 shows that higher scores for clinic ReACH adherence were associated with higher compliance with assessments. A positive association between ReACH adherence and child compliance proved significant for baseline BodPod (p = 0.002) and baseline blood test (p = 0.009) clinics.

thumbnail
Table 3. Associations of clinic ReACH adherence scores (out of a maximum of 13) with child compliance for assessments at baseline and final clinics.

https://doi.org/10.1371/journal.pone.0241764.t004

Child and parent evaluation.

Associations of child compliance with parent and child self-reported satisfaction at BodPod and blood test clinics are shown in Table 4. The majority of participants reported high levels of satisfaction with BodPod assessments at baseline (91.7% of children; 87.5% of parents) and final clinics (82.6% of children; 95.3% of parents), although five children (11%) were willing but unable to be assessed in the BodPod at the final clinic, due to equipment failure, which affected their clinic satisfaction ratings. Satisfaction was positively associated with compliance for children at the baseline BodPod assessment (p = 0.029), and for their parents at the final BodPod clinic (p < 0.001). Fewer children expressed satisfaction with blood tests at baseline (56.5% of children satisfied) and final clinics (58.1% satisfied) than their parents. Effect sizes were not considered meaningful owing to very low numbers of participants within certain groups in each analysis.

thumbnail
Table 4. Associations of parent and child self-reported satisfaction with child compliance at BodPod and blood test clinics, assessed using chi-squared tests and reported as numbers and percentages of the total.

https://doi.org/10.1371/journal.pone.0241764.t005

Parents rated the Milky Way Study itself very highly, with 44 (91.7%; n = 48 evaluations) satisfied at baseline, and 46 (100%) satisfied after the intervention and final clinic visit. Parents also provided informative and largely positive qualitative feedback relating to their child’s clinic visit and study experiences, with representative comments cited in Box 5.

Box 5. Representative parent comments on Milky Way Study clinics, assessments and the study as a whole, at baseline and/or post-intervention

BodPod Body Composition Parent Feedback

  • “Everything was great! Really made it easier on [my child] & myself!
  • “It was lovely. I really appreciated how [my child] was treated as someone who understood his body and study requirements rather than being treated as a baby”
  • [My child] was a little apprehensive after his first clinic but was able to go in the BodPod on the 2nd try & was very proud and happy once he had completed it”
  • “It was great! I wish everything they do [involving child health assessment] was like that”
  • “The team members were amazing—so understanding and great with both my kids [participant and younger sibling]
  • “I think it was very well organised and executed”
  • “No improvements required as everything was clearly explained & my child was respected & made to feel comfortable. As a result, he enjoyed the BodPod experience”

Blood Tests

  • “This was my child's first experience, and I couldn't ask for a better experience’
  • “Much more positive [than her previous experience with blood tests]. The numbing cream helped lots as well as letting her help with setup”
  • “It was great. My child enjoyed testing his blood”
  • “Even better than the last time he had a blood collection, he was confident–well prepared due to the researcher”
  • “Blood tests are difficult to do. My child had made up his mind from the start [not to do it] and he would not have changed his mind no matter what”
  • “Better [than her previous experience]: greater care with explanations, more time for her to familiarise herself with the room, personnel and procedure”
  • “His feelings, and fears, were fully taken into consideration, and previously the pain relief option wasn't given”
  • “Better [than previous experience] because the children knew what to expect”
  • “I loved the breathing and empowering thinking”
  • “New patches are much better than the first ones”
  • “The removal of the patch took longer but caused no pain as the researcher had explained. The patch removal was the only thing my child was concerned about”
  • “The second time a better experience in terms of patch being removed. In terms of the actual blood draw both times were a good experience–definitely helped by the use of the EMLA”
  • “This one was better. No pain. The new method of removing the EMLA patch worked well”
  • He was happier to do the baseline test. This time he was anxious and didn't want to go through with the test”

Milky Way Study after Initial and/or Final Clinics

  • “I think it’s excellent, very friendly and appropriate”
  • “You did a great job, and you covered all areas in a nice way”
  • “All good, she was excited to come here again today”
  • “I found the study very easy to do and will be fascinated to see the results”
  • “It was already a good experience. My child was respected and comfortable with the process”
  • “The study was good, and a good effort was made with dairy selections”
  • “The reminders were very helpful and reassuring. The rest of the study was great”

Effects of parental offered bribes and distraction on child compliance

Despite verbal and written information on application of the child-centred approach at assessments, 22 of 47 parents (46.8%) offered a bribe (n = 3; 6.4%), a distraction (n = 10; 21.3%) or both types of reinforcement (n = 9; 19.1%) to their child to participate in the baseline blood test. However, children who were not offered any type of parental reinforcement were more likely to be compliant with this blood test (p = 0.008). More parents offered such reinforcements at blood tests (46.8% at baseline and 35.7% post-intervention), than for the BodPod (28.6% and 13.3%, respectively), but there was lower compliance overall for the blood tests. Parents reduced the number of offered bribes and distractions at the final clinic visit.

Discussion

Child compliance with assessments

We investigated the feasibility and acceptability of the Milky Way Study Respectful Approach to Child-centred Healthcare (ReACH) approach, using child compliance with assessments (being willing to try on the day) as an appropriate measure of success in our study. By this definition, 95% of children were prepared to have their body composition assessed in the BodPod; 89% to have blood pressure measured, and 92% (baseline) and 87% (post-intervention) to have blood drawn at study clinics.

To enable blood draw comparisons with other studies, we need to consider rates of success rather than compliance: 77.1% of our study participants achieved a successful draw at baseline and 71.7% post-intervention. This is an excellent result, given that blood draws have been reported to fail in up to 44% of children across a variety of settings [48]. For comparison with reported ‘first attempt’ success, or a successful initial venous access on the day, we achieved rates of 70.8% at baseline and 65.2% at the final clinic, after removal of one participant per clinic who achieved a successful venous access via the second arm attempted, and two participants per clinic who achieved success at a follow-up appointment. On this basis, tertiary hospital phlebotomists achieved ‘first attempt’ success rates of 81.9% with Turkish inpatients aged 4–10 years (mean 7.2 ± 2.2 years; n = 155) [50]. In a Netherlands tertiary paediatric hospital, successful inner elbow venous access insertions, including cannulation, were reported for 78.0% of 3–11 year-olds in the operating theatre (n = 534), and for 76.9% in the outpatient unit (n = 91) [56]. However, in hospital-based studies success could be influenced by the theatre environment, including non-specialised phlebotomists and/or sedated children, while the need for treatment decisions around procedural schedules may have excluded consideration of child assent or dissent [56].

In our study, technical issues with locating suitable veins and parent-influenced child needle fear appeared the major reasons why child compliance did not always produce success, although EMLA product packaging noted a side-effect of vein-shrinkage. Our study phlebotomist reported 10 (12.2%) instances of difficult intravenous access among compliant participants, with two of these (2.4% of total compliance) achieving a successful draw from the second arm. Comparatively, market research into blood draws in children reported that 43% of children needed at least three needle sticks and 16% involved painful needle probing, or "fishing," to gain venous access [48].

In a paediatric hospital study, difficult vascular access and assessed Difficult Intravenous Access scores were found to be negatively correlated (p < 0.001 for both; n = 155) with first-attempt (on the day) venipuncture success among 4–10 year-old inpatients [50]. In findings similar to our own, this study noted that the major predictors of failure were the child’s fear, self-reported anxiety before venipuncture, and difficult vascular access. Another paediatric hospital study also appeared to support our findings, that increasing child age and phlebotomy practitioner were the major predictors of successful intravenous access [56]. However, this finding was for 3–11 year-old children in the operating theatre, where phlebotomy could be performed by a range of healthcare professionals, but not for those in outpatient care [56]. Additionally, duration of the most recent previous venipuncture procedure was found to adversely affect the success of subsequent blood draws [50]; this factor may have contributed towards our lower success rates at the final blood draws, by which time all compliant study children had attempted at least one previous blood test.

We did not allow restraint of any of our participants during blood tests. It has been estimated that 38% of 3–10 year-olds need to be physically restrained for a conventional, needle-based blood draw [48]; however, such restraint during procedures can also be proposed or initiated by the parents. In a Swedish hospital study into child participation in their own care (n = 32 children; total care procedures observed = 300), some parents were observed to lose patience, restrain their child themselves and urge the healthcare professional to proceed [25]. Nurses have described the loss of control experienced by restrained children as an ‘injustice’, potentially worse than the needle itself [23]. We believe that the compliance figures we obtained for our Milky Way Study participant blood draws without any such restraint show that a child-centred approach can form part of a medical phlebotomy protocol and achieve acceptable rates of success. Our ReACH approach included promotion of active coping behaviours in the children [45, 49, 57], with parents commenting favourably on researcher-led controlled breathing before the blood test (Box 4).

Evaluation of how we operationalized ReACH principles into practice

Researcher evaluation of our ReACH approach, as developed and applied within the Milky Way Study, showed that assigned clinic adherence scores improved slightly from baseline to final clinics, potentially as participants and researchers become familiar and more confident with the study proceedings. Our study included healthy children in the research setting. By comparison, researchers in Sweden observed and rated active child participation in their own hospital care, including emergency care, in 32 children (18 girls; mean age 8; age range = 2–18 years). Out of 300 optimal and non-optimal care situations, assessed from level 1 (healthcare worker does not listen to child’s opinions and wishes) to level 5 (healthcare worker acts in accordance with child’s opinions and wishes), 73 cases (24.3%) were rated as optimal care at level 4, and 153 cases (51%) at level 5. This suggests that optimal active child participation in their own care is possible in the majority of hospital care procedures, but specialist paediatric healthcare professionals need to receive appropriate training in child-centred care to achieve this goal [25]. If ‘non-optimal’ care at each level reflects a relative failure of healthcare professionals to appropriately engage the child in each case, this study appears to provide support not only for child-centred care [25] in general, but also for our three foundation ReACH principles [37, 38] around child communication, concerns and participation, summarised in Box 1.

Parents reported they were satisfied with the Milky Way Study protocol and clinical assessments: 87–95% of all parental baseline and final clinic assessment evaluations met or exceeded the satisfaction cut-off. Similarly, all parents evaluated indicated they were satisfied with the Milky Way Study as a whole after the final clinic visit. Representative qualitative comments noted in Box 4 appeared to endorse our key principles and application of the ReACH approach, as summarised in Box 1. We concluded that such direct and relevant feedback appeared to highlight the value of using pre-trial qualitative research [32, 33, 58] to inform our study methodology [22], stakeholder consultation and engagement throughout [28, 31, 45], and basing all study clinical procedures on a respectful approach that promotes the fundamental rights of the child in healthcare and research [11, 34]. As we found in our community consultation, parents valued consideration of the needs and preferences of their children [22, 59].

We observed a positive association between child satisfaction and compliance frequencies, significant for the baseline BodPod clinic assessment. We both anticipated, and observed, that many children were apprehensive about blood tests prior to and during the first blood test clinic. As has been trialled successfully in other child studies [53], we added a specific category for the blood test itself to our Child Comfort Evaluation Tool, to isolate the effects of venipuncture and associated discomfort from the remaining clinic procedures. Several children gave lower evaluation scores to their blood tests, and/or to application of EMLA patches, but rated the rest of these clinics highly; for us, the ultimate positive evaluation was that they appeared happy to return for follow-up. This has important implications in the healthcare setting, as a negative experience may affect future child willingness to actively participate in the procedure, with possible withdrawal, while a positive experience can improve future motivation and engagement [25]. Discussing these problems and our various improvements with the children built trust and allowed them to become stakeholders in improving the research experience [16, 18, 28, 60].

Parenting behaviours, needle fear and ReACH adherence

Overall, our analysis appeared to show that the majority of children were compliant when there was no bribe or distraction from the parent. We feel that this endorses further testing of the ReACH approach, and suggests that the child-centred education and advice we gave parents at baseline could be more strongly targeted in future application and investigation. Parents made fewer offers of reinforcement at the final clinic, possibly because they were becoming more accustomed to our study ReACH approach.

A variety of practical and psychological approaches have been used to help manage pain and/or associated anxiety in paediatric clinical procedures, such as psycho-education, play therapy, medical play, deep breathing and/or relaxation, comforting language, music, hypnosis and/or hypnotic suggestions of make-believe scenarios, filmed modelling of behaviours, cognitive behavioural rehearsal and therapy, and classical operant techniques such as positive and/or negative reinforcement [45, 49, 51, 57, 61]. To date, cognitive behavioural therapy and hypnosis alone have been considered to provide validated efficacy in pain management [49]. Psychological approaches used with children should promote self-control and encourage active participation in their own care [49]. However, care is recommended in dealing with accompanying parents, as parental emotions and attachment may affect the child’s coping mechanisms [57].

In our study, both distraction, known as negative reinforcement in the psychology behavioural literature, and, bribes, known as positive reinforcement [51], appeared to have a negative effect on child behaviour and to influence the child’s independent understanding of the situation. Refining application of our ReACH approach over the study has strengthened our belief that parents should avoid either type of manipulation, and the ReACH adherence tool scores both these aspects as zero. The ReACH researcher attempted to build a comfortable relationship with each child, using authentic explanations at eye level with the child to enhance trust. Crouching or kneeling to match position and establish eye contact, rather than towering over small children, has been recommended as critical in establishing trust ahead of medical procedures [57]. However well-intended, parents—possibly reacting instinctively and emotionally to a medical-type setting—could displace their child’s considered assent and trust in the healthcare professional or researcher with a distraction, by effectively removing their attention from the procedure. This could disrupt activation and enhancement of the child’s innate coping mechanisms [57], while negating both prior parental consent and child assent.

A particular issue with distraction proved to be our initial use of an iPad tablet programmed with space-themed activities. Some children became engrossed in the iPad, disrupting developing researcher engagement and trust. We consistently found that appropriate researcher explanations and continued engagement with each child filled waiting times and proved true to ReACH principles. In a rapidly progressing digital age, healthcare facilities aiming for a more child-friendly environment increasingly include digital games and touch screen devices, often presented on arrival to distract children from upcoming procedures. While agreeing that it should be a major therapeutic objective of hospitals to reduce anxiety and help children cope with the stress of upcoming procedures [45], we regard this development as an inappropriate use of negative reinforcement, and Australian ethical guidelines strongly discourage distracting children from understanding what is happening [7, 24]. We feel that our findings provide preliminary support for prioritising respectful child familiarisation, education and engagement as part of healthcare paediatric protocols; offers of digital device entertainment should be reserved for convalescence, or once the child is confident and knowledgeable about upcoming procedures. We did find the iPad useful for showing the children the study video in the initial warm-up time in the clinic visit if they had not already viewed it beforehand.

We observed several examples of negative reinforcement during blood tests, where parents did not ask but positioned smart phone videos between their child and the ReACH researcher or phlebotomist. This distracted the child, and consequently they were startled by the needle, and could jerk away and cry. Despite frequently mentioning their own fears of small spaces to us, parents made fewer attempts to distract their children from the BodPod than from blood tests. This suggests that parental needle fear may have strongly affected their attitudes and behaviours when their child had to undergo the procedure.

Child vaccinations can often result in needle fear, generally manifesting from around 5–10 years of age [21]. If not treated, the grown adult may model this fear to their children, and our community consultation revealed parent needle fear as a dominant theme [22]. A good argument has been made for consistent and appropriate pain management as the best way to break this generational cycle of needle fear [21, 47, 62], but application in the Australian healthcare sector mostly depends on parents purchasing and applying such anaesthetics. Although the use of topical anaesthetic appeared to reduce parent anxiety prior to blood collection, the 60-minute activation time seemed to heighten anxiety, and, potentially, anxiety-related pain [19] in the children. In previous research, fear and anxiety in children before venipuncture in the hospital setting was negatively correlated (p = 0.048; n = 155) with phlebotomy success [50].

We observed that parents openly well-disposed to research, and children who loved science, were the most likely to exhibit interest in the blood test instead of fear, with very high rates of compliance in these children. In our opinion, targeted parent education is needed to overcome deep-rooted needle fear, so that they can provide practical support to their children [23]. Research to improve paediatric venipuncture success rates could include onsite and/or online appropriate and respectful education of all parents and children before the first such procedure.

Developing a holistic child-centred approach

We aimed to develop a model that placed and maintained the child at the centre of our focus; that acknowledged the parent/caregiver/family as an authority on their own child [18], and that could apply across research and healthcare settings. We developed and refined the principles and philosophy of the ReACH approach over the course of our clinical trial, with the ultimate hope of extending and embedding this work into future research and healthcare provision [35].

The widely-favoured family-centred model of care can be applied imperfectly and inconsistently by different healthcare professionals [36], particularly problematic for hospitalised children [63]. This has resulted in unintended consequences for the child, such as effectively marginalising active participation in their own care [25, 30, 34], as well as for their care-givers, such as placing barriers to involvement, communication and role negotiation [36]. The emerging framework of child-centred care aligned well with our aims, as it focuses consistently on the child at the centre of the family, and attempts to reconcile the key strengths and challenges of family-centred care by allowing for a participatory partnership between the child, their parents and paediatric healthcare professionals trained in its use [17, 25, 35, 36].

We have discussed the Bronfenbrenner ecological model [40, 41] as a suitable theoretical model for a holistic child-centred approach across a range of paediatric settings. As we found, respectful paediatric research should, ultimately, be able to ease the interactive response of the child to unfamiliar faces and unfamiliar settings [23] through planning that includes family support from the earliest stages of recruitment and study information. Additionally, combining respectful observation of the engaged child and their family with study information on a range of family and cultural settings may help provide more objective and consistent researcher evaluation, and might help illuminate why participants and parents show different behaviours in the laboratory versus their home setting [40]. Issues of child behaviour and responses being affected by researcher observation is one definition of the so-called ‘Hawthorne effect’, which has been noted across study participation and evaluation for over 100 years, and should, potentially, be able to be refined and factored into current research [64]; better understanding of family dynamics might help control for responder bias in both participant and parental evaluation.

Informed assent and dissent

Current practice considers 7–9 year-old children to have acceptable developmental maturity to provide a satisfactory level of informed assent [8, 24, 62, 65]. However, in our experience children aged 4–7 years understood our explanations and resources, asking relevant questions and providing informed comments. We feel that our broader assessment of the emotional and developmental maturity of 4–7 year-olds is justified, at least where a consistent child-centred approach is applied and the concept of dissent is fully factored into the model [11, 13, 24]. Likewise, children as young as four years have appeared capable of sophisticated description, problem solving and decisional reasoning around treatment in a healthcare facility, when similarly provided with a secure and conducive environment [19, 60]. We consider that application of a child-centred approach, including pre-education, familiarisation, playtime and invited participation, could help formulate an appropriate and respectful level of informed assent for this age-group in research and healthcare settings.

Study strengths and limitations

Our feasibility study appeared to show positive associations between clinic adherence to ReACH principles and child compliance with body composition, blood pressure and blood tests. Final researcher assessment of ReACH adherence was not compared across study time-points, as changes incorporated were progressive over the year. We regard our high rates of compliance for these assessments as providing preliminary support for further testing of the ReACH approach in the research setting, while noting that associations could be bidirectional and that we do not suggest any causality. Our mixed methods approach combined analysis of quantitative process evaluation data, triangulated from three different stakeholder perspectives, and qualitative responses. Further research is necessary to assess any outcome or impact evaluation in the context of each paediatric setting.

To reduce potential feedback bias by parents, we provided them with unidentified evaluation questionnaires in a plain envelope to complete, seal and return, and instructions included an altruistic appeal to help improve our study for other children, and for research in general. We found that parental qualitative evaluation at both time-points included a mix of positives and constructive criticism. After observing that early child evaluation appeared distracted and aimed to please, we engaged the child and their parent simultaneously at separate tables during evaluation. In addition to a possible ‘Hawthorne effect’ [64] on each child due to researcher observation, we also had to factor in the family dynamics of parental observation and intervention on the child’s responses, as well as sibling distractions. In strengthening child focus on evaluating each clinic procedure, not just the assessments, our Child Comfort Evaluation Tool colouring-in activity appeared to ameliorate social desirability bias and to provide thoughtful and considered answers.

There were concerns that some parents misunderstood the study ReACH principles, despite supplying them with verbal and written information at several study time-points. When they opposed the approach at critical moments, such as hurrying a child who was not ready, this was noted to compromise ReACH adherence, child comfort and even compliance. In a few cases, parents who maintained a ‘gatekeeper’ (authoritarian) stance, by making firm decisions for their child when no assent was shown, misinterpreted our respectful approach as ‘mollycoddling’. Similarly, in the Swedish hospital setting, some parents were observed to be more involved in making decisions than their child in certain situations; and could be regarded as unsympathetic when they did not request or support their child’s requests for alternative solutions to painful and unpleasant procedures [25].

The ReACH adherence tool is subjective. The ReACH researcher carried out and assessed clinic visits using the tool, while the study chief investigator performed a check of ReACH adherence ratings for a sample of children across all clinics. As the ReACH researcher was both involved in running the sessions and scoring the session with the tool, this presents a risk of bias due to a potential conflict of interest. Future studies could investigate recording sessions and subsequent coding by an independent researcher, to help control for this potential source of bias.

The study design does not include a biochemical marker to validate observations, and further research might consider using salivary cortisol as an objective indicator of child anxiety or stress. Finally, this evaluation of ReACH has only been conducted in the setting of one clinical trial. Although results are promising, further research in additional trials is warranted to justify routine inclusion of ReACH in future paediatric research.

Conclusions

Our preliminary findings indicate that the ReACH approach is likely to be effective and acceptable, and justify further investigation in additional paediatric research. We suggest that researchers ensure that parents fully understand and accept this kind of approach prior to enrolling their children in child-centred research, and provide education around parental needle fear where required. Respecting our young participants at all times should be a core principle and a key promise across the full spectrum of child research and healthcare settings.

Supporting information

S1 File. Milky Way Study ReACH de-identified data.

https://doi.org/10.1371/journal.pone.0241764.s001

(XLSX)

S2 File. Detailed description on incorporating emerging ReACH principles into Milky Way Study clinics and specific child assessments.

https://doi.org/10.1371/journal.pone.0241764.s002

(PDF)

Acknowledgments

The authors would like to thank Julie Hill, who designed the illustrated Child Information Leaflet; developed and tested the initial BodPod protocol, and worked as a study research assistant. We gratefully acknowledge our child phlebotomist, Amber Harland, for her help in making blood tests a positive experience for the children. We are especially grateful to our dedicated team of Milky Way Study research assistants: Amy Kokkinos, Teresa Deering and Cory Wilson; research cadets: Avril Bezant, Drew Georgiades, Krystal Kotkis, Clare Richards and Corlize Lombard, and undergraduate volunteers, for help including clinic preparation, dairy product blinding and data preparation. Senior researchers, Prof Amanda Devine and Dr Claus Christopherson, provided practical advice and feedback. Finally, we would like to thank all our participating children, parents, grandparents and siblings for their active and enthusiastic participation in our research study.

References

  1. 1. United Nations Children's Fund [UNICEF]. United Nations Convention on the Rights of the Child Geneva: United Nations1989. p. 1–14.
  2. 2. Rentea RM, Oyetunji TA, Peter SDS. Ethics of randomized trials in pediatric surgery. Pediatr Surg Int. 2020. pmid:32394059
  3. 3. Declaration of Helsinki: ethical principles for medical research involving human subjects [Internet]. World Medical Association [WMA]. 2013 [cited December 10, 2019]. Available from: http://www.wma.net/en/30publications/10policies/b3/.
  4. 4. Caldwell PH, Dans L, de Vries MC, Newman J, Sammons H, Spriggs M, et al. Standard 1: consent and recruitment. Pediatrics. 2012;129 Suppl 3:S118–23. pmid:22661757.
  5. 5. Shirkey HC. Therapeutic orphans. J Pediatr. 1968;72(1):119–20. pmid:5634934.
  6. 6. Shirkey HC. Therapeutic orphans-everybody's business. Ann Pharmacother. 2006;40(6):1174. pmid:16735665.
  7. 7. National Health and Medical Research Council [NHMRC], Australian Research Council [ARC], Universities Australia [UA]. National Statement on Ethical conduct in Human Research 2007 [updated 2015, 2018]. In: NHMRC, editor. Canberra: Australian Government; 2018.
  8. 8. Lipstein EA, Brinkman WB, Fiks AG, Hendrix KS, Kryworuchko J, Miller VA, et al. An emerging field of research: challenges in pediatric decision making. Med Decis Making. 2015;35(3):403–8. Epub 2014/08/26. pmid:25145576; PubMed Central PMCID: PMC4336633.
  9. 9. Bosch X. Pediatric medicine. Europe follows U.S. in testing drugs for children. Science. 2005;309(5742):1799. pmid:16166486.
  10. 10. Steinbrook R. Testing Medications in Children. N Engl J Med. 2003;347(18):1462–70.
  11. 11. Neill SJ. Research with children: a critical review of the guidelines. J Child Health Care. 2005;9(1):46–58. pmid:15684439.
  12. 12. Klassen TP, Hartling L, Craig JC, Offringa M. Children are not just small adults: the urgent need for high-quality trial evidence in children. PLoS Med. 2008;5(8):e172. pmid:18700813
  13. 13. Brostrom L, Johansson M. Involving children in non-therapeutic research: on the development argument. Med Health Care Philos. 2014;17(1):53–60. pmid:23690163.
  14. 14. Edwards SD, McNamee MJ. Ethical concerns regarding guidelines for the conduct of clinical research on children. J Med Ethics. 2005;31(6):351–4. pmid:15923485
  15. 15. McIntosh N, Bates P, Brykczynska G, Dunstan G, Goldman A, Harvey D, et al. Guidelines for the ethical conduct of medical research involving children. Royal College of Paediatrics and Child Health: Ethics Advisory Committee. Arch Dis Child. 2000;82(2):177–82. pmid:10648379
  16. 16. Joseph PD, Craig JC, Caldwell PHY. Clinical trials in children. B J Clin Pharmacol. 2015;79(3):357–69. pmid:24325152.
  17. 17. Ford K, Dickinson A, Water T, Campbell S, Bray L, Carter B. Child Centred Care: Challenging Assumptions and Repositioning Children and Young People. J Pediatr Nurs. 2018;43:e39–e43. pmid:30172421.
  18. 18. Pope N, Tallon M, Leslie G, Wilson S. Why we need to research with children, not on children. JBI Database System Rev Implement Rep. 2017;15(6):1497–8. 01938924-201706000-00001. pmid:28628506
  19. 19. Pope N. Experiences of acute pain in children who present to a healthcare facility for treatment: a systematic review of qualitative evidence. JBI Database System Rev Implement Rep. 2017;15(6):1612–44. pmid:28628521
  20. 20. Orenius T, LicPsych , Säilä H, Mikola K, Ristolainen L. Fear of injections and needle phobia among children and adolescents: an overview of psychological, behavioral, and contextual factors. SAGE Open Nurs 2018;4:2377960818759442.
  21. 21. McMurtry CM, Pillai Riddell R, Taddio A, Racine N, Asmundson GJG, Noel M, et al. Far from “just a poke”: common painful needle procedures and the development of needle fear. Clin J Pain. 2015;31:S3–S11. 00002508-201510001-00003. pmid:26352920
  22. 22. Nicholl A, O'Sullivan TA. Keep calm and carry on: parental opinions on improving clinical dietary trials for young children. Nutrients. 2018;10(9). pmid:30149614; PubMed Central PMCID: PMC6163458.
  23. 23. Karlsson K, Rydstrom I, Enskar K, Englund AC. Nurses' perspectives on supporting children during needle-related medical procedures. Int J Qual Stud Health Well-being. 2014;9:23063. pmid:24646473; PubMed Central PMCID: PMC3955765.
  24. 24. Spriggs M. Understanding consent in research involving children: the ethical issues (a handbook for human research ethics committees and researchers). Melbourne: University of Melbourne; 2010 [cited 2019, February 2]. Available from: https://scholar.google.com/scholar_lookup?hl=en&publication_year = 2010&author = M+Spriggs&title = Understanding+Consent+in+Research+Involving+Children%3A+The+Ethical+Issues.
  25. 25. Quaye AA, Coyne I, Söderbäck M, Hallström IK. Children's active participation in decision-making processes during hospitalisation: An observational study. J Clin Nurs. 2019;28(23–24):4525–37. pmid:31430412
  26. 26. Fisher HR, McKevitt C, Boaz A. Why do parents enroll their children in research: a narrative synthesis. J Med Ethics. 2011;37(9):544–51. Epub 2011/04/12. pmid:21478415.
  27. 27. Shilling V, Young B. How do parents experience being asked to enter a child in a randomised controlled trial? BMC Med Ethics. 2009;10:1. pmid:19220889; PubMed Central PMCID: PMC2652490.
  28. 28. Martin-Kerry JM, Knapp P, Atkin K, Bower P, Watt I, Stones C, et al. Supporting children and young people when making decisions about joining clinical trials: qualitative study to inform multimedia website development. BMJ Open. 2019;9(1):e023984. pmid:30782720
  29. 29. Coyne I, Amory A, Kiernan G, Gibson F. Children's participation in shared decision-making: children, adolescents, parents and healthcare professionals' perspectives and experiences. Eur J Oncol Nurs 2014;18(3):273–80. pmid:24629505
  30. 30. Coyne I, Gallagher P. Participation in communication and decision-making: children and young people’s experiences in a hospital setting. J Clin Nurs. 2011;20(15–16):2334–43. pmid:21410571
  31. 31. Gillies K, Entwistle VA. Supporting positive experiences and sustained participation in clinical trials: looking beyond information provision. J Med Ethics. 2012;38(12):751–6. pmid:22875981
  32. 32. Lewin S, Glenton C, Oxman AD. Use of qualitative methods alongside randomised controlled trials of complex healthcare interventions: methodological study. Br Med J. 2009;339:b3496. pmid:19744976; PubMed Central PMCID: PMC2741564.
  33. 33. O'Cathain A, Thomas KJ, Drabble SJ, Rudolph A, Hewison J. What can qualitative research do for randomised controlled trials? A systematic mapping review. Br Med J Open. 2013;3(6):e002889. Epub 2013/06/26. pmid:23794542; PubMed Central PMCID: PMC3669723.
  34. 34. Coyne I. Children's participation in consultations and decision-making at health service level: a review of the literature. Int J Nurs Stud. 2008;45(11):1682–9. Epub 2008/08/19. pmid:18706560.
  35. 35. Coyne I, Hallström I, Söderbäck M. Reframing the focus from a family-centred to a child-centred care approach for children’s healthcare. J Child Health Care. 2016;20(4):494–502. pmid:27141084.
  36. 36. Shields L. What is “family-centred care”? Eur J Pers Cent Healthc. 2015;3(2):139–44. pmid:26609128
  37. 37. Gerber M. Dear parent: Caring for infants with respect. Weaver J, editor. Los Angeles, CA: Resources for Infant Educarers [RIE]; 1998.
  38. 38. Gerber M. The RIE manual: For parents and professionals: Resources for Infant Educarers; 2000.
  39. 39. Marlen D. All about…: Pikler. Nursery World. 2017;5:23–7. https://doi.org/10.12968/nuwa.2017.5.23
  40. 40. Bronfenbrenner U. The ecology of human development: Harvard university press; 1979. https://doi.org/10.1016/0006-8993(79)90419-0 pmid:83896
  41. 41. Bronfenbrenner U. Ecology of the family as a context for human development: Research perspectives. Dev Psychol. 1986;22(6):723–42. 1987-06791-001.
  42. 42. Howie S. Blood sample volumes in child health research: review of safe limits. Bull World Health Organ. 2011;89:46–53. pmid:21346890
  43. 43. Council of Europe. Child participation assessment tool. In: Council of Europe Children’s Rights Division and Youth Department, editor. Strasbourg, France: Council of Europe; 2016. p. 1–36.
  44. 44. Woolfall K, Shilling V, Hickey H, Smyth RL, Sowden E, Williamson PR, et al. Parents' agendas in paediatric clinical trial recruitment are different from researchers' and often remain unvoiced: a qualitative study. PLoS One. 2013;8(7):e67352. Epub 2013/07/12. pmid:23844006; PubMed Central PMCID: PMC3701006.
  45. 45. Capurso M, Ragni B. Psycho-educational preparation of children for anaesthesia: A review of intervention methods. Patient Educ Couns 2016;99(2):173–85. pmid:26603504
  46. 46. Piira T, Sugiura T, Champion GD, Donnelly N, Cole ASJ. The role of parental presence in the context of children's medical procedures: a systematic review. Child: Care Health Dev. 2005;31(2):233–43. pmid:15715702
  47. 47. Melhuish S, Payne H. Nurses' attitudes to pain management during routine venepuncture in young children. Paediatr Nurs. 2006;18(2):20–3. pmid:16544799.
  48. 48. Behm S, Dunn T. Blood draws: a mandate to improve patient experience [Medical Technology & Innovation]. Online: Beckers Hospital Review; 2016 [updated February 10, 2016; cited 2019 March 8]. Available from: https://www.beckershospitalreview.com/quality/blood-draws-a-mandate-to-improve-patient-experience.html.
  49. 49. International Association for the Study of Pain [IASP]. 2019 global year against pain in the most vulnerable: fact sheets on pain in the most vulnerable Washington DC: IASP; 2019 [cited 2019, June 9]. Available from: www.iasp-pain.org/GlobalYear?navItemNumber=580.
  50. 50. Gerçeker GÖ, Ayar D, Özdemir EZ, Bektaş M. The impact of the difficult vascular access, fear, and anxiety level in children on the success of first-time phlebotomy. J Vasc Access. 2018;19(6):620–5. pmid:29562830.
  51. 51. Passer MW, Smith RE. Psychology: the science of mind and behaviour. Australian ed. North Ryde, NSW.: McGraw-Hill Australia; 2013.
  52. 52. Marechal C, Berthiller J, Tosetti S, Cogniat B, Desombres H, Bouvet L, et al. Children and parental anxiolysis in paediatric ambulatory surgery: a randomized controlled study comparing 0.3 mg kg−1 midazolam to tablet computer based interactive distraction. Br J Anaesth. 2017;118(2):247–53. pmid:28100529
  53. 53. Buchanan H. Assessing dental anxiety in children: the Revised Smiley Faces Program. Child Care Health Dev. 2010;36(4):534–8. pmid:20184594.
  54. 54. Howard KE, Freeman R. Reliability and validity of a faces version of the Modified Child Dental Anxiety Scale. Int J Paediatr Dent. 2007;17(4):281–8. Epub 2007/06/15. pmid:17559456.
  55. 55. Birnie KA, Hundert AS, Lalloo C, Nguyen C, Stinson JN. Recommendations for selection of self-report pain intensity measures in children and adolescents: a systematic review and quality assessment of measurement properties. Pain. 2019;160(1):5–18. Epub 2018/09/05. pmid:30180088.
  56. 56. Cuper NJ, de Graaff JC, van Dijk ATH, Verdaasdonk RM, van der Werff DBM, Kalkman CJ. Predictive factors for difficult intravenous cannulation in pediatric patients at a tertiary pediatric hospital. Paediatr Anaesth 2012;22(3):223–9. pmid:21851476
  57. 57. Lang EV, Viegas J, Bleeker C, Bruhn J, Geert-Jan van G. Helping children cope with medical tests and interventions. J Radiol Nurs. 2017;36(1):44–50. pmid:28943814.
  58. 58. O’Cathain A, Goode J, Drabble SJ, Thomas KJ, Rudolph A, Hewison J. Getting added value from using qualitative research with randomized controlled trials: a qualitative interview study. Trials. 2014;15(1):215. pmid:24913438
  59. 59. Shilling V, Williamson PR, Hickey H, Sowden E, Beresford MW, Smyth RL, et al. Communication about children's clinical trials as observed and experienced: qualitative study of parents and practitioners. PLoS One. 2011;6(7):e21604. pmid:21765898
  60. 60. Pope N, Tallon M, Leslie G, Wilson S. Ask me: children's experiences of pain explored using the draw, write, and tell method. J Spec Pediatr Nurs. 2018;23(3):e12218–e. pmid:29790268.
  61. 61. Huth MM, Broome ME, Good M. Imagery reduces children's post-operative pain. Pain. 2004;110(1):439–48. https://doi.org/10.1016/j.pain.2004.04.028.
  62. 62. Modi N, Vohra J, Preston J, Elliott C, Van't Hoff W, Coad J, et al. Guidance on clinical research involving infants, children and young people: an update for researchers and research ethics committees. Arch Dis Child 2014;99(10):887–91. pmid:24914095.
  63. 63. Uniacke S, Browne TK, Shields L. How should we understand family-centred care? J Child Health Care. 2018;22(3):460–9. pmid:29347833.
  64. 64. McCambridge J, Witton J, Elbourne DR. Systematic review of the Hawthorne effect: New concepts are needed to study research participation effects. J Clin Epidemiol. 2014;67(3):267–77. pmid:24275499
  65. 65. Tait AR, Voepel-Lewis T, Malviya S. Participation of children in clinical research: factors that influence a parent's decision to consent. Anesthesiol 2003;99(4):819–25. pmid:14508312