Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Innovative protocol of an exploratory study evaluating the acceptability of a humanoid robot at home of deaf children with cochlear implants

  • Sabrina Stiti ,

    Roles Conceptualization, Formal analysis, Methodology, Software, Validation, Visualization, Writing – original draft

    sabrina.stiti@univ-tlse3.fr

    Affiliations Laboratoire Cognition, Langues, Langage, Ergonomie (CLLE), Université Toulouse Jean Jaurès & CNRS, Toulouse, France, Le Centre de Recherche Cerveau et Cognition (CerCo), Université Paul Sabatier & CNRS, Toulouse, France

  • Loïc Caroux,

    Roles Conceptualization, Funding acquisition, Methodology, Resources, Supervision, Writing – review & editing

    Affiliation Laboratoire Cognition, Langues, Langage, Ergonomie (CLLE), Université Toulouse Jean Jaurès & CNRS, Toulouse, France

  • Pascal Gaillard,

    Roles Conceptualization, Funding acquisition, Resources, Writing – review & editing

    Affiliation Laboratoire Cognition, Langues, Langage, Ergonomie (CLLE), Université Toulouse Jean Jaurès & CNRS, Toulouse, France

  • Pierre-Vincent Paubel,

    Roles Conceptualization, Resources, Software, Writing – review & editing

    Affiliation Laboratoire Cognition, Langues, Langage, Ergonomie (CLLE), Université Toulouse Jean Jaurès & CNRS, Toulouse, France

  • Olivier Deguine

    Roles Conceptualization, Funding acquisition, Methodology, Resources, Supervision, Writing – review & editing

    Affiliations Le Centre de Recherche Cerveau et Cognition (CerCo), Université Paul Sabatier & CNRS, Toulouse, France, Service D’oto-rhino-laryngologie, Oto-neurologie et O.R.L Pédiatrique, CHU Toulouse, Hôpital Pierre-Paul Riquet, Toulouse, France

Abstract

The purpose of this paper is to introduce a research methodology for the assessment of the acceptability of a humanoid robot at home for children with cochlear implants (CI). The quality of audiology rehabilitation for cochlear implanted child administrated at the hospital with pluri-weekly sessions is a major prognostic factor in the outcome on communications abilities, but represents also a constraint for families related to the access to care that are more difficult. Further, home training with tools would balance the equitable distribution of care in the territory and promote the child’s progress. The humanoid robot should allow an ecological approach to this complementary training. Before developing this approach, it is necessary to study the acceptability of the humanoid robot at home, both by cochlear implanted child and their families. Ten families were chosen to have a humanoid robot at home, to explore their acceptability of the humanoid robot Pepper. The study lasts for 1 month per participants (i.e. cochlear implemented children and parent). Participants were invited to use the robot at home as much as they want. The humanoid robot Pepper was able to communicate and proposed activities not related to rehabilitation. Once a week during the study, data were collected from participants (questionnaires and robot’s logs) and the smooth running of the study was checked. Questionnaires are used to evaluate the acceptability of the robot by children and parents. User data from the robot’s logs are used to quantify the time and the actual use of the robot over the period of the study. Results of the experimentation will be reported, once all 10 participants have completed their passation. The robot is anticipated to be used and accepted by children with cochlear implants and their families.

Clinical trial registration: Clinical Trials ID: NCT04832373; https://clinicaltrials.gov/.

1. Introduction

1.1. Rationale and background

According to the World Health Organization’s (WHO) world report on hearing, nearly 2.5 billion people worldwide will be living with some degree of hearing loss by 2050. Even in countries with relatively high proportions of ear and hearing care professionals, there is unequal distribution of specialists [1]. A medically underserved area is defined as a lack of access to practitioners, and the unequal distribution. Based on the WHO, around 34 million children worldwide live with disabling hearing loss, which affects their health and quality of life [1]. In this context, children with hearing impairment are one of the populations that suffer from medical desertification [1]. Cochlear implantation is the reference treatment for restoring hearing and promoting language development in children with total bilateral deafness that cannot be resolved. The invention of the cochlear implant has allowed deaf people to hear. It requires a surgical procedure, the indication for which is established through multidisciplinary consultation. More precisely, the cochlear implant is an instrument developed for people suffering from profound deafness. It provides access to sound using electrical stimulation to the auditory system. A child with a cochlear implant needs to learn how to identify sounds, locate their sources, recognize correlations between objects, and develop language abilities. The rehabilitation process for children with CI typically begins with learning to listen using the implant, without relying on lip-reading or with cued speech and then progressing to speaking and writing [2]. While speech therapy rehabilitation after surgery is effective, many parents struggle to continue this work at home. Family involvement in the rehabilitation process is a major prognostic factor for speech comprehension and language development after cochlear implantation [37]. However, children with cochlear implants may experience delays in the acquisition of reading, writing and social development, as well as deficits in visual-spatial-perceptual skills [6, 8]. Furthermore they tend to have low ability for problem-solving and logical thinking [3, 6, 811], which can impede their learning progress [7]. As a result, children with CI may require more attention and motivation for learning as they may become easily distracted and demotivated, when facing tasks that are beyond their ability level or that fail to capture their interest [9, 10, 12]. These difficulties have repercussions at the academic and social interaction [7, 13]. That’s the reason why, children with cochlear implants needs particular attention and a strict follow-up with evaluations and rehabilitations of hearing ability and speech intelligibility. Follow-up are carried out cooperatively by cochlear implantation team at hospital and speech therapist with pluri-weekly sessions in order for them to develop their cognitive abilities (e.g. auditory perception, speech comprehension and production, communication and language). Follow-up with pluri-weekly sessions represent a real constraint for families in term of time, number of rides and availabilities of families, so complementary home training work as a telemedicine service for speech comprehension and oral expression would balance the equitable distribution of care in the territory, decreased workload of families and should promote the child’s progress.

Even, the World Health Organization’s report on telemedicine, enhance that telemedicine has contributed to the quality and accessibility of health care [14]. Telemedicine can be defined by providing a medical care remote diagnosis and treatment of patients by means of telecommunications technology. For example, telemedicine has multiple applications and can be used for a variety of services, including wireless tools, email, two-way video and other methods of telecommunications technology. Telemedicine applications have successfully improved the quality and accessibility of medical care by allowing distant providers to evaluate, diagnose, treat, and provide follow-up care to patients [14, 15]. In fact, by increasing the accessibility of medical care, telemedicine can enable patients to seek treatment earlier and adhere better to their prescribed treatments [16], and improve the quality of life for patients with chronic conditions [14, 1618] such as children with cochlear implants [1922]. Indeed, cochlear implemented patients need to have their regular rehabilitation sessions, especially in infants and young children. For example, during the coronavirus (COVID-19) pandemic many parents couldn’t get an access to medical care for their children. Parents reported that cochlear implemented children rehabilitation was negatively affected [22]. In fact, the negative effect was mainly observed in their communication skills and ability of engagement in interactive activities [22]. If families could access to different types of telemedicine during pandemic or for areas lacking accessibility to medical care that would enhance follow-up of implanted children and avoid negative effect on their progress during rehabilitation.

So, one of a solution found to solve the lack of accessibility of medical care for implanted children, was the use of robots as one type of telemedicine that will provide a solution to the lack of practitioner and will solve mobility limitations [17, 23]. Indeed, social robots ’often represent technological solutions’, in the use of a technological approach to solve a pressing societal problem [24]. In the case of medical desertification, social robots will undeniably contribute to improving people’s quality of life [25]. In the field of health, robots are usually used to assist the independent living of people in situations of specific demand for assistance, to monitor the mental and physical well-being of patients [26, 27]. Social robots served as companionship, to provide comfort during check-up, increase well-being by reducing anxiety depression, fear, and pain, and also increase motivation, improve engagement, self-management and positive affect linked to healthcare intervention [23, 2833].

So how social robots in healthcare as a telemedicine’s tool, would be fully accepted and trusted by people implicated in the healthcare system (patient, their family and care staff). That’s the reason why, the aim of this paper is to introduced a research methodology for the assessment of the acceptability of a social humanoid robot at home for children with cochlear implants and their family for a long stay of 1 month. The duration of one month was chosen based on Wu et al.’s [34] method, which allowed participants to become familiar with the robot and provide a more accurate evaluation of its performance.

First of all, considering every children (with and without impairments), the attribution of human-like characteristics to robots could enhance children’s understandings of usability and facilitated the children-robot interactions [35]. But a limit to the level of human-likeness should not be crossed otherwise might fall into Mori’s "uncanny valley" [3638]. Mori’s theory postulates that the human appearance of robots is appreciated up to a certain point of similarity. Once the threshold is exceeded, to the point that the robot is so human-like in appearance as to be confusing, all the non-human aspects of the entity, triggered a feeling of strangeness. Thus, a robot with a human appearance will not be judged as a robot but as a human whose imperfections (slow movements, slow speech, wrinkles on the face) show that it is not acting in a normal way [38, 39]. The acceptability of social robots in various populations demonstrates that several types of factors need to be considered in order to foster user opinion and attitude [36, 37, 40, 41]. A review of the literature on the human response to assistive robots used in healthcare, shows that it is essential to consider both user factors and technology factors to promote acceptance [42]. There are 8 factors influencing user response to consider: age, needs, gender, experience with technology, cognitive skills, education level, anxiety level and initial attitude towards robots. In particular, participants’ initial attitude towards assistive robots would be a primary variable, with a participant’s positive attitude before an interaction with the technology being strongly correlated with a positive evaluation after the interaction [43].

Lastly, several researchers have investigated the use of robots for children who were deaf and implanted with cochlear implants or hearing aids [28, 4447]. For example, according to Uluer et al. [48], the view of a robot in an interactive social environment, induce for users an expectation of a socially intelligent and socially conscious level of behavior based on the capabilities of the robot and the parameters of human-robot interactions [6]. However, most users are inexperienced with robots, and may have special needs like deaf children with CI. As Ioannou and Andreva showed the integration of a humanoid robot for hearing-impaired children, as a supportive tool for learning through play, have encouraging preliminary results [45]. Also robot movements are more effective than telling a story [45]. Children would also found the quality of the interaction with physically embodied robots more enjoyable than virtually embodied agents [44]. Indeed, having physical contact with the robot plays an important role in interactions with the child [49]. Also, humanoid robot affords numerous research opportunities and can be personalized for each child. In the case of the personalization of humanoid robots for children with cochlear implant, it is important to consider those elements of the robot that meet their needs. A balance is required between meeting these needs and the ability of the robot. It will enhance exchange, cooperation and engagement between the child and the robot. It also helps in building a relationship between two entities [50].

Therefore, robotic technologies are expected to fit certain social norms in order to facilitate interaction. Measurement of the acceptability of a humanoid robot for children with hearing disabilities, must be evaluated based on basic skills they have to interact, like Cano et al. [10] evaluation method for children with CI on interactive products. Which were direct observation of the child, thinking aloud, drawing intervention [51], identifying an image on a picture card, wizard of Oz, fun toolkit [52] and surveys. This indicates that these metrics may vary depending on the user profile (e.g. level of attention span and cognitive skills) and the purpose of the evaluation (assessing the user experience, the satisfaction or the usability). Basically, for deaf children with CI starting to develop their abilities to speak intelligibility, the thinking aloud method wouldn’t be a wise choice due to the need of verbalization while completing a task [53]. The picture card method would also be avoided for children with low ability of logical thinking but would be recommended for children with difficulties to speak because it doesn’t implicated verbalization [9, 10, 54]. The need to established evaluation methods adapted to the level of difficulty for deaf children with CI is crucial to assessed the child-robot interaction [9, 10, 12]. However, we were unable to find any studies that had investigated long-term interaction between deaf children with CI and a robot. Even studies about how to evaluate the level of acceptability of deaf children with cochlear implant. That’s the reason why, the aim of this paper is to introduced a methodology for the assessment of the acceptability of a social humanoid robot at home for children with cochlear implants and their family for a long period of time of 1 month.

1.2. Aim of the study

While development of telemedicine can help reduce medical desert and contribute to faster care and better quality for patients, the objective of this paper is to introduce a new framework of research methodology to evaluate the acceptability of a humanoid robot at home for deaf children with CI and their family members [55]. In this study, we firstly used questionnaires assessing the acceptability of the social robot weekly (usability, usefulness, playfulness, intention to use, attitude toward using the robot, etc.), for children with CI which were adapted for their level of language development and also for family members. And finally, user data from the robot were also recorded in real-time and weekly collected (user identification, date and hour of use, applications launched). This study aimed to investigate the use and acceptance of a humanoid robot during a one-month stay at home by deaf children with cochlear implants and their family members.

2. Materials and methods

2.1. Populations

Participants will be limited to children with cochlear implant and their parents or legal guardians. The selected children are part of the cohort followed regularly by the doctors and speech therapists of the pediatric cochlear implant unit (UPIC) of the Toulouse University Hospital. 10 families will be selected for this study. Recruitment of families started in September 2021 and is ongoing.

2.1.1. Inclusion criteria.

Children and their parents or legal guardians will be chosen amongst firstly, children who showed optimal use of the cochlear implant, and secondly, family with a favorable environment evaluated by speech therapists with Moeller’s scale for family involvement [56]. The following inclusion criteria for children will be used: (1) children aged between 8 to 12 years old. (2) The child must have at least one cochlear implant. (3) Surrounded by a supportive family environment, (4) undergo speech therapy and (5) be monitored by the pediatric cochlear implant unit (UPIC) of the Toulouse University Hospital.

2.1.2. Exclusion criteria.

The following exclusion criteria will be used: (1) children with cognitive or psychological incapacity; (2) refusal to give informed consent; (3) sensory or motor deficits that may interfere with the use of the robot; (4) an unstable psychiatric condition; (5) and a child whose two parents benefit from a measure of legal protection.

2.2. Ethics statement

Participants gave their written informed consent to participate in this study. Parents signed a confidentiality agreement and a non-disclosure agreement for the study. Their participation will be voluntary and will not affect the healthcare process. The entire study will be conducted in accordance with the Declaration of Helsinki and all relevant guidelines and regulations covering respect for the rights and dignity of participants. To protect confidentiality, all subjects will be given unique subject IDs which will be used for all study documentation. Authors will not get access to information that could identify individual participants during or after data collection. This research has been registered in ClinicalTrials.gov (https://clinicaltrials.gov/), April 5, 2021, under no. NCT04832373. The study is promoted by the University Hospital Center (CHU) of Toulouse. The Ethics Committee for Human Research in Ile de France Region 1 N°IRB: IORG0009918 (Paris, France) approved the study under number: 21.03768.041844-MS02. Written informed consent will be obtained for every participant.

2.3. Material

2.3.1. Specifications of a humanoid Robot: Pepper.

Considering the various factors that needed to be taken into account for the acceptability of social robots in different populations, the robot Pepper was chosen as an adequate option for the aim of study [33, 36, 37]. Pepper is an autonomous humanoid robot designed and created by the French company Aldebaran (acquired in 2015 by SoftBank Robotics) [57]. The version of Pepper used was 2.5.5 and is controlled by a Linux-based operating system called NAOqi. Physically, Pepper have a height of 1210mm and a weight of 27,82kg which makes Pepper small in size. Pepper was also selected because of a tablet of 10” fixed on its chest, which give a visual support and an alternative option to users, to answer in case of a lack of understanding by the robot. Pepper has 2 speakers, 4 microphones, ultrasonic sensors (2 transmitter and 2 receivers) and 2 cameras up to 640pp of resolution which is used by the robot for searching with his gaze and whole-body contacts with humans around. The Autonomous Life mode was enabled in order to give a more human like and natural behavior to the robot. The robot reacts to sounds and voices. The robot was able to speak, hear, and had facial and voice identification [58]. The robot was kept plug on its charger to disabled its wheels, so it wasn’t being able to drive, spin or turn. The lower body of the robot was immobilized in this study to avoid accidents and low battery alerts. The robot’s parameters were customized using Aldebaran’s Choregraphe 2.5.10.7 software which is used for programming and controlling of the robot.

2.3.2. Personalization of Pepper.

To enhance the interaction between the robot and each child with CI, the robot was personalized for each participant. It was designed to ask questions based on the child’s declared centers of interest during the inclusion process. The questions were implemented on the robot according to the child’s fields of interest and there were five themes with 10 questions per category that could only be activated by vocal command. An example is illustrated in Table 1.

thumbnail
Table 1. Example of customizable question themes implemented in Pepper, originally in French.

https://doi.org/10.1371/journal.pone.0285927.t001

The robot was also personalized according to the rhythm of the family. Indeed, the robot was programmed with the family’s sleeping and meal times, which allowed it to adapt its activities and interactions accordingly. This personalization meant that the robot does not offer any activity during these times, so as not to disturb the rhythm of family life. He also makes remarks related to these times like "I’m getting hungry" at mealtimes or "I’m tired" at bedtime. The child also had the opportunity to ask general questions to the robot, to question the temporality (date and time of day) or the origins and function of the robot as well as to ask to make imitations of animals or sports for example. The robot can also tell some jokes and asks if the child is having fun. The speech rate was set to 80 words per minute (wpm) and the sounds settings were adjusted at home with the child. The child can also modify the "sound" setting to his liking with a command on the tablet or by asking the robot to increase or decrease the volume [59].

2.3.3. Games and activities of Pepper on demand.

In Table 2 below are described games and activities proposed by the robot and developed for participants.

The robot recorded activity data in a log folder on its internal hard drive. The file made it possible to know the time and date of use, to identify the user and the start and end of an activity (games/dance/conversation).

2.4. Procedure

2.4.1 Temporality of a passation.

The Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT) flow diagram schedule of enrolment, interventions and assessment procedures is provided in Fig 1. The temporality of the study takes place in several stages (Fig 2). First of all, the pre-inclusion, where the speech therapist from the ENT department in the pediatric cochlear implantation unit (UPIC) introduced the study to the family, checked the eligibility of the participants and explained the purpose of the study. Followed by the inclusion, where each parent and children signed a consent form before starting the study and then complete questionnaires of the preliminary assessment. Visit 1 was the installation of the robot at the participants home, for a period of one month (about 30 days). During this period, 4 visits (each week: visit 2, visit 3, visit 4 and visit 5) to the family’s home will be made to check if the study is running smoothly, to take data from the robot on a USB key and to retrieve questionnaires completed by the family, as well as the user’s oral feedback and the impression of the family. Visit 5 was marking the last day of a passation for participants with the uninstallation of the robot and the final assessment with questionnaires.

thumbnail
Fig 1. SPIRIT flow diagram: Schedule of enrolment, interventions, and assessment procedures.

https://doi.org/10.1371/journal.pone.0285927.g001

The chronology of the protocol creation began in 2018, and it took three years to select to population, develop questionnaires, select, and configure a humanoid robot suitable for deaf children with cochlear implants.

2.4.2. Tasks during the stay of Pepper at home.

The robot remained autonomously in participants home. The family and the child were instructed to use the robot at any time of the day and as many times as the child and the family wished. A society specialized in providing at home health care, was attributed to transport the robot at participants house and to visits them once a week, every week during the study (5 visits per participant). They will do three tasks: (1) check with the family if there is any problem or observation during the week with the robot at home; (2) collect data from the robot on a USB key thought the robot interface accessible on a computer with a RJ45 cable and the IP address of the robot; (3) give questionnaires to be completed by participants (children with cochlear implant and parents or legal guardians) during visits. It is important to note that questionnaires were administrated on paper and participants were given a sufficient amount of time to answer the questions (Table 3). Questionnaires were applied to children and parents as describe down below for visits and the details of questionnaires on the Table 3 and description on Table 5 for children and Table 6 for parents:

  • Inclusion: Preliminary assessment for children and parents
  • Visit 2 to 4: Intermediate assessment for children
  • Visit 2 and 4: Intermediate assessment for parents
  • Visit 5: Final assessment for parents and children
thumbnail
Table 3. Questionnaires applied for children and parents in preliminary intermediates and final assessment.

https://doi.org/10.1371/journal.pone.0285927.t003

2.4.3. Measures.

2.4.3.1. Logs from the robot. Data collection from the robot’s folder are time-stamped files which contain informational events relevant to the application. Therefore, logs contain transcription of activities done with the robot. The transcription of logs shows the name of the user, with dates and hours of use from the beginning till the end of the activity launched and the name of each activity initiated during the interaction. Logs are descripted in Table 4 with detail of which value were used to identify user interaction with the robot as a temporal analysis of the evolution of the use of the robot over the period of the study.

thumbnail
Table 4. Identification of logs retrieved from the robot and assessed measure.

https://doi.org/10.1371/journal.pone.0285927.t004

2.4.3.2. Questionnaires for children with cochlear implant. The purpose of using multiples questionnaires was to identify different aspects of the acceptability of the robot by assessing dimensions of usability, usefulness, playfulness, intention to use the robot, attitude toward using the robot, engagement of the participants (child with CI and parents) with the robot. This study was designed by dividing questionnaire of parents and children with CI. Considering the cognitive abilities of children with CI and the age range of 8 to 12 years old, we chose to use short questionnaires with sentences easy to understand (children with CI questionnaires were validated by speech therapists beforehand). Whereas parent questionnaire was chosen based on the evaluation of dimensions we aimed for (e.g. attractiveness to technology, innovative behaviors, intention to use, usability, acceptance). It was important to have data collected coming out of questionnaires from the child perception of the experience but also how parents perceived the robot. The child and their parents may have different perspectives on the interaction with the robot, and their feedback can complement and enrich each other. It would helped to have a more comprehensive understanding of the perception of the robot and the overall experience.

On Table 5 below, are described questionnaires proposed to children with cochlear implant to assessed the interaction between the child and the robot at home. Questionnaires were chosen in order to evaluated different aspect of perceived interaction to have detailed dimensions of the acceptability of the robot by children with CI and the evolution of results each week during the 1 month’s stay considering age, level of vocabulary and difficulties with verbal channel of communication. For example, drawing intervention [51] was selected as an alternative to verbalization and interview with the child with CI. Adding usability assessment and usefulness through Adapted System Usability Scale [12], Use Intention Scale [60] and meCue questionnaire [61] that were simplified with Likert-Smiley scale. Others dimensions such as mood (Pick-a-mood Child and Robot [63]), engagement (the Again-Again table [62]) and fun (Funometre [66, 67]) are assessed through visual channel of communication (as described in Table 5).

thumbnail
Table 5. Description of questionnaires for children with cochlear implant.

https://doi.org/10.1371/journal.pone.0285927.t005

2.4.3.3. Questionnaires for parents. Below are described questionnaires proposed to parents to assessed the interaction with the robot at home (Table 6). Questionnaires for parents were chosen in order to evaluated different aspect of perceived interaction to have detailed dimensions of the acceptability of the robot by children with CI and the evolution of results each week during the 1 month’s stay. Innovative behaviors [64] and attractiveness to technology [65] are measured to get a general understanding of parent’s technological profile. Ease of use, Usefulness and Playfulness through Use Intention Scale [60] are fundamental in determining the acceptance of the robot by measuring factor of actual length of use, Attitude toward using the robot and Behavioral intentions to use the robot [60]. The Almere Model [40] measure the acceptance of assistive social agent by following 13 constructs such as Attitude, Anxiety, Facilitating Conditions, Intention to Use, Perceived Adaptability, Perceived Enjoyment, Perceived Ease of Use, Perceived Sociability, Perceived Usefulness, Social Influence, Social Presence, Trust and Use. Finally, a modular evaluation of the parent User Experience [61] were used with 4 modules: Perception of Instrumental Qualities, User Emotions, Consequences of Use and a Global assessment of the robot.

3. Results

The results of the experimentation are expected to be fully analyzed once all participants have completed their passation. Concerning the main criterion, the number of weekly hours of use of the robot will be described week by week for each patient, which will make it possible to describe the temporal evolution of the acceptability. The quantitative distribution of this indicator will be described in detail (number, mean, standard deviation, minimum, quartiles, median and maximum). A linear mixed model will be applied to estimate the average temporal evolution of the number of weekly hours of robot use in the whole study population. The same analysis approach will be applied form the results of the subjective assessment from questionnaires measured repeatedly during the follow-up: usability, acceptability, fun and emotions.

4. Perspectives

This article presents an original methodology that provides support for following the necessary guidelines to evaluate acceptability of a humanoid robot, adapted to the characteristics of children with cochlear implant and their family at home.

Our project proposed to develop an interactive, personalized solution of home training to help cochlear implanted children to progress in language expression and comprehension as a complement to regular speech therapy. This first step will provide essential data to improve knowledge in the field of the acceptability of a humanoid robot at home. In the long term, the development of a humanoid robot adapted to the training of deaf and implanted children at home will represent a therapeutic and technological breakthrough, since such a device could improve the quality of life and autonomy of these patients, and promote training, particularly in isolated areas.

Supporting information

S2 File. Questionnaires in original French version and the English translation: Preliminary assessment, intermediate assessment and final assessment for parents and children.

https://doi.org/10.1371/journal.pone.0285927.s002

(RAR)

S3 File. Study Protocol approved by the Ethics committee in French and English.

https://doi.org/10.1371/journal.pone.0285927.s003

(PDF)

Acknowledgments

The research team would like to express their gratitude to Nadine Cochard, Hélène Husson, and Sébastien Ribas from the ENT department in the pediatric cochlear implantation unit (UPIC) of the CHU of Toulouse for providing support in participant selection and advice for adapting questionnaires for children with CI.

References

  1. 1. World Health Organization. World report on hearing. Geneva: World Health Organization; 2021. Available: https://apps.who.int/iris/handle/10665/339913
  2. 2. Völter C, Schirmer C, Hinsen D, Roeber M, Dazert S, Bilda K. Therapist-Guided Telerehabilitation for Adult Cochlear Implant Users: Developmental and Feasibility Study. JMIR Rehabil Assist Technol. 2020;7: e15843. pmid:32255434
  3. 3. Strelnikov K, Rouger J, Lagleyre S, Fraysse B, Deguine O, Barone P. Improvement in speech-reading ability by auditory training: Evidence from gender differences in normally hearing, deaf and cochlear implanted subjects. Neuropsychologia. 2009;47: 972–979. pmid:19022268
  4. 4. Fagan MK, Eisenberg L, Johnson KC. Investigating Early Pre-implant Predictors of Language and Cognitive Development in Children with Cochlear Implants. 2020.
  5. 5. Marx M, Mosnier I, Venail F, Mondain M, Uziel A, Bakhos D, et al. Cochlear Implantation and Other Treatments in Single-Sided Deafness and Asymmetric Hearing Loss: Results of a National Multicenter Study Including a Randomized Controlled Trial. AUD. 2021;26: 414–424. pmid:33789270
  6. 6. Socher M, Lyxell B, Ellis R, Gärskog M, Hedström I, Wass M. Pragmatic Language Skills: A Comparison of Children With Cochlear Implants and Children Without Hearing Loss. Frontiers in Psychology. 2019;10. Available: https://www.frontiersin.org/article/10.3389/fpsyg.2019.02243
  7. 7. Chao W-C, Lee L-A, Liu T-C, Tsou Y-T, Chan K-C, Wu C-M. Behavior problems in children with cochlear implants. Int J Pediatr Otorhinolaryngol. 2015;79: 648–653. pmid:25744493
  8. 8. Daza MT, Phillips-Silver J, Ruiz-Cuadra M del M, López-López F. Language skills and nonverbal cognitive processes associated with reading comprehension in deaf children. Res Dev Disabil. 2014;35: 3526–3533. pmid:25240218
  9. 9. Cano S, Arteaga JM, Collazos CA, Amador VB. Model for analysis of serious games for literacy in deaf children from a user experience approach. Proceedings of the XVI international conference on human computer interaction. 2015. pp. 1–9.
  10. 10. Cano S, Collazos CA, Aristizábal LF, Gonzalez CS, Moreira F. Towards a methodology for user experience assessment of serious games with children with cochlear implants. Telematics and Informatics. 2018;35: 993–1004.
  11. 11. Calmels M-N, Saliba I, Wanna G, Cochard N, Fillaux J, Deguine O, et al. Speech perception and speech intelligibility in children after cochlear implantation. International Journal of Pediatric Otorhinolaryngology. 2004;68: 347–351. pmid:15129946
  12. 12. Sánchez-Morales A, Durand-Rivera JA, Martínez-González CL. Usability evaluation of a tangible user interface and serious game for identification of cognitive deficiencies in preschool children. International Journal of Advanced Computer Science and Applications. 2020;11: 486–493.
  13. 13. Spencer PE, Marschark M. Evidence-Based Practice in Educating Deaf and Hard-of-Hearing Students. Oxford University Press; 2010.
  14. 14. WHO Global Observatory for eHealth. Telemedicine: opportunities and developments in Member States: report on the second global survey on eHealth. World Health Organization; 2010. Available: https://apps.who.int/iris/handle/10665/44497
  15. 15. Telemedicine in wound care—Chanussot‐Deprez—2008—International Wound Journal—Wiley Online Library. [cited 18 Jul 2022]. Available: https://onlinelibrary.wiley.com/doi/full/10.1111/j.1742-481X.2008.00478.x
  16. 16. Kvedar J, Heinzelmann PJ, Jacques G. Cancer diagnosis and telemedicine: a case study from Cambodia. Annals of Oncology. 2006;17: viii37–viii42. pmid:16801338
  17. 17. Jang SM, Hong Y-J, Lee K, Kim S, Chiến BV, Kim J. Assessment of User Needs for Telemedicine Robots in a Developing Nation Hospital Setting. Telemedicine and e-Health. 2021;27: 670–678. pmid:33095109
  18. 18. Desbois D. La télémédecine, un instrument susceptible de corriger les inégalités de santé? Terminal Technologie de l’information, culture & société. 2018 [cited 7 Sep 2022].
  19. 19. Bush ML, Thompson R, Irungu C, Ayugi J. The Role of Telemedicine in Auditory Rehabilitation: A Systematic Review. Otol Neurotol. 2016;37: 1466–1474. pmid:27755363
  20. 20. Flórez-Aristizábal L, Cano S, Collazos CA, Benavides F, Moreira F, Fardoun HM. Digital transformation to support literacy teaching to deaf Children: From storytelling to digital interactive storytelling. Telematics and Informatics. 2019;38: 87–99.
  21. 21. EBSCOhost | 156438156 | The method of rehabilitation treatment of patients after cochlear implantation using telemedicine technologies. [cited 5 Sep 2022]. Available: https://web.p.ebscohost.com/abstract?direct=true&profile=ehost&scope=site&authtype=crawler&jrnl=2083389X&AN=156438156&h=Db6iJ9qoodQHSZblnZ8LLYvZaAR6iWGQQnSkAR6C%2bsgv%2bfzVRo9%2fdiwTxcpbEvF8vpx9X6ZXoDqu%2fVyJv5SVJw%3d%3d&crl=c&resultNs=AdminWebAuth&resultLocal=ErrCrlNotAuth&crlhashurl=login.aspx%3fdirect%3dtrue%26profile%3dehost%26scope%3dsite%26authtype%3dcrawler%26jrnl%3d2083389X%26AN%3d156438156
  22. 22. Telmesani LM, Said NM, Mahrous MM, Alrusayyis DF. The Difficulties Encountered by Pediatric Cochlear Implant Patients and Their Parents during the COVID-19 Pandemic. Audiol Neurotol. 2022;27: 48–55. pmid:34515055
  23. 23. Lima MR, Wairagkar M, Natarajan N, Vaitheswaran S, Vaidyanathan R. Robotic Telemedicine for Mental Health: A Multimodal Approach to Improve Human-Robot Engagement. Frontiers in Robotics and AI. 2021;8. Available: https://www.frontiersin.org/articles/10.3389/frobt.2021.618866 pmid:33816568
  24. 24. Šabanović S. Robots in Society, Society in Robots. Int J of Soc Robotics. 2010;2: 439–450.
  25. 25. Yang G-Z, J Nelson B, Murphy RR, Choset H, Christensen H, H Collins S, et al. Combating COVID-19-The role of robotics in managing public health and infectious diseases. Sci Robot. 2020;5: eabb5589. pmid:33022599
  26. 26. Lambert A, Norouzi N, Bruder G, Welch G. A systematic review of ten years of research on human interaction with social robots. International Journal of Human–Computer Interaction. 2020;36: 1804–1817.
  27. 27. Wrobel J, Pino M, Wargnier P, Rigaud A-S. Robots et agents virtuels au service des personnes âgées: une revue de l’actualité en gérontechnologie. NPG Neurologie—Psychiatrie—Gériatrie. 2014;14: 184–193.
  28. 28. Logan DE, Breazeal C, Goodwin MS, Jeong S, O’Connell B, Smith-Freedman D, et al. Social Robots for Hospitalized Children. Pediatrics. 2019;144: e20181511. pmid:31243158
  29. 29. Beyer-Wunsch P, Reichstein C. Effects of a Humanoid Robot on the Well-being for Hospitalized Children in the Pediatric Clinic-An Experimental Study. Procedia Computer Science. 2020;176: 2077–2087.
  30. 30. Cifuentes C, Pinto MJ, Céspedes N, Múnera M. Social Robots in Therapy and Care. 2020.
  31. 31. Kabacińska K, Prescott TJ, Robillard JM. Socially Assistive Robots as Mental Health Interventions for Children: A Scoping Review. Int J of Soc Robotics. 2021;13: 919–935.
  32. 32. Moerman CJ, Jansens RM. Using social robot PLEO to enhance the well-being of hospitalised children. J Child Health Care. 2021;25: 412–426. pmid:32840383
  33. 33. Dawe J, Sutherland C, Barco A, Broadbent E. Can social robots help children in healthcare contexts? A scoping review. BMJ Paediatr Open. 2019;3: e000371. pmid:30815587
  34. 34. Wu Y-H, Wrobel J, Cornuet M, Kerhervé H, Damnée S, Rigaud A-S. Acceptance of an assistive robot in older adults: a mixed-method study of human–robot interaction over a 1-month period in the Living Lab setting. Clinical interventions in aging. 2014;9: 801–11. pmid:24855349
  35. 35. Tung F-W, Chang T-Y. Exploring Children’s Attitudes towards Static and Moving Humanoid Robots. In: Kurosu M, editor. Human-Computer Interaction Users and Contexts of Use. Berlin, Heidelberg: Springer; 2013. pp. 237–245. https://doi.org/10.1007/978-3-642-39265-8_26
  36. 36. Broadbent E, Stafford R, MacDonald B. Acceptance of Healthcare Robots for the Older Population: Review and Future Directions. Int J of Soc Robotics. 2009;1: 319.
  37. 37. Dinet J, Vivian R. Perception et attitudes à l’égard des robots anthropomorphes en France: validation d’une échelle d’attitudes. Psychologie française. 2015;60: 173–189.
  38. 38. Mori M. Bukimi no tani [the uncanny valley]. Energy. 1970;7: 33–35.
  39. 39. Mori M, MacDorman KF, Kageki N. The Uncanny Valley [From the Field]. IEEE Robotics Automation Magazine. 2012;19: 98–100.
  40. 40. Heerink M, Kröse B, Evers V, Wielinga B. Assessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Model. Int J of Soc Robotics. 2010;2: 361–375.
  41. 41. de Graaf MMA, Ben Allouch S, van Dijk JAGM. What Makes Robots Social?: A User’s Perspective on Characteristics for Social Human-Robot Interaction. In: Tapus A, André E, Martin J-C, Ferland F, Ammi M, editors. Social Robotics. Cham: Springer International Publishing; 2015. pp. 184–193. https://doi.org/10.1007/978-3-319-25554-5_19
  42. 42. Broekens J, Heerink M, Rosendal H. Assistive social robots in elderly care: a review. Gerontechnology. 2009;8: 94–103.
  43. 43. Stafford RQ, MacDonald BA, Li X, Broadbent E. Older People’s Prior Robot Attitudes Influence Evaluations of a Conversational Robot. Int J of Soc Robotics. 2014;6: 281–297.
  44. 44. Köse H, Uluer P, Akalın N, Yorgancı R, Özkul A, Ince G. The Effect of Embodiment in Sign Language Tutoring with Assistive Humanoid Robots. Int J of Soc Robotics. 2015;7: 537–548.
  45. 45. Ioannou A, Andreva A. Play and Learn with an Intelligent Robot: Enhancing the Therapy of Hearing-Impaired Children. Human-Computer Interaction–INTERACT 2019. Berlin, Heidelberg: Springer-Verlag; pp. 436–452. https://doi.org/10.1007/978-3-030-29384-0_27
  46. 46. Uluer P, Kose H, Oz BK, Can Aydinalev T, Barkana DE. Towards An Affective Robot Companion for Audiology Rehabilitation: How Does Pepper Feel Today? 2020 29th IEEE International Conference on Robot and Human Interactive Communication (RO-MAN). Naples, Italy: IEEE; 2020. pp. 567–572. https://doi.org/10.1109/RO-MAN47096.2020.9223534
  47. 47. Uluer P, Kose H, Landowska A, Zorcec T, Robins B, Barkana DE. Child-robot interaction studies during COVID-19 pandemic. arXiv preprint arXiv:210500215. 2021.
  48. 48. Uluer P, Kose H, Gumuslu E, Barkana DE. Experience with an Affective Robot Assistant for Children with Hearing Disabilities. Int J of Soc Robotics. 2021 [cited 27 Apr 2022]. pmid:34804256
  49. 49. Tanaka F, Isshiki K, Takahashi F, Uekusa M, Sei R, Hayashi K. Pepper learns together with children: Development of an educational application. Humanoids. 2015. pp. 270–275.
  50. 50. Lee MK, Forlizzi J, Kiesler S, Rybski P, Antanitis J, Savetsila S. Personalization in HRI: A longitudinal field experiment. 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE; 2012. pp. 319–326.
  51. 51. Barendregt W, Bekker T. Exploring the potential of the drawing intervention method for design and evaluation by young children. CHI ‘13 Extended Abstracts on Human Factors in Computing Systems. New York, NY, USA: Association for Computing Machinery; 2013. pp. 193–198. https://doi.org/10.1145/2468356.2468392
  52. 52. Read JC. Validating the Fun Toolkit: an instrument for measuring children’s opinions of technology. Cogn Tech Work. 2008;10: 119–128.
  53. 53. Markopoulos P, Read JC, MacFarlane S, Hoysniemi J. Evaluating Children’s Interactive Products: Principles and Practices for Interaction Designers. Elsevier; 2008.
  54. 54. Cano S, Collazos CA, Aristizábal LF, Gonzalez CS, Moreira F. Assessing user experience for serious games in auditory-verbal therapy for children with cochlear implant. World Conference on Information Systems and Technologies. Springer; 2017. pp. 861–871.
  55. 55. Nys J-F. La télémedecine, simple évolution ou véritable révolution des usages dans le système de santé français?: Marché et organisations. 2020;n° 38: 15–36.
  56. 56. Moeller MP. Early intervention and language development in children who are deaf and hard of hearing. Pediatrics. 2000;106: E43. pmid:10969127
  57. 57. Robotics S. Softbank robotics documentation. Obtenido de SoftBank Robotics: http://doc.aldebaran.com/2-8/index.html. 2017.
  58. 58. Gardecki A, Podpora M. Experience from the operation of the Pepper humanoid robots. 2017 Progress in Applied Electrical Engineering (PAEE). Koscielisko, Poland: IEEE; 2017. pp. 1–6. https://doi.org/10.1109/PAEE.2017.8008994
  59. 59. Choregraphe Setup 2.1.4 Windows | SoftBank Robotics. [cited 12 May 2022]. Available: https://www.softbankrobotics.com/emea/fr/support/nao-6/choregraphe-setup-214-windows
  60. 60. Moon J-W, Kim Y-G. Extending the TAM for a World-Wide-Web context. Information & Management. 2001;38: 217–230.
  61. 61. Lallemand C, Koenig V. How Could an Intranet be Like a Friend to Me? Why Standardized UX Scales Don’t Always Fit. Proceedings of the European Conference on Cognitive Ergonomics 2017. New York, NY, USA: Association for Computing Machinery; 2017. pp. 9–16. https://doi.org/10.1145/3121283.3121288
  62. 62. Read JC, MacFarlane S. Using the fun toolkit and other survey methods to gather opinions in child computer interaction. Proceedings of the 2006 conference on Interaction design and children. New York, NY, USA: Association for Computing Machinery; 2006. pp. 81–88. https://doi.org/10.1145/1139073.1139096
  63. 63. Desmet PMA, Vastenburg MH, Romero N. Mood measurement with Pick-A-Mood: review of current methods and design of a pictorial self-report scale. JDR. 2016;14: 241.
  64. 64. Agarwal R, Karahanna E. Time Flies When You’re Having Fun: Cognitive Absorption and Beliefs about Information Technology Usage. MIS Quarterly. 2000;24: 665–694.
  65. 65. Lallemand C, Koenig V, Gronier G, Martin R. Création et validation d’une version française du questionnaire AttrakDiff pour l’évaluation de l’expérience utilisateur des systèmes interactifs. European Review of Applied Psychology. 2015;65: 239–252.
  66. 66. Read JC, MacFarlane S, Casey C. Endurability, engagement and expectations: Measuring children’s fun. Interaction design and children. Shaker Publishing Eindhoven; 2002. pp. 1–23.
  67. 67. Hanna L, Risden K, Alexander K. Guidelines for usability testing with children. interactions. 1997;4: 9–14.