https://orcid.org/0000-0002-7346-0441
Figures
Abstract
Tinnitus affects a considerable part of the population and develops into a severe disorder in some sufferers. App-based interventions are able to provide low-threshold, cost-effective, and location-independent care for tinnitus patients. Therefore, we developed a smartphone app combining structured counseling with sound therapy and conducted a pilot study to evaluate treatment compliance and symptom improvement (trial registration: DRKS00030007). Outcome variables were Ecological Momentary Assessment (EMA) measured tinnitus distress and loudness and Tinnitus Handicap Inventory (THI) at baseline and final visit. A multiple-baseline design with a baseline phase (only EMA) followed by an intervention phase (EMA and intervention) was applied. 21 patients with chronic tinnitus (≥ 6 months) were included. Overall compliance differed between modules (EMA usage: 79% of days, structured counseling: 72%, sound therapy: 32%). The THI score improved from baseline to final visit indicating a large effect (Cohens d = 1.1). Tinnitus distress and loudness did not improve significantly from baseline phase to the end of intervention phase. However, 5 of 14 (36%) improved clinically meaningful in tinnitus distress (ΔDistress ≥ 10) and 13 of 18 (72%) in THI score (ΔTHI ≥ 7). The positive relationship between tinnitus distress and loudness weakened over the course of the study. A trend but no level effect for tinnitus distress could be demonstrated by a mixed effect model. The improvement in THI was strongly associated with the improvement scores in EMA of tinnitus distress (r = -0.75; 0.86). These results indicate that app-based structured counseling combined with sound therapy is feasible, has an impact on tinnitus symptoms and reduces distress for several patients. In addition, our data suggest that EMA could be used as a measurement tool to detect changes in tinnitus symptoms in clinical trials as has already been shown in other areas of mental health research.
Author summary
Tinnitus is the perception of a phantom sound which is generated in the brain. Many people are affected by tinnitus and some suffer severely. Management strategies can effectively reduce suffering of some patients. However, the access towards these treatments is limited due to long distances and lack of trained therapists. Therefore, there is increasing interest whether tinnitus management can be delivered via smartphone. In this study, we evaluated a smartphone application consisting of educational counseling and sound therapy with respect to treatment compliance and symptom improvement. We measured tinnitus symptoms at the beginning of baseline and at the end of intervention using clinical questionnaires, but also during the course of treatment using daily questions which were integrated in the mobile application. The app was used regularly by the patients (sound therapy: 32% of days, structured counseling: 72% of days; tinnitus assessment: 79% of days). Tinnitus handicap improved clinically meaningful for 13 of 18 patients, tinnitus distress for 5 of 14 and tinnitus loudness for 2 of 14. The correlation between tinnitus distress and loudness weakened during the study course. Thus, this study indicates that app-based tinnitus management has an impact on tinnitus symptoms and reduces suffering for several patients.
Citation: Engelke M, Simões J, Vogel C, Schoisswohl S, Schecklmann M, Wölflick S, et al. (2023) Pilot study of a smartphone-based tinnitus therapy using structured counseling and sound therapy: A multiple-baseline design with ecological momentary assessment. PLOS Digit Health 2(1): e0000183. https://doi.org/10.1371/journal.pdig.0000183
Editor: Padmanesan Narasimhan, University of New South Wales, AUSTRALIA
Received: August 16, 2022; Accepted: December 13, 2022; Published: January 18, 2023
Copyright: © 2023 Engelke et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: The data that support the findings of this study are openly available on GitHub (https://github.com/MilenaEn/UNITI-SCED-paper). DOI: 10.5281/zenodo.6958300.
Funding: This project has received funding from the European Union's Horizon 2020 Research and Innovation Programme, Grant Agreement Number 848261 (ME, JS, CV, SS, MS, SW, RP, BL, WS). TP didn’t receive any funding. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Introduction
Experiencing subjective tinnitus implies an involuntary perception of a phantom sound that is generated by abnormal neural activity in the auditory system [1,2]. Around 14–15% of the population in European countries are affected by tinnitus, while 1–2% are severely impaired by tinnitus [3,4]. Tinnitus is a heterogeneous condition, not only in terms of level of impairment, but also regarding its perceptual characteristics, etiological factors, pathological markers, clinical comorbidities, and its treatment response [2,5,6]. Psychological, auditory, and neurological treatment approaches exist that aim towards reduction of tinnitus symptoms and improvement of life quality, but up to now, there is no universal cure for tinnitus available for the clinical routine [1,7].
Patients who seek health care usually suffer from severe tinnitus which is accompanied by emotional distress, cognitive dysfunction and increased arousal ultimately leading to functional disability and reduced life quality [2,3]. Among others, patients complain sleep disturbances, problems in concentration, attention, communication, and memory and some are severely affected by mental disorders [8,9]. Tinnitus severity is mainly influenced by psychological factors. High life stress, poor coping resources, co-morbid mental diseases and personality dimensions shape negative emotional reactions, selective attention, and cognitive appraisal towards the tinnitus. Involving numerous feedback loops, tinnitus distress is likely to persist which in turn prevents habituation to the new stimulus [10–12]. Tinnitus management strategies aim towards stimulation of the habituation process by reducing stress, anxiety, negative emotional responses, and dysfunctional cognitions on one hand, and by enhancing coping resources on the other hand [13,14].
Despite scientific efforts, the health care situation for tinnitus patients is deficient, since the access to available treatment options for tinnitus is limited [15]. In addition to the lack of trained therapists, environmental factors such as the COVID-19 outbreak in 2020 can further reduce access to face-to-face treatments [16–18]. Moreover, tinnitus has a substantial economic burden in terms of health care and indirect costs with increasing trend [3,19,20].
In response to the deficient health care situation, smartphone-based therapies are capable to provide low-threshold (easily accessible), cost-effective and location-independent healthcare and can potentially increase patients treatment compliance [15,21,22]. They are particularly beneficial for the management of chronic diseases as they strengthen patient empowerment and are able to induce behavior modification and lifestyle changes [21,22]. Furthermore, smartphone-based therapies can be used to provide information about tinnitus to a large number of affected people, as well as to track the course of tinnitus symptoms in a longitudinal, ecologically valid, and momentary fashion [15,23,24]. Currently, there are many available smartphone applications for tinnitus, but evidence for their efficacy is limited [15,25]. Preliminary findings indicate that app-based treatments have the potential to improve tinnitus symptoms [25–30]. Most evaluated apps use Cognitive Behavioural Therapy (CBT) approaches and auditory treatments; to the best of our knowledge, there is currently no evaluation of an app-based structured counseling combined with sound therapy.
Therefore, we developed a tinnitus management app that provides structured counseling supported by sound therapy. Structured counseling has been shown to improve tinnitus distress and quality of life in face-to-face settings or through written manuals [31,32] and may have better effects when combined with sound therapy [32–34]. Additionally, the app contains an Ecological Momentary Assessment (EMA) module that tracks changes in tinnitus symptoms on a daily basis. The feasibility of EMA to measure the course of tinnitus has already been investigated in several studies [23,24,35] and has also been used to evaluate tinnitus treatments [36].
Hence, we conducted a pilot-study to evaluate the app-based treatment. The objective was to investigate treatment adherence and improvement of tinnitus symptoms individually and on a group level. A trend effect (improvement over time) for daily measured tinnitus distress was hypothesized. Furthermore, we analyzed the association of the two measurement methods, namely EMA and clinical questionnaires. To account for tinnitus heterogeneity and individual treatment effects, a multiple-baseline across groups design was chosen. Multiple-baseline designs belong to the group of single-case experimental designs (SCED) where the outcome variable is measured longitudinally before (baseline phase) and during the intervention (intervention phase) in single cases. Hence, with the baseline phase, each case has its own control and is considered as replication [37]. As SCEDs can be performed with small sample sizes, they are especially recommended for piloting novel interventions [38]. In multiple-baseline designs, the introduction of the intervention phase is staggered in time to separate treatment effects from random time effects and therefore enhance internal validity [37].
Materials and methods
Study design
A randomized multiple-baseline design across groups was used. Participants first underwent a baseline phase where tinnitus symptoms were measured daily using app-based EMA, followed by an intervention phase where the intervention (structured counseling and sound therapy) was additionally introduced. Participants were allocated to 4 groups with different baseline lengths to realize staggered introduction of the intervention and to fulfil the recommendations of at least 3 replications [38]. The baseline phase had a minimum duration of 7 days (i.e. 7 EMA data points) to exceed the recommended standard of 5 data points per phase [39]. Furthermore, the groups entered the intervention phase with a distance of 3–5 days to each other to keep baseline phase as short as possible. As randomization is recommended for SCEDs to minimize threats to internal validity, the Koehler-Levin randomization procedure was used to randomize the intervention start [40,41]. Therefore, 2 potential starting points for each group were defined considering the 3–5 days distance to the other groups. First, the participants were randomly assigned to the 4 groups. Then, the order of the groups was randomly assigned and finally, one out of two potential starting points was randomly selected for each group. The intervention phase had the same duration of 12 weeks for all participants. At the beginning of the baseline phase and at final visit (after intervention phase), participants completed online versions of clinical questionnaires about tinnitus and other health-related aspects using an electronic database. The study was designed in line with SCED recommendations [39].
The study is approved under the ethic vote 20–1936_2–101 „UNification of treatments and Interventions for TInnitus patients–Randomized Clinical Trial (UNITI-RCT)”(Amendment No. 2) by the ethics committee of the University of Regensburg, Germany [42]. All persons were informed about the objectives and methodologies of the present study, and gave written informed consent prior to study start. Participants received neither compensation nor incentives for adherence to the study protocol. The study was conducted according to the guidelines in the Declaration of Helsinki. It was retrospectively registered in the German Clinical Trials Register (DRKS-ID: DRKS00030007) because of lack of awareness that pilot trials need to be registered. The CONSORT checklist (S1 Checklist) and the study protocol (S1 Protocol) are part of the supporting information.
Participants
Inclusion criteria were: 1) adult (age ≥ 18 years), 2) chronic tinnitus (duration ≥ 6 months), and 3) THI-score ≥ 18 (indicating at least a mild tinnitus handicap) [43]. We included patients with any tinnitus type (e.g., subjective, objective, somatosensory) regardless of comorbidities (e.g., hearing loss, hyperacusis). Exclusion criteria were: 1) tinnitus-related therapy within the last 3 months and 2) similar therapy with long term effects e.g., noiser. Further, potential participants had to own a smartphone with the operating systems iOS 12.0 (or newer) or Android 5.0 (or newer) in order to use the mobile application as part of the study.
Procedures
The whole study was conducted online during the COVID-19 pandemic (May 2021 –October 2021). Patient communication was realized by mail. By giving their consent, participants were included into the study and randomized to one of the four groups. Also, they were provided online via a database with the clinical questionnaires before the baseline phase. With the start of the baseline phase on the same day for all participants, information about app installation and login data were provided. During baseline phase, participants were instructed to answer the diary (EMA module) every evening. With the start of the intervention phase, participants received instructions and new login data that enabled access to the treatment modules. All participants immediately started the intervention phase on the defined day. Apart from answering the diary, participants were instructed to complete daily sessions of structured counseling and sound therapy during a 12-week intervention phase. At halftime (after 6 weeks of intervention), a reminder to fulfill the study protocol (daily usage of intervention and diary) was sent out. The intervention phase ended after 12 weeks with the final visit assessment.
App-based intervention
Both EMA recordings and the intervention modules (structured counseling and sound therapy) were provided via the smartphone-based application UNITI running on the operating systems iOS 12.0 or newer and Android 5.0 or newer. It is available in the Apple App Store and the Google Play Store. App architecture is described elsewhere [44].
Structured counseling
The structured counseling module TinEdu consists of 12 chapters, each chapter includes 7 sections and a quiz at the end. The sections contain informative texts, related links, illustrations, and audio files imparting knowledge about tinnitus ranging from basics about hearing and tinnitus to more advanced topics such as therapeutic options and current tinnitus research. In addition, practical tips are provided on how to deal with tinnitus on a daily basis. The last section of each chapter gives a short summary of the provided content. After that, participants can test themselves in a subsequent quiz. The quiz consists of single- and multiple-choice questions related to the respective chapter. Participants were provided with feedback on their test performance and were advised to repeat the relevant sections in case of a wrong answer. The Feedback section is a separate module of the UNITI app that functionally belongs to TinEdu and saves the feedback of the quizzes. As the intervention is scheduled for 12 weeks, one section should be completed each day so that a chapter is completed every week. To ensure the processing order of TinEdu, each section is unlocked only when the previous one has been completed.
Sound therapy
The sound therapy Shades of Noise (SoN) forms the second treatment module of the UNITI application. It provides a sound library of 64 sounds from which 29 are naturalistic and 35 are digitally produced sounds. In the first category, sounds as beach waves or waterfall noise are presented. The second category consists of pure tones and broad band noises of different frequencies with optional filters and modulation rates representing the different sound therapeutic approaches (e.g., masking, residual inhibition). At the first use, subjects could optionally set their tinnitus frequency, if known, so that some sounds could be adjusted to the pitch. To increase the benefit of the therapy, it was recommended to listen to the sounds with headphones to achieve a more even distribution to both ears. When participants started a session, they had to indicate their current tinnitus loudness and distress on a visual analogue scale (VAS). After that, they could select any sound from the library to listen to. Different play times could be set, between 1 minute and infinite play time. Also, sounds could be marked as favourites, making them appear at the top of the sound list for the upcoming sessions. Furthermore, each sound could optionally be rated on how much the tinnitus loudness changed after listening to it. Participants were encouraged to use SoN in a self-guided manner with a recommendation of at least 15 minutes per day.
Measures
Outcomes were measured with clinical questionnaires at the beginning of the baseline phase and at the final visit assessment after the end of the intervention provided via an electronic database, as well as with active EMA data using the diary via the smartphone-application. Data protection and data transfer was handled according to the highest security standards and has been approved by the Data Protection Officer (DPO) of the University of Regensburg, Germany.
Clinical questionnaires included the THI [43], the German Hyperacusis Questionnaire (GUEF) [45], the Patient Health Questionnaire for Depression (PHQ-9) [46], and the European School of Interdisciplinary Tinnitus Research Screening Questionnaire (ESIT-SQ) [47]. The THI consists of 25 items with 3 answer options addressing the impact of tinnitus on daily life. Higher THI score indicates higher tinnitus handicap [43]. The remaining questionnaires provide information on demographics, tinnitus characteristics, co-morbid hyperacusis and mental health. The questionnaire data were stored anonymized in an electronic database (EU Tinnitus Database). The database is hosted by database experts from the University of Regensburg at the Bezirksklinikum Regensburg, where the server is located.
The EMA module (tinnitus diary) consisted of a collection of 10 VAS questions regarding current tinnitus perception and thoughts, neck and jaw tension, as well as psychological wellbeing. In an additional empty field, subjects were allowed to make notes on special occurrences. The EMA module was designed as an end-of-day diary to track changes in tinnitus symptoms evoked by the intervention, therefore, participants received daily notifications at 19:30. The authors are aware that the notifications might influence the time of app usage. For this study, results of two questions about tinnitus perception have been included in the analysis (see S1 Table). These questions assess the current tinnitus distress (How burdensome do you find your tinnitus at the moment?) and the current tinnitus loudness (How loud is your tinnitus at the moment?) on a continuous rating scale (0–100; not burdensome/inaudible–very burdensome/very loud). The app data are stored in a relational database using Maria DB 11, which runs in a Linux environment (Debian Buster) and on a LAMP technology stack. No personal information is stored there.
Statistical analysis
All participants who filled in the ‘begin of baseline’ and ‘final visit’ questionnaires and used the app at least once during baseline and intervention phase were included in the data analysis. Descriptive statistics for demographics, tinnitus characteristics (retrieved from the clinical questionnaires) and app use were calculated to characterize the sample. A paired t-test was used to determine the sample difference in THI score from begin of baseline to final visit. The main analysis focus was on the EMA data provided by the app diary. Therefore, data were additionally prepared and missing values were imputed using the aregImpute function of the Hmisc R package with its default settings [48]. To support visualization of tinnitus symptom courses, individual means and standard deviation were calculated for baseline phase and end of intervention phase and statistically contrasted on a group level using a paired t-test. The change in relation between tinnitus distress and loudness was described with Pearson’s product-moment correlation for each week. A mixed effect model was computed to predict tinnitus distress including demographics (age, gender), psychological burden (THI, PHQ-9) and intervention variables (trend, level) as fixed effects and participants as random intercepts. To compare the different measurement methods, Pearson’s product-moment correlation between improvement in THI and improvement in tinnitus distress was calculated. Data preparation and analysis was conducted in R (version 4.1.2).
Results
Participants
A minimum of 20 participants were defined for inclusion to allocate at least 5 participants to each group. 40 potentially eligible patients were preselected from a patient pool based on inclusion criteria and contacted per mail (see Fig 1 for patient flow). 21 declared their consent, were included into the study and randomized to one of the 4 groups. The Koehler-Levin method was applied [40,41]. Group 1 was assigned to a baseline length of 11 days, group 2 of 19 days, group 3 of 16 days and group 4 of 8 days. Double-checking of the eligibility at begin of the baseline phase confirmed that all 21 participants fulfilled the inclusion criteria. For data analysis, 3 cases (3/21, 14%) had to be excluded, because of missing final visit questionnaires (case 02, case 09) and missing app data from the intervention phase (case 01). Hence, 18 patients are considered for data analysis.
Flow diagram of patient recruitment and dropouts. Study design: Multiple-baseline design across groups. The four groups introduced the treatment staggered in time to separate treatment effects from potential time effects and therefore enhance internal validity. Baseline length for each group was randomly selected following the Koehler-Levin procedure and patients were randomly allocated to groups. Intervention phase was the same length for all groups. Before baseline and after intervention phase, clinical questionnaires were applied.
Demographics, tinnitus characteristics and app use
Table 1 summarizes demographics, tinnitus characteristics and app use. The sample was balanced in terms of gender, age and education level. PHQ-9 score at baseline indicated mild depressive symptoms on average [49]. The sample was moderately handicapped (THI) by their tinnitus, slightly to moderately impaired by hyperacusis (GUEF) and has had tinnitus for an average of 183 months [45,50]. 11 patients had seen a physician in the past year due to their tinnitus complaints. Patients had good overall compliance using the app. On average, the diary was used on 75.9 days (about 79% of days), structured counseling was used on 60.7 days (72% of days), and sound therapy on 26.6 days (32% of days). A daily usage was recommended (the intervention phase lasted for 84 days and the baseline phase for 8–19 days, depending on group affiliation).
Change in THI
Change of THI score from the begin of baseline phase to final visit is depicted in Table 2 and visualized in Fig 2. The mean THI was improved by 11.8 points from begin of baseline to final visit indicating a large effect (Cohens d = 1.1). 13 of 18 cases (72%) improved clinically meaningful on the THI score (ΔTHI ≥ 7). A THI improvement of 7 points has been empirically determined as the minimal clinically relevant improvement [51].
a) Significant improvement of Tinnitus Handicap Inventory (THI) score from the begin of baseline phase to final visit of the sample. Higher scores indicate higher handicap. Dots represent means, error bars are standard errors; ** p < .001; N = 18. b) Individual THI values at baseline and final visit. The same shape represents the same individual.
Change in EMA of tinnitus symptoms
EMA data from the tinnitus diary were prepared for visualization and analysis creating a structure of one data point per case per day. In case of multiple entries per day, the first one was kept (n = 79 duplicates removed). Cases were visually inspected regarding randomness of missing values, 4 cases had to be excluded because of data not missing at random (cases 03, 06, 08, 21). For the remaining 14 cases, missing data points were imputed with multiple imputation using bootstrapping to simulate the process of drawing predicted values from a full Bayesian predictive distribution (n = 1.510 imputed data points). The EMA subset (N = 14) is comparable with the full sample (N = 18) regarding participant demographics and tinnitus characteristics (see S2 Table).
Visualization of tinnitus symptom courses
Fig 3 displays the course of daily measured tinnitus distress and loudness for each case over the study duration. The grey area represents the baseline phase (only EMA), the white area represents the intervention phase (EMA, structured counseling, sound therapy). The heterogeneity between cases and the fluctuation of symptom courses hamper identification of symptom improvement from visualization, therefore, descriptive summaries and statistical analysis are performed in the next step.
Individual courses of tinnitus symptoms that were assessed daily with Ecological Momentary Assessment over the study period. The grey area represents the baseline phase (EMA), the white area represents the intervention phase (EMA, structured counseling, sound therapy). Distress: How burdensome do you find your tinnitus at the moment? (0 not burdensome– 100 very burdensome); Loudness: How loud is your tinnitus at the moment? (0 inaudible– 100 very loud). N = 14.
Improvement from baseline phase to the end of intervention phase
Next, we were interested if tinnitus symptoms improved from baseline phase to the end of the intervention phase. The end of the intervention phase is defined by the last days of the intervention phase using the same time window than the baseline phase (Group 1: 11 days, group 2: 19 days, group 3: 16 days, group 4: 8 days). Mean and standard deviation were calculated for the baseline phase and the end of the intervention phase. Individual values are depicted in Table 3 for tinnitus distress and Table 4 for tinnitus loudness. On a group level, no significant differences between baseline phase and end of intervention phase have been found neither for tinnitus distress (mean of the difference = 4.5; t(13) = 1.08, p = 0.30, 95% CI [-4.5;13.6]), nor for tinnitus loudness (mean of the difference = -2.2; t(13) = -0.79, p = 0.45, 95% CI [-8,1;3.8]). On an individual level, 5 of 14 cases (36%) improved clinically meaningful on distress (ΔDistress ≥ 10). Those patients improved clinically meaningful on the THI score as well (ΔTHI ≥ 7, see Table 3). Regarding tinnitus loudness, only 2 of 14 cases (14%) improved clinically meaningful from baseline phase to the end of intervention phase (ΔLoudness ≥ 10, see Table 4). An improvement of 10 points has been empirically determined as the minimal clinically relevant improvement for tinnitus distress and loudness measured on a 100 point VAS [52].
Change in relationship between tinnitus distress and loudness
Visualization of the individual symptom courses have led to the observation that the courses of tinnitus distress and loudness seem to diverge for some individuals (Case 13 & 16, see Fig 3). To quantify that observation, we calculated means for tinnitus distress and loudness for the baseline phase and for each of the 12 weeks of the intervention phase and correlated the weekly distress and loudness means with each other (see Fig 4). All correlations are positive and reach statistical significance (p < .001). The strongest correlation was measured in week 2 of the intervention phase (r = 0.72) and the weakest in week 11 (r = 0.35). On a descriptive level, the correlation coefficients between tinnitus distress and loudness tended to decline over the course of the study.
Pearson’s product-moment correlations between tinnitus distress and loudness during baseline phase (week 0) and intervention phase (week 1–12). All correlations are statistically significant (p < .001). N = 14.
Trend and level effect of tinnitus distress
A mixed effect model was only conducted for tinnitus distress, as prior findings indicate no effect for tinnitus loudness. In Table 5, the results are summarized. To evaluate the treatment effect for tinnitus distress, a trend and level effect was modeled [53]. The trend effect models the change in tinnitus distress over time (in days), while the level effect models the change in distress between the phases (from baseline to intervention phase). Hence, trend and level were included as fixed effects. Besides from the intervention variables, demographics (age, gender) and psychological burden variables (THI, PHQ-9) were additionally included as fixed effects to enhance tinnitus distress prediction. Participants were included as random intercepts. The outcome variable was daily measured tinnitus distress.
The model explained 62% of the variance of daily tinnitus distress, mainly explained by the fixed effects (52% explained variance). On average, tinnitus distress was significantly reduced by 0.06 points per day (within the whole study period; trend effect) and descriptively reduced by 2.38 points from baseline to intervention phase (level effect). Moreover, cases with higher daily distress tended to be male with higher baseline THI and PHQ-9 scores.
To test the model for overfitting, the train/test split method was applied. The mixed effect model was fitted to the training data (80% of the data set) and tested on the test data. The explained variance of the test data was R2 = 0.67 (conditional).
Comparison of improvement in THI and tinnitus distress
As the THI score is a well-accepted clinical validation tool for tinnitus treatments, we were furthermore interested if improvement in EMA of tinnitus distress was associated with THI improvement and which EMA improvement score represents THI improvement best. Therefore, we defined two EMA improvement scores. The first score is the Distress trend (slope of tinnitus distress during intervention phase) and the second score is the ΔDistress used before (see Table 3, baseline phase–end of intervention phase). We compared the association of both EMA improvement scores with ΔTHI (THI begin baseline–THI final visit), the results are depicted in Fig 5. ΔTHI is strongly associated with both EMA improvement scores (Distress trend and ΔDistress), with a descriptively stronger association with ΔDistress (see Fig 5B; r = 0.86, p < 0.001).
Pearson’s product-moment correlation of ΔTHI with two EMA improvement scores: Distress trend (a) and ΔDistress (b). ΔTHI = THI begin baseline–THI final visit; Distress trend = slope of tinnitus distress during intervention phase; ΔDistress = Baseline phase–end of intervention phase. N = 14.
Discussion
We conducted a pilot study to investigate the feasibility and efficacy of an app-based tinnitus intervention combining structured counseling with acoustic therapy using a multiple-baseline across groups design with an initial sample of 21 participants. Outcome variables were EMA of tinnitus distress and loudness and retrospectively measured THI at the begin of baseline phase and final visit after intervention phase.
A good compliance using the app was observed, particularly regarding the diary (about 79% daily usage) and structured counseling (72% daily usage). 14% (3/21) dropped out. This high adherence was unexpected since app-based interventions in chronic diseases are normally characterized by high attrition and dropout rates [54]. This is especially true for the EMA module, because in a study with its predecessor (TrackYourTinnitus), only about 68% had more than one diary entry [55]. The authors assumed that incentives could improve adherence rates noticeably. In fact, this could have been supported empirically in other trials [35,56]. Therefore, in this study, although not intended as incentives, the intervention modules may have contributed to good user engagement, because of potential symptom improvement occurring through the usage. The finding of a more favorable compliance could have also been driven by the chosen study design with a small sample size that enabled a frequent mail contact (regarding study procedure, concerns and questions) and possibly increased the involvement of the participants. Moreover, the significance of the EMA data for research was re-emphasized before and during the study.
The THI changed statistically and clinically significant from baseline to final visit with a large effect size (Cohens d = 1.1). Meta-analysis of CBT applied to tinnitus report effect sizes between 0.54 and 0.91 [14,57]. However, caution should be taken in the interpretation of this effect. First the THI change occurred during the baseline and the intervention phase and can thus not be solely attributed to the intervention. Second, data come from a pilot study with a small sample size and no control group. Larger, controlled samples are needed to validate the effect on THI. Regarding the individual level, 13 of 18 (72%) improved clinically meaningful (ΔTHI ≥ 7) [51]. This reflects the well-known heterogeneity of treatment response in tinnitus patients, i.e. tinnitus distress decreases only for some individuals, but not for the whole sample. This could also be observed in visualization of individual symptom courses and in comparisons of baseline phase with end of intervention phase. Future research should aim to identify predictors of response to treatment, especially for app-based interventions [58]. Previous evidence showed that the positive correlation between working alliance and treatment outcome known from face-to-face psychological therapy remains stable for internet-based treatments [59]. Moreover, the acceptability of internet-based interventions is a considerable predictor of treatment outcomes [60,61]. Hence, these factors should be considered in subsequent studies testing app-based tinnitus treatments.
The main analysis focus was on the EMA data (tinnitus distress and loudness). The heterogeneity between the cases and the fluctuation of symptom courses hampered identification of symptom improvement from visualization. High fluctuation has already been observed in prior EMA studies measuring tinnitus symptoms using mobile devices and reflects their usual time course [23,24,62]. Fluctuations in tinnitus symptoms are probably influenced by a combination of many factors, including neurobiological markers, circadian rhythm, behavioral and emotional processes, and stress [63–67].
To overcome the obstacle of heterogeneity and symptom fluctuation, individual means and standard deviations were calculated for the baseline phase and the end of the intervention phase (same time window than baseline phase). On a group level, neither tinnitus distress nor loudness showed a significant change from baseline to the end of intervention phase. On an individual level, however, 5 of 14 cases improved clinically meaningful in tinnitus distress (ΔDistress ≥ 10) as well as in the THI score (ΔTHI ≥ 7). Thus, 36% of the sample experienced a reduction in tinnitus burden during the intervention. Interestingly, more patients improved clinically meaningful in the THI than in EMA of tinnitus distress (72% vs. 36%). This might indicate that the THI is more sensitive to change than EMA of tinnitus distress. Regarding tinnitus loudness, only 2 of 14 cases (14%) improved clinically meaningful from baseline to the end of intervention phase (ΔLoudness ≥ 10).
As visual inspection of the EMA data suggested a dissociation of tinnitus distress and loudness scores over the course of the study (see Fig 3), correlations scores between distress and loudness were calculated for the baseline phase and for each week of the intervention phase. Fig 4 depicts a descriptive decline in the correlation between tinnitus distress and loudness over the study period. This could reflect a psychological process that was triggered by the information about tinnitus received from structured counseling and the provided tips that helped the patients to better cope with their tinnitus. In other words, the patients have learned to evaluate their tinnitus in a more differentiated way, i.e. more independent of acoustic features and as a result, tinnitus distress became more independent of tinnitus loudness. Prior studies identified tinnitus acceptance and emotional valence as partial mediators of the relationship between tinnitus distress and loudness [64,68]. If the app-based intervention induces a change in those mediators could be of interest for subsequent studies.
To predict daily measured tinnitus distress, a mixed effect model was set up including demographics (age, gender), psychological burden (baseline THI and PHQ-9), intervention effects (trend, level) as fixed effects and participants as random intercepts. The model could explain 62% of the variance of the daily tinnitus distress and was checked for overfitting. Cases with higher daily distress tended to be male with higher baseline THI and PHQ-9 scores. Whereas the influence of THI and PHQ-9 on predicting the tinnitus distress score is not surprising, the gender effect was somehow unexpected, as female patients tend to report higher levels of distress than male in other studies [69,70]. This discrepancy could be due to our small sample size which may not be representative for the tinnitus population. Regarding the treatment effect, tinnitus distress is significantly reduced by 0.06 points per day (trend effect). Thus, considering a study length of about 100 days (84 days intervention phase, 8–19 days baseline phase), tinnitus distress is reduced by 6 units in total (scale: 0–100). This effect is rather weak when compared with the THI which was reduced by almost 12 units (scale: 0–100). The level effect did not reach statistical significance.
Importantly, both the trend effect in tinnitus distress and the THI effect consider the whole study period, i.e. baseline and intervention phase. Thus, presumably in some patients, tinnitus distress improved already to some extent during the baseline phase. This may indeed explain why no group effect was found for tinnitus distress (EMA), as the whole baseline phase was summarized as a contrast to the end of the intervention phase. An improvement during baseline phase could describe an anticipation effect, that is participants experience symptom improvement before the intervention has started because they expect relief from the upcoming intervention [71]. Another possibility is that the daily reflection of one’s own emotional state through EMA somehow contributed to the improvement in tinnitus distress, although prior findings didn’t assume any influence [23,24,35].
Finally, we compared the improvement in THI (pre-post clinical questionnaire) with improvement in tinnitus distress (EMA). ΔTHI was strongly associated with the Distress trend (r = -0.75, p < 0.01) and ΔDistress (r = 0.86, p < 0.001). Despite high correlations, previous findings suggested that the THI could be more sensitive to change than EMA of tinnitus distress. Different thresholds for retrospective questionnaires and EMA might be appropriate. Even though, further validation research is needed to examine whether EMA is feasible to detect relevant changes in tinnitus symptoms and to validate clinical trials. In depression research, EMA has already been compared to standard assessment instruments [72,73]. In those studies, it was shown that EMA did not perform worse than paper-pencil questionnaires using the same items with respect to sensitivity to change. The authors even argued that assessing symptoms with EMA methodology may be more accurate than pre-post questionnaires that reflect just a random time point overlooking the complex clinical picture. The high symptom fluctuation observed here underlines this point. Note that for the Distress trend only the intervention phase was considered, because we did not expect any relevant symptom changes during baseline phase. Thus, an improvement during baseline phase could explain the slightly weaker correlation of the Distress trend with ΔTHI than ΔDistress revealed.
The results in this study should be interpreted alongside considerations of its limitations. First of all, it is a pilot study with a small sample size testing the app-based intervention for the first time, thus, further studies with larger samples sizes are required to confirm its efficacy. Furthermore, due to the online and app-based study environment, data assessment and app usage could not be controlled with respect to correct app usage, user identity, and circumstances of EMA recordings. The latter should be paid special attention, because the given situation might influence the perception of tinnitus, at least its loudness. Considering future research, an implemented sensor detecting the ambient sound level might reduce this bias. Although the natural study setting leads to reduced internal validity, it increases ecological validity on the other hand. Moreover, there was no THI assessment after the baseline phase before the intervention phase started to distinguish effects between the phases. Furthermore, we have no data on long-term outcomes nor from severely affected patients. Nonetheless, based on available evidence one could speculate, that long-term outcomes and the inclusion of more severely affected patients would have increased the observed effect: counseling takes some time to evolve its whole effect and higher baseline scores in tinnitus questionnaires predict better treatment outcomes [27,29,33]. Regarding the EMA subset, we had to exclude 4 more patients because of data not missing at random. This should be considered when interpreting and comparing group effects on THI and tinnitus distress, although the data sets are comparable regarding participant demographics and tinnitus characteristics.
In conclusion, we found good treatment compliance, a meaningful improvement in tinnitus distress and tinnitus handicap for part of the sample and a weakening of the relationship between tinnitus distress and loudness over the course of the intervention. Also, there is a strong correlation between improvement in THI and improvement in EMA of tinnitus distress, however, sensitivity to change could differ and separate thresholds might be appropriate. Importantly, these results should be interpreted alongside the fact that the treatment is unguided, resource-efficient, location-independent and immediately available. On a large scale, it could provide relief for a considerable number of tinnitus patients without any additional cost or effort.
Acknowledgments
We want to thank Susanne Staudinger and Jan Musman who helped implement and conduct the study.
References
- 1. Baguley D, McFerran D, Hall D. Tinnitus. The Lancet. 2013;382: 1600–1607.
- 2.
De Ridder D, Schlee W, Vanneste S, Londero A, Weisz N, Kleinjung T, et al. Tinnitus and tinnitus disorder: Theoretical and operational definitions (an international multidisciplinary proposal). In: Schlee W, Langguth B, Kleinjung T, Vanneste S, De Ridder D, editors. Tinnitus—An Interdisciplinary Approach Towards Individualized Treatment: From Heterogeneity to Personalized Medicine. Amsterdam: Elsevier; 2021. pp. 1–25. https://doi.org/10.1016/S0079-6123(21)X0003-9
- 3. Biswas R, Lugo A, Akeroyd M, Schlee W, Gallus S, Hall D. Tinnitus prevalence in Europe: a multi-country cross-sectional population study. Lancet Reg Health—Eur. 2022;12: 100250. pmid:34950918
- 4. Jarach C, Lugo A, Scala M, Brandt P, Cederroth C, Odone A, et al. Global Prevalence and Incidence of Tinnitus: A Systematic Review and Meta-analysis. JAMA Neurol. 2022;79. pmid:35939312
- 5. Cederroth C, Gallus S, Hall D, Kleinjung T, Langguth B, Maruotti A, et al. Editorial: Towards an Understanding of Tinnitus Heterogeneity. Front Aging Neurosci. 2019;11: 53. pmid:30941029
- 6.
Møller A. Different forms of tinnitus. In: Møller A, Langguth B, De Ridder D, Kleinjung T, editors. Textbook of Tinnitus. New York, NY: Springer New York; 2011. pp. 9–12. https://doi.org/10.1007/978-1-60761-145-5
- 7.
Goodey R. Introduction. In: Møller A, Langguth B, De Ridder D, Kleinjung T, editors. Textbook of Tinnitus. New York, NY: Springer New York; 2011. pp. 523–526. https://doi.org/10.1007/978-1-60761-145-5
- 8. Langguth B, Landgrebe M, Kleinjung T, Sand P, Hajak G. Tinnitus and depression. World J Biol Psychiatry. 2011;12: 489–500. pmid:21568629
- 9. Stobik C, Weber R, Münte T, Walter M, Frommer J. Evidence of psychosomatic influences in compensated and decompensated tinnitus. Int J Audiol. 2005;44: 370–378. pmid:16078732
- 10. Hallam R, Rachman S, Hinchcliffe R. Psychological aspects of tinnitus. In: Rachman S, editor. Contributions to Medical Psychology. 1984. pp. 31–53.
- 11.
Searchfield G, Magnusson J, Shakes G, Biesinger E, Kong O. Counseling and Psycho-Education for Tinnitus Management. In: Møller A, Langguth B, De Ridder D, Kleinjung T, editors. Textbook of Tinnitus. New York, NY: Springer New York; 2011. pp. 535–556. https://doi.org/10.1007/978-1-60761-145-5
- 12. McKenna L, Handscomb L, Hoare D, Hall D. A Scientific Cognitive-Behavioral Model of Tinnitus: Novel Conceptualizations of Tinnitus Distress. Front Neurol. 2014;5. pmid:25339938
- 13. Coles R, Hallam R. Tinnitus and its management. Br Med Bull. 1987;43: 983–998. pmid:3329937
- 14. Mazurek B, Hesse G, Dobel C, Kratzsch V, Lahmann C, Sattel H. Clinical practice guideline: Chronic tinnitus—diagnosis and treatment. Dtsch Ärztebl Int. 2022;119: 219–225. pmid:35197187
- 15. Kleinjung T, Langguth B. Avenue for Future Tinnitus Treatments. Otolaryngol Clin North Am. 2020;53: 667–683. pmid:32381341
- 16. Weise C, Kleinstäuber M, Andersson G. Internet-Delivered Cognitive-Behavior Therapy for Tinnitus: A Randomized Controlled Trial. Psychosom Med. 2016;78: 501–510. pmid:26867083
- 17. Hoare D, Gander P, Collins L, Smith S, Hall D. Management of tinnitus in English NHS audiology departments: an evaluation of current practice: Tinnitus management in England. J Eval Clin Pract. 2012;18: 326–334. pmid:21087449
- 18. Aazh H, Swanepoel D, Moore B. Telehealth tinnitus therapy during the COVID-19 outbreak in the UK: uptake and related factors. Int J Audiol. 2021;60: 322–327. pmid:33000663
- 19. Trochidis I, Lugo A, Borroni E, Cederroth C, Cima R, Kikidis D, et al. Systematic Review on Healthcare and Societal Costs of Tinnitus. Int J Environ Res Public Health. 2021;18: 6881. pmid:34206904
- 20. Maes I, Cima R, Vlaeyen J, Anteunis L, Joore M. Tinnitus: A Cost Study. Ear Hear. 2013;34: 508–514. pmid:23411656
- 21.
Messner E, Probst T, O’Rourke T, Stoyanov S, Baumeister H. mHealth Applications: Potentials, Limitations, Current Quality and Future Directions. In: Baumeister H, Montag C, editors. Digital Phenotyping and Mobile Sensing: New Developments in Psychoinformatics. Cham: Springer International Publishing; 2019. pp. 235–248. https://doi.org/10.1007/978-3-030-31620-4
- 22. Bendig E, Bauereiß N, Ebert D, Snoek F, Andersson G, Baumeister H. Internet-Based Interventions in Chronic Somatic Disease. Dtsch Ärztebl Int. 2018; 659–65. pmid:30381130
- 23. Schlee W, Pryss R, Probst T, Schobel J, Bachmeier A, Reichert M, et al. Measuring the Moment-to-Moment Variability of Tinnitus: The TrackYourTinnitus Smart Phone App. Front Aging Neurosci. 2016;8. pmid:28018210
- 24. Wilson M, Kallogjeri D, Joplin C, Gorman M, Krings JG, Lenze E, et al. Ecological Momentary Assessment of Tinnitus Using Smartphone Technology: A Pilot Study. Otolaryngol Neck Surg. 2015;152: 897–903. pmid:25676150
- 25. Mehdi M, Dode A, Pryss R, Schlee W, Reichert M, Hauck F. Contemporary Review of Smartphone Apps for Tinnitus Management and Treatment. Brain Sci. 2020;10: 867. pmid:33212928
- 26. Oron Y, Ben David B, Doron G. Brief cognitive-behavioral training for tinnitus relief using a mobile application: A pilot open trial. Health Informatics J. 2022;28: 146045822210834. pmid:35349777
- 27. Kutyba J, Gos E, Jędrzejczak W, Raj-Koziak D, Karpiesz L, Niedziałek I, et al. Effectiveness of tinnitus therapy using a mobile application. Eur Arch Otorhinolaryngol. 2022;279: 1257–1267. pmid:33783597
- 28. Henry J, Thielman E, Zaugg T, Kaelin C, Choma C, Chang B, et al. Development and field testing of a smartphone “App” for tinnitus management. Int J Audiol. 2017;56: 784–792. pmid:28669224
- 29. Kim S, Chang M, Hong M, Yoo S, Oh D, Park M. Tinnitus therapy using tailor-made notched music delivered via a smartphone application and Ginko combined treatment: A pilot study. Auris Nasus Larynx. 2017;44: 528–533. pmid:27979609
- 30. Schlee W, Neff P, Simoes J, Langguth B, Schoisswohl S, Steinberger H, et al. Smartphone-Guided Educational Counseling and Self-Help for Chronic Tinnitus. J Clin Med. 2022; 1825. pmid:35407432
- 31. Xiang T, Zhong J, Lu T, Pu J, Liu L, Xiao Y, et al. Effect of educational counseling alone on people with tinnitus: Meta-analysis of randomized controlled trials. Patient Educ Couns. 2020;103: 44–54. pmid:31378310
- 32. Bauer C, Brozoski T. Effect of Tinnitus Retraining Therapy on the Loudness and Annoyance of Tinnitus: A Controlled Trial. Ear Hear. 2011;32: 145–155. pmid:20890204
- 33. Henry J, Schechter M, Zaugg T, Griest S, Jastreboff P, Vernon J, et al. Clinical trial to compare tinnitus masking and tinnitus retraining therapy. Acta Otolaryngol (Stockh). 2006;126: 64–69. pmid:17114146
- 34. Johansen J, Skellgaard P, Caporali S. Effect of Counseling, Amplification and Fractal Tones in Tinnitus Management. J Commun Disord Deaf Stud Hear Aids. 2014;02.
- 35. Gerull K, Kallogjeri D, Piccirillo M, Rodebaugh T, Lenze E, Piccirillo J. Feasibility of Intensive Ecological Sampling of Tinnitus in Intervention Research. Otolaryngol Neck Surg. 2019;161: 485–492. pmid:31013203
- 36. Schlee W, Simoes J, Pryss R. Auricular Acupressure Combined with Self-Help Intervention for Treating Chronic Tinnitus: A Longitudinal Observational Study. J Clin Med. 2021;10: 4201. pmid:34575312
- 37. Lobo M, Moeyaert M, Baraldi Cunha A, Babik I. Single-Case Design, Analysis, and Quality Assessment for Intervention Research. J Neurol Phys Ther. 2017;41: 187–197. pmid:28628553
- 38. Krasny-Pacini A, Evans J. Single-case experimental designs to assess intervention effectiveness in rehabilitation: A practical guide. Ann Phys Rehabil Med. 2018;61: 164–179. pmid:29253607
- 39. Tate R, Perdices M, Rosenkoetter U, Wakim D, Godbee K, Togher L, et al. Revision of a method quality rating scale for single-case experimental designs and n -of-1 trials: The 15-item Risk of Bias in N -of-1 Trials (RoBiNT) Scale. Neuropsychol Rehabil. 2013;23: 619–638. pmid:24050810
- 40. Levin J, Ferron J, Gafurov B. Comparison of randomization-test procedures for single-case multiple-baseline designs. Dev Neurorehabilitation. 2018;21: 290–311. pmid:27367902
- 41. Koehler M, Levin J. Regulated randomization: A potentially sharper analytical tool for the multiple-baseline design. Psychol Methods. 1998;3: 206–217.
- 42.
Schlee W, Schoisswohl S, Staudinger S, Schiller A, Lehner A, Langguth B, et al. Towards a unification of treatments and interventions for tinnitus patients: The EU research and innovation action UNITI. In: Schlee W, Langguth B, Kleinjung T, Vanneste S, De Ridder D, editors. Tinnitus—An Interdisciplinary Approach Towards Individualized Treatment. Amsterdam, Netherlands: Elsevier B.V.; 2021. pp. 441–451. https://doi.org/10.1016/bs.pbr.2020.12.005 pmid:33637231
- 43. Newman C, Jacobson G, Spitzer J. Development of the Tinnitus Handicap Inventory. Arch Otolaryngol—Head Neck Surg. 1996;122: 143–148. pmid:8630207
- 44.
Vogel C, Schobel J, Schlee W, Engelke M, Pryss R. UNITI Mobile—EMI-Apps for a Large-Scale European Study on Tinnitus. 2021 43rd Annual International Conference of the IEEE Engineering in Medicine & Biology Society (EMBC). Mexico: IEEE; 2021. pp. 2358–2362. https://doi.org/10.1109/EMBC46164.2021.9630482
- 45. Nelting M, Rienhoff N, Hesse G, Lamparter U. The assessment of subjective distress related to hyperacusis with a self-rating questionnaire on hypersensitivity to sound. Laryngorhinootologie. 2002;81: 327–334. pmid:12001021
- 46. Kroenke K, Spitzer R, Williams J. The PHQ-9: Validity of a brief depression severity measure. J Gen Intern Med. 2001;16: 606–613. pmid:11556941
- 47. Genitsaridi E, Partyka M, Gallus S, Lopez-Escamez J, Schecklmann M, Mielczarek M, et al. Standardised profiling for tinnitus research: The European School for Interdisciplinary Tinnitus Research Screening Questionnaire (ESIT-SQ). Hear Res. 2019;377: 353–359. pmid:30871820
- 48.
RDocumentation. aregImpute: Multiple Imputation using Additive Regression, Bootstrapping, and Predictive Mean Matching. [cited 6 Jul 2022]. Available: https://www.rdocumentation.org/packages/Hmisc/versions/4.7-0/topics/aregImpute
- 49. Kroenke K, Spitzer R. The PHQ-9: A New Depression Diagnostic and Severity Measure. Psychiatr Ann. 2002;32: 509–515.
- 50. McCombe A, Baguley D, Coles R, McKenna L, McKinney C, Windle-Taylor P. Guidelines for the grading of tinnitus severity: the results of a working group commissioned by the British Association of Otolaryngologists, Head and Neck Surgeons, 1999. Clin Otolaryngol Allied Sci. 2001;26: 388–393. pmid:11678946
- 51. Zeman F, Koller M, Figueiredo R, Aazevedo A, Rates M, Coelho C, et al. Tinnitus Handicap Inventory for Evaluating Treatment Effects: Which Changes Are Clinically Relevant? Otolaryngol Neck Surg. 2011;145: 282–287. pmid:21493265
- 52. Adamchic I, Langguth B, Hauptmann C, Tass P. Psychometric Evaluation of Visual Analog Scale for the Assessment of Chronic Tinnitus. Am J Audiol. 2012;21: 215–225. pmid:22846637
- 53.
Wilbert J. Using the SCDA package (0.8) for analysing single and multiple case AB designs. 2014. Available: https://www.uni-potsdam.de/fileadmin/projects/inklusion/PDFs/SCDA_Documentation.pdf
- 54. Meyerowitz-Katz G, Ravi S, Arnolda L, Feng X, Maberly G, Astell-Burt T. Rates of Attrition and Dropout in App-Based Interventions for Chronic Disease: Systematic Review and Meta-Analysis. J Med Internet Res. 2020;22: e20283. pmid:32990635
- 55. Schleicher M, Unnikrishnan V, Neff P, Simoes J, Probst T, Pryss R, et al. Understanding adherence to the recording of ecological momentary assessments in the example of tinnitus monitoring. Sci Rep. 2020;10: 22459. pmid:33384428
- 56. Unnikrishnan V, Schleicher M, Shah Y, Jamaludeen N, Pryss R, Schobel J, et al. The Effect of Non-Personalised Tips on the Continued Use of Self-Monitoring mHealth Applications. Brain Sci. 2020;10: 924. pmid:33266315
- 57. Fuller T, Cima R, Langguth B, Mazurek B, Vlaeyen J, Hoare D. Cognitive behavioural therapy for tinnitus. Cochrane Database Syst Rev. 2020;1. pmid:31912887
- 58. Engelke M, Schlee W. Welche Therapie für welchen Tinnitus? HNO Nachrichten. 2021;51: 48–49.
- 59. Flückiger C, Del Re A, Wampold B, Horvath A. The alliance in adult psychotherapy: A meta-analytic synthesis. Psychotherapy. 20180524;55: 316. pmid:29792475
- 60. Ebert D, Berking M, Cuijpers P, Lehr D, Pörtner M, Baumeister H. Increasing the acceptance of internet-based mental health interventions in primary care patients with depressive symptoms. A randomized controlled trial. J Affect Disord. 2015;176: 9–17. pmid:25682378
- 61. Mira A, Soler C, Alda M, Baños R, Castilla D, Castro A, et al. Exploring the Relationship Between the Acceptability of an Internet-Based Intervention for Depression in Primary Care and Clinical Outcomes: Secondary Analysis of a Randomized Controlled Trial. Front Psychiatry. 2019;10: 325. pmid:31133899
- 62. Henry J, Galvez G, Turbin M, Thielman E, McMillan G, Istvan J. Pilot Study to Evaluate Ecological Momentary Assessment of Tinnitus. Ear Hear. 2012;33: 179–290. pmid:21960147
- 63.
Schlee W, Kraft R, Schobel J, Langguth B, Probst T, Neff P, et al. Momentary Assessment of Tinnitus—How Smart Mobile Applications Advance Our Understanding of Tinnitus. In: Baumeister H, Montag C, editors. Digital Phenotyping and Mobile Sensing: New Developments in Psychoinformatics. Cham: Springer International Publishing; 2019. pp. 209–220. https://doi.org/10.1007/978-3-030-31620-4
- 64. Probst T, Pryss R, Langguth B, Schlee W. Emotional states as mediators between tinnitus loudness and tinnitus distress in daily life: Results from the “TrackYourTinnitus” application. Sci Rep. 2016;6: 20382. pmid:26853815
- 65. Probst T, Pryss R, Langguth B, Rauschecker J, Schobel J, Reichert M, et al. Does Tinnitus Depend on Time-of-Day? An Ecological Momentary Assessment Study with the “TrackYourTinnitus” Application. Front Aging Neurosci. 2017;9. pmid:28824415
- 66. Goldberg R, Piccirillo M, Nicklaus J, Skillington A, Lenze E, Rodebaugh T, et al. Evaluation of Ecological Momentary Assessment for Tinnitus Severity. JAMA Otolaryngol Neck Surg. 2017;143: 700. pmid:28448659
- 67. Simoes J, Bulla J, Neff P, Pryss R, Marcrum S, Langguth B, et al. Daily Contributors of Tinnitus Loudness and Distress: An Ecological Momentary Assessment Study. Front Neurosci. 2022;16: 883665. pmid:35864989
- 68. Weise C, Kleinstäuber M, Hesser H, Westin V, Gerhard Andersson. Acceptance of Tinnitus: Validation of the Tinnitus Acceptance Questionnaire. Cogn Behav Ther. 2013;42: 100–115. pmid:23627873
- 69. Niemann U, Boecking B, Brueggemann P, Mazurek B, Spiliopoulou M. Gender-Specific Differences in Patients With Chronic Tinnitus—Baseline Characteristics and Treatment Effects. Front Neurosci. 2020;14: 487. pmid:32523506
- 70. Seydel C, Haupt H, Olze H, Szczepek A, Mazurek B. Gender and Chronic Tinnitus: Differences in Tinnitus-Related Distress Depend on Age and Duration of Tinnitus. Ear Hear. 2013;34: 661–672. pmid:23439056
- 71. Ariel B, Sutherland A, Bland M. The trick does not work if you have already seen the gorilla: how anticipatory effects contaminate pre-treatment measures in field experiments. J Exp Criminol. 2021;17: 55–66.
- 72. Targum S, Sauder C, Evans M, Saber J, Harvey P. Ecological momentary assessment as a measurement tool in depression trials. J Psychiatr Res. 2021;136: 256–264. pmid:33621911
- 73. Moore R, Depp C, Wetherell J, Lenze E. Ecological momentary assessment versus standard assessment instruments for measuring mindfulness, depressed mood, and anxiety among older adults. J Psychiatr Res. 2016;75: 116–123. pmid:26851494