Skip to main content
Advertisement
  • Loading metrics

Post-concussion symptom burden and dynamics: Insights from a digital health intervention and machine learning

  • Rebecca Blundell,

    Roles Conceptualization, Formal analysis, Methodology, Validation, Writing – original draft, Writing – review & editing

    Affiliation Department of Neurosurgery, The National Hospital for Neurology and Neurosurgery, London, United Kingdom

  • Christine d’Offay,

    Roles Conceptualization, Data curation, Funding acquisition, Methodology, Project administration, Validation, Writing – review & editing

    Affiliation HeadOn Health Ltd, Edinburgh, United Kingdom

  • Charles Hand,

    Roles Funding acquisition, Investigation, Methodology, Project administration, Writing – review & editing

    Affiliation HeadOn Health Ltd, Edinburgh, United Kingdom

  • Daniel Tadmor,

    Roles Investigation, Methodology, Project administration, Writing – review & editing

    Affiliation Carnegie School of Sport, Leeds Beckett University, Leeds, United Kingdom

  • Alan Carson,

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation Department of Clinical Neurosciences (DCN), Royal Infirmary of Edinburgh, Edinburgh, United Kingdom

  • David Gillespie,

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliation Department of Clinical Neurosciences (DCN), Royal Infirmary of Edinburgh, Edinburgh, United Kingdom

  • Matthew Reed,

    Roles Conceptualization, Funding acquisition, Methodology, Project administration, Supervision, Writing – review & editing

    Affiliations The Emergency Medicine Research Group Edinburgh (EMERGE), Royal Infirmary of Edinburgh, Edinburgh, United Kingdom, Acute Care Edinburgh, Usher Institute, The University of Edinburgh, Edinburgh, United Kingdom Department of Clinical Neuroscience, Edinburgh Royal Infirmary, Edinburgh, United Kingdom

  • Aimun A. B. Jamjoom

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    v1ajamjo@ed.ac.uk

    Affiliations HeadOn Health Ltd, Edinburgh, United Kingdom, Centre for Clinical Brain Sciences, The University of Edinburgh, Edinburgh, United Kingdom, Department of Neurosurgery, Queen’s Hospital, Romford, United Kingdom

Abstract

Individuals who sustain a concussion can experience a range of symptoms which can significantly impact their quality of life and functional outcome. This study aims to understand the nature and recovery trajectories of post-concussion symptomatology by applying an unsupervised machine learning approach to data captured from a digital health intervention (HeadOn). As part of the 35-day program, patients complete a daily symptom diary which rates 8 post-concussion symptoms. Symptom data were analysed using K-means clustering to categorize patients based on their symptom profiles. During the study period, a total of 758 symptom diaries were completed by 84 patients, equating to 6064 individual symptom ratings. Fatigue, sleep disturbance and difficulty concentrating were the most prevalent symptoms reported. A decline in symptom burden was observed over the 35-day period, with physical and emotional symptoms showing early rates of recovery. In a correlation matrix, there were strong positive correlations between low mood and irritability (r = 0.84), and poor memory and difficulty concentrating (r = 0.83). K-means cluster analysis identified three distinct patient clusters based on symptom severity. Cluster 0 (n = 24) had a low symptom burden profile across all the post-concussion symptoms. Cluster 1 (n = 35) had moderate symptom burden but with pronounced fatigue. Cluster 2 (n = 25) had a high symptom burden profile across all the post-concussion symptoms. Reflecting the severity of the clusters, there was a significant relationship between the symptom clusters for both the Rivermead (p = 0.05) and PHQ-9 (p = 0.003) questionnaires at 6-weeks follow-up. By leveraging digital ecological momentary assessments, a rich dataset of daily symptom ratings was captured allowing for the identification of symptom severity clusters. These findings underscore the potential of digital technology and machine learning to enhance our understanding of post-concussion symptomatology and offer a scalable solution to support patients with their recovery.

Author summary

Individuals who sustain a concussion can experience a range of post-concussion symptoms that can significantly impact their quality of life. In this study, we used digital technology to capture daily symptom ratings from 84 patients over a 35-day period as they recovered from a concussion. This provided a rich dataset of over 6,000 individual symptom assessments, one of the largest collections of post-concussion symptom data to date. We found that fatigue, sleep disturbance, and difficulty concentrating were among the most prevalent and severe symptoms reported by patients. While the overall symptom burden declined over the 35 days, there was variation in how quickly different symptoms improved, with physical and emotional symptoms showing early recovery. By applying machine learning techniques, we were able to identify three distinct clusters of patients based on their symptom severity profile. These symptom clusters correlated with outcomes like depression and concussion symptomatology scores at 6 weeks. Our findings underscore how digital tools and data science approaches can provide novel insights into post-concussion symptomatology. Capturing granular, daily symptom data allowed us to characterize patient trajectories and identify differing symptom burden phenotypes. This scalable approach could help guide more personalized management strategies for patients recovering from concussion.

Introduction

Individuals who sustain a concussion can experience a constellation of post-concussion symptoms, including physical (e.g., headaches and dizziness), cognitive (e.g., difficulty concentrating and memory problems), emotional (e.g., depression and anxiety) symptoms and sleep disturbance (hypo- or hyper-somnolence) [1]. Post-concussion symptomatology is highly heterogenous with a variety of symptom profiles and recovery trajectories [2]. Although symptom burden tends to improve over time, up to 40% or individuals can develop persistent symptoms up to a year after injury [3,4]. A high post-concussion symptom burden is associated with work absenteeism [5,6], poor quality of life [7] and difficulties with community integration [8]. Understanding the nature and recovery trajectories of post-concussion symptomatology is important to inform discussions with patients, guide management plans and allocate healthcare resources cost-effectively. Studies examining post-concussion symptoms have typically captured data at a limited number of time-points, usually weeks or months apart. We therefore lack a granular understanding of daily post-concussion symptom burden and dynamics. Scalable digital technology provides the opportunity to capture a large volume of symptom and recovery data from patients through digital ecological momentary assessments. We developed HeadOn, a digital health intervention designed to support patients with their recovery after a concussion [9]. During HeadOn patients share data on their symptoms and recovery. In this article, we describe the analysis of digitally collected data using machine learning approaches with the aim of providing novel insights into post-concussion symptom clusters and recovery trajectories.

Materials and methods

Digital Health Intervention

HeadOn is a digital health intervention designed to support patients with their recovery after a concussion (Fig 1). It was developed using a systematic evidence-, theory-, and person-based approach and the Medical Research Council (MRC) guidance on the development of complex interventions [9,10]. HeadOn is delivered as a web application and runs over 5 stages sequentially, with each stage lasting 7 days (total duration of 35 days). On registering, patients filled out a simple questionnaire covering demographics and whether the concussion was sports-related and if they had consumed alcohol at the time of the injury. They also completed baseline questionnaires including Rivermead Post-Concussion Symptom Questionnaire, Patient Health Questionnaire-9 (PHQ-9) and the FAST alcohol screening test [1113]. These measures were chosen as they are well validated questionnaires that have been used extensively in concussion research [14,15]. The five stages of HeadOn are (1) Understanding your symptoms, (2) Sleep after a concussion, (3) Lifestyle and exercise, (4) Your thoughts, and (5) Getting back to baseline (Fig 2). During each stage, the patient is invited to complete a task and has access to a range of multimedia educational material. The weekly tasks vary by stage and comprise: completing symptom diaries, setting exercise goals, counting alcohol unit consumption, completing a thought diary and setting up a sleep time routine (Table 1). Completing the symptom diary is a core task of HeadOn and patients are invited to complete it every day of the 35-day program. The symptom diary can be completed once at any time during the day. This single daily Ecological Momentary Assessment (EMA) data capture at a random time is a well-established sampling methodology [16]. The 35-day cut off was decided in conjunction with patients during the co-development process [9]. The rationale behind it was based on evidence that patient engagement with digital interventions diminishes as patients recover and that the majority of patients’ post-concussion symptom burden improves around a month post-injury [17,18]. In the symptom diary, patients can rate 8 post-concussion symptoms from 0 (‘none’) to 4 (‘severe’). The symptoms include: sleep disturbance, dizziness, headache, difficulty concentrating, poor memory, low mood, irritability, and fatigue. At the end of HeadOn, patients were invited to complete the Rivermead and PHQ-9 questionnaires again. A 6-week functional outcome, the Glasgow Outcome Score Extended, was also collected by telephone for a group of the study participants.

thumbnail
Fig 1. Demonstration of the HeadOn user interface including the symptom support area and progress tracker.

Image used with permission from HeadOn Health Ltd under the Creative Commons Attribution 4.0 International (CC BY 4.0) license.

https://doi.org/10.1371/journal.pdig.0000697.g001

thumbnail
Fig 2. Schematic of the HeadOn user journey across the sequential 5 stages which each last 1 week, alongside when the core HeadOn tasks are introduced to the user.

SD: Symptom diary; SS: Sleep setting; AT: Alcohol tracker; ES: Exercise setting; TM: Thought monitor; GS: Goal setting. Image used with permission from HeadOn Health Ltd under the Creative Commons Attribution 4.0 International (CC BY 4.0) license.

https://doi.org/10.1371/journal.pdig.0000697.g002

thumbnail
Table 1. Summary of the HeadOn digital health intervention, these are consecutive weeks with associated tasks9.

PHQ-9: Patient Health Questionnaire 9; CBT: Cognitive Behavioural Therapy; SMART: Specific, Measurable, Achievable, Relevant, and Time-Bound.

https://doi.org/10.1371/journal.pdig.0000697.t001

Study participants

Participants were recruited over two study phases. The first phase was a prospective cohort study conducted in the Royal Infirmary of Edinburgh Emergency Department (ED) which ran between November 2021 and April 2022. Inclusion criteria for the study were aged ≥16 years presenting with a concussion, which was defined according to the American Congress of Rehabilitation Medicine—a traumatically induced disruption of brain function presenting as any alteration of mental status, loss of consciousness, or posttraumatic amnesia [19]. Patients (n = 50) presenting to the ED with a concussion were invited to participate and use HeadOn freely. After completion of the study, HeadOn was implemented into the Royal Infirmary of Edinburgh ED concussion care pathway and patients diagnosed with a concussion by an emergency physician were signposted to the intervention. A total of 44 patients registered with HeadOn between August and November 2023.

Statistical analysis

Engagement rates with HeadOn tasks were defined as the percentage of participants who completed a particular task during the course of the HeadOn program (eg: the percentage of participants who completed a thought diary). The normality of continuous data was checked using the Shapiro-Wilk test. The Kruskal Wallis test was used for comparison of non-parametric continuous data and the Chi-squared test for categorical data. For correlational analyses, the Spearman rank correlation coefficient was calculated. For the symptom diary data analysis, the average symptom ratings for each patient were calculated to generate the correlation matrix. K-means clustering was used to categorise the average symptom ratings for each patient across the 8 post-concussion symptoms. To determine the optimal number of clusters, we applied the Elbow Method examining the inertia decrease across 1 to 6 potential clusters. Following this, K-means clustering was performed with the chosen number of clusters. The results were then visualized using Principal Component Analysis (PCA) to reduce the dataset to two dimensions for easy graphical representation. Data analysis and visualisation were conducted with Python using the Data Analyst function of ChatGPT.

Ethics statement

The prospective cohort study adhered to the relevant ethical guidelines and regulations, gaining approval from the North West—Preston Research Ethics Committee (reference 21/NW/0211) on September 14, 2021. Participants in this study (n = 50) provided written informed consent prior to involvement. They received no compensation for taking part. After implementation of HeadOn at the Royal Infirmary of Edinburgh ED, patients (n = 44) did not provide consent as HeadOn was part of routine clinical practice. This phase of the study was approved as a service evaluation by the Royal Infirmary of Edinburgh Clinical Governance department. Data collected during the research were securely maintained according to the privacy and data protection policies of the University of Edinburgh and NHS Lothian. The databases utilized met industry standards for safeguarding sensitive information. Data exported from HeadOn underwent de-identification and encryption before analysis.

Results

Baseline patient parameters and intervention engagement

A total of 94 patients were included in the study. Average patient age was 41(±16) and 65.9% were female. At the time of concussion, 31 (32.9%) had consumed alcohol and 18 (19.1%) concussions were sports related. The average time from concussion to registration with HeadOn was 7 (±8) days. Across the six core HeadOn tasks, engagement was as follows: symptoms diary (n = 84, 89.3%), sleep setting (n = 50, 53.1%), exercise planning (n = 39, 41.4%), alcohol tracker (n = 44, 44.6%), thought diary (n = 30, 31.9%) and goal setting (n = 22, 23.4%). Twenty-one (22.3%) participants were high engagers, which was defined as participants completing all the tasks across the 5 stages of HeadOn. Table 2 summarises patient parameters and user engagement with each of the tasks.

thumbnail
Table 2. Summary of patient demographics, baseline patient reported outcome scores and user engagement with the HeadOn tasks across the 5 stages.

https://doi.org/10.1371/journal.pdig.0000697.t002

Post-concussion symptom burden and dynamics

At registration, the average Rivermead was 32 (±13) and PHQ-9 was 13 (±7). There was a positive Spearman’s rank correlation coefficient between Rivermead and PHQ-9 (0.78; p<0.001). During the study period, a total of 758 symptom diaries were completed by 84 patients (average of 9 diaries per patient). This equated to 6064 individual post-concussion symptom ratings. Overall aggregate symptom scores burdens (total score across 8 symptoms = 5726) revealed the following burden of post-concussion symptomatology: fatigue (864; 15.1%), sleep disturbance (824; 14.4%), difficulty concentrating (724; 12.6%), low mood (710; 12.4%), poor memory (699; 12.2%), headache (695; 12.1%), dizziness (606; 10.6%) and irritability (604; 10.6%). Aggregate daily symptom scores demonstrated wide variation but an overall trend to declining symptom burden over the 35-day HeadOn program (Fig 3A). Temporal analysis of individual post-concussion symptoms revealed inter-symptom variation in the recovery dynamics (Fig 3B). Physical (headache and dizziness) and emotional (irritability and low mood) symptoms demonstrated earlier rates of recovery from day 14 days of HeadOn. In contrast, it was not until day 28 that improvements in fatigue and sleep disturbance were observed. In the correlation matrix, there were strong positive correlations between low mood and irritability (r = 0.84), poor memory and difficulty concentrating (r = 0.83), and difficulty concentrating and fatigue (r = 0.79) (Fig 4).

thumbnail
Fig 3.

Aggregate daily symptom burden over the 35-day HeadOn program (A) heat map depicting temporal changes in individual post-concussion symptom burden over the course of HeadOn (B).

https://doi.org/10.1371/journal.pdig.0000697.g003

thumbnail
Fig 4. Correlation matrix of the 8 post-concussion symptoms averaged over the course of HeadOn for 84 patients.

https://doi.org/10.1371/journal.pdig.0000697.g004

Post-concussion symptom k-means clustering

Next, we applied K-means clustering to categorise the 84 patients who inputted symptom data. We opted for 3 clusters after the application of the Elbow Method (Fig 5A). Following this, K-means clustering was performed with the chosen number of clusters. The results were then visualised using Principal Component Analysis (PCA) to reduce the dataset to two dimensions for easy graphical representation (Fig 5B). The symptom profiles of each cluster were defined in radar plots (Fig 5C). Cluster 0 (n = 24) had a low symptom burden profile across all the post-concussion symptoms. While Cluster 1 (n = 35) had moderate symptom burden but with more pronounced fatigue. Cluster 2 (n = 25) had a high symptom burden profile across all the post-concussion symptoms. Comparison of the clusters demographics and baseline features found no significant difference in the average age or time to registration for HeadOn from injury (Table 3). There was a higher percentage of males in Cluster 0 compared to the other two clusters. Baseline Rivermead and PHQ-9 scores were significantly different across the three clusters and reflected the symptom burdens of the clusters throughout HeadOn. At the completion of HeadOn, 28 (29.8%) participants completed the Rivermead and PHQ-9 questionnaires. There was a significant relationship between the symptom clusters for both the Rivermead (p = 0.05) and PHQ-9 (p = 0.003), reflecting the severity of the clusters (Table 4). For participants with 6-week functional outcome (n = 27; 28.7%), there was a higher percentage of participants with a GOSE <8 in Cluster 2 (62.5%) compared to Clusters 0 (26.3%) and 1 (37.5%), but this did not reach statistical significance (p = 0.47).

thumbnail
Fig 5.

Determining the optimum number of clusters using Elbow method (A) k-means clustering visualized using Principal Component Analysis (B) radar plots demonstrating clusters symptom burden. SD: sleeping difficulty; Dz: dizziness; Hd: Headache; Di: difficulty concentrating; Pm: poor memory; Lm: low mood; Ir: irritability; Ft: fatigue.

https://doi.org/10.1371/journal.pdig.0000697.g005

thumbnail
Table 3. Comparison of demographics and baseline patient reported scores between the three symptomatology clusters.

PHQ-9: Patient Health Questionnaire 9.

https://doi.org/10.1371/journal.pdig.0000697.t003

thumbnail
Table 4. Comparison of outcome data at 6 weeks between the three symptomatology clusters.

PHQ-9: Patient Health Questionnaire 9; GOSE: Glasgow Outcome Score Extended.

https://doi.org/10.1371/journal.pdig.0000697.t004

Qualitative analysis of patient perspectives, concerns, and goals

A total of 53 thought diaries were completed by 30 patients with an average of 1.8 diaries per patient (range 1–7). Thematic analysis demonstrated 7 distinct themes to patient thoughts about their concussion recovery. For just under a fifth of thought diary entries (16.9%), patients shared positive feelings and optimism about their recovery. This included entries such as ‘Not my fault. Feeling fine, and proud my recovery has been so swift’. Conversely, the rest of the entries conveyed concern including: ‘frustration about their post-concussion symptoms’ (18.8%)–“I was annoyed that it was taking so long to go away because it came at the worst possible time”, ‘uncertainty on daily life and the future’ (15.1%)—“How long will it take until I make a recovery and return back to college to complete my course”, ‘guilt and regret at not preventing the incident’ (15.1%), ‘anxious, lethargic and depressed mood’ (13.2%), ‘scared about post-concussion symptoms’ (11.3%) and ‘concern about poor memory and concentration’ (9.4%)—“I feel distressed that I can’t remember how I fell and frightened at the sight of blood when I gained consciousness”. A total of 35 goals were set by 22 patients with an average of 1.6 goals per patient (range 1–6). The most common goal set by patients centred on physical activity (82.9%). This was followed by work-related goals (5.7%), sleep goals (2.9%) and dietary goals (2.9%). The average subjective difficulty rating of achieving these goals (0 = easy, 4 = hard) was 2.3 (±1.1). Just under half (45.7%) of patients recorded in HeadOn that they had attained their goals. The top four reasons quoted by patients on what helped them achieve their goals were: ‘being organised’ (25.7%), ‘being motivated and focused’ (25.7%), ‘performed coping exercises’ (17.1%) and ‘getting good sleep’ (14.2%). Conversely, the four reasons that patient didn’t achieve their goals were: ‘being anxious, lethargic and lack of motivation’ (50.0%), ‘work and lack of time’ (17.1%), ‘feeling scared and apprehensive’ (14.2%) and the ‘impact of poor weather’ (8.6%).

Discussion

Post-concussion symptoms can have a significant impact on patients’ function and quality of life [4,7]. Understanding concussion symptomatology and dynamics is vital to inform personalised patient management. In this study, we present one of the largest post-concussion symptomatology datasets which was gathered using digital ecological momentary assessments. This included over 6000 symptom ratings from 84 patients covering 35 days. We identified the most severe post-concussion symptoms experienced by patients using HeadOn. We also confirmed a temporal decline in the burden of symptoms. By applying machine learning approaches, we identified three clusters of patients based on the severity of symptom burden. Ecological momentary assessments have been employed with individuals who have experienced a concussion in the past. Lewandowski and colleagues examined six adolescents (three of whom suffered a concussion and three non-injured controls) using ecological momentary assessments for 5 days [20]. More recently, a further study captured daily symptom data on 34 adolescents who had experienced a concussion for 20 days [21]. A similar study examined 10 adolescents with a recent concussion over 20 days [22]. Our study surpasses what was previously reported in the literature both in terms of the scale and volume of data.

In our sample, we found that fatigue, low mood and difficulty concentrating were the top three symptoms in terms of severity. This is in keeping with previous reports including a longitudinal population study spanning two weeks to 1-year post-injury [23]. The authors found fatigue to be the most prevalent post-concussion symptom. Other studies have suggested that somatic symptoms (headache and dizziness) are prominent in the early stage (1–2 weeks) and then psychosocial symptoms (irritability and low mood) are reported increasingly often in the later period of recovery (4–8 weeks) [24]. We did not find this in our studied cohort who registered for HeadOn an average of 7 days from injury. The temporal profile of symptoms pointed toward a general improvement across all symptom types and no evidence of delayed worsening of psychosocial symptomatology. The trend of improving symptom burden over time has been reported by other authors. Wiebe and colleagues captured ecological momentary assessments over a period of 20 days and found a gradual decline in the severity of post-concussion symptom burden [21]. The same group conducted a larger study examining time to symptom resolution in a cohort of 118 of adolescent patients with sports-related concussion [25]. They found that by using mobile ecological momentary assessments, they could identify patients with symptom resolution between 9–10 days post injury compared to clinical clearance at a clinical consultation which took an average of 14 days. The authors argue that digital ecological momentary assessments allow remote monitoring and expedite treatment decisions.

By using k-means cluster analysis, we identified three clusters of patient post-concussion symptomatology. This machine learning approach has been used to identify symptom-based patient clusters in a variety of diseases including COVID, cervical myelopathy and cancer [2628]. K-means cluster analysis doesn’t demand significant computational power and performs well with moderate datasets of continuous numerical data. This makes it a powerful analytical approach to examining symptom rating data. The symptom severity clusters we identified have the potential to support clinical decision-making and the delivery of targeted support to those in higher risk clusters. However, prior to translation into clinical practice, these clusters need to be both internally validated in a larger dataset from HeadOn (which is on-going) and undergo external validation from another concussion symptom dataset. A recent review of concussion subtypes identified five groups based on symptom profile rather than severity: cognitive, oculomotor, headache-migraine, vestibular and anxiety-mood [2]. These profiles were based on patient assessments within 3 days of concussive injury, earlier than the profiles determined in the current study. The headache-migraine subtype was the most prevalent in children whereas the cognitive subtype was most prevalent in adults. Interestingly, in our analysis there was evidence of positive correlation between post-concussion symptom subtypes including the cognitive (difficulty concentrating and poor memory) and emotional (irritability and low mood) symptoms. However, when k-means clustering was applied, patients were grouped based on symptom severity rather than symptom-type profile. K-means clustering groups cases based on data proximity in a feature space, which in the context of this study, was defined by symptom ratings. These findings suggest that in our dataset, the variation in symptom severity across cases was more pronounced than the variation in the types of symptoms experienced. This fits with another k-means cluster analysis of concussion patient who identified five clusters where symptom severity was the main differentiator of the cluster phenotypes [29]. A series of outcome measures including the Patient-Reported Outcomes Measurement Information System, Dizziness Handicap Inventory, Pain Catastrophizing Scale, and Immediate Post-Concussion Assessment and Cognitive Testing Tool were analysed retrospectively from 275 patients. This analysis supports our finding that post-concussion symptom heterogeneity appears to lie more with variation in severity of symptom burden, rather than symptom-specific profiles. This holds relevance to determining clinic outcome as there is growing evidence that symptom burden at 2–3 weeks post-injury is a strong predictor of functional outcome at 6 months [30].

There is a fine balance in developing digital interventions for concussion between the value in supporting patients against concerns on the impact of screen time on recovery. Concussion guidance is to limit screen time early after an injury. A clinical trial looking at this question found that patients who abstained from screen time for the first 48 hours after their injury had a shorter recovery than those permitted to engage in screen time [31] In the trial, the screen time–abstinent group had 130 minutes of screen time in the first 3 days after their injury. Although HeadOn is delivered mostly through a screen (mobile or desktop), there is the option of consuming some of the content through audio. Also, HeadOn was designed to be delivered with limited screen time (5–10 minutes per day), which could easily be achieved within the 130 minutes of the intervention group quoted in the screen time RCT.

This study has several limitations. Firstly, patients volunteered to use HeadOn and input data into the symptom diaries. This may have introduced selection bias based both in terms of the participants but also the amount and type of data collected. Alongside this, the fact that the average sign-up time to HeadOn was 7 days means that the data presented in the article likely represents a higher severity group who opted to access support later in their recovery journey. Therefore, caution should be used extrapolating these findings to all de-novo patients at the start of their recovery following a concussion. HeadOn measured symptoms once daily at a random time and therefore it was not possible to provide insights into diurnal variation of concussive symptoms. A once daily approach is not uncommon in brain injury EMA research as it can provide a longer view of symptom burden over weeks or months [32]. For the correlation matrix and k-means clustering, symptom burdens for each patient were averaged across 35-day program meaning these analyses provided an overview of the study period rather than a temporal analysis.

Conclusions

Post-concussion symptomatology is highly heterogenous and can have a significant impact on patient outcome. By leveraging digital ecological momentary assessments, we have captured a rich dataset of post-concussion symptom burden over a 35-day period. K-means analysis identified three patient clusters based on the severity of symptom burden. By leveraging these approaches, patients with high symptom burden can be identified and supported at scale to meet the public health challenge of concussion.

Acknowledgments

We would like to extend our gratitude to all the patients who participated in this study and took the time to use HeadOn. We would also like to thank Julia Grahamslaw and Alison Grant from the Emergency Medicine Research Group Edinburgh (EMERGE) who supported the delivery of the research study. Finally, we would like to thank Dr Molly Brewster for her work on implementing HeadOn into the concussion care pathway at the emergency department in The Royal Infirmary of Edinburgh. Finally, we would like thank our funders: The NIHR Brain Injury MedTech Co-operative and the Scottish EDGE.

References

  1. 1. Levin HS, Diaz-Arrastia RR. Diagnosis, prognosis, and clinical management of mild traumatic brain injury. Lancet Neurol. 2015;14: 506–517. pmid:25801547
  2. 2. Lumba-Brown A, Teramoto M, Josh Bloom O, Brody D, Chesnutt J, Clugston JR, et al. Concussion Guidelines Step 2: Evidence for Subtype Classification. Neurosurgery. 2020;86: 2–13. pmid:31432081
  3. 3. Cnossen MC, van der Naalt J, Spikman JM, Nieboer D, Yue JK, Winkler EA, et al. Prediction of Persistent Post-Concussion Symptoms after Mild Traumatic Brain Injury. J Neurotrauma. 2018;35: 2691–2698. pmid:29690799
  4. 4. McMahon P, Hricik A, Yue JK, Puccio AM, Inoue T, Lingsma HF, et al. Symptomatology and Functional Outcome in Mild Traumatic Brain Injury: Results from the Prospective TRACK-TBI Study. J Neurotrauma. 2013;8: 1–8. pmid:23952719
  5. 5. Graff HJ, Deleu NW, Christiansen P, Rytter HM. Facilitators of and barriers to return to work after mild traumatic brain injury: A thematic analysis. Neuropsychol Rehabil. 2020. pmid:32584206
  6. 6. Gaudette É, Seabury SA, Temkin N, Barber J, Digiorgio AM, Markowitz AJ, et al. Employment and Economic Outcomes of Participants with Mild Traumatic Brain Injury in the TRACK-TBI Study. JAMA Netw Open. 2022;5: 1–11. pmid:35767257
  7. 7. Emanuelson I, Andersson Holmkvist E, Bjorklund R, Stalhammar D. Quality of life and post-concussion symptoms in adults after mild traumatic brain injury: a population-based study in western Sweden. Acta Neurol Scand. 2003;108: 332–338. pmid:14616303
  8. 8. Stålnacke B-M. Community integration, social support and life satisfaction in relation to symptoms 3 years after mild traumatic brain injury. Brain Inj. 2007;21: 933–942. pmid:17729046
  9. 9. d’Offay C, Ng XY, Alexander L, Grant A, Grahamslaw J, Pagliari C, et al. A Digital Health Intervention for Concussion: Development and Clinical Feasibility Study. JMIR Form Res. 2023;7. pmid:36724010
  10. 10. Skivington K, Matthews L, Simpson SA, Craig P, Baird J, Blazeby JM, et al. A new framework for developing and evaluating complex interventions: Update of Medical Research Council guidance. The BMJ. 2021;374: 1–11. pmid:34593508
  11. 11. King NS, Crawford S, Wenden FJ, Moss NEG, Wade DT. The Rivermead Post Concussion Symptoms Questionnaire: a measure of symptoms commonly experienced after head injury and its reliability. Journal of Neurology 1995 242:9. 1995;242: 587–592. pmid:8551320
  12. 12. Kroenke K, Spitzer RL. The PHQ-9: A new depression diagnostic and severity measure. Psychiatr Ann. 2002;32: 509–515.
  13. 13. Hodgson R, Alwyn T, John B, Thom B, Smith A. THE FAST ALCOHOL SCREENING TEST. Alcohol and Alcoholism. 2002;37: 61–66. pmid:11825859
  14. 14. Maruta J, Lumba-Brown A, Ghajar J. Concussion Subtype Identification With the Rivermead Post-concussion Symptoms Questionnaire. Front Neurol. 2018;9. pmid:30559709
  15. 15. Carson JD, Healey KE, Frémont P. Using the PHQ-9 to identify and manage depressive symptoms in patients with sport-related concussion. Canadian Family Physician. College of Family Physicians of Canada; 2021. pp. 183–184. pmid:33727378
  16. 16. Dawood S, Hallquist MN, Pincus AL, Ram N, Newman MG, Wilson SJ, et al. Comparing Signal-Contingent and Event-Contingent Experience Sampling Ratings of Affect in a Sample of Psychotherapy Outpatients. J Psychopathol Behav Assess. 2020;42: 13–24. pmid:33664551
  17. 17. Iverson GL, Gardner AJ, Terry DP, Ponsford JL, Sills AK, Broshek DK, et al. Predictors of clinical recovery from concussion: A systematic review. British Journal of Sports Medicine. BMJ Publishing Group; 2017. pp. 941–948. pmid:28566342
  18. 18. Sufrinko AM, Howie EK, Charek DB, Elbin RJ, Collins MW, Kontos AP. Mobile Ecological Momentary Assessment of Postconcussion Symptoms and Recovery Outcomes. J Head Trauma Rehabil. 2019;34. Available: https://journals.lww.com/headtraumarehab/fulltext/2019/11000/mobile_ecological_momentary_assessment_of.15.aspx pmid:30829823
  19. 19. Kay T, Harrington DE, Adams R. American Congress of Rehabilitation Medicine, Head Injury Interdisciplinary Special Interest Group. Definition of mild traumatic brain injury. J Head Trauma Rehabil. 1993;8: 86–87.
  20. 20. Lewandowski L, Rieger B, Smyth J, Perry L, Gathje R. Measuring Post-concussion Symptoms in Adolescents: Feasibility of Ecological Momentary Assessment. Archives of Clinical Neuropsychology. 2009;24: 791–796. pmid:19892712
  21. 21. Wiebe DJ, Nance ML, Houseknecht E, Grady MF, Otto N, Sandsmark DK, et al. Ecologic Momentary Assessment to Accomplish Real-Time Capture of Symptom Progression and the Physical and Cognitive Activities of Patients Daily Following Concussion. JAMA Pediatr. 2016;170: 1108–1110. pmid:27617669
  22. 22. Rabinowitz AR, Fisher AJ. Person-Specific Methods for Characterizing the Course and Temporal Dynamics of Concussion Symptomatology: A Pilot Study. Sci Rep. 2020;10: 1–9. pmid:31988354
  23. 23. Theadom A, Parag V, Dowell T, McPherson K, Starkey N, Barker-Collo S, et al. Persistent problems 1 year after mild traumatic brain injury: a longitudinal population study in New Zealand. British Journal of General Practice. 2016;66: e16–e23. pmid:26719482
  24. 24. Yang C-C, Tu Y-K, Hua M-S, Huang S-J. The association between the postconcussion symptoms and clinical outcomes for patients with mild traumatic brain injury. J Trauma. 2007;62: 657–663. pmid:17414343
  25. 25. Wiebe DJ, Storey EP, Orchinik JE, Grady MF, Leddy JJ, Willer BS, et al. Measuring Recovery With Ecological Momentary Assessment in a Randomized Trial of Exercise After Sport-Related Concussion. Clinical Journal of Sport Medicine. 2022;32: 345–353.
  26. 26. Touzet AY, Rujeedawa T, Munro C, Margetis K, Davies B. MACHINE LEARNING AND SYMPTOM PATTERNS IN DEGENERATIVE CERVICAL MYELOPATHY: AN ONLINE SURVEY STUDY (Preprint). JMIR Form Res. 2023;8: 1–8. pmid:38271070
  27. 27. Xu H, Mohamed M, Flannery M, Peppone L, Ramsdale E, Loh KP, et al. An Unsupervised Machine Learning Approach to Evaluating the Association of Symptom Clusters with Adverse Outcomes among Older Adults with Advanced Cancer: A Secondary Analysis of a Randomized Clinical Trial. JAMA Netw Open. 2023;6: E234198. pmid:36947036
  28. 28. Epsi NJ, Powers JH, Lindholm DA, Mende K, Malloy A, Ganesan A, et al. A machine learning approach identifies distinct early-symptom cluster phenotypes which correlate with hospitalization, failure to return to activities, and prolonged COVID-19 symptoms. PLoS One. 2023;18: 1–16. pmid:36757946
  29. 29. Rosenblatt CK, Harriss A, Babul AN, Rosenblatt SA. Machine Learning for Subtyping Concussion Using a Clustering Approach. Front Hum Neurosci. 2021;15: 1–10. pmid:34658816
  30. 30. Mikolić A, Steyerberg EW, Polinder S, Wilson L, Zeldovich M, von Steinbueche N, et al. Prognostic Models for Global Functional Outcome and Post-Concussion Symptoms Following Mild Traumatic Brain Injury: A Collaborative European NeuroTrauma Effectiveness Research in Traumatic Brain Injury (CENTER-TBI) Study. J Neurotrauma. 2023;40: 1651–1670. pmid:37078144
  31. 31. Macnow T, Curran T, Tolliday C, Martin K, McCarthy M, Ayturk D, et al. Effect of Screen Time on Recovery From Concussion: A Randomized Clinical Trial. JAMA Pediatr. 2021;175: 1124–1131. pmid:34491285
  32. 32. Mitchell RJ, Goggins R, Lystad RP. Synthesis of evidence on the use of ecological momentary assessments to monitor health outcomes after traumatic injury: rapid systematic review. BMC Med Res Methodol. 2022;22. pmid:35459086