https://orcid.org/0000-0002-6785-214X
Figures
Abstract
Introduction
In patients suspected of stroke or transient ischemic attack (TIA), rapid triaging is imperative to improve clinical outcomes. For this purpose, balance-eye-face-arm-speech-time (BEFAST) items are used in out-of-hours primary care (OHS-PC). We explored the risk of stroke and TIA among BEFAST positive patients calling to the OHS-PC, and assessed whether additional predictors could improve risk stratification.
Methods
This is a cross-sectional study of retrospectively gathered routine care data from telephone triage tape-recordings of patients calling the OHS-PC with neurological deficit symptoms, classified as BEFAST positive. Four models–with the predictors age, sex, a history of cardiovascular or cerebrovascular disease, and cardiovascular risk factors–were fitted using logistic regression to predict the outcome stroke or TIA. Likelihood ratio testing was used to select the best model, which was subsequently internally validated.
Results
The risk of stroke or TIA diagnosis was 52% among 1,289 BEFAST positive patients, median age 72 years, 56% female sex. Of patients with the outcome stroke/TIA, 24% received a low urgency allocation, while 92% had signs or symptoms when calling. Only the addition of age and sex improved predicting stroke or TIA (internally validated c-statistic 0.72, 95%CI 0.69–0.75). The predicted risk of stroke or TIA remained below 20% in those aged below 40. Females aged 70 or over and males aged 55 or over, had a predicted risk above 50%.
Citation: van Royen FS, Geersing G-J, Erkelens DC, Delissen M, Rutten JVF, Zwart DL, et al. (2024) Additional predictors of stroke and transient ischaemic attack in BEFAST positive patients in out-of-hours emergency primary care. PLoS ONE 19(9): e0310769. https://doi.org/10.1371/journal.pone.0310769
Editor: Shashank Shekhar, Duke University Medical Center: Duke University Hospital, UNITED STATES OF AMERICA
Received: January 22, 2024; Accepted: September 5, 2024; Published: September 20, 2024
Copyright: © 2024 van Royen et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: Data cannot be shared publicly because there are ethical restrictions being placed upon the data. The data contain potentially identifying and sensitive patient information. Moreover, a third party was involved in providing the telephone triage recordings from which the data were collected. This third party did not agree to make the data publicly available. The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request. The data can also be requested by filling in the data request form from the University Medical Center Utrecht. The link is provided below. Research support staff from the division will review and consider the requests. https://preview.umcutrecht.nl/en/data-request-form-umc-utrecht.
Funding: This study was funded by an unrestricted grant from ZonMw (grant number 10060012210005). The Safety First Study was supported by the Department of General Practice of the University Medical Center Utrecht, the foundation ‘Netherlands Triage Standard’ and the foundation ‘Stoffels-Hornstra’. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
List of abbreviations: AUC, area under the curve; BEFAST, balance eye face arm speech time; CAD, cardiac artery disease; CI, confidence interval; CVD, cardiovascular disease; EHR, electronic healthcare record; FAST, face arm speech time; GDPR, General Data Protection Regulation; GP, general practitioner; ICPC, International Classification of Primary Care; IQR, interquartile range; MAR, missing at random; MNAR, missing not at random; NTS, Netherlands Triage Standard; OHS-PC, out-of-hours primary care; R2cs, R2 Cox-Snell; TIA, transient ischemic attack; U, urgency
Introduction
Stroke and transient ischemic attack (TIA) are life-threatening medical emergencies that require rapid action to reduce morbidity and mortality. Nonetheless, early recognition remains difficult as stroke/TIA present themselves with many non-specific and often ambiguous symptoms. Moreover, there are important mimicking disorders such as migraine with aura, seizures, metabolic and toxic disorders, peripheral vestibular disease, Bell’s palsy, collapse, and functional disorders [1–3]. In the Netherlands, many patients with such yet undefined symptoms will contact primary care first. During out-of-hours, this happens to be telephonically with the out-of-hours services in primary care (OHS-PCs) [4]. On the phone, patients are first assisted by a triage nurse supervised by a general practitioner (GP). The triage nurse assesses the urgency of the symptoms based on triage questions from the Netherlands Triage Standard (NTS), which is a semi-automatic decision support tool [5]. This allocation of urgency through triaging is a balancing act between safety and efficiency. Telephone triage needs to be safe enough to avoid missing cases of stroke/TIA (good sensitivity), while also being efficient enough by not unnecessarily assigning high urgency to low-risk patients that may overwhelm already strained healthcare utilisation during out-of-hours primary care (good specificity). Hence, triaging remains a difficult and challenging process [6].
The FAST items (face, arm, speech, time), later updated to BEFAST (adding balance and eye to FAST), were developed as diagnostic tools to create awareness about warning signs suggestive of stroke or TIA [7, 8]. The BEFAST items are mainly used and validated in the prehospital setting (ambulance dispatch centers and OHS-PC) and the emergency department of the hospital [9]. While these items are part of one of the 56 ‘entrance complaints’ of the NTS, namely ‘neurologic deficit’, it is yet unclear what the implications are of using BEFAST items for the estimation of stroke/TIA risk through telephone triage in the primary care emergency setting [5].
This study describes the risk of stroke/TIA in callers to the OHS-PC with symptoms suggestive of neurological deficit and consequently classified as BEFAST positive. Furthermore, it aims to explore other simple clinical predictors to be used during telephone triage in BEFAST positive patients that can further aid in distinguishing between patients that have a higher risk of a diagnosis of stroke or TIA from those with a lower risk of having these diagnoses.
Methods
Study design and setting
This is a cross-sectional study using retrospective data from telephone triage tape-recordings of patients calling to the OHS-PC. In these facilities, triage nurses and GPs provide out-of-hours emergency primary care for all Dutch citizens. Data from nine OHS-PC locations in the central region of the Netherlands were used that provide out-of-hours care to 1.5 million inhabitants with 300,000 calls on average per year. This is a post-hoc analysis of the Safety First study and its design has been described in more detail elsewhere [10]. Data were accessed from April 25 until November 17 2023. Where applicable, this study adhered to the TRIPOD checklist for prediction modelling studies [11].
Study population
Between January 1 2014 and December 31 2017, a random sample of 2,500 recorded calls was selected for analysis. Patients with symptoms suggestive of stroke or TIA were identified based on a search of International Classification of Primary Care (ICPC) codes and/or keywords in the electronic healthcare records (EHR) of the OHS-PCs. Exclusion criteria for this study were age below 18, callers living outside OHS-PC area (final diagnosis not possible to retrieve), poor quality of recording and non-triage calls [10]. BEFAST classification was done after data collection. Those having at least one item scored as positive were considered ‘BEFAST positive’, and only BEFAST positive patients were included for further analyses. All ICPC codes and keywords used for inclusion and definitions of BEFAST items are provided in S1 Table.
Data collection
Data were collected from the OHS-PC EHR and from telephone triage tape-recordings. Patient demographics and call characteristics were retrieved from the EHR and BEFAST items, medical history and final urgency allocation were collected from the phone tape-recordings. There are five urgency categories used by the OHS-PCs: U1 (ambulance dispatch within 15 min), U2 (GP consultation (home visit or at the OHS-PC) within one hour), U3 (GP consultation within three hours), U4 (GP consultation within 24 hours) and U5 (self-care telephone advice). All data were collected by trained researchers and medical students while blinded for the outcome.
Outcome
The primary outcome of this study was a final diagnosis of stroke or TIA diagnosed by a neurologist or GP, the first with neuroimaging and the latter based on neurological deficit symptoms only. During triage and based upon urgency allocation, either an ambulance was sent, a home visit or consultation at the OHS-PC was offered, or the patient was advised to contact their own GP the next working day. Therefore, following clinical practice, the diagnostic work-up differed between patients. To ensure similar assessment of outcome for all patients, the final diagnosis was confirmed by the patient’s own GP through discharge letters and medical record screening up to one month after the date of calling to the OHS-PC.
Data analysis
Descriptive statistics were used for baseline characteristics. Categorical variables were summarised as numbers with percentages and continuous variables were summarised as means with standard deviations or medians with interquartile ranges. To identify additional predictors of stroke and TIA among BEFAST positive callers to the OHS-PC, four multivariable logistic regression models were fitted and compared by likelihood ratio tests (alpha of 0.05 for significance). A fixed modelling approach was used with predefined predictors based on literature and clinical experience. Model one consisted of the predictors age and sex. Model two additionally included a combined predictor for history of cardio- and/or cerebrovascular disease. Model three consisted of a combined predictor for cardiovascular risk factors including hypertension, diabetes and/or hypercholesterolaemia, in addition to age and sex. The fourth model included all predictors (age, sex, disease history of cardio- and cerebrovascular disease and cardiovascular risk factors). Age was handled as a continuous variable and a restricted cubic spline with four knots on the percentiles 0.05, 0.35, 0.65 and 0.95 was applied to account for non-linearity. Additionally, an interaction term was added to age and sex [12]. Sex was handled as a categorical variable with two categories (biologically male and female) and all other predictors were also handled as categorical variables with two categories (e.g. history of cardio- and cerebrovascular disease being present or absent). To correct for optimism in the model’s estimates, the best model was internally validated using bootstrapping with 100 repetitions after which the area under the curve (AUC/c-statistic), R2 and slope were calculated. Statistical analyses were performed in R version 4.2.2 with R base, rms, mice and pROC packages [13–16].
Sample size considerations
For sample size calculation, the method by Riley et al. for logistic regression modelling was used [17]. For prediction model development, 1,289 BEFAST positive patients were available with an outcome rate of 0.52 for the combined outcome of stroke and TIA. A c-statistic of 0.70 was chosen for sample size calculation which was based on the c-statistic reported in a similar study validating a TIA recognition tool in primary care [18]. The sample size of 1,289 patients was calculated to be large enough to include up to a maximum of 18 candidate predictors. This was sufficient to include the prespecified predictors as described above, restricted cubic spline for age with four knots and an interaction term for age and sex.
Missing data
Missing data for BEFAST items were not imputed because of the complexity of data structure, i.e. the presence of BEFAST items is dependent on ordered questions and answers on previous triage questions. Hence, we assumed missing data on BEFAST to follow a MNAR (missing not at random) pattern. It is widely acknowledged that in such circumstances it is preferred to refrain from imputation of these items [19]. Missing data for candidate predictors were assumed to be MAR (missing at random) and were imputed using multiple imputation by chained equation methods included in the ‘mice’ package in R. A random forests method was used, and 100 datasets were generated with 20 iterations [13, 20]. The percentage of missing data per predictor is shown in S2 Table.
Ethical approval
This study was conducted in accordance with Dutch law, the European Union General Data Protection Regulation (GDPR) and the principles of the Declaration of Helsinki. It is part of the larger Safety First study (National Trial Register identification number: NTR7331) [10]. The Medical Ethics Review Committee Utrecht, the Netherlands, reviewed the study and formal approval was waived as minimal patient participation was required. During data collection from telephone recordings, data were pseudonymised for further analyses conform the GDPR.
Results
Population
From the random sample of 2,500 recorded calls that were selected based on the inclusion criteria, 1,381 could be used for final analyses. The other 1,119 calls were excluded based on exclusion criteria or because the outcome could not be retrieved due to nonresponse or refusal of the enlisted GP. Details on patient flow through the study are depicted in S1 Fig. After data collection, 1,289 patients were classified as BEFAST positive. There were 92 patients for whom BEFAST could not be determined because of missing data, and these patients were excluded from further analyses.
Patient characteristics
Characteristics of all BEFAST positive patients are shown in Table 1. Median age was 72 years, 56% were female and 92% still had symptoms during the call to the OHS-PC. In 52% of stroke or TIA was diagnosed; 17% stroke and 35% TIA or minor stroke. These patients were generally older (median 79 years versus median 64 years), more often had a history of cardiovascular disease and had more cardiovascular risk factors (hypertension, hypercholesterolaemia and diabetes) than those without stroke or TIA. 24% of BEFAST positive patients with stroke or TIA received a low urgency allocation during triage (U3, U4 or U5), these patients had similar demographic characteristics (median age 80 versus 79 years and 58% versus 55% female sex), more often had a personal history of TIA (37% versus 32%) and less often had a personal history of stroke (23% versus 28%) than patients that were correctly allocated to high urgency (U1 and U2). A neurologist diagnosed stroke or TIA in 83% of the cases based on clinical symptoms plus neuroimaging, and 17% (mainly older patients) was diagnosed by GPs based on clinical symptoms.
Predictors of stroke and TIA in BEFAST positive patients
All 1,289 BEFAST positive patients were used to develop the four prespecified models. When compared by likelihood ratio test, in our dataset, model 2, 3 and 4 (including the added predictors history of cardio- and cerebrovascular disease and cardiovascular risk factors) did not prove to perform significantly better than model 1 only including age and sex, as shown in Table 2. The regression coefficients with confidence intervals, the apparent performance and internal validation performance of model 1 are shown in Table 3. Regression coefficients with confidence intervals and apparent performance of model 2, model 3 and model 4 are provided in S3 Table. The apparent c-statistic of model 1 was 0.73 (95% CI 0.70–0.75) and the internally validated c-statistic was 0.72 (95%CI 0.69–0.75). In Fig 1, the predicted risks of stroke and TIA predicted by model 1 are plotted for age, and male and female sex. Overall, predicted risk increased with age and was higher for male patients at mid-life than for female patients at mid-life. For instance, until the age of 40, the predicted risk for both female and male patients remained below 20%. A risk of >50% was reached for female patients from the age of about 70, while for male patients this was reached from the age of about 55.
Plot of predicted risk of stroke and TIA in BEFAST positive patients shown for men and women at different ages. Confidence intervals are shown in grey.
Discussion
This study showed that patients calling to the OHS-PC with symptoms suggestive of stroke or TIA, and at least one item of BEFAST positive, had a high risk (52%) of having a final diagnosis of stroke or TIA. Of these stroke/TIA patients, 76% received a high urgency allocation. Only sex and age could improve triaging while a history of cardio- and cerebrovascular disease, or cardiovascular risk factors (hypertension, diabetes or hypercholesterolaemia) could not further aid in predicting stroke/TIA in this high-risk patient group.
Comparison with existing literature
In the prehospital setting, such as the OHS-PC, where patients with possible stroke/TIA often present early-on in the disease course, it is pivotal to differentiate life-threatening conditions, such as stroke/TIA, from more benign conditions and mimics such as migraine with aura. During initial telephone triage, an accurate definitive diagnose may not yet be necessary, but accurate urgency allocation of patients at (high) risk of stroke or TIA is crucial. Therefore, any triaging tool needs a sufficiently high sensitivity (i.e. not missing any cases) while a high specificity is needed for efficiency. A Cochrane review from 2019 assessed the diagnostic accuracy of the FAST items and identified three studies reporting a sensitivity in the prehospital setting ranging from 0.64 to 0.97, however, with a broad range in specificity from 0.13 to 0.75 [9]. The addition of balance disturbance (B) and eye problems (E) to FAST is supposed to prevent missing stroke or TIA of the posterior cerebral circulation and thus increase sensitivity, however adding items to FAST will certainly further decrease specificity and thus efficiency [8]. By design, we selected patients that were all classified as BEFAST positive in our study sample, therefore, it was not feasible to calculate sensitivity and specificity for the BEFAST triaging tool.
Currently, there are many stroke and TIA prediction models and diagnostic tools available, mainly to be used at the emergency department or to detect large vessel occlusions to direct intervention [9, 21, 22]. Almost all these tools use similar items to BEFAST (i.e. signs and symptoms) to assess the probability of stroke or TIA, lacking possible additional predictors such as age, sex, cardio-cerebrovascular history and cardiovascular risk factors. In our study, sex and age provided additive predictive information in a BEFAST positive population while a history of cardio- or cerebrovascular disease, or cardiovascular risk factors (hypertension, diabetes or hypercholesterolaemia) did not add predictive information beyond signs and symptoms of BEFAST. Apparently, in a population already selected for their signs and symptoms and therefore with a high a priori risk of a stroke/TIA diagnosis, other clinical factors besides adding age and sex, will not further increase the ability to distinguish between higher and lower risk. We also assessed ‘someone else calling the OHS-PC for the patient’ as a predictor for stroke or TIA, but this variable had no added value beyond the predictors age and sex (data not shown).
Strengths and limitations
The major strength of this research is the use of routine care data, reflecting real-world clinical practice. Furthermore, only readily available predictors were analysed, preventing the increase in workload of triage nurses and GPs. Formal external validation of the final prediction model should be conducted to confirm predictive performance over time in the Dutch OHS-PC setting or to prove its predictive performance in other settings.
Two limitations to this work must be discussed. First, the dataset had missing values, a common finding when using routine care data. Although imputations were carefully executed and only under the MAR assumptions, introduction of some bias cannot be fully ruled out. Importantly, BEFAST is only considered negative if none of the symptoms are present, which was in none of our patients (partly due to missing data). As a result, we could not calculate the sensitivity, specificity, and predictive values of BE-FAST. Therefore, our results should be interpreted with some caution, and studies repeating our analyses in new data are necessary to confirm our findings. Second, the outcome of stroke and TIA was not assessed similarly for all patients, since only the patients that were still considered to be at risk of stroke or TIA after GP consultation were referred to the neurologist for further diagnostic imaging (differential verification) [11]. However, it is unlikely that many stroke or TIA cases were missed as a consequence of this selective referral. To make it even more unlikely to miss cases of stroke or TIA and to assess the outcome for all patients in a similar way, the outcome was assessed through contacting the enlisted GPs up to one month after visiting the OHS-PC, which also encompasses, for instance, delayed discharge letters.
Clinical implications
This study adds to a better understanding of the distribution of risks among BEFAST positive patients (i.e. the patients suspected of stroke or TIA) at the triage stage. While 92% of BEFAST positive patients still had symptoms at the moment of calling and 52% eventually received a diagnosis of stroke or TIA, only 76% of patients with the outcome stroke/TIA received a high urgency allocation. Incorporating age and sex of the patient in the triage process may improve urgency allocation, e.g. upscaling the urgency for elderly patients (both sexes) and for middle-aged male patients. External validation studies (temporal as well as geographical) and implementation studies are needed to evaluate the generalizability and clinical impact of these findings. Moreover, additional strategies to improve urgency allocation in patients suspected of stroke or TIA may be considered. For instance, it has been shown that safety of telephone triage improved when triage nurses overruled the decision support system (NTS), and urgency allocation was adjusted, either or not after consultation of a GP [6]. Such strategies may be the key to sustainable, safe and efficient telephone triage.
Conclusion
For BEFAST positive patients calling to the OHS-PC, the risk of stroke or TIA was above 50%. Despite this high risk, one in four patients received a low urgency allocation. The addition of age and sex can improve risk stratification with higher risks observed in older and male patients.
Supporting information
S1 Table. ICPC codes, keywords and definition of BEFAST items used in this study.
ICPC = International Classification of Primary Care.
https://doi.org/10.1371/journal.pone.0310769.s002
(DOCX)
S2 Table. Percentage of missing data per predictor in BEFAST positive patients.
https://doi.org/10.1371/journal.pone.0310769.s003
(DOCX)
S3 Table. Model development and apparent performance of model 2, model 3 and model 4 using multivariable logistic regression.
Regression coefficients with 95% confidence intervals, c-statistic, and apparent performance measures of model 2, model 3 and model 4. Age was divided into three subgroups (shown as age, age’ and age”) using restricted cubic spline function to account for non-linearity. *The predictor history of cardio- and cerebrovascular disease is a combination of history of stroke, history of TIA and history of cardiovascular disease. **The predictor cardiovascular risk factors is a combination of diabetes, hypercholesterolaemia and hypertension. CI = confidence interval.
https://doi.org/10.1371/journal.pone.0310769.s004
(DOCX)
Acknowledgments
The authors thank the OHS-PC foundation ‘Primair Huisartsenposten’ and all medical students that contributed to data collection.
References
- 1. Zweifler RM. Initial Assessment and Triage of the Stroke Patient. Prog Cardiovasc Dis. 2017 May 1;59(6):527–33. pmid:28457790
- 2. Buck B H., Akhtar N, Alrohimi A, Khan K, Shuaib A. Stroke mimics: incidence, aetiology, clinical features and treatment. Vol. 53, Annals of Medicine. Taylor and Francis Ltd.; 2021. p. 420–36.
- 3. Pohl M, Hesszenberger D, Kapus K, Meszaros J, Feher A, Varadi I, et al. Ischemic stroke mimics: A comprehensive review. Vol. 93, Journal of Clinical Neuroscience. Churchill Livingstone; 2021. p. 174–82.
- 4. Giesen P, Smits M, Huibers L, Grol R, Wensing M. Quality of After-Hours Primary Care in the Netherlands: A Narrative Review [Internet]. 2011. Available from: https://annals.org pmid:21768584
- 5.
Netherlands Triage Standard, https://de-nts.nl/, accessed July 31 2023.
- 6. Erkelens DC, Rutten FH, Wouters LT, Dolmans LS, de Groot E, Damoiseaux RA, et al. Accuracy of telephone triage in patients suspected of transient ischaemic attack or stroke: a cross-sectional study. BMC Fam Pract. 2020 Dec 1;21(1).
- 7. Harbison J, Hossain O, Jenkinson D, Davis J, Louw SJ, Ford GA. Diagnostic accuracy of stroke referrals from primary care, emergency room physicians, and ambulance staff using the face arm speech test. Stroke. 2003 Jan 1;34(1):71–6. pmid:12511753
- 8. Aroor S, Singh R, Goldstein LB. BE-FAST (Balance, Eyes, Face, Arm, Speech, Time): Reducing the Proportion of Strokes Missed Using the FAST Mnemonic. Stroke. 2017 Feb 1;48(2):479–81. pmid:28082668
- 9. Zhelev Z, Walker G, Henschke N, Fridhandler J, Yip S. Prehospital stroke scales as screening tools for early identification of stroke and transient ischemic attack. Cochrane Database of Systematic Reviews. 2019 Apr 9;2019(4). pmid:30964558
- 10. Erkelens DCA, Wouters LTCM, Zwart DLM, Damoiseaux RAMJ, De Groot E, Hoes AW, et al. Optimisation of telephone triage of callers with symptoms suggestive of acute cardiovascular disease in out-of-hours primary care: Observational design of the Safety First study. BMJ Open. 2019 Jul 1;9(7). pmid:31266836
- 11. Moons KGM, Altman DG, Reitsma JB, Ioannidis JPA, Macaskill P, Steyerberg EW, et al. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): Explanation and elaboration. Ann Intern Med. 2015;162(1):W1–73. pmid:25560730
- 12.
Harrell FE Jr. Regression modeling strategies: with applications to linear models, logistic and ordinal regression, and survival analysis. Springer. 2015.
- 13. van Buuren S, Groothuis-Oudshoorn K. mice: Multivariate Imputation by Chained Equations in R. J Stat Softw. 2011;45(3).
- 14.
Team RC. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. URL https://www.R-project.org/. 2020.
- 15.
Harrell Jr FE. rms: Regression Modeling Strategies. R package version 6.2–0. https://CRAN.R-project.org/package=rms. 2021.
- 16. Xavier R, Turck N, Hainard A, Tiberti N, Lisacek F, Sanchez JC, et al. pROC: an open-source package for R and S+ to analyze and compare ROC curves. MC Bioinformatics. 2011;12:77. pmid:21414208
- 17. Riley RD, Ensor J, Snell KIE, Harrell FE, Martin GP, Reitsma JB, et al. Calculating the sample size required for developing a clinical prediction model. The BMJ [Internet]. 2020;368(March):1–12. Available from: http://dx.doi.org/doi:10.1136/bmj.m441
- 18. Lasserson DS, Mant D, Hobbs FDR, Rothwell PM. Validation of a TIA recognition tool in primary and secondary care: Implications for generalizability. International Journal of Stroke. 2015 Jul 1;10(5):692–6. pmid:24207004
- 19. Donders ART, van der Heijden GJMG, Stijnen T, Moons KGM. Review: A gentle introduction to imputation of missing values. J Clin Epidemiol. 2006 Oct;59(10):1087–91. pmid:16980149
- 20. Austin PC, White IR, Lee DS, van Buuren S. Missing Data in Clinical Research: A Tutorial on Multiple Imputation. Canadian Journal of Cardiology. 2021 Sep;37(9):1322–31. pmid:33276049
- 21. Antipova D, Eadie L, MacAden A, Wilson P. Diagnostic accuracy of clinical tools for assessment of acute stroke: A systematic review. BMC Emerg Med. 2019 Sep 4;19(1).
- 22. Duvekot MHC, Venema E, Rozeman AD, Moudrous W, Vermeij FH, Biekart M, et al. Comparison of eight prehospital stroke scales to detect intracranial large-vessel occlusion in suspected stroke (PRESTO): a prospective observational study. Lancet Neurol. 2021 Mar 1;20(3):213–21. pmid:33422191