Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Open Access

Peer-reviewed

Research Article

Comparison of RIPASA and ALVARADO scores for risk assessment of acute appendicitis: A systematic review and meta-analysis

  • Giuliana Favara,

    Roles Data curation, Writing – original draft, Writing – review & editing

    Affiliation Department of Medical and Surgical Sciences and Advanced Technologies "GF Ingrassia", University of Catania, Catania, Italy

    ⨯
  • Andrea Maugeri,

    Roles Data curation, Writing – original draft, Writing – review & editing

    Affiliation Department of Medical and Surgical Sciences and Advanced Technologies "GF Ingrassia", University of Catania, Catania, Italy

    ⨯
  • Martina Barchitta,

    Roles Data curation, Writing – original draft, Writing – review & editing

    Affiliation Department of Medical and Surgical Sciences and Advanced Technologies "GF Ingrassia", University of Catania, Catania, Italy

    ⨯
  • Andrea Ventura,

    Roles Data curation, Writing – review & editing

    Affiliation Department of General Surgery and Medical-Surgical Specialties, University of Catania, Catania, Italy

    ⨯
  • Guido Basile,

    Roles Conceptualization, Data curation, Writing – review & editing

    Affiliation Department of General Surgery and Medical-Surgical Specialties, University of Catania, Catania, Italy

    ⨯
  • Antonella Agodi

    Roles Conceptualization, Writing – review & editing

    agodia@unict.it

    Affiliation Department of Medical and Surgical Sciences and Advanced Technologies "GF Ingrassia", University of Catania, Catania, Italy

    ⨯

Abstract

Background

In the last decades, several clinical scores have been developed and currently used to improve the diagnosis and risk management of patients with suspected acute appendicitis (AA). However, some of them exhibited different values of sensitivity and specificity. We conducted a systematic review and metanalysis of epidemiological studies, which compared RIPASA and Alvarado scores for the diagnosis of AA.

Methods

This systematic review was conducted using PubMed and Web of Science databases. Selected studies had to compare RIPASA and Alvarado scores on patients with suspected AA and reported diagnostic parameters. Summary estimates of sensitivity and specificity were calculated by the Hierarchical Summary Receiver Operating Curve (HSROC) using STATA 17 (STATA Corp, College Station, TX) and MetaDiSc (version 1.4) software.

Results

We included a total of 33 articles, reporting data from 35 studies. For the Alvarado score, the Hierarchical Summary Receiver Operating Curve (HSROC) model produced a summary sensitivity of 0.72 (95%CI = 0.66–0.77), and a summary specificity of 0.77 (95%CI = 0.70–0.82). For the RIPASA score, the HSROC model produced a summary sensitivity of 0.95 (95%CI = 0.92–0.97), and a summary specificity of 0.71 (95%CI = 0.60–0.80).

Conclusion

RIPASA score has higher sensitivity, but low specificity compared to Alvarado score. Since these scoring systems showed different sensitivity and specificity parameters, it is still necessary to develop novel scores for the risk assessment of patients with suspected AA.

Citation: Favara G, Maugeri A, Barchitta M, Ventura A, Basile G, Agodi A (2022) Comparison of RIPASA and ALVARADO scores for risk assessment of acute appendicitis: A systematic review and meta-analysis. PLoS ONE 17(9): e0275427. https://doi.org/10.1371/journal.pone.0275427

Editor: Ibrahim Umar Garzali, Aminu Kano Teaching Hospital, NIGERIA

Received: August 1, 2022; Accepted: September 16, 2022; Published: September 30, 2022

Copyright: © 2022 Favara et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the paper and its Supporting Information files.

Funding: The authors received no specific funding for this work.

Competing interests: The authors have declared that no competing interests exist.

Introduction

Acute appendicitis (AA) represents one of the most frequent disorders in abdominal surgery, with a prevalence ranging from 7 to 12% in the general population [1, 2]. If untreated or undiagnosed, AA could lead to a higher risk of adverse outcomes, including death. Despite its common occurrence, the diagnosis of AA is still challenging for clinicians, suggesting the need of novel approaches to improve patients’ management [3, 4]. Indeed, clinical presentation of AA is commonly atypical and easily mistaken for other conditions, with only about 40% of the cases presenting typical signs and symptoms (i.e., periumbilical pain, nausea, vomiting, pain migration to the right lower quadrant) [5–7].

In the last decades, several scoring systems have been developed to assist clinicians in the assessment of patients with suspected appendicitis [8, 9]. Among these, the ALVARADO score—proposed for the first time in 1986—is one of the most widely used in the diagnosis of AA based on 6 clinical parameters and 2 laboratory measurements (i.e., localized tenderness in the right lower quadrant, migration of pain, temperature elevation, nausea-vomiting, anorexia, rebound pain, leukocytosis and leukocyte shift to the left) [8]. Despite not being specific enough, a score of 4–5 is compatible with the diagnosis of AA, a score of 7–8 indicates a probable appendicitis, and a score of 9–10 indicates a very probable AA [10, 11]. However, the Alvarado score is also considered lacking some parameters, including age, gender, and duration of symptoms, which have shown to be crucial in the diagnosis of AA [3, 12]. The RIPASA is one of the most recently developed scoring systems, which is based on six additional clinical and personal patients’ parameters than those included in the Alvarado score (i.e., age, gender, duration of symptoms, guarding, Rovsing’s sign, and negative urinalysis).

In this case, a RIPASA score of more than 7.5 is considered positive for appendicitis [1, 8, 11, 13–15]. Although RIPASA and Alvarado scores are the most commonly used in clinical practice, no clear indication exists for choosing what scoring system might be more suitable for patients at risk of AA [16]. Here, we conducted a systematic review and metanalysis of epidemiological studies comparing RIPASA and Alvarado scores, in order to identify which is the one providing more accurate diagnosis of AA.

Material and methods

Literature search and selection criteria

The current systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) statements and the Cochrane Handbook’s guidelines (PRISMA checklist available in S1 Appendix) [17]. The research protocol was registered in the PROSPERO database, with the code CRD42022339490. Two authors (GB and AV) conducted a literature search of articles, using the databases PubMed and Web of Science. The electronic search strategy included the following keywords: ((Appendicitis) AND (RIPASA) AND (Alvarado)). The last search was conducted on 21 July 2021. After identifying and removing duplicates, the authors also conducted a cross-search through the articles cited by the studies, aiming to identify additional articles to be included in the systematic review. Selected studies had to meet the following inclusion criteria: (i) observational studies; (ii) which provided full-text and written in English language; (iii) which included patients with suspected acute appendicitis (iv) and compared RIPASA and Alvarado scores. By contrast, the following articles were excluded: (i) experimental studies; (ii) studies conducted only on a specific population (e.g. pregnant women or pediatric patients); (iii) studies not comparing the mentioned scoring systems; (iv) studies conducted on patients with an already established cause of abdominal pain and/or patients who experienced pain for a prolonged period; (v) letters, comments, case reports, case series, reviews.

Titles and abstracts of all identified articles were independently screened by two authors (GB and AV). Articles potentially eligible were full-text reviewed to assess whether eligibility criteria were fully met. Discordant opinions between investigators were resolved by consulting a third author (AA).

Data extraction

The following information was extracted from all included studies: first author, year of publication, study design, sample size, age, sex, histologically confirmed acute appendicitis, other previous diagnoses, computerized tomography (CT) performed. In addition, for both the RIPASA and Alvarado scores, the authors collected the following information: specificity, sensitivity, positive predictive value, negative predictive value, diagnostic accuracy, negative appendicectomy rate, area under the roc-curve, positive likelihood ratio, negative likelihood ratio. Discordant opinions between investigators were resolved by consulting a third author (AA).

Definitions of RIPASA and ALVARADO scores

Clinical Scoring Systems are useful to group patients according to their symptoms and signs, and to identify patients with suspected appendicitis. Alvarado clinical score includes 6 clinical parameters and 2 laboratory measurements, which are relevant in the diagnosis of acute appendicitis. Among these, migration of abdominal pain to the right iliac fossa, anorexia or ketones in the urine, nausea or vomiting, localized tenderness in the right iliac fossa, rebound pain, body temperature more than 37.3°C, leukocytosis, and neutrophilia. Alvarado score indicates a confirmed, probable, or very probable diagnosis of acute appendicitis, in the case of a score of 4–6, 7–8, or 9–10, respectively. Commonly, a score of 7.0 is considered as positive for appendicitis [10, 11].

RIPASA clinical score includes the following parameters: age, gender, right iliac fossa pain, migration of pain to the right iliac fossa, nausea or vomiting, anorexia, duration of symptoms, localized tenderness in the right iliac fossa, guarding, rebound tenderness, Rovsing’ s sign, fever, raised white cell count, negative urinalysis, and foreign national registration identity card. Commonly, a score above 7.5 is considered as positive for the diagnosis of appendicitis [1, 8, 11, 13–15].

Risk of bias and quality assessment

The methodological quality of the included studies was assessed using a set of criteria for the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2). By considering 4 domains (i.e., patient selection, index test, reference standard, and flow and timing), this approach is useful for the evaluation of diagnostic accuracy studies. In particular, the questions can be answered using “low”, “high” or “unclear” to judge the risk of bias [18].

Statistical analysis

Meta-analysis of diagnostic test accuracy requires a statistically rigorous approach based on hierarchical models that respect the binomial data structure. In the present study, we first obtained for each score the forest plots of sensitivity and specificity and their 95% Confidence Intervals (CI) based on a random-effects model and using the MetaDiSc software (version 1.4). The heterogeneity was assessed with the I2 statistic. Next, the summary estimates of sensitivity and specificity were calculated by the Hierarchical Summary Receiver Operating Curve (HSROC), using the package Metandi for STATA 17 statistical software (STATA Corp, College Station, TX). To visualize the HSROC curve, we also used the command metandiplot.

Results

Selection and characteristics of included studies

Fig 1 reported the PRISMA flow diagram describing the study selection process. A total of 75 studies were identified from the literature search, of which 53 were screened after removing duplicates. After full-text screening of 31 articles deemed eligible for inclusion, 2 studies not comparing two scoring systems considered, 2 reviews, and 1 study not written in English were excluded. After a cross-search through the articles cited by the studies, the authors identified 7 additional articles to be included. Hence, a total of 33 studies were included in the present systematic review and meta-analysis. However, Abdelrhman et al. (2018) reported findings from two different populations, while Erdem et al. (2013) used two different couples of cut-offs for the RIPASA and ALVARADO scores. Accordingly, the meta-analysis was conducted on 35 different estimates of sensitivity and specificity. Table 1 shows the main characteristics (i.e., country, type of study, sample size) of the included studies, as well as characteristics of patients (i.e., age, sex). Table 2, instead, summarizes statistical parameters of RIPASA and ALVARADO scores, respectively.

thumbnail
Download:
Fig 1. Prisma flow diagram describing study selection process.

https://doi.org/10.1371/journal.pone.0275427.g001

thumbnail
Download:
Table 1. Characteristics of studies included in the systematic review.

https://doi.org/10.1371/journal.pone.0275427.t001

thumbnail
Download:
Table 2. Characteristics of clinical scoring systems for each study included in the systematic review.

https://doi.org/10.1371/journal.pone.0275427.t002

Main characteristics of included studies

All the included studies were published between 2011 and 2020. In particular, most of the studies were conducted in South-Eastern countries, of which 14 in India, 5 in Turkey, 2 in Pakistan, 2 in Egypt, 2 in Iran, 1 in Jordan, 1 in China, 1 in Korea, 1 in Brunei, 2 in Mexico, 1 in USA and 1 in Poland. With respect to the study design, all the 33 articles included in the study were observational studies. Specifically, 26 were prospective, 4 retrospective, and 3 cross-sectional. The overall sample size ranged from 56 to 600 participants. Although gender distribution throughout the studies was fairly balanced, almost all studies reported a higher proportion of men. The most commonly considered symptom to identify patients with AA was the pain in Right Iliac Fossa. Moreover, some studies required more extensive list of clinical symptoms, as well as advanced imaging techniques.

Cut-offs of scoring systems

In the various studies, diagnostic parameters for RIPASA and Alvarado scores were calculated according to different cut-offs. Most of the studies used 7.0 and 7.5 as conventional cut-offs for Alvarado and RIPASA scores, respectively. Accordingly, patients were considered as affected by AA if their scores exceeded these cut-off values. However, Korkut et al. and Ozdemir et al. used the value of 8 for the Alvarado, and the values of 10 or 12 for the RIPASA, respectively. Reasons of using different cut-offs may be explained by the aim to improve the diagnostic parameters of the scores. For all the studies considered, the gold standard is given by the histopathological exam performed post-surgery.

Scoring systems performances

Overall, the present systematic review included 5384 patients with AA who were tested with the RIPASA and Alvarado scores. The sensitivity values ranged from 16.4% to 100% for the RIPASA score, and from 14.8% to 97.2% for the Alvarado score (Fig 2). Interestingly, all studies reported a higher sensitivity for the RIPASA score than for the Alvarado score. Most of the studies reported higher values of specificity for the Alvarado score than for the RIPASA score. The specificity values ranged from 9% to 100% for the RIPASA score, and from 16% to 100% for the Alvarado score (Fig 3). The majority of studies reported higher Positive Predictive Value for the Alvarado score. Conversely, the majority of studies reported higher Negative Predictive Values for the RIPASA score. Moreover, in the studies included in the present meta-analysis, the RIPASA score showed higher values of diagnostic accuracy and Area Under the Curve (AUC) compared to the Alvarado.

thumbnail
Download:
Fig 2.

Plots of individual values of sensitivity for the Alvarado (A) and RIPASA (B) scores.

https://doi.org/10.1371/journal.pone.0275427.g002

thumbnail
Download:
Fig 3.

Plots of individual values of specificity for the Alvarado (A) and RIPASA (B) scores.

https://doi.org/10.1371/journal.pone.0275427.g003

Fig 4 shows hierarchical summary estimates of sensitivity and specificity for the Alvarado and the RIPASA scores, respectively. The graphs also report a 95% prediction ellipse for the individual values of sensitivity and specificity, and the 95% confidence ellipse around the mean values of sensitivity and specificity. For the Alvarado score (Fig 4A), the HSROC model produced a summary sensitivity of 0.72 (95%CI = 0.66–0.77), and a summary specificity of 0.77 (95%CI = 0.70–0.82). The heterogeneity was I2 = 0.90 for the sensitivity and I2 = 0.59 for the specificity. For the RIPASA score (Fig 4B), the HSROC model produced a summary sensitivity of 0.95 (95%CI = 0.92–0.97), and a summary specificity of 0.71 (95%CI = 0.60–0.80). The heterogeneity was I2 = 0.76 for the sensitivity and I2 = 0.70 for the specificity.

thumbnail
Download:
Fig 4.

The HSROC of sensitivity and specificity for the Alvarado (A) and RIPASA (B) scores.

https://doi.org/10.1371/journal.pone.0275427.g004

Quality assessment

The details of the quality assessment are reported in S2 Appendix. In general, the risk of bias was unclear or high for all domains under investigation (i.e., patient selection, index test, reference standard, and flow and timing). Similarly, we noted unclear or high concerns of applicability for all studies.

Discussion

AA is one of the most common causes of acute abdominal pain, posing a serious diagnostic challenge for general surgeons due to its clinical variability and high prevalence [3]. Although a wide range of diagnostic tests hold great promise in clinical practice, early identifying an abnormal appendicitis is still challenging both for avoiding unnecessary surgical intervention and reducing healthcare costs [19, 20]. Moreover, complications related to the inflammation of the appendix further complicate patient’s prognosis, also suggesting the need of implementing prediction scoring systems [20]. In this scenario, the use of clinical scoring systems can help healthcare providers in improving decision-making, patients’ management, and identification of suspected appendicitis [3]. Moreover, several lines of evidence suggest that the integrated use of clinical scoring systems and diagnostics images allow to correctly identify patients with AA [3, 8]. Among the most common scores, RIPASA and Alvarado constitute the most utilized to clinically diagnose appendicitis in suspected patients [21]. In this study, we carried out a systematic review and meta-analysis of epidemiological studies comparing these two scores in terms of sensitivity and specificity. In line with previous evidence, our results reveal that the RIPASA score has higher sensitivity but lower specificity than the Alvarado score. It means that the RIPASA score has a higher ability in predicting patients with AA, but also giving a high proportion of false positives. Thus, these findings should be considered when choosing the most appropriate test for the clinical practice. On the one hand, the high diagnostic performance of the RIPASA score could reduce the morbidity and mortality of patients with AA. On the other hand, however, the high number of false positives could lead to an increase in inappropriate procedures and healthcare costs.

To our knowledge, the strength of our work was represented by the lack of systematic reviews and meta-analyses in medical literature published on the same topic. Moreover, our study considered two scoring systems that have the advantages of being easy to use for clinicians, also requiring low healthcare costs to be applied. However, our study had some limitations to be considered. Firstly, most studies included in the present meta-analysis considered different cut-off values for the RIPASA and Alvarado scoring systems. Therefore, this could be considered a potential source of bias, also increasing the heterogeneity between studies. In fact, our analysis detected significant heterogeneity for both sensitivity and specificity. The quality assessment also reported an unclear-high risk of bias associated to patient selection, index test, reference standard, flow, and timing. Another source of misinterpretation is the possible existence of publication bias, which occurs when some studies have a higher probability to be published than others. However, there are no currently adequate methods to detect publication bias in meta-analyses of diagnostic tests, not allowing to completely exclude the presence of this kind of bias. Secondly, these scoring systems are mainly based on patient’ clinical parameters measured in emergency situations and critical environments, which in turn could lead to wrong diagnoses and scoring systems calculation. Moreover, using these two scores could make difficult the diagnosis of AA for specific subgroups of patients, including those with older age, diabetes mellitus and pediatric patients. Thirdly, most of the studies included in the present meta-analysis did not compare RIPASA and Alvarado scores with other diagnostic tests used in clinical practice. With these considerations in mind, the present systematic review and meta-analysis points out benefits and drawbacks of the two widely used scoring systems for the diagnosis of AA. Specifically, we found that the RIPASA scoring system can be useful both for excluding the diagnosis of AA and for relaying intermediate-risk patients to more accurate diagnostic imaging techniques. However, it is not currently possible to define a universal diagnostic test to be used in the clinical practice. The choice depends on several factors, including the resource to obtain data and different clinical settings. In this scenario, our findings could guide future studies to improve the current knowledge about the risk assessment of patients with AA, also promoting the implementation of existing scores and/or the development of innovative tools for clinical practice.

Conclusions

In conclusion, the early diagnosis of patients with suspected AA is still a challenge for clinical practitioners and public health professionals. Although the existing scoring systems help in the risk assessment and in the prediction of clinical deterioration, these scores show variable values of specificity and sensitivity. In our study, the RIPASA score had a superior performance in identifying true positive patients, while the Alvarado score was better in predicting true negative patients. For this reason, further research should be encouraged to develop novel scores and strategies for improving the risk assessment of patients with suspected AA.

References

  1. 1. Noor S, Wahab A, Afridi G, Ullah K. Comparing Ripasa Score And Alvarado Score In An Accurate Diagnosis Of Acute Appendicitis. J Ayub Med Coll Abbottabad. 2020;32(1):38–41. pmid:32468752.
  2. 2. Krzyzak M, Mulrooney SM. Acute Appendicitis Review: Background, Epidemiology, Diagnosis, and Treatment. Cureus. 2020;12(6):e8562. Epub 20200611. pmid:32670699; PubMed Central PMCID: PMC7358958.
  3. 3. Di Saverio S, Podda M, De Simone B, Ceresoli M, Augustin G, Gori A, et al. Diagnosis and treatment of acute appendicitis: 2020 update of the WSES Jerusalem guidelines. World J Emerg Surg. 2020;15(1):27. Epub 20200415. pmid:32295644; PubMed Central PMCID: PMC7386163.
  4. 4. Humes DJ, Simpson J. Acute appendicitis. BMJ. 2006;333(7567):530–4. pmid:16960208; PubMed Central PMCID: PMC1562475.
  5. 5. Golden SK, Harringa JB, Pickhardt PJ, Ebinger A, Svenson JE, Zhao YQ, et al. Prospective evaluation of the ability of clinical scoring systems and physician-determined likelihood of appendicitis to obviate the need for CT. Emerg Med J. 2016;33(7):458–64. Epub 20160302. pmid:26935714; PubMed Central PMCID: PMC5443621.
  6. 6. Snyder MJ, Guthrie M, Cagle S. Acute Appendicitis: Efficient Diagnosis and Management. Am Fam Physician. 2018;98(1):25–33. pmid:30215950.
  7. 7. Podda M, Pisanu A, Sartelli M, Coccolini F, Damaskos D, Augustin G, et al. Diagnosis of acute appendicitis based on clinical scores: is it a myth or reality? Acta Biomed. 2021;92(4):e2021231. Epub 20210902. pmid:34487066; PubMed Central PMCID: PMC8477120.
  8. 8. Frountzas M, Stergios K, Kopsini D, Schizas D, Kontzoglou K, Toutouzas K. Alvarado or RIPASA score for diagnosis of acute appendicitis? A meta-analysis of randomized trials. Int J Surg. 2018;56:307–14. Epub 20180712. pmid:30017607.
  9. 9. Şenocak R, Kaymak Ş. Diagnostic accuracy of ultrasonography and scoring systems: The effects on the negative appendectomy rate and gender. Ulus Travma Acil Cerrahi Derg. 2020;26(2):306–13. pmid:32185777.
  10. 10. Dezfuli SAT, Yazdani R, Khorasani M, Hosseinikhah SA. Comparison between the specificity and sensitivity of the RIPASA and Alvarado Scoring systems in the diagnosis of acute appendicitis among patients with complaints of right iliac fossa. AIMS Public Health. 2020;7(1):1–9. Epub 20200102. pmid:32258184; PubMed Central PMCID: PMC7109537.
  11. 11. Akbar I, Shehzad JA, Ali S. Diagnostic Accuracy Of Ripasa Score. J Ayub Med Coll Abbottabad. 2019;31(3):411–4. pmid:31535517.
  12. 12. Moris D, Paulson EK, Pappas TN. Diagnosis and Management of Acute Appendicitis in Adults: A Review. JAMA. 2021;326(22):2299–311. pmid:34905026.
  13. 13. Chong CF, Adi MI, Thien A, Suyoi A, Mackie AJ, Tin AS, et al. Development of the RIPASA score: a new appendicitis scoring system for the diagnosis of acute appendicitis. Singapore Med J. 2010;51(3):220–5. pmid:20428744.
  14. 14. Chisthi MM, Surendran A, Narayanan JT. RIPASA and air scoring systems are superior to alvarado scoring in acute appendicitis: Diagnostic accuracy study. Ann Med Surg (Lond). 2020;59:138–42. Epub 20200924. pmid:33024555; PubMed Central PMCID: PMC7527659.
  15. 15. Malik MU, Connelly TM, Awan F, Pretorius F, Fiuza-Castineira C, El Faedy O, et al. The RIPASA score is sensitive and specific for the diagnosis of acute appendicitis in a western population. Int J Colorectal Dis. 2017;32(4):491–7. Epub 20161215. pmid:27981378.
  16. 16. Mantoglu B, Gonullu E, Akdeniz Y, Yigit M, Firat N, Akin E, et al. Which appendicitis scoring system is most suitable for pregnant patients? A comparison of nine different systems. World J Emerg Surg. 2020;15(1):34. Epub 20200518. pmid:32423408; PubMed Central PMCID: PMC7236497.
  17. 17. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: an updated guideline for reporting systematic reviews. BMJ. 2021;372:n71. Epub 20210329. pmid:33782057; PubMed Central PMCID: PMC8005924.
  18. 18. Whiting PF, Rutjes AW, Westwood ME, Mallett S, Deeks JJ, Reitsma JB, et al. QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies. Ann Intern Med. 2011;155(8):529–36. pmid:22007046.
  19. 19. Pinto F, Pinto A, Russo A, Coppolino F, Bracale R, Fonio P, et al. Accuracy of ultrasonography in the diagnosis of acute appendicitis in adult patients: review of the literature. Crit Ultrasound J. 2013;5 Suppl 1:S2. Epub 20130715. pmid:23902717; PubMed Central PMCID: PMC3711731.
  20. 20. Ozkan S, Duman A, Durukan P, Yildirim A, Ozbakan O. The accuracy rate of Alvarado score, ultrasonography, and computerized tomography scan in the diagnosis of acute appendicitis in our center. Niger J Clin Pract. 2014;17(4):413–8. pmid:24909462.
  21. 21. Kularatna M, Lauti M, Haran C, MacFater W, Sheikh L, Huang Y, et al. Clinical Prediction Rules for Appendicitis in Adults: Which Is Best? World J Surg. 2017;41(7):1769–81. pmid:28258458.
  22. 22. Korkut M, Bedel C, Karancı Y, Avcı A, Duyan M. Accuracy of Alvarado, Eskelinen, Ohmann, RIPASA and Tzanakis Scores in Diagnosis of Acute Appendicitis; a Cross-sectional Study. Arch Acad Emerg Med. 2020;8(1):e20. Epub 20200313. pmid:32259117; PubMed Central PMCID: PMC7130437.
  23. 23. Devarajan L, Ramesh A, Gayathri S. A prospective study of comparison of RIPASA and Alvarado scores for the diagnosis of acute appendicitis in government Vellore medical college. J. Evolution Med. Dent. Sci. 2019;8(19):1578–1581,
  24. 24. Ozdemir U Z, Ozdemir H, Sunamak O, Akyuz C, Torun M. “Comparison of the reliability of scoring systems in the light of histopathological results in the diagnosis of acute appendicitis.” Hong Kong Journal of Emergency Medicine 26 (2018): 323–327.
  25. 25. Ak R, Doğanay F, Unal Akoğlu E, et al. Predictive value of scoring systems for the diagnosis of acute appendicitis in emergency department patients: Is there an accurate one? Hong Kong Journal of Emergency Medicine. 2020;27(5):262–269.
  26. 26. Bolívar-Rodríguez MA, Osuna-Wong BA, Calderón-Alvarado AB, Matus-Rojas J, DehesaLópez E, Peraza-Garay FJ. [Comparative analysis of diagnostic scales of acute appendicitis: Alvarado, RIPASA and AIR]. Cir. 2018;86(2):169–74. pmid:29809191.
  27. 27. Ansari TS, Kumar VS. Comparison of RIPASA and Alvarado scoring system in acute appendicitis- a descriptive study. J. Evolution Med. Dent. Sci. 2018;7(15):1872–1876,
  28. 28. Patil SB, Vishweshvarayya. Validation of RIPASA scoring system for diagnosis of acute appendicitis. J. Evolution Med. Dent. Sci. 2018;7(32):3599–3603,
  29. 29. Chavan S, Bhatnagar S, Bendre M, Sinha N. Comparative study of Alvarado score and RIPASA score in the diagnosis of acute appendicitis. Int Surg J 2018;5:1330–4.
  30. 30. Abdelrhman T, Al Saeed M, Badr S, Shaban M, Abu-Duruk A, Hatem M. “Validity of RIPASA scoring system as a diagnostic tool of acute appendicitis in comparison with Alvarado scoring system in the Arab population.” International Surgery Journal 5 (2018): 2011.
  31. 31. Pasumarthi V, Madhu CP. A comparative study of RIPASA score and ALVARADO score in diagnosis of acute appendicitis. Int Surg J 2018;5:796–801.
  32. 32. Elhosseiny Mostafa M., Eltokhy Eman A., Omar Atef Elekiabi, Elaidy Mostafa. M., Mohamed Tamer Youssef, El shahidy and Ahmed Embaby. “Comparative Study between Alvarado Score& Ripasa Score in Diagnosis of Acute Appendicitis.” Medicine (2018).
  33. 33. Nancharaiah P, Aishwarya M, Venkateswarulu M. Comparative Study of Alvarado and RIPASA Scoring System in Diagnosing Acute Appendicitis. Indian J Surg 81, 150–153 (2019). https://doi.org/10.1007/s12262-018-1752-1
  34. 34. Arroyo-Rangel C, Limón IO, Vera Á, Guardiola PM, Sánchez-Valdivieso EA. Sensitivity, Specificity and Reliability of the RIPASA Score for Diagnosis of Acute Appendicitis in Relation to the Alvarado Score. Cir Esp (Engl Ed). 2018;96(3):149–54. Epub 20180224. pmid:29486897.
  35. 35. Rodrigues W, Sindhu S. “Diagnostic Importance of Alvarado and RIPASA Score in Acute Appendicitis.” Medicine (2017).
  36. 36. Karami MY, Niakan H, Zadebagheri N, Mardani P, Shayan Z, Deilami I. Which One is Better? Comparison of the Acute Inflammatory Response, Raja Isteri Pengiran Anak Saleha Appendicitis and Alvarado Scoring Systems. Ann Coloproctol. 2017;33(6):227–31. Epub 20171231. pmid:29354605; PubMed Central PMCID: PMC5768477.
  37. 37. Chae MS, Hong CK, Ha YR, Chae MK, Kim YS, Shin TY, et al. Can clinical scoring systems improve the diagnostic accuracy in patients with suspected adult appendicitis and equivocal preoperative computed tomography findings? Clin Exp Emerg Med. 2017;4(4):214–21. Epub 20171020. pmid:29055962; PubMed Central PMCID: PMC5758620.
  38. 38. Regar MK, Choudhary GS, Nogia C, Pipal DK, Agrawal AK, Srivastava H. “Comparison of Alvarado and RIPASA scoring systems in diagnosis of acute appendicitis and correlation with intraoperative and histopathological findings.” International Surgery Journal 4 (2017): 1755–1761.
  39. 39. Subramani B, Kalaichelvan L, Selvam G, et al. Comparison between RIPASA and ALVARADO scoring in diagnosing acute appendicitis. J. Evid. Based Med. Healthc. 2017; 4(11), 624–627.
  40. 40. Muduli IC, Rout BK, Mallick SN. Comparison of RIPASA and Alvarado score in diagnosis of acute appendicitis. J. Evolution Med. Dent. Sci. 2016;5(33):1794–1798,
  41. 41. Sinnet PR, Chellappa PM, Kumar S, et al. Comparative study on the diagnostic accuracy of the RIPASA score over Alvarado score in the diagnosis of acute appendicitis. J. Evid. Based Med. Healthc. 2016; 3(80), 4318–4321.
  42. 42. Liu W, Wei Qiang J, Xun Sun R. Comparison of multislice computed tomography and clinical scores for diagnosing acute appendicitis. J Int Med Res. 2015;43(3):341–9. Epub 20150311. pmid:25762518.
  43. 43. Srikantaiah HC, Arvind Nayak K. “Validation of RIPASA Scoring System for the Diagnosis of Acute Appendicitis.” Journal of Evolution of Medical and Dental Sciences 2015; Vol. 4, Issue 100, December 14; Page:16533–16547,
  44. 44. Verma M, Chanchal , Karamveer , Vashist MG, Goyal K, Yadav P. (2016). Comparision of Alvarado And Ripasa Scoring Systems in Diagnosis of Acute Appendicitis. Paripex Indian Journal Of Research, 4.
  45. 45. Walczak DA, Pawełczak D, Żółtaszek A, Jaguścik R, Fałek W, Czerwińska M, et al. The Value of Scoring Systems for the Diagnosis of Acute Appendicitis. Pol Przegl Chir. 2015;87(2):65–70. pmid:26146097.
  46. 46. N N, Mohammed A, Shanbhag V, Ashfaque K, S A P. A Comparative Study of RIPASA Score and ALVARADO Score in the Diagnosis of Acute Appendicitis. J Clin Diagn Res. 2014;8(11):NC03–5. Epub 20141120. pmid:25584259; PubMed Central PMCID: PMC4290278.
  47. 47. Erdem H, Çetinkünar S, Daş K, Reyhan E, Değer C, Aziret M, et al. Alvarado, Eskelinen, Ohhmann and Raja Isteri Pengiran Anak Saleha Appendicitis scores for diagnosis of acute appendicitis. World J Gastroenterol. 2013;19(47):9057–62. pmid:24379631; PubMed Central PMCID: PMC3870559.
  48. 48. Alnjadat I, Baha A. “Alvarado versus RIPASA score in diagnosing acute appendicitis.” Rawal Medical Journal 38 (2013): 147–151.
  49. 49. Chong CF, Thien A, Mackie AJ, Tin AS, Tripathi S, Ahmad MA, et al. Comparison of RIPASA and Alvarado scores for the diagnosis of acute appendicitis. Singapore Med J. 2011;52(5):340–5. pmid:21633767.