Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Rapid label-free detection of cholangiocarcinoma from human serum using Raman spectroscopy

  • Peeraya Suksuratin,

    Roles Conceptualization, Data curation, Investigation, Writing – original draft, Writing – review & editing

    Affiliation Biomedical Engineering Program, Faculty of Engineering, Khon Kaen University, Khon Kaen, Thailand

  • Rutchanee Rodpai,

    Roles Data curation, Investigation, Writing – original draft, Writing – review & editing

    Affiliations Department of Parasitology, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand, Mekong Health Science Research Institute, Khon Kaen University, Khon Kaen, Thailand

  • Vor Luvira,

    Roles Conceptualization, Data curation

    Affiliation Department of Surgery, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand

  • Pewpan M. Intapan,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Software, Writing – original draft, Writing – review & editing

    Affiliations Department of Parasitology, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand, Mekong Health Science Research Institute, Khon Kaen University, Khon Kaen, Thailand

  • Wanchai Maleewong,

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Project administration, Writing – original draft, Writing – review & editing

    Affiliations Department of Parasitology, Faculty of Medicine, Khon Kaen University, Khon Kaen, Thailand, Mekong Health Science Research Institute, Khon Kaen University, Khon Kaen, Thailand

  • Oranat Chuchuen

    Roles Conceptualization, Data curation, Funding acquisition, Investigation, Project administration, Software, Writing – original draft, Writing – review & editing

    oranat@kku.ac.th

    Affiliations Biomedical Engineering Program, Faculty of Engineering, Khon Kaen University, Khon Kaen, Thailand, Mekong Health Science Research Institute, Khon Kaen University, Khon Kaen, Thailand, Department of Chemical Engineering, Faculty of Engineering, Khon Kaen University, Khon Kaen, Thailand

Abstract

Cholangiocarcinoma (CCA) is highly prevalent in the northeastern region of Thailand. Current diagnostic methods for CCA are often expensive, time-consuming, and require medical professionals. Thus, there is a need for a simple and low-cost CCA screening method. This work developed a rapid label-free technique by Raman spectroscopy combined with the multivariate statistical methods of principal component analysis and linear discriminant analysis (PCA-LDA), aiming to analyze and classify between CCA (n = 30) and healthy (n = 30) serum specimens. The model’s classification performance was validated using k-fold cross validation (k = 5). Serum levels of cholesterol (548, 700 cm-1), tryptophan (878 cm-1), and amide III (1248,1265 cm-1) were found to be statistically significantly higher in the CCA patients, whereas serum beta-carotene (1158, 1524 cm-1) levels were significantly lower. The peak heights of these identified Raman marker bands were input into an LDA model, achieving a cross-validated diagnostic sensitivity and specificity of 71.33% and 90.00% in distinguishing the CCA from healthy specimens. The PCA-LDA technique provided a higher cross-validated sensitivity and specificity of 86.67% and 96.67%. To conclude, this work demonstrated the feasibility of using Raman spectroscopy combined with PCA-LDA as a helpful tool for cholangiocarcinoma serum-based screening.

Introduction

The epidemiology of cholangiocarcinoma (CCA) varies greatly in different world regions but mostly in northeastern Thailand. According to a report of the European Network for the cholangiocarcinoma study (ENS-CCA), the statistics revealed that the northeast of Thailand possessed the highest worldwide incidence of approximately 85 per 100,000 people per year [1]. CCA was more prevalent in males than females in this region (over 100 vs. 40 per 100,000 people) [2]. CCAs are commonly found in elderly adults over 65 ages [3]. According to data on CCA incidence from 1989–2018, the average age of CCA patients was 62.7±11.1 in males and 64.7±11.3 in females [4]. An infection with fish-borne liver flukes of the Opisthorchiidae family has been a major cause of CCA in Southeast Asia [2], leading to chronic inflammation in the bile duct such as (i) mechanical damage from a sucker, (ii) toxic excretory-secretion, and (iii) immunopathology [5]. As definite cancer causes, these helminths are classified by the International Agency for Research on Cancer (IARC) as Group 1 biological carcinogens (i.e., fluke-related CCA) [6]. However, in other regions where the liver flukes are not endemic (e.g., Europe, America, Australia), non-fluke-related CCA has also been reported [2]. CCA patients rarely display symptoms early, so most patients visit doctors when symptoms appear in stages 3 or 4 [7]. There are a variety of diagnostic techniques for CCA, such as ultrasonography [8], magnetic resonance imaging (MRI) [8], computed tomography (CT) [9], endoscopic retrograde cholangiopancreatography (ERCP) [10], and brush biopsy [11]. However, these diagnostic techniques are relatively costly, time-consuming, and can cause pain and discomfort to the patients. Current blood-test screening techniques also have limitations as they rely on the detection of the biomarkers (e.g., carbohydrate antigen (CA19–9), carcinoembryonic antigen (CEA)), which are nonspecific to CCA, leading to insufficient diagnostic sensitivity and specificity [12]. Thus, there has not yet been any specific and effective blood test currently available for CCA screening in a large population.

Raman Spectroscopy is a low-cost, label-free, rapid, and simple-used technique for detecting small-molecule analytes and biomarkers. It has been increasingly used in biomedical and clinical diagnostics. This spectroscopic technique relies on the vibration of molecules based on inelastic Raman scattering that emerges from the changing of photon energy levels, providing unique Raman fingerprints of the molecules. Therefore, it has been employed to detect and quantitatively measure small-molecule drugs in various pharmaceutical and biological matrices [1315]. Raman spectroscopy can also identify biomolecules such as proteins, nucleic acids, lipids, and biomarkers, which are important for detecting the biochemical alterations in cells, tissues, or biofluids of various diseases [1618]. It has been used to investigate and identify microbial phenotypic changes, such as detecting phenotypic differences in Escherichia coli enriched for 1-butanol tolerance [19], developing phenotypic profiles of Escherichia coli for antibiotic drug development research [20], and isolating carotenoid-containing cells using single-cell genomics based on Raman sorting [21]. In cancer research, Raman spectroscopy has been extensively studied for cancer detection in serum [22, 23], plasma [24, 25], and tissue [26, 27] for several cancer types, including gastric cancer [22], colorectal cancer [28], breast cancer [29], cervical cancer [30], prostate cancer [31] and laryngeal cancer [32]. However, the Raman signal is intrinsically weak due to the small Raman scattering cross-section of biological molecules (around 10−30 cm-2 per molecule) [33]. Surface-enhanced Raman scattering (SERS) has been developed by absorbing molecules onto metal nanostructure surfaces (e.g., silver and gold nanoparticles) to enhance the Raman signal [34]. Although the SERS technique can effectively amplify the Raman signal by up to 1013–1015 times [35], it requires relatively complicated sample preparation and often gives poor measurement repeatability. The electroporation-assisted surface-enhanced Raman spectroscopy (SERS) technique was developed for screening intrahepatic cholangiocarcinoma from a cell suspension mixed with silver colloids. The principal component analysis and linear discriminant analysis (PCA-LDA) technique was then employed to discriminate the intrahepatic cholangiocarcinoma cells (ICC) from the normal cells, achieving a sensitivity of 97% and a specificity of 96% [36]. However, at present, there has not been any study employing the Raman technique for cholangiocarcinoma screening with biofluid.

This study applied Raman spectroscopy to distinguish cholangiocarcinoma from healthy serum specimens by analyzing important biomolecular components and identifying major Raman marker bands for separating the two groups. Raman spectroscopy was also combined with PCA-LDA to analyze and classify Raman spectra of the serum samples. The model’s classification efficiency was validated using k-fold cross-validation (k = 5). This simple and low-cost technique can provide initial CCA screening using patient serum specimens. Besides, it is a minimally invasive diagnosis, which reduces the risks to the patients and allows for faster diagnosis. This work highlights the potential of Raman Spectroscopy in the biomedical field, demonstrating that the identified Raman marker bands and the Raman-combined PCA-LDA technique could be effectively used for cholangiocarcinoma detection and screening.

Materials and methods

Serum sample preparation

The study reported a retrospective study of medical records and obtained the residual CCA sera (leftover samples) from the routine investigation of thirty CCA (n = 30) volunteers before surgery. The sample size was calculated using Cochran’s formula: [37].

A population proportion (p) of 0.00085 was used based on the incidence rate of cholangiocarcinoma in Thailand’s northeastern region, which was 85 per 100,000 individuals per year [38]. With a 95% confidence interval (95%CI, z = 1.96) and a 1.2% error margin (d = 0.012), the sample size was estimated to be 22.66. As a result, 30 specimens were collected for each study group.

The CCA group consisted of 7 serum specimens in the early cancer stages (stages T0, T1-2) and 23 in the advanced stages (stages T3-4). The group comprised all CCA types classified according to their anatomical location, i.e., intrahepatic, perihilar, and distal CCA. All healthy serum samples (n = 30) were randomly selected from a frozen biobank at the Department of Parasitology, Faculty of Medicine, Khon Kaen University. The average age of the CCA and healthy groups was 61 ± 9.45 and 64 ± 7.25 years old, respectively. All data were fully anonymized, and the IRB waived the requirement for informed consent.

Each CCA serum was separated from the venipuncture blood sample by centrifugation (Cobas 8100, Roche Diagnostics, Manheim, Germany) at 5,000 rpm (2,136 g) for 10 min. The serum samples were aliquoted into seven separated tubes (4 μl in each) and stored at -20°C for further Raman spectroscopic analysis. The study protocol was approved by the Khon Kaen University Ethics Committee for Human Research (HE641114).

Confocal Raman measurements

The serum of 2.3 μl was dropped onto a sample well made by attaching a flat washer (0.3 mm thickness, 2.8 mm diameter) onto a mirror-grade stainless steel plate. The sample well was covered with a quartz coverslip (R52500, Esco Optics, Oak Ridge, NJ) to prevent serum evaporation. The serum samples were measured with a Horiba XploRA PLUS confocal Raman microscope (Horiba Jobin Yvon, Northampton, UK) with a 50x objective lens (LMPLFL50X, Olympus, St. Joseph, MI) to provide a relatively stable signal in an integrated high-performance system. This instrument used a charge-coupled device (CCD) detector of the thermoelectric (TE) cooling type, which operated at -60°C to eliminate thermally-induced noise signals. It employed a 785 nm laser excitation, delivering a maximum output power of up to 90–100 mW. The near-infrared (NIR) laser light was used to reduce the background fluorescence interference and prevent sample damage from overheating. A grating of 1200 gr/mm, a hole diameter of 500 μm, and a slit of 200 μm width were used. Raman spectral data were recorded in.txt format by LabSpec 6 software (Horiba Scientific, Edison, NJ). Before each spectral measurement, the Raman microscope was calibrated with a silicon wafer for its Raman peak at 520 cm-1. Each serum sample was measured independently five times using an integration time of 60 seconds, collected in a spectral region of 0–2000 cm-1. A schematic summary of the overall experimental procedure used in this study is displayed in Fig 1.

thumbnail
Fig 1. Experimental setup and procedure for Raman measurements of serum specimens of cholangiocarcinoma and healthy groups.

The experimental steps consisted of: (1) placing a sample well containing 2.3 μl serum sample on a Raman microscope stage, (2) setting measurement parameters, (3) measuring serum samples with a laser excitation wavelength of 785 nm, (4) recording raw spectral data in LabSpac6 software, and (5) exporting the collected data to MATLAB for furfure spectral processing and machine learning classification analysis.

https://doi.org/10.1371/journal.pone.0275362.g001

Raman data processing and peak height analysis

After the Raman spectra were recorded, initial spectral pre-processing and analysis were performed in Labspec 6. The spectral baseline of each spectrum was first subtracted by a polynomial fitting algorithm (degree 4). Next, each spectrum was smoothed using a Savitzky-Golay filter (20 points) and fitted with a Gaussian–Lorentzian function by a nonlinear least-squares method to calculate its peak height values. Statistical analysis was performed using IBM SPSS Statistics 26 (SPSS Inc., Chicago, IL) by an independent sample t-test with p-values of less than 0.05 considered statistically significant. Raman marker bands were selected from the peaks that exhibited a statistically significant difference in the peak height between healthy and CCA samples. The heights of these Raman bands were then input into a linear discriminant analysis (LDA) model for further classification analysis.

Multivariate Raman spectral analysis

Raw Raman spectral data were exported to MATLAB software (R2021a, MathWorks, Natick, MA) for multivariate statistical analysis. Each Raman spectrum in the range of 350–1800 cm-1 was cropped for use in the analysis before being baseline-subtracted by a polynomial fitting algorithm (degree 4) and smoothed with a Savitzky-Golay filter (20 points). Next, the mean spectral intensity across all wavenumbers was used to normalize each spectrum. The processed Raman spectra were then analyzed by principal component analysis (PCA), which was used to reduce the variability of high-dimensional data by reducing the data features and transforming the spectral data into new variables called principal components (PCs). The scores of all PCs were analyzed by an independent sample t-test to identify the PCs that could statistically significantly distinguish between the CCA and healthy groups (p-value ≤ 0.05). The scores of the first ten PCs were input into the LDA model in MATLAB for human serum classification. The peak heights of the Raman marker bands obtained previously were also input into the LDA model. To prevent model overfitting, the Classification Learner App in MATLAB was employed for performing a cross validation analysis with k-fold cross-validation (k = 5). With this method, the data were randomly divided into k subgroups. The holdout approach was then repeated k times, with one of the k subsets providing the test set (validation set) and the other k-1 subsets forming a training set each time [39]. The performance estimation was averaged over all k trials to evaluate the model’s overall efficiency. The cross-validated results of the peak height-LDA and PCA-LDA methods, including the confusion matrices and the receiver operating characteristic (ROC) curves, were compared.

Results and discussion

Each serum specimen from the cholangiocarcinoma (CCA) patients (n = 30) and the healthy subjects (n = 30) was measured independently five times using Raman spectroscopy. The mean serum Raman spectra of both subject groups and their biochemical element assignments are shown in Fig 2 and Table 1, respectively. The averaged peak intensities of the major Raman bands are displayed in Fig 3. All of these peaks exhibited a statistically significant difference in peak height between healthy and CCA groups (p-value < 0.05) and were selected as Raman marker bands to differentiate CCA samples from healthy ones. Interestingly, the serum beta-carotene peak intensities (1158, 1524 cm-1) of the healthy group were significantly higher than those of the CCA patients. On the contrary, the serum specimens of the CCA patients demonstrated significantly higher intensities in the Raman peaks of cholesterol (548 cm-1 and 700 cm-1), methionine (700 cm-1), tryptophan (757 cm-1 and 878 cm-1), and amide III (1248–1265 cm-1). These Raman maker peaks can be employed to distinguish the CCA from healthy subjects, and their peak heights can be combined with the LDA technique to improve the classification results.

thumbnail
Fig 2. Mean serum Raman spectra of cholangiocarcinoma patients (red, n = 30) and healthy subjects (blue, n = 30).

(A) Raman spectra that were offset for clarity of presentation. The solid lines and shaded regions show the averages and standard deviations of the data, respectively. (B) Superimposed average Raman spectra of the two groups.

https://doi.org/10.1371/journal.pone.0275362.g002

thumbnail
Fig 3. Comparison of averaged Raman peak intensities between the CCA and healthy groups.

The Raman peak height values were calculated using a Gaussian–Lorentzian function. Data shown represent mean ± standard error of the measurements (150 total measurements for each group). Significant differences (p-value ≤ 0.05) are indicated by *. ν: stretching mode.

https://doi.org/10.1371/journal.pone.0275362.g003

thumbnail
Table 1. Peak positions and assignments of major Raman spectral peaks observed in serum of cholangiocarcinoma patients.

https://doi.org/10.1371/journal.pone.0275362.t001

The differences observed in the serum biomolecular level of the CCA patients compared to the healthy group were consistent with the literature. Several studies found a correlation between the level of beta-carotene and the severity of cancer. Because beta-carotene is an antioxidant, it can inhibit cancer cell transformation at the molecular level by decreasing the growth rate and inducing apoptosis of the cancer cells [43, 46]. Our findings suggested that the CCA patients had lower levels of beta-carotene than the healthy group, agreeing with previous studies involving liver cancer [47], colorectal cancer [28], and nasopharyngeal cancer [48].

Furthermore, the Raman peaks of cholesterol at 548 cm-1 and 700 cm-1, whose intensities were higher in the CCA patients, could indicate a potential elevated serum cholesterol level resulting from the obstruction of the bile flow (cholestasis). Cholesterol is a precursor of bile acids. Therefore, the obstruction of the bile duct in CCA patients can cause a reduction in bile creation, leading to increased serum cholesterol levels [49]. Cholestasis is one of the risk factors of cholangiocarcinoma. It causes the accumulation of abnormal bile acids and leads to abnormal cell proliferation and genetic mutations of cancer cells [50]. Cholesterol has thus been selected as an indicator of necrosis in certain cancer cells, such those in the lung and liver [21, 51], in order to determine the progression from benign to malignant states and the severity of the disease [21]. It is consistent with our findings, in which the serum of the CCA patients demonstrated higher cholesterol peak heights (548 cm-1 and 700 cm-1) than the healthy group. The Raman peak found at 700 cm-1 could also be assigned to methionine, an essential amino acid potentially necessary for the growth of cancer cells that require exogenous methionine for survival and proliferation [52, 53]. Our findings showed that the Raman peak height of methionine was significantly higher in the serum specimens of the CCA patients. The growth of prostate, breast, and colorectal cancer cells has also been shown to be dependent on methionine [52].

In addition, the amide III Raman band (1248–1265 cm-1) was significantly higher in intensity in the CCA patients. It can be caused by the protein’s endogenous composition changes during metastasis or the increasing of the DNA and RNA expression caused by apoptosis or necrosis of the cancer cells [54]. When cells are degraded, intracellular elements such as nucleic acid fragments are released into the bloodstream, becoming cell-free DNA [54]. The RNA expression then stimulates increased protein production, resulting in a higher amino acid level. Our results were consistent with a previous study that intrahepatic cholangiocarcinoma cells (ICC) had abnormal DNA amplification ability leading to the higher nucleic acid level in ICC than the normal liver cells [36].

Moreover, the results suggested that the serum of the CCA patients contained comparably higher levels of tryptophan (757 cm-1 and 878 cm-1), agreeing with previous studies being reported for colon cancer [55], cervical cancer [43], and nasopharyngeal cancer [48]. Tryptophan plays a major role in protein synthesis and the generation of molecules that influence immunological activity [40]. Consequently, the alterations in the tryptophan metabolism and the enzyme indoleamine 2,3-dioxygenase activity may contribute to the changes in physiopathological conditions of cancer cells, acting as a promoter of cancer growth [48]. The study revealed that cancer cells exhibited important metabolic disorders, which presented an opportunity for spectroscopic techniques such as Raman spectroscopy to be used to detect these biomolecular changes. Raman spectroscopy can also be combined with machine learning techniques to more precisely identify and classify those spectral differences between the diseased and healthy groups.

To improve the efficiency of the CCA classification, the peak heights of the Raman marker bands, as identified in Fig 3, were input into a discriminant function LDA, a supervised machine-learning approach, to increase the variance between the two sample groups and decrease the variance within each group. In addition, the multivariate statistical method of PCA-LDA was employed. The PCA analysis, a dimensionality reduction method, transformed the Raman spectra features into independent variables known as principal components (PCs) before feeding them into the LDA model. Two sets of data were analyzed. (i) a total data set containing 300 measurements acquired from independently measuring each of the total 60 specimens (30 specimens from each group) five times; and (ii) an averaged data set acquired from averaging those five independent measurements of each specimen. The PCA analysis revealed six statistically significant PCs (PC-1, PC-2, PC-5, PC-8, PC-9, PC-12) from the total data set and three significant PCs (PC-1, PC-5, PC-7) from the averaged data set. As shown by the significant PC loadings in S1 Fig, the Raman spectral features of the CCA and healthy groups were clearly distinct and contained important spectral information that could be used to distinguish the two groups.

The PCA score scatter plots revealed the two distinguishable clusters representing each subject group (Fig 4). The healthy group appeared to be more tightly grouped, while the CCA group was more dispersed and less clustered. A higher level of data dispersion of the CCA group could be due to the variations in the relative amounts of the biomolecular components due to the heterogeneous metabolic processes among different cancer patients. Moreover, using the averaged data set for the PCA analysis (Fig 4C) demonstrated superior diagnostic performance (sensitivity: 90.00%, specificity: 76.67%) than using the total data set (Fig 4A, sensitivity: 81.33%, specificity: 73.33%). Utilizing the average data set could improve the classification performance by reducing the intra-individual variability of human serum, which is a biological matrix with heterogeneous components.

thumbnail
Fig 4. PCA score scatter plots of the healthy group (n = 30, blue) versus cholangiocarcinoma patients (n = 30, red).

Before the PCA analysis, each Raman spectrum between 350 and 1800 cm-1 was baseline-subtracted and normalized. A and B panels display a total data set of 150 measurements for each group (30 specimens, each measured independently five times). C and D panels display an averaged data set obtained from averaging the five independent measurements of each specimen. The dotted line is a diagnostic line separating the two groups: (A) PC8 = -0.28PC1-0.19 and (C) PC7 = 0.20PC1-0.09.

https://doi.org/10.1371/journal.pone.0275362.g004

To further improve the diagnostic classification between the CCA and healthy groups. All the first ten PCs of the averaged data set were loaded into an LDA model. The first ten PCs accounted for 94.56% of the total Raman spectral variance (PC-1: 40.16%, PC-2: 23.97%, PC-3: 11.06%, PC-4: 9.41%, PC-5: 4.21%, PC-6: 2.23%, PC-7: 1.13%, PC-8: 1.03%, PC-9: 0.75% and PC-10: 0.59%). For the peak height -LDA analysis, the peak heights of the seven Raman marker bands identified previously (Fig 3; 548, 700, 878, 1158, 1248, 1265 and 1524 cm-1) were input into the LDA model. Fig 5 shows the posterior probability of belonging to the CCA and healthy groups by a discrimination threshold of 0.5. The PCA-LDA approach demonstrated superior diagnostic performance (90% sensitivity and 100% specificity) to peak height-LDA (sensitivity: 86.67%, specificity: 90%). Notably, the peak height-LDA employed only the identified seven Raman marker bands (Fig 3) in the classification analysis. PCA-LDA, on the other hand, utilized ten PCs that together covered 94.56% of the total Raman spectral variance, and each PC contained a number of significant Raman spectral features extracted from the PCA analysis that could effectively differentiate the two groups. Thus, the combination of these PCs with LDA resulted in improvement of the overall classification performance.

thumbnail
Fig 5. Scatter plots of the posterior probability of belonging to cholangiocarcinoma (n = 30) and healthy groups (n = 30).

The posterior probability results were acquired by (A) the peak height analysis of the marker bands combined with LDA and (B) the PCA-LDA algorithm utilizing the first 10 PCs. The dotted line represented the discrimination threshold of 0.5.

https://doi.org/10.1371/journal.pone.0275362.g005

To validate the model classification performance and prevent potential model overfitting, a k-fold cross-validation approach was employed [56]. The k-fold cross-validation results (k = 5; Table 2) confirmed that the PCA-LDA method distinguished CCA from healthy groups more effectively than the peak height-LDA approach, as indicated by higher values for all diagnostic performance parameters. The cross-validated receiver operating characteristic (ROC) curves and confusion matrices were generated (Fig 6) to further evaluate and compare the diagnostic performances of the two methods. In PCA-LDA, 86.67% of CCA were correctly identified, 13.33% were incorrectly classified as healthy samples, while only 3.33% of the healthy group was misclassified. The performance of peak height-LDA was inferior, with 28.67% of CCA incorrectly identified as healthy. In other words, peak height-LDA had a higher false negative rate (FNR: 28.67%) and false positive rate (FPR: 10.00%) than the PCA-LDA method (FNR: 13.33%, FPR: 3.33%). A high FPR would be unfavorable for a diagnostic test because it could expose healthy individuals to unneeded therapy, whereas a high FNR could result in patients being left untreated. In addition, the PCA-LDA method had a higher integrated area under the ROC curve (0.963) than the peak height-LDA method (0.899). The closer the value of the area under the ROC curve is to one, the more accurate the classifier’s predictions [57]. Therefore, these cross-validated classification results demonstrated that although both diagnostic algorithms were able to discriminate between CCA and healthy groups, the PCA-LDA-based diagnostic algorithm that utilized several prominent spectral features present in serum Raman spectra provided a more effective diagnostic performance for cholangiocarcinoma detection than the peak height-LDA method.

thumbnail
Fig 6. Cross-validated ROC curves and confusion matrices for classification between CCA and healthy groups.

(A) The integrated area under the ROC curves was 0.963 for the PCA-LDA analysis and 0.899 for the peak height analysis combined with the LDA approach. The confusion matrices for the classification performance between (B) the peak height-LDA model and (C) the PCA-LDA model as validated by a 5-fold cross validation method.

https://doi.org/10.1371/journal.pone.0275362.g006

thumbnail
Table 2. The diagnostic performance in classification between the CCA and healthy groups using peak height-LDA and PCA-LDA methods together with a k-fold cross validation approach (k = 5).

https://doi.org/10.1371/journal.pone.0275362.t002

The combined Raman spectroscopy and PCA-LDA approach presented has shown promise as a rapid, label-free technique for cholangiocarcinoma detection and screening, as evidenced by its comparatively high sensitivity (86.67%) and specificity (96.67%) to other diagnostic techniques (Table 3). Due to the limitations of existing diagnostic methods, the diagnosis of CCA remains challenging, and there has been a growing demand for a low-cost, easy-to-use detection and diagnostic screening approach. Non-invasive imaging modalities, such as ultrasonography, computed tomography (CT), and magnetic resonance imaging (MRI), can offer relatively high diagnostic sensitivity and specificity for identifying CCA features and staging, but come at a high cost and necessitate the use of experienced medical personnel. Thus, these techniques can present a challenge in poor-resource settings. The experience level of radiologists could also compromise the accuracy of diagnosis and the frequency of misdiagnoses [58]. ERCP-based methods provide a definitive diagnosis of CCA through the collection of biliary tissue; however, the procedures are invasive, can be time-consuming, and may expose patients to procedure-related risks. Furthermore, despite being minimally invasive, the CA19-9 and CEA biomarker methods are not specific to CCA and may be present in other malignancies, such as colorectal and gastric cancers. The developed Raman spectroscopic technique can provide a minimally invasive and low-cost diagnostic tool for CCA screening, which can be used in conjunction with other diagnostic methods. However, the method has limitations that require further research before it can be applied effectively in a clinical setting.

thumbnail
Table 3. Comparison of current diagnostic methods for cholangiocarcinoma detection.

https://doi.org/10.1371/journal.pone.0275362.t003

The capability of the developed Raman technique in determining CCA stages and classifying its anatomical origin has not been investigated and confirmed in this study. A larger population would be required to study the classification of CCA’s disease stage and anatomical origins, as the majority (77%) of the CCA patient samples used in this study were of advanced disease stage. Since CCA was typically diagnosed after the disease had manifested [1, 59, 60], the recruitment of early-stage volunteers may be difficult. In addition, the intrinsically small cross-section of Raman scattering of biomolecules may pose a challenge for Raman detection of early-stage cancer samples with subtle cancer-induced biochemical alterations. Other Raman-related techniques, such as SERS, may be utilized to enhance the Raman signal and improve the diagnostic sensitivity for early-stage CCA detection.

Despite demonstrating a relatively high sensitivity and specificity for CCA detection, the current method was performed on a commercial benchtop Raman spectrometer with highly optimized optical properties (e.g., signal-to-noise ratio, spectral resolution and stability). However, CCA is highly prevalent in resource poor rural communities with limited access to healthcare [61]. To be able to implement this technique in remote and resource-constrained endemic regions, the measurements may need to be acquired with a portable Raman device that potentially has inferior optical performance, thereby compromising the overall diagnostic performance of the method. Thus, future research could focus on optimizing this method on a lower performance portable spectrometer or developing highly sensitive portable Raman spectrometer for use with this technique in order to increase its accessibility to patients in remote areas. Collectively, the Raman approach combined with machine learning offers a promising strategy as a simple, rapid, and effective diagnostic method that can be further implemented for CCA screening in a large population and may be able to complement the existing imaging modalities to improve the overall CCA diagnosis and prognosis outcomes.

Conclusion

The study presented here showed that the Raman spectroscopy technique combined with the PCA-LDA analysis as a non-invasive and rapid diagnostic approach could analyze serum differences and distinguish between cholangiocarcinoma patients and healthy subjects. The empirical analysis of the Raman spectra revealed several Raman bands whose peak heights showed statistically significant differences between the CCA and healthy groups. Serum from the cholangiocarcinoma patients contained significantly higher levels of cholesterol, tryptophan, and amide III but lower levels of beta-carotene than the healthy subjects. These biomolecular components can be identified as Raman marker bands for cholangiocarcinoma detection from serum. A peak height analysis of these Raman marker bands combined with LDA generated diagnostic performances of 80.67% accuracy, 71.33% sensitivity, and 90.00% specificity in classifying between the CCA and healthy serum specimens, with an area under the ROC curve of 0.899. In comparison, the PCA-LDA technique provided better diagnostic performances of 91.67% accuracy, 86.67% sensitivity, and 96.67% specificity for cholangiocarcinoma detection, with a higher ROC area under the curve of 0.963. Thus, Raman spectroscopy combined with PCA–LDA provided a promising tool for cholangiocarcinoma serum detection and screening. In future work, the capability of this technique in discrimination of CCA stages and anatomical sites of origin will be further explored.

Supporting information

S1 Fig. Loading spectra of the PCA analysis.

(A) Loadings of 12 PCs acquired from the PCA analysis of the total data set (150 measurements for each group). (B) Loadings of 7 PCs acquired from the averaged data set (averaged from five independent measurements of each specimen). Significant PCs (p-value ≤ 0.05) are indicated by *.

https://doi.org/10.1371/journal.pone.0275362.s001

(TIF)

Acknowledgments

We would like to thank Faculty of Medicine at Khon Kaen University for granting us permission to use the Horiba XploRA PLUS confocal Raman microscope in this study. We thank Dr. Lakkhana Sadaow, Ms. Chanida Suprom, and Ms. Punyisa Buadee (Department of Parasitology, Faculty of Medicine, Khon Kaen University), Ms. Saranya Worawiset (Graduate School, Khon Kaen University), Dr. Tinnakorn Kumsaen (Department of Chemical Engineering, Faculty of Engineering, Khon Kaen University), and Asst. Prof. Chavis Srichan (Department of Computer Engineering, Faculty of Engineering, Khon Kaen University) for their assistance and helpful advice during the various stages of the research project.

References

  1. 1. Banales JM, Cardinale V, Carpino G, Marzioni M, Andersen JB, Invernizzi P, et al. Expert consensus document: Cholangiocarcinoma: current knowledge and future perspectives consensus statement from the European Network for the Study of Cholangiocarcinoma (ENS-CCA). Nat Rev Gastroenterol Hepatol. 2016;13(5):261–80. Epub 2016/04/21. pmid:27095655
  2. 2. Brindley PJ, Bachini M, Ilyas SI, Khan SA, Loukas A, Sirica AE, et al. Cholangiocarcinoma. Nat Rev Dis Primers. 2021;7(1):65. pmid:34504109
  3. 3. Doherty B, Nambudiri VE, Palmer WCJCgr. Update on the diagnosis and treatment of cholangiocarcinoma. 2017;19(1):1–8.
  4. 4. Kamsa-Ard S, Santong C, Kamsa-Ard S, Luvira V, Luvira V, Suwanrungruang K, et al. Decreasing trends in cholangiocarcinoma incidence and relative survival in Khon Kaen, Thailand: An updated, inclusive, population-based cancer registry analysis for 1989–2018. 2021;16(2):e0246490.
  5. 5. Zheng S, Zhu Y, Zhao Z, Wu Z, Okanurak K, Lv ZJPr. Liver fluke infection and cholangiocarcinoma: a review. 2017;116(1):11–9.
  6. 6. Brindley PJ, Da Costa JMC, Sripa BJTic. Why does infection with some helminths cause cancer? 2015;1(3):174–82.
  7. 7. Khuntikeo N, Loilome W, Thinkhamrop B, Chamadol N, Yongvanit PJPNTD. A comprehensive public health conceptual framework and strategy to effectively combat cholangiocarcinoma in Thailand. 2016;10(1):e0004293.
  8. 8. Siripongsakun S, Sapthanakorn W, Mekraksakit P, Vichitpunt S, Chonyuen S, Seetasarn J, et al. Premalignant lesions of cholangiocarcinoma: characteristics on ultrasonography and MRI. 2019;44(6):2133–46.
  9. 9. Kim YY, Yeom SK, Shin H, Choi SH, Rhee H, Park JH, et al. Clinical Staging of Mass‐Forming Intrahepatic Cholangiocarcinoma: Computed Tomography Versus Magnetic Resonance Imaging. 2021;5(12):2009–18.
  10. 10. Buerlein RC, Wang AYJGEC. Endoscopic retrograde cholangiopancreatography-guided ablation for cholangiocarcinoma. 2019;29(2):351–67.
  11. 11. Kaura K, Sawas T, Bazerbachi F, Storm AC, Martin JA, Gores GJ, et al. Cholangioscopy biopsies improve detection of cholangiocarcinoma when combined with cytology and FISH, but not in patients with PSC. 2020;65(5):1471–8.
  12. 12. Alsaleh M, Leftley Z, Barbera TA, Sithithaworn P, Khuntikeo N, Loilome W, et al. Cholangiocarcinoma: A guide for the nonspecialist. 2019;12:13. pmid:30588065
  13. 13. Chuchuen O, Maher JR, Simons MG, Peters JJ, Wax AP, Katz DF. Label-Free Measurements of Tenofovir Diffusion Coefficients in a Microbicide Gel Using Raman Spectroscopy. J Pharm Sci. 2017;106(2):639–44. Epub 2016/11/14. pmid:27837968
  14. 14. Chuchuen O, Maher JR, Henderson MH, Desoto M, Rohan LC, Wax A, et al. Label-free analysis of tenofovir delivery to vaginal tissue using co-registered confocal Raman spectroscopy and optical coherence tomography. PLoS One. 2017;12(9):e0185633. Epub 2017/09/30. pmid:28961280
  15. 15. Chuchuen O, Henderson MH, Sykes C, Kim MS, Kashuba AD, Katz DF. Quantitative analysis of microbicide concentrations in fluids, gels and tissues using confocal Raman spectroscopy. PLoS One. 2013;8(12):e85124. Epub 2014/01/05. pmid:24386455
  16. 16. Parlatan U, Inanc MT, Ozgor BY, Oral E, Bastu E, Unlu MB, et al. Raman spectroscopy as a non-invasive diagnostic technique for endometriosis. 2019;9(1):1–7.
  17. 17. Chuchuen O, Thammaratana T, Sanpool O, Rodpai R, Maleewong W, Intapan PMJPo. Rapid label-free analysis of Opisthorchis viverrini eggs in fecal specimens using confocal Raman spectroscopy. 2019;14(12):e0226762.
  18. 18. Khan S, Ullah R, Shahzad S, Anbreen N, Bilal M, Khan AJP, et al. Analysis of tuberculosis disease through Raman spectroscopy and machine learning. 2018;24:286–91.
  19. 19. Freedman BG, Zu TN, Wallace RS, Senger RS. Raman spectroscopy detects phenotypic differences among Escherichia coli enriched for 1-butanol tolerance using a metagenomic DNA library. Biotechnol J. 2016;11(7):877–89. Epub 2016/01/28. pmid:26814030
  20. 20. Athamneh AI, Alajlouni RA, Wallace RS, Seleem MN, Senger RS. Phenotypic profiling of antibiotic response signatures in Escherichia coli using Raman spectroscopy. Antimicrob Agents Chemother. 2014;58(3):1302–14. Epub 2013/12/04. pmid:24295982
  21. 21. Stone N, Hart Prieto MC, Crow P, Uff J, Ritchie AWJA, chemistry b. The use of Raman spectroscopy to provide an estimation of the gross biochemistry associated with urological pathologies. 2007;387(5):1657–68.
  22. 22. Bahreini M, Hosseinzadegan A, Rashidi A, Miri SR, Mirzaei HR, Hajian PJT. A Raman-based serum constituents’ analysis for gastric cancer diagnosis: In vitro study. 2019;204:826–32.
  23. 23. Wang H, Zhang S, Wan L, Sun H, Tan J, Su QJSAPAM, et al. Screening and staging for non-small cell lung cancer by serum laser Raman spectroscopy. 2018;201:34–8.
  24. 24. Nargis H, Nawaz H, Ditta A, Mahmood T, Majeed M, Rashid N, et al. Raman spectroscopy of blood plasma samples from breast cancer patients at different stages. 2019;222:117210.
  25. 25. Paraskevaidi M, Ashton KM, Stringfellow HF, Wood NJ, Keating PJ, Rowbottom AW, et al. Raman spectroscopic techniques to detect ovarian cancer biomarkers in blood plasma. 2018;189:281–8.
  26. 26. Sbroscia M, Di Gioacchino M, Ascenzi P, Crucitti P, di Masi A, Giovannoni I, et al. Thyroid cancer diagnosis by Raman spectroscopy. Sci Rep. 2020;10(1):13342. Epub 2020/08/10. pmid:32770073
  27. 27. Desroches J, Jermyn M, Pinto M, Picot F, Tremblay MA, Obaid S, et al. A new method using Raman spectroscopy for in vivo targeted brain cancer tissue biopsy. Sci Rep. 2018;8(1):1792. Epub 2018/01/31. pmid:29379121
  28. 28. Jenkins CA, Jenkins RA, Pryse MM, Welsby KA, Jitsumura M, Thornton CA, et al. A high-throughput serum Raman spectroscopy platform and methodology for colorectal cancer diagnostics. Analyst. 2018;143(24):6014–24. Epub 2018/11/07. pmid:30398225
  29. 29. Nargis HF, Nawaz H, Bhatti HN, Jilani K, Saleem M. Comparison of surface enhanced Raman spectroscopy and Raman spectroscopy for the detection of breast cancer based on serum samples. Spectrochim Acta A Mol Biomol Spectrosc. 2021;246:119034. Epub 2020/10/14. pmid:33049470
  30. 30. Wang J, Zheng CX, Ma CL, Zheng XX, Lv XY, Lv GD, et al. Raman spectroscopic study of cervical precancerous lesions and cervical cancer. Lasers Med Sci. 2021;36(9):1855–64. Epub 2021/01/07. pmid:33404885
  31. 31. Correia NA, Batista LTA, Nascimento RJM, Cangussu MCT, Crugeira PJL, Soares LGP, et al. Detection of prostate cancer by Raman spectroscopy: A multivariate study on patients with normal and altered PSA values. J Photochem Photobiol B. 2020;204:111801. Epub 2020/01/25. pmid:31978674
  32. 32. Lai H, Wan Z, Wu Q, Lin S, Li C, Wang DJLP. Surface-enhanced Raman spectroscopy for classification of laryngeal cancer and adjacent tissues. 2019;29(10):105601.
  33. 33. Feng S, Wang W, Tai IT, Chen G, Chen R, Zeng H. Label-free surface-enhanced Raman spectroscopy for detection of colorectal cancer and precursor lesions using blood plasma. Biomed Opt Express. 2015;6(9):3494–502. Epub 2015/09/30. pmid:26417518
  34. 34. Lu Y, Lin Y, Zheng Z, Tang X, Lin J, Liu X, et al. Label free hepatitis B detection based on serum derivative surface enhanced Raman spectroscopy combined with multivariate analysis. Biomed Opt Express. 2018;9(10):4755–66. Epub 2018/10/16. pmid:30319900
  35. 35. Lin J, Lin X, Hu C, Bai P, Yang H, Dai Y, et al. Silver nanoparticle based surface-enhanced Raman spectroscopy for label-free discrimination of diabetic albumin under near-infrared laser excitation. 2018;15(9):095703.
  36. 36. Hong Q, Zhou J, Zhang Z, Chen W, Wei G, Huang H, et al. Label-free screening of intrahepatic cholangiocarcinoma cells using electroporation assisted surface-enhanced Raman scattering combined with statistical algorithms. Laser Physics. 2020;30(2).
  37. 37. Charan J, Biswas TJIjopm. How to calculate sample size for different study designs in medical research? 2013;35(2):121–6.
  38. 38. Sa-Ngiamwibool P, Aphivatanasiri C, Sangkhamanon S, Intarawichian P, Kunprom W, Thanee M, et al. Modification of the AJCC/UICC 8th edition staging system for intrahepatic cholangiocarcinoma: proposal for an alternative staging system from cholangiocarcinoma-prevalent Northeast Thailand. HPB (Oxford). 2022. Epub 2022/07/10. pmid:35810105
  39. 39. Berrar D. Cross-Validation. 2019.
  40. 40. Pezzotti GJJoRS. Raman spectroscopy in cell biology and microbiology. 2021;52(12):2348–443.
  41. 41. Movasaghi Z, Rehman S, Rehman IUJASR. Raman spectroscopy of biological tissues. 2007;42(5):493–541.
  42. 42. Khan S, Ullah R, Javaid S, Shahzad S, Ali H, Bilal M, et al. Raman spectroscopy combined with principal component analysis for screening nasopharyngeal cancer in human blood sera. 2017;71(11):2497–503.
  43. 43. Gonzalez-Solis JL, Martinez-Espinosa JC, Torres-Gonzalez LA, Aguilar-Lemarroy A, Jave-Suarez LF, Palomares-Anda P. Cervical cancer detection based on serum sample Raman spectroscopy. Lasers Med Sci. 2014;29(3):979–85. Epub 2013/11/08. pmid:24197519
  44. 44. Poon KW, Lyng FM, Knief P, Howe O, Meade AD, Curtin JF, et al. Quantitative reagent-free detection of fibrinogen levels in human blood plasma using Raman spectroscopy. Analyst. 2012;137(8):1807–14. Epub 2012/03/03. pmid:22382127
  45. 45. Pichardo-Molina JL, Frausto-Reyes C, Barbosa-Garcia O, Huerta-Franco R, Gonzalez-Trujillo JL, Ramirez-Alvarado CA, et al. Raman spectroscopy and multivariate analysis of serum samples from breast cancer patients. Lasers Med Sci. 2007;22(4):229–36. Epub 2007/02/14. pmid:17297595
  46. 46. Rowles JL 3rd, Erdman JW Jr. Carotenoids and their role in cancer prevention. Biochim Biophys Acta Mol Cell Biol Lipids. 2020;1865(11):158613. Epub 2020/01/15. pmid:31935448
  47. 47. Ou Q, Yang X, Yang W, Jiang L, Qian K, Shi Y, et al. Based on Serum Raman and Fluorescence Spectra to Diagnose Liver Cancer. 2022.
  48. 48. Khan S, Ullah R, Shahzad S, Javaid S, Khan A. Optical screening of nasopharyngeal cancer using Raman spectroscopy and support vector machine. Optik. 2018;157:565–70.
  49. 49. Hisham Nazer M, FRCP, DTM&H Professor of Pediatrics, Consultant in Pediatric Gastroenterology, Hepatology and Clinical Nutrition, University of Jordan Faculty of Medicine, Jordan. Cholestasis 2017. https://emedicine.medscape.com/article/927624-overview#showall.
  50. 50. Labib PL, Goodchild G, Pereira SP. Molecular Pathogenesis of Cholangiocarcinoma. BMC Cancer. 2019;19(1):185. Epub 2019/03/02. pmid:30819129
  51. 51. Lei K, Kurum A, Kaynak M, Bonati L, Han Y, Cencen V, et al. Cancer-cell stiffening via cholesterol depletion enhances adoptive T-cell immunotherapy. Nat Biomed Eng. 2021;5(12):1411–25. Epub 2021/12/08. pmid:34873307
  52. 52. Wanders D, Hobson K, Ji X. Methionine Restriction and Cancer Biology. Nutrients. 2020;12(3). Epub 2020/03/07. pmid:32138282
  53. 53. Cavuoto P, Fenech MF. A review of methionine dependency and the role of methionine restriction in cancer growth control and life-span extension. Cancer Treat Rev. 2012;38(6):726–36. Epub 2012/02/22. pmid:22342103
  54. 54. Mehta K, Atak A, Sahu A, Srivastava S, C MK. An early investigative serum Raman spectroscopy study of meningioma. Analyst. 2018;143(8):1916–23. Epub 2018/04/06. pmid:29620771
  55. 55. Li P, Chen C, Deng X, Mao H, Jin S. Drop coating deposition Raman spectroscopy of blood plasma for the detection of colorectal cancer. J Biomed Opt. 2015;20(3):037004. Epub 2015/03/11. pmid:25756306
  56. 56. Santos MS, Soares JP, Abreu PH, Araujo H, Santos J. Cross-Validation for Imbalanced Datasets: Avoiding Overoptimistic and Overfitting Approaches [Research Frontier]. IEEE Computational Intelligence Magazine. 2018;13(4):59–76.
  57. 57. Mandrekar JNJJoTO. Receiver operating characteristic curve in diagnostic test assessment. 2010;5(9):1315–6.
  58. 58. Xu X, Mao Y, Tang Y, Liu Y, Xue C, Yue Q, et al. Classification of Hepatocellular Carcinoma and Intrahepatic Cholangiocarcinoma Based on Radiomic Analysis. 2022;2022.
  59. 59. Tawarungruang C, Khuntikeo N, Chamadol N, Laopaiboon V, Thuanman J, Thinkhamrop K, et al. Survival after surgery among patients with cholangiocarcinoma in Northeast Thailand according to anatomical and morphological classification. BMC Cancer. 2021;21(1):497. Epub 2021/05/05. pmid:33941120
  60. 60. Squadroni M, Tondulli L, Gatta G, Mosconi S, Beretta G, Labianca R. Cholangiocarcinoma. Crit Rev Oncol Hematol. 2017;116:11–31. Epub 2017/07/12. pmid:28693792
  61. 61. Wilcox BA, Echaubard P. Balancing biomedical and ecological perspectives in research framing of liver fluke and cholangiocarcinoma in NE Thailand. Parasitol Int. 2017;66(4):372–7. Epub 2016/10/26. pmid:27729246
  62. 62. Li F, Li Q, Liu Y, Han J, Zheng W, Huang Y, et al. Distinguishing intrahepatic cholangiocarcinoma from hepatocellular carcinoma in patients with and without risks: the evaluation of the LR-M criteria of contrast-enhanced ultrasound liver imaging reporting and data system version 2017. Eur Radiol. 2020;30(1):461–70. Epub 2019/07/13. pmid:31297632
  63. 63. Kim YY, Yeom SK, Shin H, Choi SH, Rhee H, Park JH, et al. Clinical Staging of Mass-Forming Intrahepatic Cholangiocarcinoma: Computed Tomography Versus Magnetic Resonance Imaging. Hepatol Commun. 2021;5(12):2009–18. Epub 2021/09/25. pmid:34559470
  64. 64. Galassi M, Iavarone M, Rossi S, Bota S, Vavassori S, Rosa L, et al. Patterns of appearance and risk of misdiagnosis of intrahepatic cholangiocarcinoma in cirrhosis at contrast enhanced ultrasound. 2013;33(5):771–9.
  65. 65. Van Beers BE. Diagnosis of cholangiocarcinoma. HPB (Oxford). 2008;10(2):87–93. Epub 2008/09/06. pmid:18773062
  66. 66. Fábrega-Foster K, Ghasabeh MA, Pawlik TM, Kamel IRJHs, nutrition. Multimodality imaging of intrahepatic cholangiocarcinoma. 2017;6(2):67. pmid:28503554
  67. 67. Yoon SB, Moon SH, Ko SW, Lim H, Kang HS, Kim JH. Brush Cytology, Forceps Biopsy, or Endoscopic Ultrasound-Guided Sampling for Diagnosis of Bile Duct Cancer: A Meta-Analysis. Dig Dis Sci. 2022;67(7):3284–97. Epub 2021/07/16. pmid:34263382
  68. 68. Aabakken L, Karlsen TH, Albert J, Arvanitakis M, Chazouilleres O, Dumonceau JM, et al. Role of endoscopy in primary sclerosing cholangitis: European Society of Gastrointestinal Endoscopy (ESGE) and European Association for the Study of the Liver (EASL) Clinical Guideline. Endoscopy. 2017;49(6):588–608. Epub 2017/04/19. pmid:28420030
  69. 69. Eloubeidi MA, Chen VK, Jhala NC, Eltoum IE, Jhala D, Chhieng DC, et al. Endoscopic ultrasound-guided fine needle aspiration biopsy of suspected cholangiocarcinoma. 2004;2(3):209–13.
  70. 70. Weber A, Schmid RM, Prinz C. Diagnostic approaches for cholangiocarcinoma. World J Gastroenterol. 2008;14(26):4131–6. Epub 2008/07/19. pmid:18636656
  71. 71. Khan SA, Davidson BR, Goldin RD, Heaton N, Karani J, Pereira SP, et al. Guidelines for the diagnosis and treatment of cholangiocarcinoma: an update. Gut. 2012;61(12):1657–69. Epub 2012/08/17. pmid:22895392
  72. 72. Kim S, Park BK, Seo JH, Choi J, Choi JW, Lee CK, et al. Carbohydrate antigen 19–9 elevation without evidence of malignant or pancreatobiliary diseases. Sci Rep. 2020;10(1):8820. Epub 2020/06/03. pmid:32483216
  73. 73. Poruk KE, Pawlik TM, Weiss MJ. Perioperative Management of Hilar Cholangiocarcinoma. J Gastrointest Surg. 2015;19(10):1889–99. Epub 2015/05/30. pmid:26022776