Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Blood Plasma-Derived Anti-Glycan Antibodies to Sialylated and Sulfated Glycans Identify Ovarian Cancer Patients

  • Tatiana Pochechueva,

    Affiliation Ovarian Cancer Research, Department of Biomedicine, University Hospital Basel and University of Basel, Hebelstrasse 20, 4031, Basel, Switzerland

  • Alexander Chinarev,

    Affiliation Shemyakin-Ovchinnikov Institute of Bioorganic Chemistry, Russian Academy of Sciences, ul. MIklukho-Maklaya, 16/10, 117997, Moscow, Russian Federation

  • Andreas Schoetzau,

    Affiliation Ovarian Cancer Research, Department of Biomedicine, University Hospital Basel and University of Basel, Hebelstrasse 20, 4031, Basel, Switzerland

  • André Fedier,

    Affiliation Ovarian Cancer Research, Department of Biomedicine, University Hospital Basel and University of Basel, Hebelstrasse 20, 4031, Basel, Switzerland

  • Nicolai V. Bovin,

    Affiliation Shemyakin-Ovchinnikov Institute of Bioorganic Chemistry, Russian Academy of Sciences, ul. MIklukho-Maklaya, 16/10, 117997, Moscow, Russian Federation

  • Neville F. Hacker,

    Affiliation Royal Hospital for Women, Gynecological Cancer Centre, School of Women’s and Children’s Health, University of New South Wales, NSW 2031, Sydney, Australia

  • Francis Jacob,

    Affiliations Ovarian Cancer Research, Department of Biomedicine, University Hospital Basel and University of Basel, Hebelstrasse 20, 4031, Basel, Switzerland, Glyco-Oncology, Ovarian Cancer Research, Department of Biomedicine, University Hospital Basel and University of Basel, Hebelstrasse 20, 4031, Basel, Switzerland

  • Viola Heinzelmann-Schwarz

    viola.heinzelmann@usb.ch

    Affiliations Ovarian Cancer Research, Department of Biomedicine, University Hospital Basel and University of Basel, Hebelstrasse 20, 4031, Basel, Switzerland, Hospital for Women, Department of Gynecology and Gynecological Oncology, University Hospital Basel and University of Basel, Spitalstrasse 21, 4021, Basel, Switzerland

Abstract

Altered levels of naturally occurring anti-glycan antibodies (AGA) circulating in human blood plasma are found in different pathologies including cancer. Here the levels of AGA directed against 22 negatively charged (sialylated and sulfated) glycans were assessed in high-grade serous ovarian cancer (HGSOC, n = 22) patients and benign controls (n = 31) using our previously developed suspension glycan array (SGA). Specifically, the ability of AGA to differentiate between controls and HGSOC, the most common and aggressive type of ovarian cancer with a poor outcome was determined. Results were compared to CA125, the commonly used ovarian cancer biomarker. AGA to seven glycans that significantly (P<0.05) differentiated between HGSOC and control were identified: AGA to top candidates SiaTn and 6-OSulfo-TF (both IgM) differentiated comparably to CA125. The area under the curve (AUC) of a panel of AGA to 5 glycans (SiaTn, 6-OSulfo-TF, 6-OSulfo-LN, SiaLea, and GM2) (0.878) was comparable to CA125 (0.864), but it markedly increased (0.985) when combined with CA125. AGA to SiaTn and 6-OSulfo-TF were also valuable predictors for HGSOC when CA125 values appeared inconclusive, i.e. were below a certain threshold. AGA-glycan binding was in some cases isotype-dependent and sensitive to glycosidic linkage switch (α2–6 vs. α2–3), to sialylation, and to sulfation of the glycans. In conclusion, plasma-derived AGA to sialylated and sulfated glycans including SiaTn and 6-OSulfo-TF detected by SGA present a valuable alternative to CA125 for differentiating controls from HGSOC patients and for predicting the likelihood of HGSOC, and may be potential HGSOC tumor markers.

Introduction

Ovarian cancer and in particular high-grade serous ovarian cancer (HGSOC) is the most deadly gynecologic cancer with an overall survival rate of less than 20% [1]. The poor outcome of this malignancy results from the lack of early disease-specific symptoms and reliable tools (e.g. tumor markers) for early diagnosis and from ineffective therapy for advanced disease and limited understanding of the initiating events and early stages of cancer progression. Though the commonly employed ovarian cancer biomarker CA125 is useful for monitoring response to chemotherapy and detecting disease recurrence, it lacks sufficient sensitivity and specificity, especially for detecting early FIGO stages of the disease [24]. Since also the era of genomics and transcriptomics did not produced clinically used novel biomarkers that overcome the limitations of CA125 [5], the identification of new and reliable biomarkers for early diagnosis of ovarian cancer is urgently needed.

A number of studies have proposed naturally occurring antibodies to tumor- associated carbohydrate (glycan) antigens (TACA) [68] or to glycopeptides [6, 9] as promising biomarkers for early detection and diagnosis of various malignancies. TACA are cancer-related glycan structures attached to proteins and lipids mostly located on the cancer cell surface. The classically known TACA are sialyl-Lewisa (sLea), T (or TF, Thomsen-Friedenreich) antigen, and Thomsen-nouvelle antigen (Tn). TACA are considered potential diagnostic markers since these glycan structures resemble molecular-level glycomic ‘fingerprints’ which facilitate the discrimination between healthy and diseased states or reflect tumor micro-heterogeneity: not surprising that most clinically used tumor markers are glycoproteins [10, 11].

TACA can be recognized by anti-glycan antibodies (AGA) that, as part of innate immunity system, are present in normal sera without deliberate immunization and serve for pathogen and apoptotic cell clearance [1214]. AGA predominantly are of IgM isotype and are crucial to immune surveillance and anti-cancer defense [15, 16] and specifically bind to glycan epitopes such as blood group A/B antigens, xenoantigens, Forssman antigen, and glycolyl-neuraminic acid containing antigens [1721]. These characteristics of AGA make them an optimal tool to investigate aberrant glycosylation, a hallmark of carcinogenesis [2225], and to search for biomarkers.

Considerable effort has been applied to the development of multiplexed biomarker-based test platforms [26, 27]. This includes our previously developed and optimized multiplex suspension glycan array (SGA) specifically designed for high-throughput, low material and little time consuming detection of AGA from human blood plasma or other bodily fluids [28, 29]. Our array elements consist of fluorescent microspheres, regularly coated with chemically synthesized glycans of highest purity, which makes SGA a sensitive, flexible, and robust tool suitable for biomarker research [30, 31]. Using this SGA, we focused in the present study on the multiplex detection of naturally occurring AGA to sialylated and sulfated (negatively charged) glycans in the plasma of HGSOC patients and benign donors. With few exceptions (e.g. antibodies to glycolyl-neuraminic acid and to glycans bearing it as well as antibodies to SiaLec and to 4’-O-su-LacNAc [3235]), naturally occurring human AGA to sialo- and particularly sulfo-glycans have not yet been identified nor have they been considered for detection of ovarian cancer.

The sialic acids, N-acetylneuraminic acid (Neu5Ac) and N-glycolylneuraminic acid (Neu5Gc), are the most common terminations of glycoconjugates expressed on mammalian cells or attached to secreted molecules [36]. Increased sialylation is one of the major events in cancer and leads to overexpression of sialylated TACA [37], including Lewis blood group antigens (SiaLex/SiaLea), sialyl Thomsen-nouvelle antigen (SiaTn), and ganglioside epitopes GM2, GD2, and GD3. Interestingly, SiaLea, SiaLex, SiaTn, and GD3 were found overexpressed in ovarian cancer [25, 38]. Sulfated glycans are less abundant and no data are available (apart from glycosaminoglycans) regarding ovarian cancer. Sulfation of SiaLex/SiaLea is involved in cancer cell extravasation and metastasis [39].

In the present study we investigated (i) whether AGA to an extended selection of sialylated and sulfated analogues of known TACA discriminate controls from HGSOC in the SGA, (ii) whether these AGA predict HGSOC, and how the results compare to CA125.

Materials and Methods

Human subjects

Two groups of female donors were involved in the current study (Table 1). The high-grade serous ovarian cancer (HGSOC) group consisted of patients with FIGO stages I-IV, whereof two thirds (63.7%) were stage III (n = 22). The control group (n = 31) consisted of samples from patients with benign diseases (leiomyoma, cystadenoma or fibroadenoma) or women undergoing medical control due to previous history of breast cancer or harboring BRCA1/2 mutation. Samples were collected either from patients admitted with an adnexal mass to the Gynaecological Cancer Centre of the Royal Hospital for Women, Randwick, Australia or were seen as outpatients at the Hereditary Cancer Centre of The Prince of Wales Hospital, Randwick, Australia. All patients were over the age of 18 years and were prospectively included after giving written informed consent to this study. The responsible ethical committee (Hunter Area Research Ethics 04/04/07/3.04; South Eastern Sydney Illawarra Human Research Ethics Committee (HREC)/ Australian Research Ethics Database (AURED) Ref:08/09/17/3.02) specifically approved this study. The processing of blood plasma samples was performed consistently on ice within three hours after collection as previously described [40, 41]. Aliquoted blood plasma samples were stored at -80°C until further use.

thumbnail
Table 1. Description of study cohort (age, grade, and FIGO stage).

The age is represented as mean and standard deviation for both groups.

https://doi.org/10.1371/journal.pone.0164230.t001

Production of glycopolymers with end-biotin group

The suspension glycan array (SGA) is a multiplex analysis system permitting the simultaneous analysis of multiple different biomolecules and includes (i) the production of glycopolymers composed of a polyacrylamide carrier provided with end biotin groups and side-pendant glycan residues chemically synthesized or purchased, (ii) the coupling of these glycopolymers to fluorescent microbeads, (iii) the incubation of these beads with serum samples, and (iv) the measurement of the AGA hybridized to the glycopolymers (“binding”) using fluorescently labelled reporter molecules (secondary antibodies) specific for each AGA with subsequent data analysis.

To produce these glycopolymers, sialylated and sulfated glycans for the SGA were chemically synthesized (Lectinity Holdings Inc., Moscow, Russia). The glycopolymers, used for coupling to fluorescent beads, were produced as previously described [42]. The glycopolymers are composed of a polyacrylamide (PAA) carrier (number of the average polymerisation degree, n = 220) provided with end biotin groups and side-pendant glycan residues, that are statistically distributed along the polymer backbone. The content of monomer units with glycan substitution is 20 mol%. Non-glycosylated monomer units are substituted with ethanolamine residues. Aminopropyl-GM1a GM2 and GD3 glycans were purchased from Elicityl (Crolles, France) and then used for synthesis of end-biotinylated glycopolymers as described above. Hetero-bifunctional polyethylene glycol (biot–PEG23–NH2, individual compound, MW = 1300) was purchased (Iris Biotech GmbH, Marktredwitz, Germany).

Coupling of glycopolymers to modified fluorescent microbeads

Biotinylated glycopolymers were coupled to fluorescent Bio-Plex Pro™ Magnetic COOH beads of 6.5 μm diameter with distinct spectral “addresses” (Bio-Rad Laboratories Inc., Cressier, Switzerland). Each bead’s region was embedded with a precise ratio of red and infrared fluorescent dyes allowing its identification using Bio-Plex 200 Suspension Array System (Bio-Rad Laboratories Inc.). Coupling of biotinylated glycopolymers to microbeads incorporating biot–PEG23–NH2 microbead modification was accomplished as described previously [29]. Briefly, the stock vial of microspheres (1.25×107 microspheres/mL) was vigorously vortexed for 30 sec and sonicated for 15 sec in a water bath prior to its use. The tube with bead suspension (1 scale reaction: 100 μl; 1.25×106 microspheres) was placed into a magnetic separator (DynaMag™-2, Life Technologies, Zug, Switzerland) for 30–60 sec and the supernatant carefully removed. The pellet was resuspended in bead wash buffer (100 μl; Bio-Plex amine coupling kit, Bio-Rad Laboratories Inc.) by vortexing and sonication, and applied for magnetic separation as described above. After gentle removal of supernatant, the pellet was resuspended in 80 μl of bead activation buffer (Bio-Plex amine coupling kit), vortexed and sonicated. Sulfo-N-hydroxysuccinimide sodium salt (S-NHS) and 1-ethyl-3-3,3-dimethylaminopropyl carbodiimide hydrochloride (EDC) (Thermo Fisher Scientific, Reinach, Switzerland, both 50 mg/mL in activation buffer), were prepared immediately prior to use, and 10 μl of each solution was added to the bead suspension, followed by vortexing for 30 sec. Beads were agitated in dark on rotator at room temperature for 20 min. The activated beads were applied for magnetic separation and supernatant removed. Bead pellets were resuspended in 150 μl of biot–PEGm–NH2 solution (10 mg/ml, 0.1 M NaHCO3, pH 8.3), agitated in dark on rotator at room temperature for 2 h. Obtained biotinylated and PEGylated beads were pelleted by magnetic separation and resuspended in 150 μl of 50 mM ethanolamine (Sigma-Aldrich Chemie GmbH, Buchs, Switzerland) in 0.1 M NaHCO3, pH 9.0 to quench unbound activated groups. Beads were agitated in dark on rotator at room temperature for 30 min. After magnetic separation the pellet was washed twice with 500 μl PBS, pH 7.4 and resuspended in streptavidin-solution (400 pmol streptavidin in 150 μl PBS; Bio-Rad Laboratories Inc.). Suspended beads were vortexed and agitated in dark on rotator at room temperature for 2 h. Beads were washed twice with 500 μl PBS using magnetic separator. Glycan-PAA-biot1 solutions (20 pmol per 1 scale coupling reaction in 150 μl PBS) were added to the reaction tubes with streptavidin-coated beads. The mixture, protected from light, was agitated on rotator at room temperature for 6 h or overnight at 4°C. Modified microspheres were applied to magnetic separator, supernatant removed and beads washed twice with 500 μl of bead storage buffer (Bio-Plex amine coupling kit). Beads were resuspended in 100 μl of bead storage buffer and concentration determined using a hemocytometer (Roth AG, Karlsruhe, Germany) before storing at 4°C, protected from light until use.

Suspension glycan array

The Bio-Plex 200 Suspension Array System is a multiplex analysis system that permits the simultaneous analysis of up to 200 different biomolecules in a single microwell plate. The constituents of each well are drawn up into the flow-based Bio-Plex array reader, which quantifies each specific reaction based on its bead color using fluorescently labelled reporter molecules specific for each target protein followed by Bio-Plax Manager software data analysis.

Incubation buffer (PBS, pH 7.2, 1% BSA (w/v), Sigma-Aldrich Chemise GmbH) incorporating 2500 beads of each region per well (50 μl/well) was added to a Bio-Plex Pro 96-well flat bottom microplate (Bio-Rad Laboratories Inc.). The plate was washed twice with washing buffer (PBS-0.02% (v/v) Tween-20, pH 7.2) using a Bio-Plex Pro II Wash Station (Bio-Rad Laboratories Inc.). Human plasma samples, diluted 1/40, or incubation buffer alone as a control were added to wells (50 μl/well) and vigorously agitated for 30 sec on a microplate shaker before incubation on a shaker with medium speed for 1 h at room temperature in the dark. After incubation, the plate was washed thrice with washing buffer using the Bio-Plex Wash Station. Secondary antibodies (goat anti-human IgM and IgG antibodies conjugated to R-phycoerythrin (R-PE) (BioConcept, Allschwil, Switzerland), 25 ng/well in incubation buffer, 50 μl/well or incubation buffer alone as a control were added and incubated for 30 min on the plate shaker in the dark. The plate was washed thrice with washing buffer; beads were resuspended and shaken for 30 sec vigorously in 125 μl of washing buffer before being analyzed on the Bio-Plex array reader. Data were acquired in real time, analyzing 100 beads by their MFI (median fluorescence intensity) using computer software package (Bio-Plex Manager 5.1).

To obtain reliable data following experimental setups and controls were incorporated. SGA experiments were performed in duplicates three times in an independent manner. The same four control plasma samples were used in every run. The opened reduced form of D-glucose (aminoglucitol), which is not present as a structural component of regular glycosylation [30] was used to determine the background binding. In concordance with our previous data antibody binding to aminoglucitol was uniformly very low with a median of 52 MFI. This value plus two standard deviations (100 MFI) was selected as an internal experimental cut-off defining lower values as background (negative AGA reactivity). Considering recommendations from the literature for immunoassays antibody binding levels above 1000 MFI (>10 cut offs) were defined as high positive, from 500 to 1000 MFI (5 to 10 cut offs) as intermediate positive, from 100 to 500 MFI (1 to 5 cut-offs) as low positive [43, 44].

Multiplexing of SGA

The multiplexing of SGA was performed by mixing several types of glycan-coupled microbeads in one reaction sample. For multiplex assays glycans with different structural motifs were combined in three sets (S1 Table) based on the absence of cross-reactivity among correspondent human plasma AGAs tested in preliminary experiments. Cross-reactivity was evaluated by comparing data obtained in singleplex (each single type of glycan-coupled microbeads in separate reaction sample) and multiplex settings using eight randomly chosen human plasma samples. The mean % coefficient of variation (CV) obtained for the same glycan in singleplex and multiplex settings did not exceed SGA inter-assay variation, described previously [28] and were smaller than 12%, thus these three sets were used for further multiplex SGA experiments.

CA125 ELISA

The quantitative measurement of CA125 (units/ml) in blood plasma samples was performed by Abcam’s CA125 in vitro SimpleStep ELISATM Kit (ab195213, Abcam plc, Cambridge, UK) according to the provided protocol. Initial dilutions of plasma samples were 1/5 for control and 1/10 for HGSOC. The samples generating values out of the range for reliable determination of CA125 concentration were rescreened with adjusted dilutions.

Statistical Methods

In a first step, descriptive statistics including median, interquartile range (IQR) and P-values based on Mann-Whitney U-Test are presented across study groups (univariate) and were graphically displayed. P-values < 0.05 were considered statistically significant. Prior to further evaluation, raw data (obtained as median fluorescence intensities, MFI) were log10-transformed to achieve approximate normal distribution.

In a second step, discriminating variables between study groups (here: anti-glycan antibodies, AGA) were assessed. L1 penalized logistic regression was performed using the package “glmnet” within the package "caret" implemented in the statistical software R [45, 46]. In our situation the "elastic-net" variant penalization of logistic regression was performed. This penalization depends on the two parameters alpha and lambda, where alpha was fixed at 0.975 and lambda was chosen using 5-fold cross-validation (with 100 repeats) to prevent from overfitting [45, 47]. The parameter lambda was additionally tuned to optimize the area under the curve (AUC), which also means that the discrimination was optimized. Details are described in https://web.stanford.edu/~hastie/Papers/Glmnet_Vignette.pdf and especially for the choice of the fixed parameter alpha. The advantage of the "elastic-net" is to perform feature selection and discrimination in one step. Additionally a “Random forest” (packages: “ROCR” and “randomForest”, [48, 49]) was applied to compare with the elastic-net. In order to tune "rf" and the "elastic-net" the package "caret" was used. This is a suitable tool to tune and compare several "machine learning" algorithm. Details are described in the corresponding package vignette.

Subsequent ROC curves with corresponding AUC's were presented and compared within the framework of "caret" [50]. Due to missing values at random (MAR) in several variables, data were imputed using the R package “mice” which implements multivariate imputation by chained equations; further details are described in van Buuren et al., 2011 [51].

As an exploratory tool, a tree-based model with the most important predictors and CA125 is performed to visualize potential interactions between variables [52]. This model was performed using the package “party” within R [53]. Correlations between antibodies were visualized using a heatmap with corresponding clustering based on non-parametric Pearson correlation. Statistical analysis was performed utilizing GraphPad Prism 6 software and open source statistical programming language R version 3.1.3 (https://cran.r-project.org).

Results

Human plasma contains anti-glycan antibodies directed to several sialylated and sulfated glycans

We and others have previously reported that human plasma contains a set of AGA directed against a variety glycans including known TACA [7, 13, 5456]. We extended this panel of glycans and investigated whether human plasma contained AGA against closely related structural analogues and sialylated and sulfated glycans including some of which have not yet been associated with cancer. To this aim, we investigated the binding of plasma-derived antibodies from each individual across the entire cohort (control group = 31, HGSOC = 22; Table 1) to 22 sia- and sulfo-glycans with separate detection of AGA of the IgM-and IgG-isotype using our previously modified SGA [29].

The SGA results presented (Fig 1) showed generally higher glycan-antibody binding intensities (expressed as median fluorescence intensity, MFI) for IgM- compared to IgG isotype AGA: exceptions are anti-GM3, anti-6-SLN(Gc), and 3’siaTn. 6-O-Sulfo-GlcNAc displayed the highest AGA binding for both isotypes (MFI>1000), followed by AGA against SiaTn (IgM), 6-OSulfo-TF (IgM), and 3’-O-Sulfo-Lec (IgM and IgG), and by AGA against GM3 (IgM), 6-SLN(Gc) (IgM), Neu5Acα2-6Gal, 6-SiaTF, 6-OSulfo-LN, 6-SLN, and SiaLex (all IgG) (MFI<500). Binding intensities are usually lower in HGSOC than in control or comparable in either group for both isotypes (exception: anti-GM1a IgM-isotype, which is, though not statistically significant, higher in HGSOC than in control).

thumbnail
Fig 1. IgM AGA bind to glycans with higher reactivity than IgG AGA.

Bar graph presentation of the binding (MFI; median fluorescence intensity) of AGA derived from plasma of controls (black) and HGSOC patients (grey) to each of the 22 glycans determined by SGA. Glycans are sorted by order of ascending MFI for controls. Results are separated into IgM- (A) and IgG- (B) isotypes. Error bars represent interquartile range (IQR).

https://doi.org/10.1371/journal.pone.0164230.g001

AGA to sialylated and sulfated glycans discriminate HGSOC from control with a significance comparable CA125

We determined whether one or more of these 22 glycans have a “discriminatory value”, i.e. whether plasma-derived AGA directed against one or more of these glycans can discriminate between controls and HGSOC. The plasma level of CA125, the today most commonly used tumor marker, was included as a reference. The results are presented in Fig 2. As expected, CA125 discriminated controls from HGSOC with high significance (P<0.001). Interestingly, AGA against 7 out of 22 glycans highly significantly discriminated controls from HGSOC (P<0.001): anti-SiaTn (IgM), anti-6-OSulfo-TF (IgM), anti-GM2 (IgG), anti-SiaTn(Gc) (IgG), anti-GD3 (IgG), anti-3’SiaLec(Gc) (IgM), and anti-GM3 (IgM) (in order of descending significance based on the descriptive statistics by the magnitude of the P-value). Detailed listing of all glycans (grouped into mono-, di-, tri-, tetra-, and pentasaccharides) and the significance of discrimination between HGSOC and controls based on AGA binding is given in S2 Table.

thumbnail
Fig 2. Plasma-derived AGA levels to sialylated or sulfated glycans significantly differentiate controls from HGSOC.

Box-whisker plots (log transformed data) showing distribution of CA125 level and AGA binding in control and HGSOC. The significant difference between two groups is indicated by P values (defined by Mann-Whitney test).

https://doi.org/10.1371/journal.pone.0164230.g002

In order to define the “most relevant” predictors (normalized to a standard deviation of 1) an L1-penalized logistic regression was calculated (feature selection = selection of predictors to discriminate between control and HGSOC). Thus, the obtained regression coefficients are directly comparable among each other. These values (Table 2) show that CA125 (1.27) was the “best predictor”, followed by anti-SiaTn IgM (-0.75), anti-O-Sulfo-TF IgM (-0.25), anti-6-OSulfo-LN IgG (0.13), anti-SiaLea IgG (-0.03), anti-GM2 IgG (-0.02).

thumbnail
Table 2. Regression coefficient was obtained by L1-penalized logistic regression (details are described in Material and Methods) and sorted by descending absolute values.

Elastic-net parameters alpha was set to 0.975 and lambda was estimated as 0.075. Coefficients were calculated with standardized variables (STDV = 1).

https://doi.org/10.1371/journal.pone.0164230.t002

Of note, not only candidates with P<0.05 were selected by penalized logistic regression but also two other candidates (6-OSulfo-LN (IgG) and SiaLea (IgG)). The results obtained from the penalized logistic regression were verified by “Random forest” (rf) as an independent popular algorithm for feature selection. The rf algorithm revealed CA125, anti-SiaTn (IgM), anti-6-OSulfo-TF (IgM) (order of descending magnitude of significance) as the most relevant predictors, a finding that supports the stability of the selection made (S1 Appendix).

Finally, ROC (receiver operating characteristic) curves and corresponding AUC (area under the curve) values were calculated based on the penalized logistic regression for CA125 alone, for a panel of selected AGA based on the feature selection, and for the combination of CA125 and the panel of selected AGA to predict the diagnostic performance of this setup (Fig 3). The respective AUC values were 0.8644 (CA125), 0.8783 (AGA panel) and 0.9853 (combination of CA125 and AGA panel), indicating that the combination of CA125 and AGA panel (AUC of nearly 1.0) exhibited a very strong diagnostic performance for this prediction. The diagnostic performance was validated by 5-fold cross-validation revealing a significantly increasing AUC value by a combination of CA125 together with individual or both AGA (anti-SiaTn (IgM), anti-6-OSulfo-TF (IgM)) (S2 Appendix).

thumbnail
Fig 3. Combination of AGA and CA125 improves the diagnostic performance.

ROC curves for separate and combined classifiers: CA125 alone (green), AGA panel (anti-SiaTn IgM, anti-6-OSulfo-TF IgM, anti-6-OSulfo-LN IgG, anti-SiaLea IgG, and anti-GM2 IgG; blue), and combination of CA125 and AGA panel (red).

https://doi.org/10.1371/journal.pone.0164230.g003

A tree-based model (displays potential interactions between predictors) with CA125 and the two best predictors (anti-SiaTn (IgM) or anti-6-OSulfo-TF (IgM)) was computed (Fig 4). This model provided an accurate likelihood to predict HGSOC in individuals with CA125 serum levels of less than a certain value. Our computation for this cohort proposes a 90% likelihood for HGSOC, if CA125 serum values are higher than 328 units/ml. For values lower than 328 units/ml, levels of anti-SiaTn or anti-6-OSulfo-TF rather than CA125 values are accurate predictors for HGSOC: here anti-SiaTn MFI values lover than 2316 predict an 80% likelihood for HGSOC (Fig 4A) and accordingly an 85% likelihood for HGSOC for anti-6-OSulfo-TF values less than 1258 (Fig 4B). These results demonstrate that, apart from CA125, IgM-isotype AGA against SiaTn and O-Sulfo-TF are highly significant predictors for HGSOC.

thumbnail
Fig 4. IgM to SiaTn and 6-OSulfo-TF predict likelihood for HGSOC.

Tree based model with CA125 and SiaTn IgM (A) or 6-OSulfo-TF IgM (B). Control (light), HGSOC (dark).

https://doi.org/10.1371/journal.pone.0164230.g004

Structural and chemical modification of sialo- and sulfo-glycans can affect anti-glycan binding

We observed that binding to SiaTn is different for IgM-isotype (discriminating) and for IgG-isotype (not discriminating) AGA and that IgM-isotype AGA against SiaTn discriminated between control and HGSOC but its analogue 3-SiaTn did not (Fig 1). SiaTn and 3-SiaTn differ in their glycosidic linkage (α2–6 vs. α2–3), indicating that the type of this glycosidic linkage “decides” between discriminating or non-discriminating, i.e. the discrimination is lost when SiaTn (α2–6) is replaced by 3-SiaTn (α2–3). These observations suggest that AGA-glycan binding is a fine-tuned matter worthwhile looking into it in more detail (Fig 1). The substitution of Neu5Ac in SiaTn by NeuGc in SiaTn(Gc) decreased IgM AGA binding in both groups and increased IgG binding in the control group and abrogated the discrimination of control and HGSOC for the IgM-isotype but produced discrimination for IgG-isotype. Likewise, the substitution of Neu5Ac in 3’SiaLec by a sulfo-group in 3’-OSulfo-Lec increased in immunoreactivity of both, the IgM- and the IgG-isotype AGA, without affecting the non-discrimination. Likewise, substitution of Neu5Ac in 3’SiaLec by non-human Neu5Gc slightly decreased IgM immunoreactivity and produced discrimination between control and HGSOC (P = 0.026) whereas it slightly increased IgG immunoreactivity without affecting non-discrimination. AGA binding to 6-OSulfo-TF was higher than to its sialylated-analogue 6-Sia-TF for both isotypes, and anti-6-OSulfo-TF IgM highly significantly discriminated between control and HGSOC (P = 0.005) while this discrimination was lost for 6-Sia-TF. While uncharged TF (Galβ1-3GalNAcα) did not, its sulfated analogue 6-OSulfo highly significantly (P = 0.002) discriminated between the two groups (S1 Fig), indicating that the observed discrimination of anti-6-OSulfo-TF was attributed to the sulfation of TF antigen.

A correlation matrix of all AGA for control and HGSOC was calculated. The resulting dendrogrammed heatmap computed by Pearson correlation analysis (S2 Fig) identified two major clusters: one comprising mostly IgM AGA and one mostly IgG AGA. While discriminating AGA against GM2 (IgG), SiaTn(Gc) (IgG), GD3 (IgG), 3’SiaLec(Gc) (IgM), and GM3 (IgM) belonged to definite clusters, our two top discriminating candidates anti- SiaTn (IgM) and anti-6-OSulfo-TF (IgM) were at the margin of the IgM cluster (S3 Appendix). CA125 positively correlated with the IgM rather than the IgG cluster in HGSOC and control, indicating a given likelihood that higher CA125 values mean higher MFI values for IgM AGA binding in both groups.

Discussion

The potential of plasma-derived AGA against an extended selection of structural and chemical analogues of known TACA to discriminate benign controls from HGSOC patients in the SGA and the ability of these AGA to predict HGSOC just from their levels in the plasma were investigated and compared to CA125.

Three major findings emerged from this investigation. Firstly, AGA to seven out of the 22 investigated glycans significantly differentiated plasma samples from control women and HGSOC patients in the SGA: the two top AGA, anti-SiaTn and anti-6-OSulfo-TF, and CA125 (standard tumor marker commonly used in the clinics) distinguished with comparable power. Secondly, the predictive value (AUC) of the 5 top candidate AGA together (anti-SiaTn, anti-6-OSulfo-TF, anti anti-6-OSulfo-LN, anti-SiaLea, and anti-GM2) is comparable to CA125, but was markedly higher (nearly 1.0) if combined with CA125. Thirdly, SiaTn and 6-OSulfo-TF were also valuable predictors for HGSOC when CA125 values were inconclusive, i.e. below a certain threshold. Another finding was that the AGA-glycan binding in the SGA was in some cases antibody isotype-dependent or sensitive to a switch in the glycosidic linkage and even to minor chemical modification in the glycans. The following conclusion may be drawn: Plasma-derived AGA to particular glycans (e.g. SiaTn and 6-OSulfo-TF) are a valuable alternative to CA125 for the discrimination of controls from HGSOC patients and for predicting the likelihood of HGSOC in a cohort, proposing these newly identified glycan-antibody interactions as potential HGSOC tumor markers in the SGA setting.

The herein identified candidate glycans may, however, at this point not replace the currently used ovarian cancer biomarker CA125 but certainly may serve as a complementary marker and predictor for HGSOC in the diagnosis of this disease. The identified candidate glycans do not belong to one specific group of glycan antigens but to gangliosides (GM2, GM3, GD3), Thomsen-nouvelle (SiaTn and SiaTn(Gc)), Thomsen-Friedenreich (6-OSulfo-TF), and “Lewis” related antigen, indicating the absence of any obvious systematic or preference. Most of them and their non-modified analogues like TF and Tn are well-described TACA [57, 58], and some (e.g. SiaLea, SiaLex, SiaTn, GD3) have been shown to be overexpressed in ovarian cancer [25, 38].

We observed that even minor modifications of the glycans alter AGA binding reactivity and consequently their discriminating properties, highlighting the high specificity of (certain) AGA in the recognition of their glycan epitopes. Our finding that 6-OSulfo-TF but not its non-sulfated analogue TF, was (apart from CA125) the second-best HGSOC from control discriminator is noteworthy, because the role of glycan sulfation (in contrast to glycan sialylation) has not yet been studied in ovarian cancer. On the other hand, the discriminating property of 6-OSulfo-TF was lost with its sialylated-analogue 6-Sia-TF. The sulfation of SiaLex and SiaLea may play a role in cancer cell extravasation and metastasis, possibly by increasing their affinity to selectins [39]. In addition, the substitution of Neu5Ac by Neu5Gc in 3’SiaLec produced discrimination, whereas that of Neu5Ac in SiaTn by NeuGc in SiaTn(Gc) abrogated discrimination between HGSOC and control groups, and the glycosidic linkage switch from α2–6 in SiaTn into α2–3 in 3-SiaTn, respectively abrogates this discrimination. Interestingly, α2–6 (in contrast to α2–3) sialylation is a hallmark of malignant transformation [57] and a mediator of cancer progression in vivo [59].

The AGA-glycan binding intensities were generally lower in HGSOC than in control or comparable in either group, which is fully consistent with previous studies including ours and indicates that cancer patients commonly had lower serum AGA levels [41, 60]: the exception to this is anti-GM1a IgM antibody, which is apparently elevated in HGSOC compared to controls. GM1a ganglioside has been suggested to inhibit cellular proliferation and migration, and to enhance differentiation [61], but it remains unknown why the serum level AGA is elevated in HGSOC.

In regards to early detection of ovarian cancer, we have shown that AGA to sialylated and sulfated glycans compete with and improve the detection of CA125 alone. Moreover, our experimental setup allows simultaneous measurement of CA125 and selected AGA in only a minute amount of plasma samples, which would minimize the health costs. Multiplex measurement of CA125 together with other biomarkers has already been validated in a multiplexed system [27] and therefore can be measured also by SGA together with AGA in one single multiplex approach and in one sample. Despite the cross-validation applied here, additional studies on extended samples size and external validation cohorts have to be performed to confirm our findings. An improvement of the current setup might also be achieved by incorporating risk factors such as menopausal status. This has already been demonstrated to improve the diagnostic performance [6264].

Supporting Information

S1 Appendix. Feature selection and ranking for univariate method, glmnet, and random forest.

https://doi.org/10.1371/journal.pone.0164230.s001

(PDF)

S3 Appendix. Spearman correlation and corresponding p-values of selected parameters.

https://doi.org/10.1371/journal.pone.0164230.s003

(PDF)

S1 Fig. Box-and-whisker plot presenting distribution of IgM AGA levels directed to 6-OSulfo-TF and TF in control and HGSOC groups.

Significant difference between control (black) and HGSOC (gray) is indicated (P values, Mann-Whitney test).

https://doi.org/10.1371/journal.pone.0164230.s004

(PDF)

S2 Fig. Dendrogrammed correlation matrix is shown for all AGA reactivities in color-coded representation in the control and HGSOC group separately.

Heatmap is based on non-parametric Spearman correlation comparing all AGA and CA125 against each other. Red color (positive correlation), blue (negative correlation), white (no correlation). Control group (A), HGSOC (B).

https://doi.org/10.1371/journal.pone.0164230.s005

(PDF)

S1 Table. Sets of glycans used in multiplexed measurements in SGA.

https://doi.org/10.1371/journal.pone.0164230.s006

(PDF)

S2 Table. Sialo-and sulfo glycans used in SGA.

P values for comparison of HGSOC vs. control are defined by Mann-Whitney test on log-transformed data; FDR (False discovery Rate) adjusted P values less than 0.1 are shown. P values considered statistically significant (<0.05) are shown in red.

https://doi.org/10.1371/journal.pone.0164230.s007

(PDF)

Acknowledgments

We thank Dr. Galina V. Pazynina (Shemyakin-Ovchinnikov Institute of Bioorganic Chemistry, Moscow) for glycan synthesis.

Author Contributions

  1. Conceptualization: TP AC AS FJ VHS.
  2. Data curation: AS FJ.
  3. Formal analysis: TP AC AS FJ.
  4. Funding acquisition: VHS NVB.
  5. Investigation: TP AS FJ.
  6. Methodology: TP AC.
  7. Project administration: AF.
  8. Resources: NVB NFH VHS.
  9. Software: AS.
  10. Supervision: VHS.
  11. Validation: TP AC AS.
  12. Visualization: TP AC AS FJ.
  13. Writing – original draft: TP AF AS FJ VHS.
  14. Writing – review & editing: TP AC AS AF NVB NFH FJ VHS.

References

  1. 1. Ozols RF. Challenges for chemotherapy in ovarian cancer. Annals of oncology: official journal of the European Society for Medical Oncology / ESMO. 2006;17 Suppl 5:v181–7. pmid:16807453.
  2. 2. Bast RC Jr, Badgwell D, Lu Z, Marquez R, Rosen D, Liu J, et al. New tumor markers: CA125 and beyond. International journal of gynecological cancer: official journal of the International Gynecological Cancer Society. 2005;15 Suppl 3:274–81. Epub 2005/12/14. pmid:16343244.
  3. 3. Cohen JG, White M, Cruz A, Farias-Eisner R. In 2014, can we do better than CA125 in the early detection of ovarian cancer? World journal of biological chemistry. 2014;5(3):286–300. pmid:25225597; PubMed Central PMCID: PMC4160523.
  4. 4. Menon U, Griffin M, Gentry-Maharaj A. Ovarian cancer screening—current status, future directions. Gynecologic oncology. 2014;132(2):490–5. pmid:24316306; PubMed Central PMCID: PMC3991859.
  5. 5. Jacob F, Goldstein DR, Fink D, Heinzelmann-Schwarz V. Proteogenomic studies in epithelial ovarian cancer: established knowledge and future needs. Biomarkers in medicine. 2009;3(6):743–56. pmid:20476844
  6. 6. Wandall HH, Blixt O, Tarp MA, Pedersen JW, Bennett EP, Mandel U, et al. Cancer biomarkers defined by autoantibody signatures to aberrant O-glycopeptide epitopes. Cancer research. 2010;70(4):1306–13. pmid:20124478
  7. 7. Wang CC, Huang YL, Ren CT, Lin CW, Hung JT, Yu JC, et al. Glycan microarray of Globo H and related structures for quantitative analysis of breast cancer. Proceedings of the National Academy of Sciences of the United States of America. 2008;105(33):11661–6. Epub 2008/08/12. pmid:18689688; PubMed Central PMCID: PMC2575271.
  8. 8. Schwartz-Albiez R. Naturally occurring antibodies directed against carbohydrate tumor antigens. Advances in experimental medicine and biology. 2012;750:27–43. pmid:22903664.
  9. 9. Pedersen JW, Blixt O, Bennett EP, Tarp MA, Dar I, Mandel U, et al. Seromic profiling of colorectal cancer patients with novel glycopeptide microarray. International journal of cancer Journal international du cancer. 2011;128(8):1860–71. pmid:21080432.
  10. 10. West MB, Segu ZM, Feasley CL, Kang P, Klouckova I, Li C, et al. Analysis of site-specific glycosylation of renal and hepatic γ-glutamyl transpeptidase from normal human tissue. The Journal of biological chemistry. 2010;285(38):29511–24. pmid:20622017; PubMed Central PMCID: PMCPMC2937983.
  11. 11. Abbott KL, Lim J-M, Wells L, Benigno BB, McDonald JF, Pierce M. Identification of candidate biomarkers with cancer-specific glycosylation in the tissue and serum of endometrioid ovarian cancer patients by glycoproteomic analysis. Proteomics. 2010;10(3):470–81. pmid:19953551.
  12. 12. Gronwall C, Silverman GJ. Natural IgM: beneficial autoantibodies for the control of inflammatory and autoimmune disease. Journal of clinical immunology. 2014;34 Suppl 1:S12–21. pmid:24691998; PubMed Central PMCID: PMC4354681.
  13. 13. Jacob F, Goldstein DR, Bovin NV, Pochechueva T, Spengler M, Caduff R, et al. Serum antiglycan antibody detection of nonmucinous ovarian cancers by using a printed glycan array. International journal of cancer Journal international du cancer. 2012;130(1):138–46. pmid:21351089
  14. 14. Jacob F, Tse BWC, Guertler R, Nixdorf S, Bovin NV, Hacker N, et al. P1 antigen is present on the serous ovarian cancer cell line, IGROV1, correlating with A4GALT overexpression and altered cell behaviour. Glycobiology. 2011;21(11):1454–531.
  15. 15. Vollmers HP, Brandlein S. Natural antibodies and cancer. N Biotechnol. 2009;25(5):294–8. pmid:19442595.
  16. 16. Vollmers HP, Brandlein S. Natural human immunoglobulins in cancer immunotherapy. Immunotherapy. 2009;1(2):241–8. pmid:20635944.
  17. 17. Milland J, Sandrin MS. ABO blood group and related antigens, natural antibodies and transplantation. Tissue antigens. 2006;68(6):459–66. pmid:17176435.
  18. 18. Cooper DK. Xenoantigens and xenoantibodies. Xenotransplantation. 1998;5(1):6–17. pmid:9507728.
  19. 19. Young WW Jr, Hakomori SI, Levine P. Characterization of anti-Forssman (anti-Fs) antibodies in human sera: their specificity and possible changes in patients with cancer. Journal of immunology. 1979;123(1):92–6. pmid:448159.
  20. 20. Bovin NV. Natural antibodies to glycans. Biochemistry-Moscow+. 2013;78(7):786–97. pmid:WOS:000321792000010.
  21. 21. Padler-Karavani V, Hurtado-Ziola N, Pu M, Yu H, Huang S, Muthana S, et al. Human xeno-autoantibodies against a non-human sialic acid serve as novel serum biomarkers and immunotherapeutics in cancer. Cancer research. 2011;71(9):3352–63. pmid:21505105; PubMed Central PMCID: PMC3085609.
  22. 22. Hakomori S. Tumor malignancy defined by aberrant glycosylation and sphingo(glyco)lipid metabolism. Cancer research. 1996;56(23):5309–18. pmid:8968075.
  23. 23. Padler-Karavani V. Aiming at the sweet side of cancer: aberrant glycosylation as possible target for personalized-medicine. Cancer letters. 2014;352(1):102–12. pmid:24141190.
  24. 24. Christiansen MN, Chik J, Lee L, Anugraham M, Abrahams JL, Packer NH. Cell surface protein glycosylation in cancer. Proteomics. 2014;14(4–5):525–46. pmid:24339177.
  25. 25. Adamczyk B, Tharmalingam T, Rudd PM. Glycans as cancer biomarkers. Biochimica et biophysica acta. 2012;1820(9):1347–53. pmid:22178561.
  26. 26. Nolen BM, Lokshin AE. Biomarker testing for ovarian cancer: clinical utility of multiplex assays. Mol Diagn Ther. 2013;17(3):139–46. pmid:23552992; PubMed Central PMCID: PMCPMC3670781.
  27. 27. Urban N, Thorpe JD, Bergan LA, Forrest RM, Kampani AV, Scholler N, et al. Potential role of HE4 in multimodal screening for epithelial ovarian cancer. Journal of the National Cancer Institute. 2011;103(21):1630–4. pmid:21917606; PubMed Central PMCID: PMCPMC3206037.
  28. 28. Pochechueva T, Chinarev A, Spengler M, Korchagina E, Heinzelmann-Schwarz V, Bovin N, et al. Multiplex suspension array for human anti-carbohydrate antibody profiling. The Analyst. 2011;136(3):560–9. Epub 2010/11/26. pmid:21107457.
  29. 29. Pochechueva T, Chinarev A, Bovin N, Fedier A, Jacob F, Heinzelmann-Schwarz V. PEGylation of microbead surfaces reduces unspecific antibody binding in glycan-based suspension array. Journal of immunological methods. 2014;412:42–52. Epub 2014/07/06. pmid:24995712.
  30. 30. Pochechueva T, Jacob F, Goldstein DR, Huflejt ME, Chinarev A, Caduff R, et al. Comparison of printed glycan array, suspension array and ELISA in the detection of human anti-glycan antibodies. Glycoconjugate journal. 2011;28(8–9):507–17. pmid:21948103; PubMed Central PMCID: PMC3228963.
  31. 31. Jacob F, Anugraham M, Pochechueva T, Tse BW, Alam S, Guertler R, et al. The glycosphingolipid P(1) is an ovarian cancer-associated carbohydrate antigen involved in migration. British journal of cancer. 2014;111(8):1634–45. Epub 2014/08/29. pmid:25167227; PubMed Central PMCID: PMC4200095.
  32. 32. Bovin NV. Natural antibodies to glycans. Biochemistry (Moscow). 2013;78(7):786–97.
  33. 33. Padler-Karavani V, Hurtado-Ziola N, Pu M, Yu H, Huang S, Muthana S, et al. Human Xeno-Autoantibodies against a Non-Human Sialic Acid Serve as Novel Serum Biomarkers and Immunotherapeutics in Cancer. Cancer research. 2011. pmid:21505105.
  34. 34. Shilova N, Navakouski M, Khasbiullina N, Blixt O, Bovin N. Printed glycan array: antibodies as probed in undiluted serum and effects of dilution. Glycoconjugate journal. 2012;29(2–3):87–91. pmid:22258790.
  35. 35. Huflejt ME, Vuskovic M, Vasiliu D, Xu H, Obukhova P, Shilova N, et al. Anti-carbohydrate antibodies of normal sera: findings, surprises and challenges. Molecular immunology. 2009;46(15):3037–49. pmid:19608278.
  36. 36. Varki A. Sialic acids in human health and disease. Trends in molecular medicine. 2008;14(8):351–60. pmid:18606570; PubMed Central PMCID: PMC2553044.
  37. 37. Christiansen MN, Chik J, Lee L, Anugraham M, Abrahams JL, Packer NH. Cell surface protein glycosylation in cancer. Proteomics. 2014;14(4–5):525–46. pmid:24339177.
  38. 38. Webb TJ, Li X, Giuntoli RL, Lopez PH, Heuser C, Schnaar RL, et al. Molecular identification of GD3 as a suppressor of the innate immune response in ovarian cancer. Cancer research. 2012;72(15):3744–52. Epub 2012/06/01. pmid:22649190; PubMed Central PMCID: PMC3438513.
  39. 39. Ushakova NA, Preobrazhenskaya ME, Bird MI, Priest R, Semenov AV, Mazurov AV, et al. Monomeric and multimeric blockers of selectins: comparison of in vitro and in vivo activity. Biochemistry Biokhimiia. 2005;70(4):432–9. pmid:15892609.
  40. 40. Jacob F, Meier M, Caduff R, Goldstein D, Pochechueva T, Hacker N, et al. No benefit from combining HE4 and CA125 as ovarian tumor markers in a clinical setting. Gynecologic oncology. 2011;121(3):487–91. Epub 2011/03/23. pmid:21420727.
  41. 41. Jacob F, Goldstein DR, Bovin NV, Pochechueva T, Spengler M, Caduff R, et al. Serum antiglycan antibody detection of nonmucinous ovarian cancers by using a printed glycan array. International journal of cancer Journal international du cancer. 2012;130(1):138–46. Epub 2011/02/26. pmid:21351089; PubMed Central PMCID: PMC3137667.
  42. 42. Chinarev AA, Galanina OE, Bovin NV. Biotinylated multivalent glycoconjugates for surface coating. Methods in molecular biology. 2010;600:67–78. pmid:19882121.
  43. 43. Shankar G, Devanarayan V, Amaravadi L, Barrett YC, Bowsher R, Finco-Kent D, et al. Recommendations for the validation of immunoassays used for detection of host antibodies against biotechnology products. Journal of pharmaceutical and biomedical analysis. 2008;48(5):1267–81. pmid:18993008.
  44. 44. Schneider C, Smith DF, Cummings RD, Boligan KF, Hamilton RG, Bochner BS, et al. The human IgG anti-carbohydrate repertoire exhibits a universal architecture and contains specificity for microbial attachment sites. Science translational medicine. 2015;7(269):269ra1. pmid:25568069.
  45. 45. Friedman J, Hastie T, Tibshirani R. Regularization Paths for Generalized Linear Models via Coordinate Descent. J Stat Softw. 2010;33(1):1–22. pmid:20808728; PubMed Central PMCID: PMCPMC2929880.
  46. 46. Kuhn K, Contributions from Wing J, Weston S, Williams A, Keefer C, Engelhardt A, et al. caret: Classification and Regression Training. R package version 6.0–71. 2016.
  47. 47. Tibshirani R. Regression Shrinkage and Selection via the Lasso. Journal of the Royal Statistical Society Series B (Methodological). 1996;58(1):267–88.
  48. 48. Liaw A, Wiener M. Classification and Regression by randomForest. R News. 2002;2(3):18–22.
  49. 49. Sing T, Sander O, Beerenwinkel N, Lengauer T. ROCR: visualizing classifier performance in R. Bioinformatics. 2005;21(20):3940–1. pmid:16096348.
  50. 50. Kuhn M. Building Predictive Models in R Using the caret Package. Journal of Statistical Software. 2008;28(5):1–26. pmid:WOS:000260799600001.
  51. 51. van Buuren S, Groothuis-Oudshoorn K. mice: Multivariate Imputation by Chained Equations in R. Journal of Statistical Software. 2011;45(3):1–67.
  52. 52. Venables WN, Ripley B.D. Modern Applied Statistics with S. fourth ed: Springer; 2002.
  53. 53. Hothorn T, Hornik K, Zeileis A. Unbiased Recursive Partitioning: A Conditional Inference Framework. Journal of Computational and Graphical Statistics. 2006;15(3):651–74.
  54. 54. Bovin N, Obukhova P, Shilova N, Rapoport E, Popova I, Navakouski M, et al. Repertoire of human natural anti-glycan immunoglobulins. Do we have auto-antibodies? Biochimica et biophysica acta. 2012;1820(9):1373–82. pmid:22365885.
  55. 55. Blixt O, Clo E, Nudelman AS, Sorensen KK, Clausen T, Wandall HH, et al. A high-throughput O-glycopeptide discovery platform for seromic profiling. Journal of proteome research. 2010;9(10):5250–61. pmid:20726594.
  56. 56. Pedersen JW, Gentry-Maharaj A, Nostdal A, Fourkala EO, Dawnay A, Burnell M, et al. Cancer-associated autoantibodies to MUC1 and MUC4—a blinded case-control study of colorectal cancer in UK collaborative trial of ovarian cancer screening. International journal of cancer Journal international du cancer. 2014;134(9):2180–88. Epub 2013/10/15. pmid:24122770; PubMed Central PMCID: PMC4234004.
  57. 57. Schultz MJ, Swindall AF, Bellis SL. Regulation of the metastatic cell phenotype by sialylated glycans. Cancer metastasis reviews. 2012;31(3–4):501–18. pmid:22699311; PubMed Central PMCID: PMC4079276.
  58. 58. Springer GF. T and Tn, general carcinoma autoantigens. Science. 1984;224(4654):1198–206. pmid:6729450.
  59. 59. Hedlund M, Ng E, Varki A, Varki NM. alpha 2-6-Linked sialic acids on N-glycans modulate carcinoma differentiation in vivo. Cancer research. 2008;68(2):388–94. pmid:18199532.
  60. 60. Huflejt ME, Blixt O, Vuskovic M, Xu H, Shaw LE, Reuben JM, et al. Glycan array identifies specific signatures of anti-glycan autoantibodies in sera of breast cancer patients: diagnostic, prognostic and therapeutic opportunities. 28th Annual SAN ANTONIO BREAST CANCER SYMPOSIUM. 2005 Dec 8–11:2008.
  61. 61. Mirkin BL, Clark SH, Zhang C. Inhibition of human neuroblastoma cell proliferation and EGF receptor phosphorylation by gangliosides GM1, GM3, GD1A and GT1B. Cell Prolif. 2002;35(2):105–15. pmid:11952645.
  62. 62. Jacobs I, Oram D, Fairbanks J, Turner J, Frost C, Grudzinskas JG. A risk of malignancy index incorporating CA 125, ultrasound and menopausal status for the accurate preoperative diagnosis of ovarian cancer. Br J Obstet Gynaecol. 1990;97(10):922–9. pmid:2223684.
  63. 63. Moore RG, McMeekin DS, Brown AK, DiSilvestro P, Miller MC, Allard WJ, et al. A novel multiple marker bioassay utilizing HE4 and CA125 for the prediction of ovarian cancer in patients with a pelvic mass. Gynecologic oncology. 2009;112(1):40–6. pmid:18851871.
  64. 64. Shah CA, Lowe KA, Paley P, Wallace E, Anderson GL, McIntosh MW, et al. Influence of ovarian cancer risk status on the diagnostic performance of the serum biomarkers mesothelin, HE4, and CA125. Cancer epidemiology, biomarkers & prevention: a publication of the American Association for Cancer Research, cosponsored by the American Society of Preventive Oncology. 2009;18(5):1365–72. pmid:19423517.