Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Radiogenomics analysis identifies correlations of digital mammography with clinical molecular signatures in breast cancer

  • Jose-Gerardo Tamez-Peña,

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Software, Supervision, Validation, Writing – original draft, Writing – review & editing

    Affiliation Cátedra en Bioinformática, Escuela de Medicina, Tecnológico de Monterrey, Av. Morones Prieto Pte 3000, Col. Los Doctores, Monterrey, NL, México

  • Juan-Andrés Rodriguez-Rojas,

    Roles Data curation, Formal analysis, Methodology, Software

    Affiliation Cátedra en Bioinformática, Escuela de Medicina, Tecnológico de Monterrey, Av. Morones Prieto Pte 3000, Col. Los Doctores, Monterrey, NL, México

  • Hugo Gomez-Rueda,

    Roles Data curation, Investigation, Methodology, Resources

    Affiliation Cátedra en Bioinformática, Escuela de Medicina, Tecnológico de Monterrey, Av. Morones Prieto Pte 3000, Col. Los Doctores, Monterrey, NL, México

  • Jose-Maria Celaya-Padilla,

    Roles Data curation, Formal analysis

    Affiliations Cátedra en Bioinformática, Escuela de Medicina, Tecnológico de Monterrey, Av. Morones Prieto Pte 3000, Col. Los Doctores, Monterrey, NL, México, Universidad Autónoma de Zacatecas, Zacatecas, Zacatecas, Mexico, CP

  • Roxana-Alicia Rivera-Prieto,

    Roles Methodology

    Affiliation Cátedra en Bioinformática, Escuela de Medicina, Tecnológico de Monterrey, Av. Morones Prieto Pte 3000, Col. Los Doctores, Monterrey, NL, México

  • Rebeca Palacios-Corona,

    Roles Data curation, Methodology

    Affiliation Centro de Investigación Biomédica del Noreste, Instituto Mexicano del Seguro Social Ave. 2 de Abril y San Luis Potosí s/n, Col. Independencia, Monterrey, NL, México, CP

  • Margarita Garza-Montemayor,

    Roles Data curation, Investigation

    Affiliation Centro de Cáncer de Mama, Hospital Zambrano Hellion, Av, Col. Real San Agustin, San Pedro Garza Garcia, Nuevo León, México

  • Servando Cardona-Huerta,

    Roles Conceptualization, Data curation, Investigation, Resources, Writing – original draft, Writing – review & editing

    Affiliation Centro de Cáncer de Mama, Hospital Zambrano Hellion, Av, Col. Real San Agustin, San Pedro Garza Garcia, Nuevo León, México

  • Victor Treviño

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Project administration, Software, Supervision, Writing – original draft, Writing – review & editing

    vtrevino@itesm.mx

    Affiliation Cátedra en Bioinformática, Escuela de Medicina, Tecnológico de Monterrey, Av. Morones Prieto Pte 3000, Col. Los Doctores, Monterrey, NL, México

Abstract

In breast cancer, well-known gene expression subtypes have been related to a specific clinical outcome. However, their impact on the breast tissue phenotype has been poorly studied. Here, we investigate the association of imaging data of tumors to gene expression signatures from 71 patients with breast cancer that underwent pre-treatment digital mammograms and tumor biopsies. From digital mammograms, a semi-automated radiogenomics analysis generated 1,078 features describing the shape, signal distribution, and texture of tumors along their contralateral image used as control. From tumor biopsy, we estimated the OncotypeDX and PAM50 recurrence scores using gene expression microarrays. Then, we used multivariate analysis under stringent cross-validation to train models predicting recurrence scores. Few univariate features reached Spearman correlation coefficients above 0.4. Nevertheless, multivariate analysis yielded significantly correlated models for both signatures (correlation of OncotypeDX = 0.49 ± 0.07 and PAM50 = 0.32 ± 0.10 in stringent cross-validation and OncotypeDX = 0.83 and PAM50 = 0.78 for a unique model). Equivalent models trained from the unaffected contralateral breast were not correlated suggesting that the image signatures were tumor-specific and that overfitting was not a considerable issue. We also noted that models were improved by combining clinical information (triple negative status and progesterone receptor). The models used mostly wavelets and fractal features suggesting their importance to capture tumor information. Our results suggest that molecular-based recurrence risk and breast cancer subtypes have observable radiographic phenotypes. To our knowledge, this is the first study associating mammographic information to gene expression recurrence signatures.

Introduction

Breast cancer is the most frequent cancer among women worldwide [1]. The tumor grade, receptor status, and other characteristics are relevant for therapy selection and estimation of recurrence and survival [2]. Studies have found molecular heterogeneity suggesting the existence of intrinsic subtypes of breast cancer [3], and similar heterogeneity has been observed in imaging studies [37].

Gene expression analysis of breast cancer has led to several signatures, but only a few of them are used in a clinical setting [8]. The Food and Drug Administration has approved the commercialization of some signatures [911]. The OncotypeDX signature, based on 21 genes, was originally used to stratify estrogen receptor (ER) positive, lymph node (LN) negative, HER-2 neu normal breast cancer into recurrence risk categories [10]. Recently, this tool has also been used in lymph-node positive breast cancer [12]. The PAM50 is a 50-gene based signature that classifies tumors into five subtypes providing prognostic information for untreated and tamoxifen-treated patients [1113].

The association between molecular properties of tumors and their image information (image phenotype) has not been widely studied. In this context, radiomics refers to an emerging methodology of extracting large amounts of features from medical images including intensities, shape, texture among many others [5,1419], and radiogenomics is referred as the methods to associate genetic information with medical images [1922]. Recent radiogenomics studies have found that molecular markers and clinical variables of interest correlate with magnetic resonance imaging (MRI) features of tumors in breast, kidney, lung, and brain cancer [14,2329]. The evidence suggests that the activity regulated by gene expression leads to the development of architectural patterns that can be identified using non-invasive imaging. However, the resolution of MRI is low compared to mammography possibly obscuring fine details. Moreover, MRI is expensive to be used routinely in clinics.

Among the breast imaging modalities, mammography is the recommended modality for routine breast-cancer screening [30]. Mammograms are often the first evidence of the existence of a tumor, providing information about the anatomical location and extent of the tumor. Additionally, mammograms are commonly available, relatively cheap, and more operator-independent than ultrasound imaging. However, the relationship between mammographic features and gene expression patterns has not been widely examined.

The aim of this study was to investigate the association between imaging tumor phenotype obtained from digital mammograms and breast cancer gene expression signatures, particularly those from OncotypeDX and PAM50. We analyzed 71 breast cancer patients where mammogram and biopsy were acquired before surgery and systemic treatment. To our knowledge, this is the first dataset containing these data. Using a highly stringent cross validation strategy, we first show that image from tumor data is able to significantly predict molecular recurrence scores. As a negative control, the prediction from data of the contralateral breast not containing tumor is significantly lower indicating, as expected, that prediction is more informative from tumor data. We then analyzed possible recurrence biomarkers from image data and found levels of correlations that could be utilized in clinics. From the features selected in putative image biomarkers, most are derived from wavelets and fractals suggesting that these types of information need to be further explored to find biological relevance. We also found that clinical indicators improve the predictions of image biomarkers. We conclude that digital mammography can be used to predict recurrence.

Results

A schematic view of the analysis pipeline is depicted in Fig 1. Briefly, we acquired routine four-image digital mammograms and core biopsy from 71 breast cancer patients (Table 1 and S1 Table). The mammography was computationally analyzed to extract 1,078 features from each region of interest (ROI), summarized in Table 2. On the mammogram obtained from the affected side, the original ROI was marked by the radiologist (MGM), surrounding the tumor and was processed to select the most informative ROI. A similar sized ROI from an apparent normal region of the mammography was used to estimate background feature values (S1 Fig and Methods section). The raw data is deposited in S2 Table for the lesion and S3 Table for the background-control. The data from Medio-lateral-oblique (MLO) and Cefalo-Caudal (CC) views were then condensed into sums or differences to finally generate 878 summary features (S4 Table, see the Methods section for details). As a negative control of the procedure, from the contralateral side mammogram not containing tumor, a ROI in an equivalent mirror position to the tumor and their corresponding background ROI were also obtained and analyzed (S5, S6 and S7 Tables). The biopsies were used to perform microarrays obtaining 44,000 gene expression features (S1 File), which were employed to estimate two clinical signatures of recurrence (OncotypeDX and PAM50 risk subtypes based on risk of recurrence scores). The image features were then used to search for associations with clinical signatures and gene expression features. The details are described in the Method section.

thumbnail
Fig 1. Radiogenomics pipeline used in the analysis of association between imaging features and gene signatures in patients with breast cancer.

First, mammograms and tumor biopsy samples were acquired before surgery or treatment. A trained radiologist delimited the lesion region of interest to calculate Image features. For tumor biopsy samples, RNA was extracted and gene expression was measured using microarray technology, then the PAM50 molecular subtype and OncotypeDX recurrence score were measured. Univariate association based on correlation was used to show that image features are associated to signatures. Multivariate analysis was used to fit predictive models using cross-validation strategies and a feature selection algorithm. A similar procedure was used for contralateral images to evaluate whether the associations were tumor-specific.

https://doi.org/10.1371/journal.pone.0193871.g001

thumbnail
Table 2. Summary of the 539 features obtained from each region of the mammogram.

https://doi.org/10.1371/journal.pone.0193871.t002

Cancer subtype and recurrence risk estimation from gene expression signatures

We estimated the OncotypeDX risk score (OncotypeDX RS) and the PAM50 risk subtype from its risk of recurrence score (PAM50 ROR) from the microarray gene expression measurements (S1 Table) similarly to original publications. From OncotypeDX RS we observed 20, 4, and 47 patients for low, intermediate, and high-risk respectively according to the threshold values used in the original assays. From PAM50, 10 patients were identified as Normal-like, 11 as Luminal-A, 22 as Luminal-B, 11 as HER2 enriched, and 17 as Basal-like. These subtypes correspond to 21 low-risk (Normal-like and Luminal-A) and 50 high-risk (Luminal-B, HER2, and Basal-like). The overall numbers of low- and high-risk assignments from both signatures are similar to those expected given the TNM and immunohistochemistry results (Table 1). Comparing the discrete scores from both signatures (S2 Fig), the patients with low or medium OncotypeDX RS were in substantial agreement with Normal-like or Luminal-A subtypes (Cohen’s kappa: k = 0.76, p<0.05). As reported [31,32], the Basal-like subtype was enriched in triple-negative breast cancers (14 of 17). Moreover, the continuous recurrence score from both signatures were highly correlated (Spearman ρ = 0.86, p<2e-16). Hence, to avoid highly redundant information for association with image features, we used the score from OncotypeDX RS and the risk subtypes given by the PAM50 ROR score. Overall, these findings are consistent with previous reports [33,34] supporting the validity of our gene expression assays and our PAM50 and OncotypeDX estimations. Therefore, these estimations can be used as sensible effective surrogates of risk of recurrence.

Image-based features are associated to OncotypeDX recurrence score

We used univariate and multivariate procedures to explore the association between image features and gene expression-based risk of recurrence from our estimations of OncotypeDX. We tested the association of individual image features with OncotypeDX RS using Spearman regression in a robust manner using bootstrapping. We observed that imaging features alone had moderate Spearman correlation, only 6 features whose correlation was |ρ| > 0.4 and 29 features at the |ρ| > 0.3 level (S8 Table). These features were majorly derived from fractals and wavelets. From the top 50 features, in general, we observed positive correlations to fractals and negative correlations for wavelets (S3 Fig). These results suggest that there are considerable correlations in the image data but also that the prediction of OncotypeDX RS from a unique image feature is limited.

To improve on the univariate prediction and to potentially generate a multivariate signature, we evaluated whether multivariate signatures can generate confident predictions from our data and sample size. For this, we used 100 repetitions of a 10-fold-CV procedure using LASSO (see S4 Fig and the Methods section for details). We evaluated the prediction over the blind test set of the models and the stability of its included features counting the number of times each individual feature was obtained within the 1000 models. The median of Spearman correlations from the 100 test estimations was ρ = 0.49 [IQR 0.41–0.57] (Fig 2). These results indicate an improvement over the univariate correlation in a more realistic scenario. From the 1000 models (100 rounds of 10-Fold-CV) the top 5 most frequent features (S9 Table) were ranked 5th, 44th, 23rd, 6th, and 82nd according to the univariate evaluation. This indicates that most frequent features in the multivariate are not necessarily top ranked in the univariate procedure.

thumbnail
Fig 2. Distribution of test correlations in the cross-validation multivariate feature selection.

White boxplots correspond to tumor ROIs whereas grayed boxplots correspond to contralateral ROIs used as controls. Note that contralateral distributions of test predictions are lower than corresponding tumor test predictions.

https://doi.org/10.1371/journal.pone.0193871.g002

Furthermore, we tested whether the OncotypeDX RS prediction is more favorable for tumor image data, thus we applied the same procedure of training and test from contralateral images. This correspond to the assumption that the unaffected contralateral data should provide scarce prediction because of the lack of apparent tumors. We noted that the median of Spearman correlations from the 100 test estimations in the contralateral data was low reaching only ρ = 0.26 [IQR 0.16–0.37] compared to ρ = 0.49 from the tumor image data (Fig 2) and most of the correlation estimations were not significant (S5 Fig). These results suggest that the image data is more correlated to OncotypeDX RS from the tumor ROI than to similar ROI from the unaffected contralateral tissue.

Image-based features are associated with PAM50 subtypes

Similar to the procedure applied to OncotypeDX recurrence score, we also used the univariate and multivariate methods to investigate associations between the risk estimated by PAM50 and image-based features. Here, we expected similar results to those from OncotypeDX because the recurrence scores of PAM50 and OncotypeDX are correlated in our data. In the univariate analysis, we found 10 features whose univariate Spearman correlation was |ρ| > 0.4 and 48 features at the |ρ| > 0.3 level (S10 Table). Consistently to OncotypeDX, we also observed higher values of wavelets features in lower scores and higher values of fractals features to higher scores within the top 50 features (S5 Fig). In the multivariate analysis using 100 rounds of 10-fold-CV LASSO runs, we noted higher values of correlation using the tumor data (ρ = 0.32 [IQR 0.23–0.41]) than using the contralateral data (ρ = -0.06 [IQR -0.17–0.04]) (Fig 2).

Assessing the prediction of image-based models for potential clinical use

Once we showed that image features could be used to predict clinical relevant indicators and that these predictions are more powerful for the tumor ROI, we explored the possibility of providing a unique prediction for an unseen sample in a putative clinical setting. From all data, we generated a unique model using LASSO. The generated model for OncotypeDX RS consists of 13 image features including 8 from wavelets, 3 from fractals, and 2 from gray level co-occurrence matrix (Fig 3A). Using this model, the correlation of the estimated OncotypeDX RS and the image-based prognostic model is high (Fig 3B Pearson ρ = 0.828, p < 10−15) and the risk assignment provided by both indicators highly concurs (Kappa k = 0.58, p < 0.05). This correlation is conserved among younger (age < 50) or older (age > 50) patients. Correspondingly for PAM50, the model using LASSO and the 71 mammograms (Fig 4) highly correlates with the PAM50 risk score (ρ = 0.784, p < 10−9). For radiologists, it has been known that the molecular subtypes show some image properties [35]. Thus, because PAM50 subtypes and the risk of recurrence from PAM50 are highly correlated, we asked whether the model could be useful to classify into molecular subtypes. We estimated that, to classify subtypes into low-risk (Normal-Like or LuminalA) and high-risk (LuminalB, or Her2- enrich, or Basal-Like), the sensitivity was 84.5% and the similarity of the prediction was statistically significant (Kappa k = 0.62, p < 0.05).

thumbnail
Fig 3. Characteristics of the model obtained for OncotypeDX.

(A) A heat map representation of the features associated to OncotypeDX RS. The figure shows the features selected by LASSO (vertical axis) and their univariate Spearman coefficient and rank along samples (horizontal axis) ordered by the OncotypeDX risk score. The top of the figure includes common clinical indicators. The image data was scaled to z-score to nightlight differences. (B) Comparison of the estimated OncotypeDX recurrence score with that of the score predicted by the image model in (A). Each dot represents a sample. Colors represent subtypes and filled or open circles represent younger or older patients.

https://doi.org/10.1371/journal.pone.0193871.g003

thumbnail
Fig 4. Characteristics of the model obtained for PAM50.

(A) A heat map representation of the features associated to risk from PAM50 ROR. The figure shows the features selected by LASSO (vertical axis) and their univariate Spearman coefficient and rank along samples (horizontal axis) ordered by the PAM50 ROR score. The top of the figure includes common clinical indicators. The image data was scaled to z-score to nightlight differences. Orange dots at the right represent features also present in the OncotypeDX model. (B) Comparison of the estimated PAM50 recurrence score with that of the score predicted by the image model in (A). Each dot represents a sample. Colors represent subtypes and filled or open circles represent younger or older patients.

https://doi.org/10.1371/journal.pone.0193871.g004

Image features related to molecular signatures

Of the top selected image features in OncotypeDX RS (Fig 3), 8 were from wavelets, 3 from fractals, and 2 from gray level co-occurrence matrix. Other image features were rarely included such as those grouped in signal distribution, Minkowski Functionals and local standard deviation. A similar result was observed from PAM50 where top features were obtained from wavelets and fractals (Fig 4). This implies that very specific sets of radiological textures of the tumors are different between low- and high-risk patients where wavelets and fractals stand out. We observed 6 features present in both predictors that could be due to the correlation between PAM50 ROR and OncotypeDX RS. In addition, to visually support the relationship of the image measurement to the tumor ROI, a graphical representation of a feature associated to fractals included in the LASSO model is shown in Fig 5.

thumbnail
Fig 5. Color representation of the distribution of the local fractal dimension.

High values indicate heterogeneous textures whereas low values represent uniform distributions of the tissue signal. Shades of blue, green, and red colors represent high, medium, and low dimension values respectively.

https://doi.org/10.1371/journal.pone.0193871.g005

Clinical data improves associations to image-based features

The associations of image features to molecular signatures shown above were based on image features alone. However, in clinical practice some important markers and risk factors are available before or after surgery and routine pathological inspection and assays. Therefore, we tested whether age, TNM histological grades, estrogen, progesterone, HER2, and triple negative status can add information to predict PAM50 subtypes or OncotypeDX RS in the presence of image based data. For this, we also ran LASSO for all samples competing image and clinical information. The overall results show an increase in LASSO prediction models for OncotypeDX RS and PAM50. Interestingly, for OncotypeDX RS, we observed that the progesterone receptor and the triple negative status were used in the model. Whilst for PAM50, we observed only the triple negative status included in the model. We did not observe TNM, ER, HER2, or Age in models once image data was considered. These results suggest that image data can compete in prediction with clinical data and that both types of information are useful.

Discussion

This radiogenomic study found that mammographic features were correlated to the breast cancer recurrence score provided by OncotypeDX and PAM50, and to the overall risk from breast cancer molecular subtypes. Predictive image-based models support these findings. This also indicates that the common mammography is able to capture molecular information. Notably, our mammography-based results are akin to other exploratory breast MRI-based studies [5,25,26]. The use of radiomic features from digital mammograms allows the use of low-cost and widely available technology to obtain surrogate measurements for validated gene signatures. To our knowledge, this is the first study showing such associations.

The association of image features to gene expression is rather challenging this can be partly explained by the fact that individual image features may be associated to complex combinations of genomic expressions. During the feature extraction process, we intended to capture several aspects of the signal distribution and parenchymal texture of the mammograms to increase the likelihood of correlation. Through multivariate analysis we were able to build mammography-based models with substantial agreement to validated gene signatures. Most of the considered aspects included in models suggest that tumor characterization requires multiple features representing different characteristics of the image. In addition, we observed that features in models were not necessarily the top ranked in a univariate analysis suggesting that a simple model combining top univariate features in not obvious supporting the use of more sophisticated methods to generate an image signature. Thus, a reasonable approach to capture tumor behavior complexity is through radiomic multivariate analysis. Nevertheless, multivariate analyses increase the space of solutions rising the risk of overfitting. To avoid this, we used 100 rounds of stringent cross-validations and also employed the contralateral images as a negative control.

The associations found of image features to molecular signatures were mainly based on texture features (fractals and wavelets) supporting the findings of previous CAD studies that have shown different patterns between normal breast tissue and tumors [3641]. Although texture features using wavelets have been explored for breast cancer diagnosis [42,43], to our knowledge, this is the first time that wavelets features have been successfully used to predict recurrence risk. Furthermore this study support the reports that have associated image features with the risk of recurrence on ductal carcinoma in situ [44] and that molecular risk subtypes can be differentiated by imaging [45]. We used features composed of the sum of both views (CC+MLO) and their absolute difference (|CC-MLO|) after reducing background from the tumor ROI. Both types of features were found in most frequently selected features in both risk predictors. This implies that both views are important and that more complex relationships and transformations of the values from CC and MLO and novel features could improve the correlations.

The multivariate unique models predicting the OncotypeDX and risk from PAM50 ROR signatures shared some features (Figs 3 and 4). This can be due to the confirmed correlation of OncotypeDX RS and PAM50 ROR. Nevertheless, it may also suggest that these features are strongly associated to a specific molecular property of the sampled tumors as indicated in mammograms (Fig 5).

Remarkably, the performance achieved by the mammogram-based models is comparable to that found in breast MRI-based studies [26,27]. It is important to mention that in the construction of our models, we used a more stringent cross-validation technique, more diverse subtypes of breast cancer samples, and digital mammography, which can be more easily replicated.

Initially, we did not use known risk factors such as radiological interpretation of the images (BIRADS, tumor size, margin, morphology), pathological information (tumor stage, receptor status, margin status), or personal information (age, GAIL score, family breast cancer history) [2]. Surprisingly, image features were still preferred by the feature selection algorithm than clinical data. Nevertheless, we have shown that the inclusion of such features could improve the performance of the models suggesting the combination of both clinical data and radiomics as a possible future direction for clinical trials.

There is evidence that tumor subtypes may be influenced by a genetic background [46]. However, the better and significant performance of the models obtained from the lesion rather than those obtained from the unaffected breast hints to the presence of macroscopic phenotype changes that are associated to tumor development. Our evidence supports the hypothesis that tumor recurrence and subtype can only be predicted by the images of the tumor tissue.

We used measurements of an ROI enclosing the tumor discriminating between higher dense regions and likely unaffected background tissue. This demonstrated that the molecular information related to images is derived specifically from the tumor. Nevertheless, for clinical use, our experimental procedure has the disadvantage of the determination of the ROI ahead of the radiomic feature extraction process. It would be more interesting, but by far more challenging, to determine automatically the ROI or to use the whole image without a priori ROI segmentation. Emerging methods in this direction are promising [4749]. We have shown that the contralateral ROI was barely or not correlated in the test sets to the recurrence scores. However, the predicted risk values from the contralateral ROI were not necessarily low. This is not a surprising finding as previous studies has shown that the non-affected contralateral breast may have some information regarding the cancer event [5052]. Our image-based models can be applied assuming the ROI is cancerous. Nevertheless, once we have shown that image-based models are correlated with risk, a similar methodology can be easily expanded to first classify normal, benign, and cancerous images before using risk prediction based on image-based models.

The size of our sampled cohort, the use of a single mammography equipment, the advanced stage of some of the cancer patients, and the lack of similar studies limit the generalization of the results. The participating subjects represent breast cancer patients from northeastern Mexico. Nevertheless, we consider that a larger and more heterogeneous radiogenomics cohort using similar analyses should show comparable findings since our methodology was rigorous in the training and test scheme and in the comparisons with the contralateral ROI. In our study we used the scores of validated signatures as the targets instead of observed clinical outcomes. Survival analysis using the imaging features would have allowed the creation of an entirely radiomic-based signatures and the identification of imaging intrinsic phenotypes associated to clinical outcomes as suggested in recent studies [14,26]. We will follow-up our population for long-term outcomes including disease-free and overall survival. Additionally, we did not found similar studies to compare the models and our methodology. Nevertheless, The Cancer Genome Atlas (TCGA) consortium, specifically the TCGA Breast Phenotype Research Group, is starting to make similar studies [7]. So, it will be possible to compare our results with other studies in the coming years. Consequently, the results and the methodology shown here could be valuable.

Conclusion

Our radiogenomic study provides supporting evidence that mammography is able to capture changes associated with intrinsic molecular characteristics in breast cancer. This is supported by predictive image-based models that had comparable behavior to validated gene signatures for breast cancer molecular subtypes and recurrence risk. The potential use of imaging surrogates is promising and can be easily be implemented in clinics. In low-income countries, it may have a profound impact where a risk of recurrence estimation based on molecular signatures is economically prohibitive. Nevertheless, additional analysis is required to determine robust image-based signatures that are useful in a broader clinical setting. Fortunately, other researchers such as TCGA that already obtained molecular estimations of risk or other outcomes could validate our analyses by recovering the routinely mammograms.

Materials and methods

Study population

The prospective study “Exploratory study for image-based biomarker discovery of breast cancer and its biological validation” (THSJ-BC) was approved by the institutional review board. We enrolled patients with breast cancer identified by mammography or by clinical inspection. Breast cancer was pathologically confirmed for all patients. For inclusion, the following criteria had to be met: consent form, bilateral mammograms (cranial caudal CC, mid-lateral oblique MLO), clinical information (age, TNM grading, ER, PR, and HER2 status), and high quality of the tumor sample for RNA, and microarray hybridization. Seventy-one patients met the criteria. All participants provided informed consent. Table 1 shows a summary of the clinical and pathological characteristics and S1 Table shows the details per donor. Images were reviewed by MGM and patients were diagnosed and treated by SCH.

Biopsy and gene expression microarrays

Tumor samples were obtained from ultrasound-guided tru-cut biopsy and immersed into RNA Later (Thermo-Fisher Scientific, Waltham, MA, USA). The samples were stored at 4°C for less than 5 days then stored at -80°C until processing. The extraction of mRNA was performed according to the RNeasy Mini Kit (Qiagen, Venlo, Netherlands). RNA integrity was corroborated with Experion Automated Electrophoresis System (BioRad, Hercules, CA, USA). The gene expression was measured employing microarrays containing 44,000 probes (Agilent, Santa Clara, CA, USA) using standard provider protocols and analyzed using a GenePix 4000B scanner (Molecular Devices, Sunnyvale, CA, USA). The raw intensities were logarithm transformed and quantile-normalized.

Gene signatures estimations

From microarray data, we estimated the diagnostic scores of two well-known breast cancer gene signatures, OncotypeDX and PAM50 [10]. The PAM50 signature uses fifty genes to determine the molecular subtype of the tumor: normal-like, luminal A, luminal B, HER2-enriched, and basal-like [11]. To estimate the subtypes, we used the implementation available at https://genome.unc.edu/pubsup/breastGEO/PAM50.zip and the corresponding original dataset for training [11]. To compare the PAM50 risk assessment to OncotypeDX scores we grouped subtypes following previous observations [53]. Briefly, patients from Normal-like and Luminal A subtypes were grouped into a “low-risk” group, and the Luminal-B, HER2+, and Basal-like patients into a “high-risk” group. Twenty-one patients were low risk and 50 high risk, respectively.

OncotypeDX is a validated assay that estimates a score proportional to the probability of breast cancer recurrence within 10 years after treatment [10]. Additionally, we confirmed such findings in-silico for several ER and LN heterogeneous populations using the SurvExpress tool [54]. This result is included in the supplementary material of SurvExpress. Consequently, we used the recurrence score (RS) from the OncotypeDX signature as an approximation of the recurrence risk in our population. OncotypeDX uses 16 genes (plus five genes for normalization) to estimate a continuous score truncated to ranges from 0 to 100 for low to high risk respectively, three risk categories are assigned accordingly [10]. We used the R-package genefu [55] to estimate the continuous non-truncated recurrence score and risk category from microarray data and avoid additional non-linearities produced by the truncation process. As suggested for PAM50, a low risk group was defined as scores lower than 18 (20 patients), intermediate risk as 18 to 30 (4 patients) and high risk higher than 30 (47 patients).

Image acquisition and feature extraction

2D Standard mammogram projections (CC and MLO) were acquired using a digital mammography system with automatic intensity adjustment (Selenia, Hologic, Bedford, MA) recorded at 70 microns per pixel and a grayscale of 12-bits. All mammograms images were evaluated by an experienced breast radiologist (MGM) who reported the relevant findings [56] and delineated the extension of the tumor using a computational tool (CiPAS, IMITEK, Monterrey, Mexico). All the segmentations were reviewed and manually refined to avoid the inclusion of pectoral muscle, skin folds or artificial markers. When two lesions were present in an image, only the lesion from which the tissue sample was extracted was taken into consideration. The segmented region of each image was processed to select the most informative region by image processing procedures determining the tumor region of interest (ROI) and the background ROI (S1 Fig). Both ROIs were used for the feature extraction procedure. For this, from each ROI, a set of radiomic features describing the shape, signal distribution, and texture of the tumor were calculated using a computational tool (CiPAS, IMITEK Mexico) and libraries from the Insight Toolkit (ITK) project (Kitware, Clifton Park, NY, USA). All computations were done using the DICOM stored images without any further post-processing. Most of the selected features of this analysis have already been shown to have some association with breast cancer risk [36,41,42,50,5759]. Some other of the features were previously used for the prediction of the BIRADS score [60], and other features were included to explore their relevance in this application. Briefly, shape features described the area, contour and compactness from the borders of the ROI. Signal distribution features include descriptive statistical properties (i.e. signal mean, median, skewness, kurtosis), and intensities values at prescribed percentiles. Parenchymal texture was described using fractal dimension [41], gray level co-occurrence matrix (GLCM) features, Daubechies-4 wavelets features at four resolution levels, local standard deviation, and Minkowski Functionals (MF) summary features [61].

From each of these ROI, we extracted 539 unique features (Table 2) generating a total of 1,078 image features per tumor and 1,078 for the background (S2 and S3 Tables respectively). Because the mammographic presentation of the breast tissue varies among women, the background ROI was used to adjust for those differences. Then, to analyze the information from both views, we used the sum and absolute difference between CC and MLO views. We removed wavelets LL data because it represents the same information as the original image in lower resolution and to avoid problems of high feature correlations in the feature selection method. Finally, the data used as the input dataset consist of 878 image features corresponding to 439 sums and 439 differences (S4 Table).

To determine whether an image signature was tumor-specific, the tumor-free contralateral breast image was used as a control. The control-image features were manually defined in a similar location than the breast tumor. The equivalent image processing procedure was performed to tumor ROI in these contralateral images (S5 and S6 Tables for raw data and S7 Table for sums and differences from the 64 patients having complete contralateral information). In this set of data, we removed 5 patients having tumors in both breasts and 2 patients missing the contralateral mammography.

Association analysis

The univariate association of individual imaging features with the OncotypeDX RS was measured using the Spearman correlation coefficient estimated by 100 random sample selections (bootstraps) of 90% of the samples similar to a 10-fold cross validation. To find multivariate models associating image features with OncotypeDX RS, we performed 100 repetitions of a feature selection method executed within a 10-fold-cross-validation procedure providing a robust and reliable estimate of the error in a blind test set independently of samples used for training (S2 Fig). For multivariate feature selection, we used LASSO [62]. LASSO performs a multivariate regression (over the OncotypeDX RS or the binary risk from PAM50 ROR) penalizing coefficients by a threshold value. Only the highest coefficients larger than the minimum error threshold were used for the regression. LASSO explores several values of the threshold value examining the error in each explored value. We used the cross-validated procedure from the LASSO algorithm implemented in the glmnet package in R. All model estimations and predictions were done using the default glmnet cross validation parameters with minimum error. Once the procedure to generate models was validated, we used all the samples to generate a LASSO model that could optimistically predict future mammographies.

Supporting information

S1 Table. Clinical data.

Relevant clinical information of all individuals included in this study.

https://doi.org/10.1371/journal.pone.0193871.s001

(XLS)

S2 Table. Tumor raw image features.

Raw image features obtained from the ROI of the tumor.

https://doi.org/10.1371/journal.pone.0193871.s002

(XLS)

S3 Table. Tumor raw image background features.

Raw image features obtained from the ROI surrounding the tumor.

https://doi.org/10.1371/journal.pone.0193871.s003

(XLS)

S4 Table. Tumor image features sums-differences.

Sums and Differences of the image features from the tumor.

https://doi.org/10.1371/journal.pone.0193871.s004

(XLS)

S5 Table. Contralateral raw image features.

Raw image features obtained from the ROI of the contralateral not containing tumor.

https://doi.org/10.1371/journal.pone.0193871.s005

(XLS)

S6 Table. Contralateral raw Image background features.

Raw image features obtained from the ROI surrounding the contralateral ROI.

https://doi.org/10.1371/journal.pone.0193871.s006

(XLS)

S7 Table. Contralateral image features sums-differences.

Sums and Differences of the image features from the contralateral.

https://doi.org/10.1371/journal.pone.0193871.s007

(XLS)

S8 Table. Univariate correlation of image features to OncotypeDX.

Bootstrapping estimations of the image features associated to OncortypeDX risk score.

https://doi.org/10.1371/journal.pone.0193871.s008

(XLS)

S9 Table. Frequency of features in 1000 models of OncotypeDX associations.

Contains the frequency of features included in models from the 100 round of 10-Fold-CV for OncotypeDX risk score.

https://doi.org/10.1371/journal.pone.0193871.s009

(XLS)

S10 Table. Univariate correlation of image features to PAM50.

Bootstrapping estimations of the image features associated to the risk subtype from the PAM50 ROR.

https://doi.org/10.1371/journal.pone.0193871.s010

(XLS)

S1 Fig. Image processing procedure.

This figure shows the computational procedure followed to generate the region of interests (ROI) of the lesion and background from the radiologist’s trace.

https://doi.org/10.1371/journal.pone.0193871.s011

(TIFF)

S2 Fig. Correlation between the risk estimations of PAM50 and OncotypeDX.

The Pearson correlation is shown. The estimated were also classified into low- and high-risk and compared using the kappa statistic.

https://doi.org/10.1371/journal.pone.0193871.s012

(TIFF)

S3 Fig. Top 50 image features associated to OncotypeDX by univariate estimation.

The heat map shows the image features in vertical and the patients in horizontal. Data shown in in z-scores. The blue shades indicate low z-scores values whereas yellow indicates high z-scores values. The univariate Spearman correlation coefficient and the rank per image feature is shown. Patients were sorted according to the OncotypeDX estimation. The PAM50 subtype is shown at top for comparison.

https://doi.org/10.1371/journal.pone.0193871.s013

(TIFF)

S4 Fig. Process to generate cross-validated models using LASSO.

https://doi.org/10.1371/journal.pone.0193871.s014

(TIFF)

S5 Fig. Top 50 image features associated to PAM50 by univariate estimation.

The heat map shows the image features in vertical and the patients in horizontal. Data shown in in z- scores. The blue shades indicate low z-scores values whereas yellow indicates high z-scores values. The univariate Spearman correlation coefficient and the rank per image feature is shown. Patients were sorted according to the PAM50 estimation. The PAM50 subtype is shown at top.

https://doi.org/10.1371/journal.pone.0193871.s015

(TIFF)

S1 File. Microarray gene expression data.

Compressed file containing the log-transform gene expression data.

https://doi.org/10.1371/journal.pone.0193871.s016

(ZIP)

Acknowledgments

We thank Dr. Vicente Valero and Dr. Cynthia Villarreal-Garza for revising and amending the manuscript.

References

  1. 1. Jemal A, Bray F, Ferlay J. Global Cancer Statistics: 2011. CA Cancer J Clin. 1999;49: 1,33–64. pmid:10200776
  2. 2. Rockhill B, Spiegelman D, Byrne C, Hunter DJ, Colditz G a. Validation of the Gail et al. model of breast cancer risk prediction and implications for chemoprevention. J Natl Cancer Inst. 2001;93: 358–366. pmid:11238697
  3. 3. Polyak K. Heterogeneity in breast cancer. Journal of Clinical Investigation. 2011. pp. 3786–3788. pmid:21965334
  4. 4. Burrell R a, McGranahan N, Bartek J, Swanton C. The causes and consequences of genetic heterogeneity in cancer evolution. Nature. 2013;501: 338–45. pmid:24048066
  5. 5. Li H, Zhu Y, Burnside ES, Drukker K, Hoadley KA, Fan C, et al. MR Imaging Radiomics Signatures for Predicting the Risk of Breast Cancer Recurrence as Given by Research Versions of MammaPrint, Oncotype DX, and PAM50 Gene Assays. Radiology. 2016;281: 382–391. pmid:27144536
  6. 6. Drukker K, Schram J, Burda S, Li H, Lan L, Giger M. Radiomics Investigation in the Distinction Between in Situ and Invasive Breast Cancers. Med Phys. American Association of Physicists in Medicine; 2015;42: 3602–3603.
  7. 7. Guo W, Li H, Zhu Y, Lan L, Yang S, Drukker K, et al. Prediction of clinical phenotypes in invasive breast carcinomas from the integration of radiomics and genomics data. J Med Imaging. 2015;4: 41007. pmid:26835491
  8. 8. Venet D, Dumont JE, Detours V. Most random gene expression signatures are significantly associated with breast cancer outcome. PLoS Comput Biol. IRIDIA-CoDE, Universite Libre de Bruxelles, Brussels, Belgium.; 2011;7: e1002240. pmid:22028643
  9. 9. van’t Veer LJ, Dai HY, van de Vijver MJ, He YDD, Hart AAM, Mao M, et al. Gene expression profiling predicts clinical outcome of breast cancer. Nature. Friend, SH Rosetta Inpharmat, 12040 115th Ave NE, Kirkland, WA 98034 USA Rosetta Inpharmat, Kirkland, WA 98034 USA Netherlands Canc Inst, Div Diagnost Oncol, NL-1066 CX Amsterdam, Netherlands Netherlands Canc Inst, Div Mol Carcinogenesis, NL-1066 CX Amste; 2002;415: 530–536. pmid:11823860
  10. 10. Paik S, Shak S, Tang G, Kim C, Baker J, Cronin M, et al. A multigene assay to predict recurrence of tamoxifen-treated, node-negative breast cancer. N Engl J Med. 2004;351: 2817–26. pmid:15591335
  11. 11. Parker JS, Mullins M, Cheang MCU, Leung S, Voduc D, Vickery T, et al. Supervised risk predictor of breast cancer based on intrinsic subtypes. J Clin Oncol. 2009;27: 1160–7. pmid:19204204
  12. 12. Jain S, Gradishar WJ. The application of Oncotype DX in early-stage lymph-node-positive disease. Current oncology reports. 2014. p. 360. pmid:24442572
  13. 13. Nielsen TO, Parker JS, Leung S, Voduc D, Ebbert M, Vickery T, et al. A comparison of PAM50 intrinsic subtyping with immunohistochemistry and clinical prognostic factors in tamoxifen-treated estrogen receptor-positive breast cancer. Clin Cancer Res. 2010;16: 5222–5232. pmid:20837693
  14. 14. Aerts HJWL, Velazquez ER, Leijenaar RTH, Parmar C, Grossmann P, Carvalho S, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5: 4006. pmid:24892406
  15. 15. Lambin P, Rios-Velazquez E, Leijenaar R, Carvalho S, Van Stiphout RGPM, Granton P, et al. Radiomics: Extracting more information from medical images using advanced feature analysis. Eur J Cancer. 2012;48: 441–446. pmid:22257792
  16. 16. Kumar V, Gu Y, Basu S, Berglund A, Eschrich SA, Schabath MB, et al. Radiomics: The process and the challenges. Magn Reson Imaging. 2012;30: 1234–1248. pmid:22898692
  17. 17. Gillies RJ, Kinahan PE, Hricak H. Radiomics: Images Are More than Pictures, They Are Data. Radiology. 2016;278: 563–577. pmid:26579733
  18. 18. Haspinger ER, Rosellini S, Ammari S, Dercle L, Bluthgen MV, Besse B, et al. Radiomics to identify HER2 amplification or mutation in metastatic patients with solid tumors prospectively enrolled in MOSCATO-01. Eur J Cancer. Elsevier; 2015;51: S101.
  19. 19. Oh J, Sutton E, Veeraraghavan H, Apte A, Morris E, Deasy J. Radiomics and Radiogenomics for Breast Cancer Using Magnetic Resonance Imaging. Med Phys. American Association of Physicists in Medicine; 2015;42: 3588–3588.
  20. 20. Kuo MD, Jamshidi N. Behind the Numbers: Decoding Molecular Phenotypes with Radiogenomics—Guiding Principles and Technical Considerations. Radiology. Radiological Society of North America; 2014;270: 320–325. pmid:24471381
  21. 21. Rutman AM, Kuo MD. Radiogenomics: Creating a link between molecular diagnostics and diagnostic imaging. Eur J Radiol. 2009;70: 232–241. pmid:19303233
  22. 22. Napel S, Giger M. Radiomics and Imaging Genomics: Quantitative Imaging for Precision Medicine. J Med Imaging. International Society for Optics and Photonics; 2015;2: 41001. pmid:26839908
  23. 23. Zinn PO, Majadan B, Sathyan P, Singh SK, Majumder S, Jolesz FA, et al. Radiogenomic mapping of edema/cellular invasion MRI-phenotypes in glioblastoma multiforme. PLoS One. 2011;6. pmid:21998659
  24. 24. Gevaert O, Leung AN, Quon A, Rubin DL, Napel S, Xu J, et al. Non–Small Cell Lung Cancer: Identifying Prognostic Imaging Biomarkers by Leveraging Public Gene Expression Microarray Data. Radiology. 2012;264: 387–396. pmid:22723499
  25. 25. Yamamoto S, Maki DD, Korn RL, Kuo MD. Radiogenomic analysis of breast cancer using MRI: A preliminary study to define the landscape. Am J Roentgenol. 2012;199: 654–663. pmid:22915408
  26. 26. Ashraf AB, Daye D, Gavenonis S, Mies C, Feldman M, Rosen M, et al. Identification of Intrinsic Imaging Phenotypes for Breast Cancer Tumors: Preliminary Associations with Gene Expression Profiles. Radiology. Radiological Society of North America; 2014;272: 374–384. pmid:24702725
  27. 27. Ashraf AB, Gavenonis SC, Daye D, Mies C, Rosen MA, Kontos D. A Multichannel Markov Random Field Framework for Tumor Segmentation With an Application to Classification of Gene Expression-Based Breast Cancer Recurrence Risk. IEEE Trans Med Imaging. 2013;32: 637–648. pmid:23008246
  28. 28. Karlo CA, Di Paolo PL, Chaim J, Hakimi AA, Ostrovnaya I, Russo P, et al. Radiogenomics of clear cell renal cell carcinoma: associations between CT imaging features and mutations. Radiology. 2014;270: 464–71. pmid:24029645
  29. 29. Yepes MM, Romilly AP, Collado-Mesa F, Net JM, Kiszonas R, Arheart KL, et al. Can mammographic and sonographic imaging features predict the Oncotype DXTM recurrence score in T1 and T2, hormone receptor positive, HER2 negative and axillary lymph node negative breast cancers? Breast Cancer Res Treat. 2014;148: 117–123. pmid:25262341
  30. 30. Khatcheressian JL, Wolff AC, Smith TJ, Grunfeld E, Muss HB, Vogel VG, et al. American Society of Clinical Oncology 2006 Update of the Breast Cancer Follow-Up and Management Guidelines in the Adjuvant Setting. J Clin Oncol. 2006;24: 5091–5097. pmid:17033037
  31. 31. Kreike B, van Kouwenhove M, Horlings H, Weigelt B, Peterse H, Bartelink H, et al. Gene expression profiling and histopathological characterization of triple-negative/basal-like breast carcinomas. Breast Cancer Res. 2007;9: R65. pmid:17910759
  32. 32. Rakha EA, Tan DS, Foulkes WD, Ellis IO, Tutt A, Nielsen TO, et al. Are triple-negative tumours and basal-like breast cancer synonymous? Breast Cancer Res. 2007;9: 404. pmid:18279542
  33. 33. Kelly CM, Bernard PS, Krishnamurthy S, Wang B, Ebbert MTW, Bastien RRL, et al. Agreement in risk prediction between the 21-gene recurrence score assay (Oncotype DX®) and the PAM50 breast cancer intrinsic ClassifierTM in early-stage estrogen receptor-positive breast cancer. Oncologist. 2012;17: 492–8. pmid:22418568
  34. 34. Haibe-Kains B, Desmedt C, Loi S, Culhane AC, Bontempi G, Quackenbush J, et al. A three-gene model to robustly identify breast cancer molecular subtypes. J Natl Cancer Inst. 2012;104: 311–325. pmid:22262870
  35. 35. Boisserie-Lacroix M, Hurtevent-Labrot G, Ferron S, Lippa N, Bonnefoi H, Mac Grogan G. Correlation between imaging and molecular classification of breast cancers. Diagn Interv Imaging. 2013;94: 1069–1080. pmid:23867597
  36. 36. Wang TC, Karayiannis NB. Detection of microcalcifications in digital mammograms using wavelets. IEEE Trans Med Imaging. 1998;17: 498–509. pmid:9845306
  37. 37. Laine AF, Schuler S, Fan J, Huda W. Mammographic Feature Enhancement by Multiscale Analysis. IEEE Trans Med Imaging. 1994;13: 725–740. pmid:18218551
  38. 38. Cheng HD, Shi XJ, Min R, Hu LM, Cai XP, Du HN. Approaches for automated detection and classification of masses in mammograms. Pattern Recognit. 2006;39: 646–668.
  39. 39. Kooi T, Litjens G, van Ginneken B, Gubern-Mérida A, Sánchez CI, Mann R, et al. Large scale deep learning for computer aided detection of mammographic lesions. Med Image Anal. 2017;35: 303–312. pmid:27497072
  40. 40. Petushi S, Garcia FU, Haber MM, Katsinis C, Tozeren A. Large-scale computations on histology images reveal grade-differentiating parameters for breast cancer. BMC Med Imaging. 2006;6: 14. pmid:17069651
  41. 41. Baish JW, Jain RK. Fractals and cancer. Cancer Res. 2000;60: 3683–8. Available: http://www.ncbi.nlm.nih.gov/pubmed/10919633 pmid:10919633
  42. 42. Ergin S, Kilinc O. A new feature extraction framework based on wavelets for breast cancer diagnosis. Comput Biol Med. 2014;51: 171–182. pmid:24951852
  43. 43. Kendall EJ, Barnett MG, Chytyk-Praznik K. Automatic detection of anomalies in screening mammograms. BMC Med Imaging. 2013;13: 43. pmid:24330643
  44. 44. Axelrod DE, Miller NA, Lickley HL, Qian J, Christens-Barry WA, Yuan Y, et al. Effect of quantitative nuclear image features on recurrence of Ductal Carcinoma In Situ (DCIS) of the breast. Cancer Inform. 2008;6: 99–109. Available: http://www.ncbi.nlm.nih.gov/pubmed/18779878 pmid:18779878
  45. 45. Trop I, LeBlanc SM, David J, Lalonde L, Tran-Thanh D, Labelle M, et al. Molecular Classification of Infiltrating Breast Cancer: Toward Personalized Therapy. RadioGraphics. 2014;34: 1178–1195. pmid:25208275
  46. 46. Hu Y, Bai L, Geiger T, Goldberger N, Walker RC, Green JE, et al. Genetic Background May Contribute to PAM50 Gene Expression Breast Cancer Subtype Assignments. PLoS One. 2013;8. pmid:24015230
  47. 47. Celaya-Padilla J, Martinez-Torteya A, Rodriguez-Rojas J, Galvan-Tejada J, Trevino V, Tamez-Pena J. Bilateral Image Subtraction and Multivariate Models for the Automated Triaging of Screening Mammograms. Biomed Res Int. 2015;2015: 231656. pmid:26240818
  48. 48. Celaya-Padilla JM, Rodriguez-Rojas J, Galván-Tejada JI, Martínez-Torteya A, Treviño V, Tamez-Peña JG. Bilateral image subtraction features for multivariate automated classification of breast cancer risk. Biomed Res Int. 2015;2015: 12.
  49. 49. Celaya-Padilla JM, Rodriguez-Rojas J, Trevino V, Gerardo Tamez-Pena JG. Local image registration a comparison for bilateral registration mammography. Proceedings of SPIE—The International Society for Optical Engineering. 2013. Available: http://www.scopus.com/inward/record.url?eid=2-s2.0-84891306996&partnerID=40&md5=23537374fcf24adaa28a56df573d1ff9
  50. 50. Dhahbi S, Barhoumi W, Zagrouba E. Breast cancer diagnosis in digitized mammograms using curvelet moments. Comput Biol Med. 2015;64: 79–90. pmid:26151831
  51. 51. Evans KK, Haygood TM, Cooper J, Culpan A-M, Wolfe JM. A half-second glimpse often lets radiologists identify breast cancer cases even when viewing the mammogram of the opposite breast. Proc Natl Acad Sci U S A. National Academy of Sciences; 2016;113: 10292–7. pmid:27573841
  52. 52. Rahbar H, McDonald ES, Lee JM, Partridge SC, Lee CI. How Can Advanced Imaging Be Used to Mitigate Potential Breast Cancer Overdiagnosis? Acad Radiol. 2016;23: 768–773. pmid:27017136
  53. 53. Liu Z, Zhang X-S, Zhang S. Breast tumor subgroups reveal diverse clinical prognostic power. Sci Rep. 2014;4: 4002. pmid:24499868
  54. 54. Aguirre-Gamboa R, Gomez-Rueda H, Martínez-Ledesma E, Martínez-Torteya A, Chacolla-Huaringa R, Rodriguez-Barrientos A, et al. SurvExpress: an online biomarker validation tool and database for cancer gene expression data using survival analysis. PLoS One. 2013;8: e74250. pmid:24066126
  55. 55. Gendoo DMA, Ratanasirigulchai N, Schröder MS, Paré L, Parker JS, Prat A, et al. Genefu: an R/Bioconductor package for computation of gene expression-based signatures in breast cancer. Bioinformatics. 2016;32: 1097–1099. pmid:26607490
  56. 56. D’Orsi C, Sickles E, Mendelson E, Morris E, et al. ACR BI-RADS® Atlas, Breast Imaging Reporting and Data System. Reston, VA, Am Coll Radiol. 2013;
  57. 57. Li H, Liu KJ, Lo SC. Fractal modeling and segmentation for the enhancement of microcalcifications in digital mammograms. IEEE Trans Med Imaging. 1997;16: 785–98. pmid:9533579
  58. 58. Malkov S, Shepherd JA, Scott CG, Tamimi RM, Ma L, Bertrand KA, et al. Mammographic texture and risk of breast cancer by tumor type and estrogen receptor status. Breast Cancer Res. 2016;18: 122. pmid:27923387
  59. 59. Keller BM, Oustimov A, Wang Y, Chen J, Acciavatti RJ, Zheng Y, et al. Parenchymal texture analysis in digital mammography: robust texture feature identification and equivalence across devices. J Med imaging (Bellingham, Wash). 2015;2: 24501. pmid:26158105
  60. 60. Rodriguez-Rojas J, Garza-Montemayor M, Trevino-Alvarado V, Tamez-Pena JG. Predictive features of breast cancer on Mexican screening mammography patients. SPIE Medical Imaging. International Society for Optics and Photonics; 2013. pp. 867023–867029.
  61. 61. Antonini M, Barlaud M, Mathieu P, Daubechies I. Image coding using wavelet transform. IEEE Trans Image Process. 1992;1: 205–220. pmid:18296155
  62. 62. Friedman J, Hastie T, Tibshirani R. Regularization Paths for Generalized Linear Models via Coordinate Descent. J Stat Softw. 2010;33: 1–22. pmid:20808728