Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

LENS: A mammography-specific hybrid CNN-Transformer with lesion-aware evidence modeling

  • Duc Quy Hoang,

    Roles Conceptualization, Data curation, Formal analysis, Methodology, Software, Supervision, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, Ho Chi Minh City, Viet Nam, Big Data Research for Infrastructure and Green Engineering (BRIDGE) Research Group, Ho Chi Minh City University of Transport, Ho Chi Minh City, Viet Nam

  • Van Kien Cao,

    Roles Conceptualization, Formal analysis, Writing – review & editing

    Affiliation Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, Ho Chi Minh City, Viet Nam

  • Tan Nhu Nguyen,

    Roles Conceptualization, Formal analysis, Writing – review & editing

    Affiliations School of Biomedical Engineering, International University, Ho Chi Minh City, Viet Nam, Vietnam National University, Ho Chi Minh City, Viet Nam

  • Ngoc Son Nguyen

    Roles Conceptualization, Formal analysis, Funding acquisition, Methodology, Supervision, Validation, Writing – review & editing

    nguyenngocson@iuh.edu.vn

    Affiliation Faculty of Electronics Technology, Industrial University of Ho Chi Minh City, Ho Chi Minh City, Viet Nam

Abstract

Background

Artificial Intelligence (AI) models for mammography classification is prone to shortcut learning because diagnostically relevant evidence is typically sparse, localized, and easily dominated by non-lesion background context. This study aimed to develop a mammography-specific framework that integrates lesion-focused evidence with global image representations to improve classification performance and provide more clinically interpretable decision support.

Methods

We propose LENS, a hybrid CNN-Transformer family designed specifically for mammography. LENS combines a lightweight multi-scale convolutional neural network (CNN) backbone with an alternating local-global Transformer encoder. In addition to global image representations, a weakly supervised lesion-aware branch identifies and aggregates suspicious regional evidence to support image-level prediction. LENS was evaluated on the large-scale VinDrMammo dataset for the three-class mammography task and compared to advanced architectures, including ConvNeXt, DINOv2, GMIC, and Swin Transformer under a unified experimental protocol.

Results

LENS-Base achieved the highest overall Accuracy of 85.5%, Macro F1-score of 79.6%, and Matthews correlation coefficient of 0.65. Quantitative localization evaluation results indicated that the selected regional evidence frequently overlapped with annotated abnormalities. Furthermore, these promising results come with fewer parameters and lower FLOPs.

Conclusion

LENS integrates local lesion-related features with global anatomical context to achieve improved class-balanced mammography classification while providing quantitatively supported lesion-focused evidence. These findings suggest that LENS is a promising framework for AI-assisted mammography screening.

Introduction

The global incidence of breast cancer increases by annually and remains one of the leading causes of malignancy-related mortality among women [1]. Mammography screening has been shown to reduce cancer mortality, underscoring its importance for early detection and improved outcomes [24]. Nevertheless, interpretation accuracy is influenced by reader expertise and workload pressures, causing inter-reader variability and inconsistent recall decisions [5,6]. Previous studies show that AI-supported systems can yield clinically competitive performance for breast cancer detection in retrospective or triage settings, suggesting value for improving interpretation and reducing radiologist workload when appropriately integrated into screening workflows [713]. Indeed, CNN-based systems have achieved considerable success in various mammography analysis tasks over the last decade due to their ability to automatically learn hierarchical features via convolutional layers and pooling operations [1420]. Despite these advantages, CNNs are limited in their ability to capture long-range dependencies and global semantic information. Vision Transformers (ViTs) have addressed this limitation by leveraging self-attention mechanisms, enabling the modeling of relationships between distant image patches [21]. This ability is particularly useful in mammography interpretation, where subtle, spatially distributed indicators of malignancy might be overlooked by architectures limited to local receptive fields [15,22]. But the drawback of using a pure Transformer is that its self-attention module has quadratic computational complexity with respect to image size and struggles to extract local information. Recent advances introduce a hierarchical architecture with shifted-window attention [23], which has a much lower computational cost. Liu et al. [24] further enhance local window attention by introducing continuous position bias (CPB), a small multilayer perceptron (MLP) that maps log-spaced relative coordinates to per-head bias values, facilitating smooth interpolation and transferability. For more efficient spatial attention, Twins-SVT [25] introduced an alternating Local-Global attention mechanism that combines non-overlapping window self-attention (LSA) with Global Sub-sampled Attention (GSA). In GSA, each local window is sub-sampled to produce groups of representative tokens. All spatial tokens then cross-attend to this compact set of representatives, reducing the quadratic computational cost. The architecture also incorporates a Conditional Position Encoding Generator (PEG) [26], which replaces fixed absolute position embeddings with a lightweight depthwise convolution, allowing the model to flexibly handle different input resolutions.

On the other hand, a vast amount of work has aimed to design hybrid networks that combine ViT and CNNs to mitigate their respective weaknesses and leverage their complementary strengths [2729]. This trend also naturally adapts to the medical images domain [30]. In the field of mammography analysis, Al-Tam et al. [31] and their subsequent work [32] trained a sequential hybrid CNN-ViT model on the region of interest (ROI) rather than the whole mammogram. Their remarkable results confirm the robustness of the hybrid network in the ROI-based classification problem. However, their works depend heavily on precise annotations, which are costly and not always available in clinical settings. Patheda et al. [33] designed a parallel hybrid architecture comprising a shallow CNNs branch that extracts fine-grained patterns and a ViT branch that models global interactions between image patches. Although their proposed model obtained performance comparable to that of CNN-based models, their study was conducted on a public Kaggle dataset and lacked peer review. Furthermore, computational efficiency analysis was absent. Another drawback is that these studies directly use vanilla ViT in their hybrid design, which is computationally intensive. Ahmed et al. [34] proposed a novel framework that integrated MaxViT as a model backbone, an evolutionary algorithm for optimal feature selection, and an XGBoost classifier. Their model reported 98.2% accuracy and an F1-score of 98.0% in the KAU-BCMD dataset, which is superior compared to other baselines. However, the KAU‑BCMD dataset is currently insufficient, making it difficult to reproduce the results. Authors in [35] introduced a novel hybrid framework that combines multi-scale local feature learning from InceptionNext blocks and global dependencies captured by a self-attention mechanism from Transformer blocks. Their model reported 98.2% accuracy in the mammography screening task. Recently, [36] proposed DeformNeXt-Swin, a staged hybrid CNN-Transformer framework for breast lesion classification. The framework synthesizes a deformable CNN and SwiGLU-GRN gate to improve morphology-sensitive local feature extraction in the early stage. The latter stage adapts hierarchical window attention to capture long-range semantic information. Their novel framework achieves an accuracy of 95.25% and an F1-score of 94.74% on mammography screening.

In mammography analysis, a lesion typically occupies only a small fraction of the high-dimensional image (Fig 1), leading AI models to rely on acquisition artifacts, positioning patterns, and other non-lesion background cues, such as skin folds [16,3739]. This problem is further complicated by class imbalance and lesion appearance. These challenges emphasize the need for advanced methods that are sensitive to small, spatially sparse lesions and can reason over broader anatomical contexts. For example, vast studies have proposed anchoring mammography classification in localized evidence by adopting Multiple-instance learning (MIL) [15,22,38,40]. Zhu et al. [15] and Hu et al. [40] ranked the likelihood of malignancy for regions on the CNN’s feature map using only the image-level label. Shen et al. [38] introduced a global-aware multiple instance classifier (GMIC), which combines a low-capacity global network for identifying informative regions with a high-capacity local network for detailed analysis. However, gradient flow is applied at the region-selection step, so the global and local branches optimize in a decoupled manner. To this end, Sun et al. [22] proposed a multi-scale region selection network (MRSN) in deep features. The model performs two rounds of region selection: channel-wise to identify feature types meaningful for malignancy and spatial-wise to locate tumor regions. Finally, they fused the top-K regions from each branch before prediction. Despite achieving promising results, their simple aggregation strategies, such as average pooling, may dilute important features. [41] introduced the FPN-MIL model for breast cancer classification and detection in high-resolution mammograms, comprising: an FPN-based instance encoder that performs multi-scale feature extraction on input patches, attention-driven instance aggregators, and an attention-driven multi-scale aggregator that adaptively weighted and fused scale-specific features, enhancing robustness to lesion variability.

thumbnail
Fig 1. Example of mammograms and their annotated findings.

Both show lesion evidence occupies only a small fraction of the image. In the left image, the lesion is clearly visible, whereas in the right image, it is less visible due to the masking effect of dense tissue.

https://doi.org/10.1371/journal.pone.0350720.g001

Based on the above observations, we propose a hybrid deep learning framework with lesion-aware evidence modeling. The framework combines a CNN-based multi-scale feature fusion (MSFF) backbone with a Transformer-based alternating local and global attention block, enabling complementary strengths while maintaining an acceptable computational cost. In addition to global representation learning, we introduce a lesion-aware branch trained solely on image-level supervision. Unlike GMIC [38] and MRSN [22], LENS retains end-to-end differentiability by integrating lesion-aware evidence routing directly into the forward computation. Furthermore, while GMIC and MRSN rely on separate or staged pathways for region processing, LENS provides direct, contextual refinement of the top-k suspicious regions with dedicated self-attention, guaranteeing that key suspicious evidence is dynamically informed by the overall image context. This results in improved accuracy and explainability, granting a more effective and interpretable mammography screening solution. The task is formulated as a three-class mammography screening problem with labels: Normal (BI-RADS 1), Benign (BI-RADS 2), and Recall (BI-RADS 4–5). The primary contributions of this work are:

  1. (1) An end-to-end lesion-aware evidence-routing mechanism that scores token-level lesion evidence from image-level supervision, contextually refines the top-k suspicious tokens, and integrates the resulting lesion representation directly into the final classification pathway.
  2. (2) A mammography-specific hybrid CNN-Transformer architecture that uses multi-scale rectangular tokenization to preserve the elongated geometry of mammograms and local-global contextual modeling to integrate local features with broader anatomical context
  3. (3) A systematic empirical evaluation, including comparisons with seven CNN, Transformer, and mammography-specific baselines under a unified experimental protocol, detailed ablation studies, quantitative lesion-localization analysis against radiologist annotations, and computational-efficiency profiling.

The remainder of the paper provides a detailed description of our LENS architecture in the Methods section. The Results section reports comprehensive quantitative findings that highlight the effectiveness of our approach. In the Discussion section, we reflect on our contributions, limitations, and directions for future research, and we conclude with a summary in the Conclusion section.

Methods

Dataset and preprocessing

We use the large-scale public dataset with 5000 exams (20000 images), namely VinDr-Mammo [42], which provides breast-level BI-RADS assessments for FFDM images and lesion-level annotations for a subset of abnormal findings. The dataset was acquired retrospectively from two primary hospitals in Vietnam, namely Hospital 108 (H108) and Hanoi Medical University Hospital (HMUH). The label assignment follows Breast Imaging Reporting and Data Systems (BI-RADS) [43]. In this study, we include only cases with BI-RADS 1, 2, 4, and 5 assessments. Specifically, we convert the provided BI-RADS labels into a 3-class screening task: Normal (BI-RADS 1), Benign (BI-RADS 2), and Recall (BI-RADS 4 or 5). BI-RADS 4 and 5 both result in the same immediate clinical action (recall for biopsy or additional imaging). From a screening workflow perspective, the distinction between “does not require recall” and “requires recall” is the operationally relevant decision. We merge these categories to reflect this decision boundary. Meanwhile, BI-RADS 3 cases are excluded because, in clinical practice, BI-RADS 3 is defined as “probably benign” and recommends short-interval follow-up rather than immediate recall. On the other hand, merging BI-RADS 3 with the benign class may increase the risk of false negatives; therefore, it is not recommended in screening [44] without comprehensive diagnostic workup [45]. This exclusion is also consistent with prior computational screening studies on VinDr-Mammo [46,47] and reflects the clinical reality that the critical triage decision is between routine screening (BI-RADS 1, 2) and recall for further assessment (BI-RADS 4, 5). The details of the dataset after excluding BI-RADS 3 are shown in Table 1. The dataset split follows the official protocol described in [42], with disjoint training (80%) and test (20%) subsets. These splits are performed at the patient level to prevent data leakage and guarantee that no test data is used at any stage of model development.

thumbnail
Table 1. VinDrMammo dataset after removing BI-RADS 3 cases. Each cell presents the number of images and the distribution of each class.

https://doi.org/10.1371/journal.pone.0350720.t001

FFDM images contain large background regions and acquisition-specific artifacts outside the breast area, as illustrated in Fig 1. Therefore, we adopt the breast-region cropping method from our previous work [48] to remove irrelevant background. All images are resized to that respects the natural ratio of mammograms. During the data-loading phase of model training, we apply image transformation techniques to augment the training data and improve model robustness to real-world variations in mammographic images. Specifically, we employ the following augmentations: random rotation within degrees (prob = 0.5), Gaussian noise injection with a standard deviation of 0.05 (prob = 0.5), and random scaling between 0.9 and 1.1 (prob = 0.3). All augmentation parameters were empirically selected to simulate common image acquisition and patient positioning variabilities.

LENS architecture

Fig 2 summarizes our proposed architecture. It integrates an EfficientNet-inspired [49,50] multi-scale feature fusion (MSFF) backbone with a geometry-aware local-global Transformer encoder and produces an explicit lesion-aware evidence branch. The design is motivated by two characteristics of mammography classification: diagnostically relevant structure is spatially sparse relative to the full field of view, yet correct classification also depends on large-scale anatomical context. Accordingly, the model is designed to preserve both long-axis breast geometry and a dedicated pathway for localized suspicious evidence.

Multi-scale feature fusion backbone

Let denote a cropped mammogram. The MSFF backbone produces a three-level feature pyramid , where denotes the feature map at stage s. Each stage is projected to a common Transformer token dimension d by a convolution and resized to a shared grid using bilinear interpolation,

(1)

where in Eqs.1 is tokenized feature at statge s. Rather than using a fixed, unweighted sum or average, LENS adopts learnable, softmax-based scale-weight fusion [50].

(2)

where are trainable fusion coefficients. This formulation allows the model to adaptively harmonize fine-grained and coarse semantic evidence during training.

Transformer encoder

Given input token sequence , each Transformer block follows a pre-norm residual local-global update,

(3)(4)(5)(6)

where denotes the non-overlapping window attention operator, denotes the global attention at block . For the LENS-small configuration, the encoder uses L = 6 consecutive LG blocks with embedding dimension d = 384 and 6 attention heads. Table 2 shows the detailed configuration of the proposed architecture. Overall, we introduce 3 variants: LENS-tiny, LENS-small, and LENS-base.

thumbnail
Table 2. Architectures of the proposed LENS variants for mammography classification. All variants use the same EfficientNet-B3 backbone and a shared hybrid local-global encoder, differing only in the embedding dimension d, the number of attention heads H, and the expansion ratio in the MLP layer. Computational complexity is reported for an input size of .

https://doi.org/10.1371/journal.pone.0350720.t002

Local window block

Let denote the input token sequence at block . The local block partitions the spatial tokens into non-overlapping windows of size , collecting the tokens of window j into a matrix . To allow the classification token to aggregate spatial context from all windows in parallel, is broadcast into every window before attention. Define the augmented window sequence

(7)

Window-level self-attention with a continuous position bias (CPB) [24] is applied independently to each ,

(8)

where is the per-head additive CPB matrix. The CPB is produced by a two-layer MLP operating on log-spaced normalized relative 2-D coordinates. The CLS outputs of all windows are averaged to form a single updated CLS token,

(9)

while the spatial outputs are merged back to the original grid layout. The full pre-norm residual update then reads as in Eqs. 3 and 4.

Global sub-sampled block

The global block replaces full self-attention with the Sub-sampled Attention (GSA) strategy of Twins-SVT [25]. Different from them, each window is reduced to a single representative token by average pooling,

(10)

yielding a compact summary sequence that is layer-normalized before serving as keys and values. Cross-attention is then computed with Q drawn from the input sequence token and K, V drawn from R, which reduces the attention complexity from to . For the default configuration (, , w = 8), versus N = 512, yielding a reduction in key/value tokens.

Lesion-aware evidence modeling

LENS complements the global evidence branch with a lesion-aware branch that explicitly focuses on suspicious local regions. Given spatial tokens , a lightweight scoring MLP estimates the lesion relevance of each token, denoted as , and converts them into a soft evidence distribution in Eqs.11,

(11)

where T = 0.1 is a lesion-score temperature hyperparameter that controls how sharp the lesion-evidence distribution is. Each token is then modulated by a channel-wise sigmoid gate with residual scaling ,

(12)

where the gate assigns an importance value in [0,1] to each feature channel, and controls how strongly the gate amplifies lesion candidate tokens. A soft lesion summary is obtained via weighted aggregation,

(13)

To preserve sparse but highly confident evidence, we select the top-k (k = 8) tokens with the highest lesion scores. The ablation study section demonstrated the impact of the top-k value empirically. We then combine them with a learnable lesion token, the classification token and refine this compact token set using a small stack of lesion-refinement blocks. The refined lesion representation is then fused with the global class token and the soft lesion summary in Eqs.13 for the final prediction.

(14)

where is a two-layer MLP. An optional auxiliary classifier on lesion-branch features, denoted as , can be used during training to provide additional supervision. Unlike post-hoc saliency methods [22,38], the mined lesion evidence directly participates in the forward prediction process. We trained the model end-to-end with the following loss function:

(15)

where and is the focal loss [51] for main classification head and auxiliary head respectively, is auxiliary loss weight.

Results

Experimental settings

Cross-validation settings.

5-fold stratified cross-validation was performed on the training set only (see Table 1), ensuring each fold maintains the clinical distribution of the dataset. The fold that achieved the highest validation Macro-F1 was selected to identify the best model checkpoint for that architecture and was used to evaluate on the held-out test set.

Implementation settings.

LENS and all comparator baselines were trained, validated, and evaluated under the same protocol: identical patient-level data splits, image preprocessing, augmentation pipeline, class weighting, optimizer and scheduler configuration, fold-selection criterion (best validation Macro-F1), and test-set evaluation. Specifically, all models were trained for a 3-class screening task using focal loss with weights proportional to inverse class frequency and to mitigate class imbalance. We trained each model for 100 epochs using the AdamW [52] optimizer, with the learning rate linearly increased from to in 5 warmup epochs, then gradually decreased using cosine annealing decay, weight decay of 0.05, dropout of 0.5 for all MLP layers, and a drop-path rate of 0.2 for all Transformer blocks. All Experiments are implemented in PyTorch [53] and conducted on an NVIDIA A6000 GPU. A summary of key hyperparameters of LENS is presented explicitly in Table 3.

thumbnail
Table 3. Key hyperparameters of the proposed model.

https://doi.org/10.1371/journal.pone.0350720.t003

Statistical analysis

We report overall Accuracy, AUC, macro F1-score, and the Matthews Correlation Coefficient (MCC) to account for class imbalance and operating-point robustness. In addition to these aggregate metrics, per-class Sensitivity, Specificity, Positive Predictive Value (PPV), and Negative Predictive Value (NPV) are used to characterize class-specific operating behavior for the Normal, Benign, and Recall categories. We also report sensitivity at a false-positive rate of 10%, denoted as Sen@FPR10, as a screening-relevant measure of the sensitivity and false-positive rate trade-off. Confusion matrices and per-class ROC curves are presented for LENS variants to validate per-class performance at different scales. For statistical analysis, we estimated paired-bootstrap 95% confidence intervals for the performance difference using 10,000 resamples. We tested statistical differences in Macro-F1, Macro-AUC, and MCC using two-sided paired permutation tests and the McNemar test for accuracy.

The VinDr-Mammo dataset does include ground-truth (GT) bounding boxes for a subset of abnormal cases. We have used these annotations to quantify the localization performance of the lesion-aware evidence branch. It is worth noting that LENS is designed to mine multiple discriminative lesion tokens for classification rather than to regress a single lesion bounding box. Accordingly, we report token-alignment metrics as the primary localization analysis. We use Pointing Game accuracy [54], Top-k token hit rate, Top-k token union IoU, and Heatmap Coverage of GT. For Top-k token hit rate, we select the highest-scoring lesion tokens from the lesion score map (k = 8 in our experiments). A case is counted as a hit when at least one selected token spatially overlaps any radiologist-annotated GT bounding box. For Top-k token union IoU (Top-k IoU), each selected token is converted to its corresponding image-space cell, and the union of the k selected cells is compared with GT bounding-box regions. In addition, we report Heatmap Coverage of GT to quantify whether the lesion score map assigns elevated activation within annotated lesion regions. A token is considered GT-overlapping if its spatial cell intersects at least one GT bounding box. We first project each GT box onto the lesion-token grid . For an image i, we compute the mean lesion-token score over the full grid, then calculate the fraction of GT-overlapping token cells whose score exceeds this image-level mean:

(16)

where is the number of ground-truth-overlapping token cells for image i, and is the lesion score of token t. A high Heatmap Coverage value indicates that a large proportion of clinically annotated lesion cells receive high lesion activation.

Mammography screening results

Table 4 presents a comprehensive comparison between LENS and other state-of-the-art baselines: the advanced CNN-based model ConvNeXt [55], the foundation ViT-based DINOv2 [56], the local attention-based model Swin Transformer [23], and the mammography-specific model GMIC [38] on the VinDr-Mammo test set. Overall, LENS-B achieved the strongest performance across most aggregate metrics. Specifically, it achieved the highest Accuracy of 85.5% (95% CI: 84.2–86.7), Macro-F1 of 79.6% (95% CI: 77.7–81.4), and MCC of 0.65 (95% CI:0.63–0.68). Meanwhile, Swin-B obtained the highest Macro AUC at 90.2% (95% CI: 88.9–91.4), whereas LENS-B reached 87.6% (95% CI: 86.2–89.1).

thumbnail
Table 4. Architecture comparison on the VinDr-Mammo test set. Values are reported as mean with bootstrap 95% confidence intervals.

https://doi.org/10.1371/journal.pone.0350720.t004

Moreover, pairwise statistical testing (Fig 3) confirms that the improvement in Macro-F1 is consistent across the evaluated baselines. Specifically, two-sided paired permutation tests show that LENS-B significantly outperforms ConvNeXt-B (p = 0.001) and all other baseline models (p < 0.001) in Macro-F1. For Accuracy, the McNemar test indicates a significant difference between LENS-B and ConvNeXt-B (p = 0.034), as well as between LENS-B and ConvNeXt-S, DINOv2-B, DINOv2-S, Swin-B, and Swin-S (all p < 0.001). In contrast, the Accuracy difference between LENS-B and GMIC is not statistically significant (p > 0.05), indicating comparable overall classification accuracy between these two models. On the other hand, the differences in Macro-AUC and MCC are not statistically significant (p > 0.05). Thus, although Swin-B has the highest Macro-AUC and LENS-B has the highest MCC, these differences are not supported by the corresponding paired statistical tests. Finally, the scaling behavior of LENS variants further supports the effectiveness of the proposed design. While LENS-S maintains competitive performance close to LENS-B, LENS-T shows a noticeable degradation, particularly in Macro-F1 (68.1%) and MCC (0.54). Nevertheless, LENS-T remains comparable to strong baselines such as DINOv2, indicating that the proposed architecture degrades gracefully under reduced model capacity.

thumbnail
Fig 3. Statistical test heatmap on F1-score and Accuracy.

* denotes p-values < 0.05, ** denotes p-values <0.001, and ns denotes non-significance (p-values > 0.05).

https://doi.org/10.1371/journal.pone.0350720.g003

Table 5 reports class-specific operating-point metrics for the Normal, Benign, and Recall categories. LENS-B provides a balanced profile across classes, with high Normal sensitivity (94.2%) and strong performance for the clinically important Recall category, including the highest Recall PPV (92.7%) and specificity (99.7%). Compared with GMIC, LENS-B substantially increased Recall sensitivity from 52.0% to 70.6% while also maintaining higher Recall specificity and PPV. For the Benign category, Swin-B achieved the highest sensitivity of 72.0%, but this was accompanied by a lower specificity of 81.3% and a PPV of 59.3%, indicating a greater false-positive burden. GMIC achieved higher Benign sensitivity than LENS-B (65.1% vs. 61.7%), whereas LENS-B provided slightly higher PPV and NPV. The results across the LENS variants also show a reduction in performance when decreasing model capacity. At a fixed false-positive rate of 10%, LENS-B achieved sensitivities of 65.8%, 70.9%, and 82.8% for the Normal, Benign, and Recall classes, respectively. It obtained the highest Sen@FPR10 for both the Normal and Recall categories, while its Benign result was close to the highest value achieved by GMIC (70.9% vs. 71.2%). Overall, LENS-B provided the most favorable balance between sensitivity, specificity, and precision for Recall predictions while maintaining comparative performance across the remaining screening categories.

thumbnail
Table 5. Per-class operating-point metrics on the VinDr-Mammo baseline evaluation. Entries are percentages in the order Normal / Benign / Recall. 95% confidence intervals are removed for readability.

https://doi.org/10.1371/journal.pone.0350720.t005

Table 6 summarizes the computational efficiency of all models under a unified hardware setting and input resolution (). For the throughput, models perform inference with a batch size of 4. Overall, the proposed LENS family demonstrates a favorable trade-off between computational cost and inference speed. Smaller variants such as LENS-T and LENS-S achieve very low complexity (22.42G and 31.51G FLOPs, respectively) while maintaining high throughput (136 and 120 img/s). Importantly, LENS-B scales to 48.79M parameters and 48.56G FLOPs while still delivering 102 img/s, substantially outperforming comparable-sized architectures. For instance, ConvNeXt-S and Swin-S require approximately higher FLOPs and achieve only 52 and 33 img/s, respectively. The efficiency gap is more pronounced than with pure Transformer models. DINOv2-B incurs 703.85G FLOPs and the highest memory footprint (1252.08 MB), resulting in a low throughput of 13 img/s. In contrast, LENS-B reduces FLOPs by over 14 and nearly halves memory usage, while improving throughput by approximately 7.5. Compared with the efficient GMIC, which has the highest throughput (150 img/s), LENS-B uses fewer FLOPs while retaining over 67% of the throughput.

thumbnail
Table 6. Efficiency profiling of the LENS family and baselines. Model parameters, floating-point operations (FLOPs), Throughput, and peak GPU memory are measured under the same hardware configuration as the training setting. Input size is .

https://doi.org/10.1371/journal.pone.0350720.t006

The F1-vs-FLOPs trade-off plot in Fig. 4 strengthens the same interpretation. Overall, the LENS family occupies the strongest performance-efficiency region in the plot: LENS-S reaches 77.62% Macro-F1 at 31.51 GFLOPs, and LENS-B reaches 79.55% Macro-F1 at 48.56 GFLOPs, compared with 75.22% Macro-F1 at 344.15 GFLOPs for Swin-Base and 69.70% at 703.85 GFLOPs for DINOv2-Base. Notably, the smallest LENS-T also reaches remarkable performance with 68.51% Macro-F1 at a modest 22.42 GFLOPs. This superior pattern also applies to GMIC with 75.5% Macro-F1 at 95.32 GFLOPs, and ConvNeXt-B with 76.5% at 320.92 GFLOPs. The plot therefore suggests that the current lesion-aware hybrid design improves class-balanced performance without entering the high-compute regime of large CNNs and Transformer baselines. Confusion matrices analysis on Fig 5 shows that all LENS variants classify the Normal class reliably, with sensitivity above 90%. The dominant residual errors are concentrated between the Benign and Recall classes rather than between normal and abnormal breasts. This pattern is consistent with the clinical difficulty posed by borderline suspicious findings, in which lesion appearance and surrounding context can overlap across the two abnormal categories. The confusion matrices also clarify the difference between model variants. LENS-Small achieves slightly higher Recall sensitivity than LENS-Base (147 cases versus 140 cases, approximately 3% diff), whereas LENS-Base recovers more Benign cases (577 versus 541, approximately 4% diff) while preserving comparable high Normal sensitivity. The stronger Benign-Recall balance of LENS-Base is consistent with its higher overall Macro-F1 and MCC in Table 4. These results suggest LENS-Base provides better class separation across all categories, particularly in reducing false positives for Recall and improving sensitivity for both Benign and Recall. The ROC curves in Fig 6 reinforce the same interpretation in the ranking space. LENS-Base dominates on one-vs-rest AUC for all three classes, reaching 87.1%, 85.2%, and 90.2% for Normal, Benign, and Recall, respectively, compared with 85.97%, 83.39%, and 87.37% for LENS-Small, and with 83.4%, 78.9%, and 89.6% for the tiny version. The Benign class remains the most difficult one-vs-rest discrimination problem for both variants, whereas Recall retains the strongest AUC. Overall, these results confirm that larger LENS variants provide better global discrimination and more stable ranking behavior, while smaller variants tend to exhibit stronger early recall at low false-positive rates.

thumbnail
Fig 4. FLOPs vs F1-score comparison plot.

LENS achieves significantly higher performance while maintaining a lower computational cost than other advanced architectures.

https://doi.org/10.1371/journal.pone.0350720.g004

thumbnail
Fig 5. Confusion matrices for LENS-variant.

The first row presents LENS-Tiny (left) and LENS-Small (right); The second row presents LENS-Base. All models classify the Normal class reliably, while the main remaining confusion is concentrated between the Benign and Recall classes.

https://doi.org/10.1371/journal.pone.0350720.g005

thumbnail
Fig 6. One-vs-rest ROC curves for LENS variants.

The first row presents LENS-Tiny (left) and LENS-Small (right); the second row presents LENS-Base. The baseline shows the best overall class separability, with consistently higher ROC curves across most false positive rates.

https://doi.org/10.1371/journal.pone.0350720.g006

Ablation study

In this section, we conduct ablation studies to investigate the contributions of individual components of LENS and the impact of the key hyperparameter top-k value. We trained and evaluated each experiment with the same protocol described in the experimental settings section. Table 7 isolates the contribution of each architectural component in LENS-base. The full model, which combines multi-scale feature aggregation, the lesion-aware head, and the main classification head, achieves the highest macro-F1 of 79.63% (95% CI: 77.65–81.41). Using only the lesion-aware branch for prediction results in the largest performance drop, to 68.49% (95% CI: 66.07–70.89), suggesting that the global contextual representation from the main branch is essential and can not be replaced by the lesion-aware branch alone. Disabling multi-scale feature aggregation while keeping both heads yields a macro-F1 of 70.74% (95% CI: 68.41–73.00), indicating that scale-diverse features are critical for distinguishing morphologically variable findings across the three-class distribution. More importantly, a substantial 6.78% drop in macro-F1 score is observed when we remove the lesion-aware head from the full model, indicating the supplementary role of the proposed weakly supervised branch. These results show that all main components work synergistically, and omitting any one leads to substantial declines in classification performance.

thumbnail
Table 7. Ablation study on LENS-base. Values are reported with bootstrap 95% confidence intervals in brackets.

https://doi.org/10.1371/journal.pone.0350720.t007

Table 8 presents the effect of the top k value across two window sizes. When the window size is set to 8, the macro F1 score reaches its optimum as k increases from 1 to 8. However, the score gradually declines as k is further increased to 16 and 32. A similar pattern is observed when the window size is reduced to 4. These results confirm that performance depends on the proposed evidence-selection mechanism.

thumbnail
Table 8. The impact of the top-k value with two local attention window sizes (w = 4 and w = 8). Values are reported with 95% bootstrap confidence intervals.

https://doi.org/10.1371/journal.pone.0350720.t008

Quantitative localization evaluation

To quantitatively validate whether the lesion-aware branch identifies clinically relevant abnormalities, we evaluated its lesion-token maps against radiologist bounding-box annotations on 193 annotated test mammograms containing 269 GT boxes. As shown in Table 9, LENS achieved 73.1% Pointing Game accuracy and 81.9% Top-8 Hit Rate, demonstrating that its selected lesion tokens frequently align with clinically annotated findings. The corresponding Top-8 IoU was 0.245. Although this overlap is moderate, LENS is trained using image-level supervision and selects a sparse set of discriminative tokens rather than predicting the complete lesion bounding box. The Heatmap Coverage reached 83.1%, indicating that the lesion-score map generally produced elevated responses within clinically annotated regions.

thumbnail
Table 9. Quantitative lesion localization evaluation of LENS-Base on the annotated test subset. Metrics were computed using GT lesion bounding boxes.

https://doi.org/10.1371/journal.pone.0350720.t009

The finding-specific analysis further demonstrates that the highlighted regions correspond to clinically meaningful abnormalities rather than arbitrary image structures. Localization was strongest for suspicious calcifications, for which LENS achieved a Pointing Game accuracy of 87.5% and a Top-8 Hit Rate of 92.5%. Strong localization was also observed for masses, with corresponding values of 73.8% and 81.6%. By contrast, performance was lower for architectural distortion and asymmetry subgroups.

Localization performance was also markedly associated with classification correctness. For correctly classified images, Pointing Game accuracy and Top-8 Hit Rate reached 86.5% and 92.2%, respectively, compared with 36.5% and 53.8% for incorrectly classified images. Similarly, Top-8 IoU increased from 0.103 for incorrect predictions to 0.297 for correct predictions, while Heatmap Coverage increased from 79.2% to 84.6%. These results indicate that correct predictions are more frequently accompanied by spatial evidence aligned with radiologist-annotated abnormalities, whereas classification errors are associated with weaker, incomplete, or misplaced lesion prioritization.

Lesion-aware inference examples

The qualitative correct-prediction examples in Fig 7 show that LENS-Base handles all three classes with visually plausible evidence routing in whole-image and zoomed views. In the Normal case (first row), the response remains diffuse and does not collapse into a spurious hotspot. This matches the absence of suspicious localized findings. In the correct Benign and Recall examples (second and third rows), the model focuses on compact regions that stay stable when zoomed around the main structure. This suggests that the lesion-aware branch improves metrics and produces class decisions from localized evidence rather than unrelated background. The misclassified examples in Fig 8 provide a more detailed error analysis than the confusion matrices. In Case 1 (first row), the model predicts Normal, while the ground truth is Benign. This outcome indicates that subtle, low-contrast abnormalities may be under-weighted when localized evidence is weak in both whole-image and zoomed views. The Benign Recall (incorrect recall classification) in the second row and Recall Benign (incorrect benign classification) in the third row illustrate the opposite failure mode. Even when the model attends to the relevant region, ambiguity in lesion morphology and parenchymal context can shift the final decision between the two abnormal categories. These qualitative examples are consistent with the class-level metrics: the primary challenge is not distinguishing normal from abnormal, but rather achieving fine-grained discrimination between subtle or borderline abnormal patterns.

thumbnail
Fig 7. Qualitative examples of correct LENS-Base predictions.

Each representative case (row) is shown with a whole-image view on the left and the corresponding zoom view on the right. Across the three classes, the lesion-aware branch remains diffuse for Normal tissue while concentrating on compact suspicious regions for Benign and Recall cases.

https://doi.org/10.1371/journal.pone.0350720.g007

thumbnail
Fig 8. Qualitative examples of misclassification by LENS-Base.

Each representative case is shown with a whole-image top view on the left and the corresponding zoom view on the right. The examples illustrate the main residual failure modes observed in the confusion matrix and localization analysis, including under-calling subtle benign findings, over-calling benign lesions as Recall, and ambiguity between Benign and Recall.

https://doi.org/10.1371/journal.pone.0350720.g008

Discussion

Interpretation of main findings

Mammography screening generates a large and recurring volume of examinations, placing a substantial workload on radiologists and motivating the development of robust and efficient AI-assisted CAD systems. However, the clinical adoption of AI-assisted CAD systems remains limited by concerns regarding their black-box decision-making [57]. This highlights the need for models that not only achieve strong predictive performance but also provide interpretable evidence for clinicians to examine. This study introduces LENS, a mammography-specific hybrid CNN-Transformer framework designed to provide accurate and lesion-aware classification with a competitive performance-computation trade-off. The principal findings of this study can be summarized in two complementary aspects:

First, the comprehensive comparison on the VinDr-Mammo test set showed that LENS-B achieved the strongest class-balanced performance among the evaluated architectures, as reflected by the significant improvement in Macro-F1 and competitive overall Accuracy and MCC. Its principal class-specific advantage was observed for the Recall category. It maintained competitive sensitivity while achieving the highest Recall specificity and PPV. It also achieved the highest Recall sensitivity at a fixed false-positive rate of 10%. These results indicate that LENS-B provides a favorable trade-off between identifying examinations that require further assessment and limiting unnecessary Recall predictions.

This performance profile may be attributable to the complementary design of LENS. Mammographic abnormalities are often spatially sparse, low-contrast, and embedded within large regions of normal tissue; therefore, their recognition requires both sensitivity to subtle local patterns and the ability to interpret these patterns within a broader anatomical context. The rectangular and multi-scale tokenization strategy is particularly relevant to mammography. Unlike conventional Transformers that operate on fixed square token grids, it is better aligned with the elongated geometry of mammograms and may preserve spatial relationships between localized tissue abnormalities and their surrounding breast anatomy before global contextual integration. The multi-scale convolutional components can capture fine-grained local texture and boundary information, whereas the local-global Transformer components can model longer-range dependencies across the breast region. Their combination may therefore allow subtle lesion-related features to be interpreted together with the surrounding anatomical context rather than relying exclusively on either local convolutional processing or global self-attention. Furthermore, the ablation results suggest that removing either multi-scale feature fusion, global context modeling, or lesion-focused evidence routing reduced performance. This finding indicates that the advantage of LENS arises from the complementary interaction among these components rather than from model scaling alone.

From a computational perspective, LENS provides a favorable balance between predictive performance and model complexity. LENS-B achieves substantially lower computational complexity and higher throughput than most CNN and Transformer baselines with comparable or larger model sizes. The consistent efficiency of the smaller LENS variants further indicates that the proposed architecture can be scaled according to available computational resources. Together with the ablation findings, these results suggest that the predictive gains arise primarily from the complementary integration of local, global, and lesion-focused representations rather than from increased model capacity alone.

Second, the quantitative and qualitative analyses demonstrate that the lesion-aware branch provides clinically meaningful evidence localization under image-level supervision. On the annotated test subset, LENS-Base achieved a Pointing Game accuracy of 73.1%, a Top-8 Hit Rate of 81.9%, a Top-8 IoU of 0.245, and a Heatmap Coverage of 83.1%, indicating that the highest-scoring and selected lesion tokens frequently overlap with radiologist-annotated lesions. Localization was particularly strong for suspicious calcifications and masses, whereas lower performance on architectural distortion and asymmetry may reflect the more diffuse and poorly circumscribed appearance of these findings, making them more difficult to represent using a small set of discrete tokens. Because some subgroups, particularly asymmetry, contain very few samples, these finding-specific results should be interpreted descriptively rather than as definitive comparisons between abnormality categories. Localization was markedly stronger in correctly classified cases than in incorrectly classified cases, with Pointing Game accuracy increasing from 36.5% to 86.5% and Top-8 Hit Rate from 53.8% to 92.2%. This association suggests that successful predictions are generally supported by spatial evidence aligned with clinically relevant regions. The qualitative examples in Figs 7 and 8 complement the quantitative localization results by illustrating successful evidence routing and representative failure modes. These examples clarify how the evidence routing operates across classes. For correctly classified Normal cases, the response remains diffuse without collapsing into an isolated hotspot, which is consistent with the absence of a localized suspicious finding. For correctly classified Benign and Recall cases, the model concentrates on compact regions that remain stable in zoomed views, supporting the interpretation that abnormal predictions are informed by localized lesion evidence.

The failure cases reveal two limitations. First, subtle or low-contrast abnormalities may be under-weighted when the lesion response is weak, leading to Benign cases being classified as Normal. Second, even when the model attends to the relevant region, overlap in lesion morphology and surrounding parenchymal context can shift the decision between Benign and Recall. Taken together, the observed error patterns suggest that a major remaining challenge lies in fine-grained discrimination between subtle or borderline abnormal patterns, particularly between Benign and Recall cases, although weak lesion evidence can also lead to errors in normal/abnormal separation. Nevertheless, these results should be interpreted as evidence of clinically meaningful region prioritization rather than precise lesion delineation, since only box-level annotations are available and the model predicts token-level suspicious regions rather than segmentation masks.

Limitations and future work

This study has limitations that should be prioritized in future work. First, all experiments were conducted on a single dataset. Although the dataset includes heterogeneous acquisition settings, evaluation on a single benchmark does not establish external validity across institutions, scanner vendors, patient populations, or acquisition protocols. Because mammography performance can be sensitive to domain shift, an independent multi-center evaluation is necessary before stronger claims about generalizability can be made. Second, substantial class imbalance remains a limitation, as reflected by the lower performance observed for minority abnormal categories. Future work will investigate complementary data-level and sampling-level strategies, including realistic lesion synthesis [47] and class-aware batch sampling. Third, although all evaluated baselines were retrained under identical experimental conditions to ensure a fair comparison, the proposed framework has not yet been experimentally compared with several recently published architectures [35,36]. Future work will include these methods under the same unified evaluation protocol to provide a broader assessment of comparative predictive performance and computational trade-offs. Fourth, although the lesion-token maps showed quantitative agreement with radiologist-provided bounding boxes, this evaluation was limited to the annotated abnormal subset and used coarse box-level annotations. The results therefore support clinically relevant region prioritization but do not establish pixel-accurate lesion delineation, causal reliance on the highlighted regions, or robustness against shortcut features. Future work should incorporate external localization cohorts, reader-based assessment, and controlled lesion or background perturbation experiments.

Conclusion

In conclusion, this study presents LENS, a mammography-specific hybrid CNN-Transformer framework designed to support lesion-focused evidence learning under image-level supervision. Quantitative localization results and qualitative visualizations showed that the lesion token responses frequently aligned with radiologist-annotated abnormalities, providing evidence that the model captures clinically relevant image regions. On the VinDr-Mammo dataset, LENS-B achieved the highest Accuracy, Macro-F1, and MCC among the evaluated models, with statistically significant improvements in Macro-F1 over all baselines. Its main class-specific advantage was observed for the clinically important Recall category, where it maintained competitive sensitivity while achieving the highest specificity, PPV, and sensitivity at a fixed 10% false-positive rate. Together with its competitive computational efficiency, the results support lesion-aware hybrid CNN-Transformer modeling as a promising direction for mammography screening AI. Nevertheless, external validation on independent datasets and prospective clinical evaluation are necessary before deployment in real-world screening workflows.

Acknowledgments

The authors used Grammarly (free version) to assist with English language editing only, specifically to improve grammatical clarity and readability. All AI-assisted passages were reviewed and verified by the corresponding author to ensure accuracy, consistency with the underlying research, and faithfulness to the authors’ intended meaning. The tool was not used to generate scientific content, interpret results, or produce any data or figures.

References

  1. 1. Kim J, Harper A, McCormack V, Sung H, Houssami N, Morgan E, et al. Global patterns and trends in breast cancer incidence and mortality across 185 countries. Nat Med. 2025;31(4):1154–62. pmid:39994475
  2. 2. Caswell-Jin JL, Sun LP, Munoz D, Lu Y, Li Y, Huang H, et al. Analysis of breast cancer mortality in the US—1975 to 2019. JAMA. 2024;331(3):233–41.
  3. 3. US Preventive Services Task Force, Nicholson WK, Silverstein M, Wong JB, Barry MJ, Chelmow D, et al. Screening for breast cancer: US preventive services task force recommendation statement. JAMA. 2024;331(22):1918–30. pmid:38687503
  4. 4. Wilkinson AN, Mainprize JG, Yaffe MJ, Robinson J, Cordeiro E, Look Hong NJ, et al. Cost-effectiveness of breast cancer screening using digital mammography in Canada. JAMA Netw Open. 2025;8(1):e2452821. pmid:39745700
  5. 5. Kim SH, Lee EH, Jun JK, Kim YM, Chang YW, Lee JH, et al. Interpretive performance and inter-observer agreement on digital mammography test sets. Korean J Radiol. 2019;20(2):218–24. pmid:30672161
  6. 6. Parikh JR, Sun J, Mainiero MB. What causes the most stress in breast radiology practice? A survey of members of the society of breast imaging. J Breast Imaging. 2021;3(3):332–42. pmid:34056593
  7. 7. McKinney SM, Sieniek M, Godbole V, Godwin J, Antropova N, Ashrafian H, et al. International evaluation of an AI system for breast cancer screening. Nature. 2020;577(7788):89–94. pmid:31894144
  8. 8. Dembrower K, Wåhlin E, Liu Y, Salim M, Smith K, Lindholm P, et al. Effect of artificial intelligence-based triaging of breast cancer screening mammograms on cancer detection and radiologist workload: a retrospective simulation study. Lancet Digit Health. 2020;2(9):e468–74. pmid:33328114
  9. 9. Lauritzen AD, Lillholm M, Lynge E, Nielsen M, Karssemeijer N, Vejborg I. Early indicators of the impact of using ai in mammography screening for breast cancer. Radiology. 2024;311(3):e232479. pmid:38832880
  10. 10. Ramli Hamid MT, Ab Mumin N, Abdul Hamid S, Mohd Ariffin N, Mat Nor K, Saib E, et al. Comparative analysis of diagnostic performance in mammography: a reader study on the impact of AI assistance. PLoS One. 2025;20(5):e0322925. pmid:40333871
  11. 11. Houssami N, Marinovich ML. AI for mammography: making double screen-reading history. Lancet Digit Health. 2025;7(3):e168–9. pmid:39904653
  12. 12. Eisemann N, Bunk S, Mukama T, Baltus H, Elsner SA, Gomille T, et al. Nationwide real-world implementation of AI for cancer detection in population-based mammography screening. Nat Med. 2025;31(3):917–24. pmid:39775040
  13. 13. Bernstein MH, Chung M, Yala A, Baird GL. A novel statistical framework for quantifying risks and benefits of AI automation in screening mammography. PLOS Digit Health. 2026;5(2):e0001231. pmid:41746988
  14. 14. Chokri F, Hayet Farida M. Mammographic mass classification according to Bi‐RADS lexicon. IET Computer Vision. 2016;11(3):189–98.
  15. 15. Zhu W, Lou Q, Vang YS, Xie X. Deep multi-instance networks with sparse label assignment for whole mammogram classification. In: Medical image computing and computer assisted intervention - MICCAI 2017, 2017. 603–11.
  16. 16. Shen L, Margolies LR, Rothstein JH, Fluder E, McBride R, Sieh W. Deep learning to improve breast cancer detection on screening mammography. Sci Rep. 2019;9(1):12495. pmid:31467326
  17. 17. Chougrad H, Zouaki H, Alheyane O. Multi-label transfer learning for the early diagnosis of breast cancer. Neurocomputing. 2020;392:168–80.
  18. 18. Duc Quy H, Van Kien C, Huy Anh HP, Son NN. Multi-view digital mammography mass classification: a convolutional neural network model approach. In: 2021 International symposium on electrical and electronics engineering (ISEE), 2021. 133–8.
  19. 19. Naeem OB, Saleem Y, Khan MUG, Khan AR, Saba T, Bahaj SA, et al. Breast mammograms diagnosis using deep learning: state of art tutorial review. Arch Computat Methods Eng. 2024;31(4):2431–49.
  20. 20. Li G, Zhou M, Fu Y, Alam N, Denton E, Zwiggelaar R. An interpretable CNN-based model for mass classification in mammography. Knowledge-Based Systems. 2025;316:113372.
  21. 21. Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T. An image is worth 16x16 words: transformers for image recognition at scale. In: International Conference on Learning Representations. 2021. https://openreview.net/forum?id=YicbFdNTTy
  22. 22. Sun L, Han B, Jiang W, Liu W, Liu B, Tao D, et al. Multi-scale region selection network in deep features for full-field mammogram classification. Med Image Anal. 2025;100:103399. pmid:39615148
  23. 23. Liu Z, Lin Y, Cao Y, Hu H, Wei Y, Zhang Z, et al. Swin transformer: hierarchical vision transformer using shifted windows. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 2021. 9992–10002.
  24. 24. Liu Z, Hu H, Lin Y, Yao Z, Xie Z, Wei Y, et al. Swin transformer V2: scaling up capacity and resolution. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022. 11999–2009.
  25. 25. Chu X, Tian Z, Wang Y, Zhang B, Ren H, Wei X. Twins: revisiting the design of spatial attention in vision transformers. In: Advances in neural information processing systems. 2021. 9355–66.
  26. 26. Chu X, Tian Z, Zhang B, Wang X, Shen C. Conditional positional encodings for vision transformers. In: International conference on learning representations (ICLR). 2023.
  27. 27. Han K, Wang Y, Chen H, Chen X, Guo J, Liu Z, et al. A survey on vision transformer. IEEE Trans Pattern Anal Mach Intell. 2023;45(1):87–110. pmid:35180075
  28. 28. Palanisamy B, Hassija V, Chatterjee A, Mandal A, Chakraborty D, Pandey A, et al. Transformers for vision: a survey on innovative methods for computer vision. IEEE Access. 2025;13:95496–523.
  29. 29. Haruna Y, Qin S, Adama Chukkol AH, Yusuf AA, Bello I, Lawan A. Exploring the synergies of hybrid convolutional neural network and vision transformer architectures for computer vision: a survey. Eng Appl Artificial Intelligence. 2025;144:110057.
  30. 30. Kim JW, Khan AU, Banerjee I. Systematic review of hybrid vision transformer architectures for radiological image analysis. J Imaging Inform Med. 2025;38(5):3248–62. pmid:39871042
  31. 31. Al-Tam RM, Al-Hejri AM, Narangale SM, Samee NA, Mahmoud NF, Al-Masni MA, et al. A hybrid workflow of residual convolutional transformer encoder for breast cancer classification using digital X-ray mammograms. Biomedicines. 2022;10(11):2971. pmid:36428538
  32. 32. Al-Hejri AM, Al-Tam RM, Fazea M, Sable AH, Lee S, Al-Antari MA. ETECADx: ensemble self-attention transformer encoder for breast cancer diagnosis using full-field digital X-ray breast images. Diagnostics (Basel). 2022;13(1):89. pmid:36611382
  33. 33. Patheda VR, Laxmisai G, Gokulnath BV, Siddique Ibrahim SP, Selva Kumar S. A robust hybrid CNN+ViT framework for breast cancer classification using mammogram images. IEEE Access. 2025;13:77187–95.
  34. 34. Ahmed S, Elazab N, El-Gayar MM, Elmogy M, Fouda YM. Multi-scale vision transformer with optimized feature fusion for mammographic breast cancer classification. Diagnostics (Basel). 2025;15(11):1361. pmid:40506933
  35. 35. Pacal I, Attallah O. InceptionNeXt-transformer: a novel multi-scale deep feature learning architecture for multimodal breast cancer diagnosis. Biomed Signal Process Control. 2025;110:108116.
  36. 36. Pacal I, Ersoy M, Ozger F. DeformNeXt-Swin: a hybrid CNN-transformer framework for breast lesion classification in ultrasound and mammography. Chemomet Intelligent Laboratory Systems. 2026;276:105799.
  37. 37. Geirhos R, Jacobsen J-H, Michaelis C, Zemel R, Brendel W, Bethge M, et al. Shortcut learning in deep neural networks. Nat Mach Intell. 2020;2(11):665–73.
  38. 38. Shen Y, Wu N, Phang J, Park J, Liu K, Tyagi S, et al. An interpretable classifier for high-resolution breast cancer screening images utilizing weakly supervised localization. Med Image Anal. 2021;68:101908. pmid:33383334
  39. 39. Banerjee I, Bhattacharjee K, Burns JL, Trivedi H, Purkayastha S, Seyyed-Kalantari L. Shortcuts causing bias in radiology artificial intelligence: causes, evaluation, and mitigation. J American College of Radiol. 2023;20(9):842–51.
  40. 40. Hu T, Zhang L, Xie L, Yi Z. A multi-instance networks with multiple views for classification of mammograms. Neurocomputing. 2021;443:320–8.
  41. 41. Mourão M, Nascimento JC, Santiago C, Silveira M. Multi-scale attention-based multiple instance learning for breast cancer diagnosis. In: Medical image computing and computer assisted intervention – MICCAI 2025. Cham: Springer Nature Switzerland; 2026. 364–74.
  42. 42. Nguyen HT, Nguyen HQ, Pham HH, Lam K, Le LT, Dao M, et al. VinDr-Mammo: a large-scale benchmark dataset for computer-aided diagnosis in full-field digital mammography. Sci Data. 2023;10(1):277. pmid:37173336
  43. 43. American College of Radiology. Breast imaging reporting and data system (BI-RADS®). 5th ed. Reston: American College of Radiology; 2013.
  44. 44. Fazeli S, Stepenosky J, Guirguis MS, Adrada B, Rakow-Penner R, Ojeda-Fournier H. Understanding BI-RADS category 3. Radiographics. 2025;45(1):e240169. pmid:39636752
  45. 45. Attallah O, Pacal I. Impact of magnification on deep learning approaches through comprehensive comparative study of histopathological breast cancer classification. Biomedical Signal Processing and Control. 2026;113:108973.
  46. 46. Nguyen T-H, Kha QH, Ngoc Toan Truong T, Lam BT, Hung Ngo B, Dinh QV, et al. Towards robust natural-looking mammography lesion synthesis on ipsilateral dual-views breast cancer analysis. In: 2023 IEEE/CVF International Conference on Computer Vision Workshops (ICCVW), 2023. 2556–65.
  47. 47. Nguyen T-H, Lam B-T, Truong TNT, Duong D-T, Dinh Q-V. MV-TRAMS: An efficient tumor region-adapted mammography synthesis under multi-view diagnosis. Biomedical Signal Processing and Control. 2026;123:110509.
  48. 48. Quy HD, Son NN, Anh HPH. DeYOLOv3: an optimal mass detector for advanced breast cancer diagnostics. Lecture notes in networks and systems. Springer International Publishing; 2022. 325–35. https://doi.org/10.1007/978-3-031-19694-2_29
  49. 49. Tan M, Le QV. EfficientNet: rethinking model scaling for convolutional neural networks. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 2019. 6105-14.
  50. 50. Tan M, Pang R, Le QV. EfficientDet: scalable and efficient object detection. In: 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2020. 10778–87.
  51. 51. Lin T-Y, Goyal P, Girshick R, He K, Dollar P. Focal loss for dense object detection. In: 2017 IEEE International Conference on Computer Vision (ICCV), 2017. 2999–3007.
  52. 52. Loshchilov I, Hutter F. Decoupled weight decay regularization. in: international conference on learning representations. 2019. https://openreview.net/forum?id=Bkg6RiCqY7
  53. 53. Paszke A, Gross S, Massa F, Lerer A, Bradbury J, Chanan G. Pytorch: an imperative style, high-performance deep learning library. Adv Neural Information Process Syst. 2019;32.
  54. 54. Cinbis RG, Verbeek J, Schmid C. Weakly supervised object localization with multi-fold multiple instance learning. IEEE Trans Pattern Anal Mach Intell. 2017;39(1):189–203. pmid:26930676
  55. 55. Liu Z, Mao H, Wu C-Y, Feichtenhofer C, Darrell T, Xie S. A ConvNet for the 2020s. In: 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), 2022. 11966–76.
  56. 56. Oquab M, Darcet T, Moutakanni T, Vo H, Szafraniec M, Khalidov V. Dinov2: Learning robust visual features without supervision. arXiv preprint. 2023.
  57. 57. Sadeghi Z, Alizadehsani R, CIFCI MA, Kausar S, Rehman R, Mahanta P, et al. A review of explainable artificial intelligence in healthcare. Computers and Electrical Engineering. 2024;118:109370.