Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Enhancing low-light images with MSHCDI-Net: A multi-scale hybrid cross-domain interaction approach

  • Bin Chen,

    Roles Conceptualization, Data curation, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation School of Electronic Information/Wuhan University of Science and Technology, Wuhan, Hubei, China

  • Peitao Li,

    Roles Conceptualization, Data curation, Methodology, Software, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation School of Electronic Information/Wuhan University of Science and Technology, Wuhan, Hubei, China

  • Chaobing Zheng ,

    Roles Conceptualization, Investigation, Resources, Visualization, Writing – review & editing

    zhengchaobing@wust.edu.cn

    Affiliation School of Electronic Information/Wuhan University of Science and Technology, Wuhan, Hubei, China

  • Meng Jia,

    Roles Data curation, Formal analysis, Supervision, Writing – review & editing

    Affiliation College of Mechanical and Electrical Engineering/Xinxiang University, Xinxiang, Henan, China

  • Shiqian Wu

    Roles Conceptualization, Formal analysis, Investigation, Writing – review & editing

    Affiliation School of Electronic Information/Wuhan University of Science and Technology, Wuhan, Hubei, China

Abstract

Low-light image enhancement aims to improve visual visibility and perceptual quality under challenging illumination conditions. However, conventional convolutional neural networks (CNNs) are inherently limited in modeling long-range dependencies due to their restricted receptive fields, which often leads to insufficient global context modeling and suboptimal restoration results. To address this limitation, we propose MSHCDI-Net, a Multi-Scale Hybrid Cross-Domain Interaction Network that effectively integrates CNN and Transformer branches to jointly capture local texture details and global contextual relationships. Specifically, the proposed framework adopts a hierarchical encoder–decoder architecture to perform multi-scale feature extraction and progressive reconstruction. A cross-domain interaction mechanism is introduced to facilitate effective information exchange between convolutional and Transformer representations across multiple resolutions, enabling complementary modeling of fine-grained structures and long-range dependencies. Through adaptive feature fusion and multi-scale guidance, the network achieves improved structural consistency and detail restoration in low-light scenes. Extensive experiments on several public benchmarks demonstrate the effectiveness of the proposed method. MSHCDI-Net achieves 23.45 dB PSNR / 0.848 SSIM on LOL-v1, 23.74 dB / 0.910 SSIM on LOL-v2-synthetic, and 22.24 dB / 0.868 SSIM on LOL-v2-real, demonstrating competitive performance in both quantitative metrics and visual quality.

1. Introduction

Low-light image enhancement (LLIE) aims to reconstruct bright, clear, and visually natural images from underexposed, noisy, and degraded inputs.This task plays a critical role in many high-level computer vision applications, such as night-time surveillance, autonomous driving, and object detection [1,2]. However, enhancing low-light images remains challenging due to the inherent low signal-to-noise ratio of dark regions, spatially uneven illumination distribution, and tendency toward local overexposure during enhancement, which easily induce severe noise amplification, loss of fine details, and distortion.

Traditional LLIE approaches mainly include grayscale stretching techniques and Retinex-based models. Grayscale stretching methods, such as histogram equalization [3] and gamma correction, enhance contrast by adjusting the global or local pixel intensity distribution. Although computationally efficient, these approaches often introduce over-enhancement and color distortion. In contrast, Retinex-based methods, inspired by the Land–McCann Retinex theory [4], aim to decompose images into illumination and reflectance components. While such methods can better adjust dynamic range, accurately estimating illumination remains difficult, often leading to halo artifacts and inconsistent visual perception. Recent frequency-domain methods [5,6] attempt to alleviate these limitations by decomposing images into structural and texture components, thereby improving noise suppression performance and fine detail preservation.

With the rapid advancement of deep learning, data-driven LLIE methods have achieved significant progress. Convolutional neural networks (CNNs) [7] have demonstrated strong capability in capturing local textures and edges, enabling effective restoration of spatial details. However, due to their inherently limited receptive fields, CNN-based models struggle to capture long-range dependencies, which are crucial for modeling global illumination consistency. To address this limitation, several studies have incorporated physical priors into deep networks. For example, Li et al. [8] introduced a Retinex-inspired framework that decomposes images into illumination and reflectance, improving illumination modeling. Nevertheless, modeling large-scale illumination variations in complex real-world low-light scenes remains a formidable challenge for purely convolutional architectures.

Recently, Transformer-based architectures [9] have been widely applied into low-level vision tasks due to their ability to model long-range dependencies through self-attention mechanisms. Methods such as Uformer [10], Restormer [11], and LLFormer [12] demonstrate improved global context modeling and enhanced feature propagation. However, vanilla Transformer architectures often suffer from high computational cost and limited ability to capture fine local textures, which are essential for low-light image enhancement.

To fully exploit the complementary advantages of CNNs and Transformers, hybrid architectures have recently emerged. For example,HVI-CIDNet [13] integrates CNN and Transformer structures for more accurate illumination modeling. Nevertheless, existing hybrid approaches often lack sufficiently deep cross-domain feature interaction, which limits the effective integration of global context and local structural details.

As visualized in Fig 1, existing methods still exhibit noticeable limitations. CNN-based methods may suffer from color shifts and detail loss, while Transformer-based approaches may blur fine textures despite superior global illumination consistency. Even hybrid models sometimes fail to fully exploit the complementary strengths of both architectures. Therefore, how to effectively integrate CNN-based local feature learning with Transformer-based global context modeling while achieve efficient cross-domain feature interaction remains a challenging open problem in the field of LLIE.

thumbnail
Fig 1. Comparison of results from four low-light image enhancement algorithms.

From (a) to (d), the images correspond to the results produced by MIR-Net [14], LLFormer [12], HVI-CIDNet [13] and ours, respectively. The (e) represents the ground truth. It can be observed that the proposed algorithm is capable of preserving detail information.

https://doi.org/10.1371/journal.pone.0352326.g001

To tackle the aforementioned critical challenges—insufficient balance between local detail preservation and global illumination consistency, shallow cross-domain feature interaction in existing hybrid architectures, and prevalent color distortion in low-light enhancement—we propose a novel Multi-Scale Hybrid Cross-Domain Interaction Network (MSHCDI-Net) for high-quality low-light image enhancement. As illustrated in Fig 2, the proposed dual-branch framework deeply integrates CNN-based local feature extraction and Transformer-based global context modeling (unlike conventional shallow fusion), with four innovative components targeting specific limitations of existing methods: (1) a Short-Distance Feature Extraction (SDFE) module to refine local textures and alleviate Transformer-induced blurring; (2) a Long-Distance Feature Extraction (LDFE) module to model global illumination and overcome CNN’s limited receptive field; (3) a novel Cross-Domain Feature Fusion (CFF) module to realize deep hierarchical interaction between local and global features; (4) a dedicated Color Restoration (CR) module to mitigate color distortion, an underaddressed issue in LLIE.

thumbnail
Fig 2. The MSHCDI-Net comprises four modules:the Short-Distance Feature Extraction Module (for local feature extraction), the Long-Distance Feature Extraction Module (for global feature extraction), the Cross-Domain Feature Fusion Module (for efficient feature fusion), and the Color Restoration Module (for high-quality color recovery).

https://doi.org/10.1371/journal.pone.0352326.g002

The main contributions of this work are summarized as follows:

  • A novel hybrid framework, MSHCDI-Net, is presented for low-light image enhancement, aiming to address the limited interaction between CNN-based local representations and Transformer-derived global contexts in existing hybrid architectures. A Cross-Domain Feature Fusion (CFF) module is introduced to enable deep, hierarchical, and adaptive cross-domain feature interaction, facilitating effective information exchange and strengthening complementary representation learning.
  • A lightweight Color Restoration (CR) module is further developed to alleviate color distortion commonly observed in low-light enhancement. The module enhances chromatic consistency and color fidelity while introducing negligible computational overhead, thereby improving visual realism and complementing the limitations of current methods.

The remainder of this paper is organized as follows. Section 2 reviews related work on low-light image enhancement. Section 3 presents the proposed method. Section 4 reports experimental results and analysis. Finally, Section 5 concludes the paper.

2. Related works

Low-light image enhancement has long been vital for applications in photography, surveillance, and autonomous systems. Existing methods can be broadly categorized into model-based and data-driven approaches, each with its own strengths and limitations.

Model-based low-light image enhancement methods, such as histogram equalization and gamma correction, enhance dynamic range and contrast by adjusting pixel intensity distribution. However, these methods often introduce visual artifacts or color distortion due to their global and non-adaptive adjustment strategies. Retinex-based methods [15,16] decompose images into illumination and reflectance, providing more natural enhancement. However, their performance is limited by simplified illumination assumptions, which reduces their robustness in complex real-world low-light scenes with spatially non-uniform lighting.

Data-driven Low-light Image Enhancement methods have leveraged deep learning for more adaptive and perceptually consistent enhancement. Retinex-Net [17], KinD [18], and EnlightenGAN [19] demonstrate the power of CNN-based architectures in capturing structural detail and suppressing noise. Nevertheless, the inherent local receptive fields of CNNs restrict their ability to model global illumination consistency, especially under spatially varying illumination, often resulting in uneven enhancement.

To address these issues, Vision Transformers (ViTs) [20] have been introduced for image restoration. Models such as MAE [21], Uformer [10], and Restormer [11] leverage global self-attention to enhance feature propagation and global contextual understanding. However, vanilla Transformer designs often incur high computational costs and may overlook fine textures.

Recent efforts have explored hybrid CNN–Transformer architectures, such as LightingFormer [22], RSTB-DRB [23], and SNR-Net [24]. Although these models introduce cross-domain feature fusion, they often lack deep multi-scale interaction, leaving the full potential of hybrid designs underexplored.

Despite progress, current methods still face challenges in balancing noise suppression, fine-grained local detail preservation, and global illumination consistency in complex real-world low-light scenes. To address these intertwined challenges, our proposed MSHCDI-Net fully integrating CNNs and Transformers through a multi-scale hybrid structure that enhances both local detail and global consistency.

3. The proposed method

To enhance both local texture detail and overall image consistency, this paper proposes MSHCDI-Net, an end-to-end low-light image enhancement (LLIE) model based on a hybrid architecture that integrates Convolutional Neural Networks (CNNs) and Vision Transformers. CNNs automatically learn spatial hierarchical features through multiple convolutional layers, enabling the effective extraction of local image details. In contrast, Transformers utilize self-attention mechanisms to model global dependencies, making them well-suited for capturing long-range contextual information. By leveraging the strengths of both CNNs and Transformers, MSHCDI-Net achieves a favourable balance between computational efficiency and enhancement performance across LLIE tasks. Moreover, this hybrid design facilitates an effective trade-off between latency and accuracy.

The overall architecture of MSHCDI-Net, depicted in Fig 2, comprises four key modules: (1) a Short-Distance Feature Extraction Module, which leverages CNNs to effectively capture local image features; (2) a Long-Distance Feature Extraction Module, which employs a multi-head self-attention mechanism to model global dependencies across the image; (3) a Cross-Domain Feature Fusion Module, which is proposed to efficiently fuse the heterogeneous features and fully exploit the complementary advantages of CNN and Transformer branches; and (4) a Color Restoration Module, responsible for reconstructing high-quality, visually realistic outputs. Detailed descriptions of each module are provided in the following sections.

3.1 Short-Distance Feature Extraction Module (SDFE)

The Short-Distance Feature Extraction Module (SDFE) adopts an optimized UNet [25] structure, as shown in Fig 3. The optimized UNet retains skip connections and the encoder-decoder structure but replaces intermediate linear layers with residual blocks. Each layer in the encoder and decoder consists of a convolution, Batch Normalization (BN), and ReLU activation. The convolution helps capture local features while reducing parameters, contributing to a lightweight network. BN stabilizes the input distribution, accelerates training, and improves generalization. ReLU introduces non-linearity to enable complex mappings and mitigating gradient vanishing.

thumbnail
Fig 3. Short-Distance Feature Extraction Module(SDFE), The SDFE module consists of convolutional layers, adopting skip connections between encoder and decoder and embedding residual blocks in intermediate layers.

https://doi.org/10.1371/journal.pone.0352326.g003

Skip connections transfer features from the encoder to the decoder, preserving spatial information for structural consistency and detail fidelity. The decoder fuses high-level semantic features with low-level details via skip connections, achieving accurate and visually coherent reconstructions. Residual blocks enhance deep feature learning, crucial for recovering subtle visual cues in low-light images. The SDFE module’s operation is defined in Equation 1:

(1)

where D and E represent the decoder and encoder of the UNet, respectively, is the output of the module, and is the input low-light image.

3.2 Long-Distance Feature Extraction Module (LDFE)

As shown in Fig 4, the Long-Distance Feature Extraction Module adopts a U-shaped structure with 10 Transformer blocks to help efficiently capture and process global features. The module consists of a hierarchical encoder and decoder. Initially, the input image is embedded via a convolutional layer, where overlapping patches are generated through a convolutional operation (kernel stride = 1, padding applied). This approach preserves inter-patch continuity, minimizing the loss of local contextual information at boundaries, which is beneficial for maintaining texture and edge continuity in image enhancement tasks.

thumbnail
Fig 4. Long-Distance Feature Extraction Module(LDFE), which integrates Transformers into the U-shaped architecture, allowing each level of the Transformer encoder to share features with the encoder from the SDFE module.

https://doi.org/10.1371/journal.pone.0352326.g004

These patch representations are fed into Transformer blocks based on Vision Transformer (ViT) [20], where we adopt the Transposed self-attention mechanism from Restormer [11].

Compared with vanilla self-attention, windowed self-attention, and non-local attention, Transposed self-attention has three specific advantages for low-light image enhancement:

  1. Computational efficiency: Vanilla self-attention suffers from O(N2C) complexity, which is too heavy for high-resolution low-light images. Transposed self-attention reshapes queries and keys to reduce the complexity to O(NC2), enabling efficient global modeling.
  2. Local-global feature synergy: Window-based attention breaks long-range dependencies and harms illumination consistency. Transposed self-attention retains full global attention while combining local details via convolutions in QKV projection, avoiding over-smoothing.
  3. Attention stability: Non-local attention easily amplifies noise in dark regions. Transposed self-attention uses a scaling factor before Softmax to stabilize attention scores and reduce noise-induced artifacts.

Given the input feature map , we initially generate the query Q, key K, and value V, which integrate local context information.Specifically, we first use the pointwise convolution of to aggregate the pixel – level cross – channel context, followed by depthwise convolution of to encode the channel – level spatial context, denoted as , , . To reduce the computational complexity of the original self – attention, we reshape the projections of the query, key and value to dimensions , , . The attention map, with a size of , is generated via dot-product interaction between and . The calculation process of the attention scores follows the formula below:

(2)

Where controls the magnitude of the dot – product between and and then applies the Softmax function.After obtaining the attention output, we apply a convolution operation and add the result to the input feature map X to obtain the final output .

(3)

Recent research, such as Restormer [11], has shown that enhancing the Transformer’s feed-forward network with a gating mechanism improves performance in image reconstruction tasks. Consequently, each Transformer block integrates a Multi-Layer Perceptron (MLP) with a gating mechanism for feature transformation and nonlinear mapping. Layer Normalization is used to help ensure training stability and accelerate convergence.

3.3 Multi-Scale Cross-Domain Feature Fusion via the LDFE Modules

To help effectively leverage structural and semantic information across multiple spatial scales, we employ a multi-scale feature extraction, fusion, and reconstruction strategy based on two heterogeneous architectures.

Multi-Scale Feature Extraction: The LDFE encoder is composed of hierarchical Transformer blocks. At each level i, features are transformed and then downsampled to reduce spatial resolution while increasing channel dimensionality, enhancing semantic abstraction. In parallel, the SDFE encoder extracts localized features at the same scale via convolutional layers.

Cross-Scale Feature Fusion: As shown in Fig 5, a hierarchical fusion mechanism is employed to integrate global features and local features . These are concatenated along the channel dimension and fused via a convolution:

(4)

where denotes the decoder output at level j, and Iin is the input feature map at level i.

thumbnail
Fig 5. Illustration of the encoding and decoding processes at different levels in the LDFE module.

The encoder-decoder structure hierarchically processes multi-resolution feature maps and fuses global and local features from both the LDFE and SDFE modules.

https://doi.org/10.1371/journal.pone.0352326.g005

Multi-Scale Reconstruction: The decoder adopts a mirror structure corresponding to the encoder. Upsampling modules progressively restore spatial resolution, and fused encoder features are integrated at each level. This design preserves both global structure and local detail. A final convolution projects the reconstructed multi-scale features back to the image domain.

Overall, this strategy enables adaptive balance between structural consistency and texture fidelity, making it highly effective for low-light image enhancement in complex visual environments.

3.4 Cross-Domain Feature Fusion Module(CFF)

As shown in Fig 6, the SDFE module (CNN-based) captures local image details through convolutional kernels, with shallow layers primarily capture low-level features (edges, textures) and deeper layers infer semantic structures. This preserves spatial correspondence and image details. In contrast, the LDFE module, based on the Transformer architecture, models long-range dependencies through self-attention mechanisms. Although it excels at capturing holistic contextual structures, the generated features tend to be more abstract and may lack explicit spatial correspondences.

thumbnail
Fig 6. To gain a more intuitive understanding of the semantic differences between the outputs of the SDFE and LDFE modules, and to assess the fusion effect achieved by the CFF module, we extracted the output features from these modules within the MSHCDI-Net architecture.

https://doi.org/10.1371/journal.pone.0352326.g006

Experimental results indicate noticeable semantic and spatial mismatches between the modules’ outputs. Basic fusion approaches (e.g., concatenation or element-wise addition) often fail to effectively combine their complementary features and may cause misalignment.

To mitigate this issue, we designed an iterative residual network employing convolutions, as depicted in Fig 7.The specific process is presented in the following formula. Here, represents the ReLU activation function, BN represents batch normalization, and represents the input of the residual module.

(5)
thumbnail
Fig 7. The Cross-Domain Feature Fusion Module (CFF) concatenates the feature maps from the LDFE and SDFE modules, followed by five sequential residual blocks comprising 3 × 3 convolutions, which are designed for semantic alignment and feature fusion.

https://doi.org/10.1371/journal.pone.0352326.g007

This network is designed to integrate the global and local semantics of the input image. Through iterative processing by multiple residual blocks, the network gradually alleviates the semantic discrepancies between the outputs of the SDFE and LDFE modules. Each layer’s convolution operations help adjust and align the feature space, thereby facilitating the effective fusion of the two types of features at a higher level.The specific operation process of the CFF module is presented in the following formula. In this formula, n denotes the number of iterations of the residual block.

(6)

By extracting and visualizing the attention distribution maps generated by the CFF module and overlaying them onto output feature maps (Fig 8a8f), we observe that post-fusion feature maps show clearer and more accurate detail restoration compared to pre-fusion states. Prior to fusion, the model’s attention mechanism was confined to local regions for targets such as coffee makers (Fig 8a), chairs (Fig 8b), ping-pong tables (Fig 8c), windows (Fig 8d), castles (Fig 8e), and sculpture heads (Fig 8f), failing to capture the complete object structure. This localized attention limits the holistic feature extraction and global-information utilization for detail enhancement.

thumbnail
Fig 8. Illustrates the visualization of attention maps after being processed by the Cross-Domain Feature Fusion (CFF) module.

Our experimental results unequivocally demonstrate the effectiveness of the CFF module in handling diverse scenes and objects. As shown in the figure, it compares the ground truth (GT), attention maps before processing through the CFF module, and attention maps after processing. This comparison highlights the enhancement achieved by the module in accurately capturing relevant features across different domains.

https://doi.org/10.1371/journal.pone.0352326.g008

The CFF module improves attention mechanisms by expanding focus from local to global scales. Post-fusion attention maps exhibit stronger capability to identify and process semantically correlated image regions. For example, attention in Fig 8a extended to the full coffee maker and contextual surroundings, enabling accurate context capture; Fig 8f showed holistic focus on sculpture heads, improving detail fidelity; and Fig 8c highlighted integrated attention to ping-pong table components (net, boundary lines, legs), enhancing recognition robustness.

In complex scenes, the CFF module also promotes better spatial layout understanding. For instance, in Fig 8b (multi-chair scenes), pre-fusion attention was fragmented across individual chairs, whereas post-fusion attention aligned to row contours, clarifying structural organization. In Fig 8e, castle representations benefited from attention spanning local architectural details (towers, arches) and global structural contexts, enabling effective extraction of complex feature hierarchies.

In summary, the CFF module enhances both local detail recognition and global structure understanding via semantic information fusion, enabling the model to achieve improved accuracy and robustness in complex low-light image enhancement tasks.

3.5 Color Restoration Module(CR)

We introduced a residual structure that is based on the stacking of 4 convolutional layers. As illustrated in Equation (7) and Fig 9, this structure aims to optimize and enhance the color representation of the image.

(7)
thumbnail
Fig 9. The Color Restoration Module (CR) employs four consecutive 1 × 1 convolutional residual blocks to perform color restoration on the feature maps fused by the CFF module.

https://doi.org/10.1371/journal.pone.0352326.g009

The output of the CR module, which serves as the final output of the MSHCDI-Net model, is presented in Equation 8. In this equation, n = 4 indicates that the iteration is carried out 4 times.

(8)

The convolution maintains spatial structure through per-pixel operations without spatial aggregation, making it particularly effective for color recovery by preserving inter-pixel color differences. It further enhances color representation in multi-channel spaces like RGB through adaptive channel weighting via linear cross-channel fusion. In contrast, larger kernels (e.g., ) induce spatial smoothing that, while useful for initial feature extraction, leads to color blurring in high-contrast regions during final recovery stages. Both theoretical analysis and experimental results demonstrate the superior performance of convolutions in color restoration tasks, achieving more precise color recovery and higher-quality image reconstruction. Fig 10 illustrates that employing larger convolution kernels for color recovery induces excessive spatial smoothing, as evidenced by text blurring in the first row and color distortion within the red-boxed regions (second row).

thumbnail
Fig 10. The choice of different convolutional kernel sizes on color recovery.

Results indicate that the use of kernel yields color recovery that is significantly closer to the ground truth. In contrast, employing kernel size results in noticeable color distortion, accompanied by a loss of fine details.

https://doi.org/10.1371/journal.pone.0352326.g010

3.6 Loss function

Since both the L2 and L1 loss functions are point-wise metrics, they tend to produce overly smooth outputs, which may lead to the loss of fine details. To mitigate this issue, the Charbonnier loss [26] and Perceptual loss [27] are incorporated during the training process. The Charbonnier loss, being a differentiable variant of the L1 norm, exhibits strong robustness to outliers (such as noise) and unlike the L2 loss, does not overly penalize large deviations. This property enables the preservation of more intricate image details. In addition, the Perceptual loss emphasizes texture representation, thereby facilitating the generation of sharper and more visually realistic outputs.

(9)

Here, denotes the predicted image and denotes the ground-truth image. Charbonnier Loss introduces a small positive number to avoid numerical instability issues. Since the dataset has been padded, the loss is calculated only for the valid region and is divided by N (the total number of pixels in the valid region) to eliminate imbalances caused by varying sizes of the effective region. This ensures stable gradient calculation during backpropagation, thereby making the training process more balanced and effective.

(10)

n represents the n -th layer’s features in the pre-trained VGG model, and the final complete loss function can be expressed as:

(11)

By combining Charbonnier Loss and Perceptual Loss, the proposed loss function helps enhances the preservation of fine details and improve visual fidelity, while concurrently maintaining training stability.

4. Experiment results

4.1 Datasets and implementation details

We evaluated the proposed method on three commonly used low-light image enhancement benchmarks: LOL-v1, LOL-v2-real, and LOL-v2-synthetic. LOL-v1 contains paired low-light and normal-light images and is widely used for supervised LLIE evaluation. LOL-v2 includes both real and synthetic subsets, where LOL-v2-real reflects real-world low-light degradation, while LOL-v2-synthetic is generated under controlled illumination conditions. These datasets provide different low-light scenarios for evaluating the enhancement performance, robustness, and generalization ability of the proposed method.

In this section, we first describe the experimental settings, including the baseline methods and evaluation metrics. Subsequently, ablation studies are conducted to demonstrate the effectiveness of the proposed model. Finally, extended experiments are carried out for comprehensive evaluation. Readers are invited to view the electronic version of the full-size figures and zoom in on them to better appreciate the differences among images.

4.2 Experimental settings

Our implementation is built upon the PyTorch framework and executed on four NVIDIA GTX 4070 Ti GPUs. To enhance the diversity of the training data, we apply data augmentation techniques, including mirroring and randomly cropping patches from each input image. The proposed MSHCDI-Net is trained using the designed loss functions and optimized with the AdamW optimizer employing a batch size of 4. The initial learning rate is set to 10−4 and progressively reduced following a cosine annealing schedule.

In this section, the proposed algorithm is compared with KinD[18], EnlightenGAN [19], Retinex-Net [17], MIR-Net [14], SNR-Net [24], LLFormer [12], LEDNet [28] and HVI-CIDNet [13]. These methods cover the main LLIE paradigms. Specifically, Retinex-Net, KinD, MIRNet, and SNR-Net are CNN-based approaches; EnlightenGAN is a GAN-based method; LLFormer is a Transformer-based model; and SNR-Net and HVI-CIDNet further represent hybrid architectures combining CNN and Transformer components. This selection enables a comprehensive evaluation across different design philosophies, facilitating a balanced and fair comparison with state-of-the-art LLIE methods.

4.3 Comparisons with different algorithms

Fig 11 presents a comparative analysis on the LOL-v2-synthetic dataset. As shown in the first row, KinD, EnlightenGAN, LLFormer, and LEDNet exhibit insufficient enhancement in low-light regions, with details often appearing blurred. Retinex-Net and SNR-Net, on the other hand, produce results with noticeable color oversaturation. Both the proposed method and HVI-CIDNet achieve superior visual quality; it is noteworthy that both approaches are hybrid models.In the second row, the results indicate that KinD suffers from under-enhancement, while SNR-Net, Retinex-Net, and HVI-CIDNet demonstrate inadequate denoising capabilities, leading to noticeably blurred outputs. In contrast, the proposed method delivers high-quality enhancement across regions of varying brightness. The third row further demonstrates that the proposed method excels in overall brightness restoration, producing results that are more visually consistent with the ground truth (GT) images. In comparison, KinD, SNR-Net, LLFormer, and HVI-CIDNet exhibit obvious deficiencies in recovering appropriate brightness levels

thumbnail
Fig 11. Comparative analysis of low-light image enhancement methods on LOL-v2-synthetic.

From left to right, the images represent the results of KinD, EnlightenGAN, Retinex-Net, SNR-Net, LLFormer, LEDNet, HVI-CIDNet and our proposed method, respectively. The last column shows the ground truth.

https://doi.org/10.1371/journal.pone.0352326.g011

Fig 12 presents a comprehensive comparison of our method against several state-of-the-art approaches on the LOL-v2-real dataset. In the first row, as highlighted by red bounding boxes, both KinD and EnlightenGAN produce noticeable artifacts in these challenging areas. Retinex-Net exhibits relatively weak performance in high-contrast regions, resulting in an obvious loss of detail. SNR-Net, LEDNet, and HVI-CIDNet exhibit minor detail loss, while HVI-CIDNet, in particular, shows insufficient brightness restoration in overexposed regions marked with blue boxes. Although LLFormer achieves reasonable brightness recovery, it introduces visible visual artifacts. In contrast, our method delivers more faithful reconstructions. The second row illustrates overall brightness and color restoration performance. Visually, our method aligns most closely with the GT images. In the context of local color restoration (highlighted in red boxes), KinD, EnlightenGAN, SNR-Net, and HVI-CIDNet exhibit inadequate color recovery, while Retinex-Net and LEDNet tend to over-enhance local color information. In the third row, we evaluate performance in scenes with pronounced brightness transitions under real-world conditions. KinD, Retinex-Net, and SNR-Net yield distorted reconstructions in both the sky and building regions. LEDNet cannot effectively recover overexposed areas and does not sufficiently enhance darker regions. EnlightenGAN introduces significant color shifts across the entire image. HVI-CIDNet generally underperforms in brightness recovery and struggles to capture the natural gradient of illumination. The fourth row focuses on the restoration of local details, indicated by red boxes. KinD, EnlightenGAN, and Retinex-Net produce unnatural enhancements and noticeable detail loss. Other methods also struggle with texture restoration, with SNR-Net and HVI-CIDNet exhibiting the relatively serious loss of fine structures. In comparison, the proposed method performs well in preserving and recovering local textures and structural details, demonstrating stable performance in terms of both visual fidelity and structural consistency.

thumbnail
Fig 12. Comparative analysis of low-light image enhancement methods using the LOL-v2-real dataset.

From left to right, the images represent the results of KinD, EnlightenGAN, Retinex-Net, SNR-Net, LLFormer, LEDNet, HVI-CIDNet and our proposed method, respectively. The last column shows the ground truth.

https://doi.org/10.1371/journal.pone.0352326.g012

In addition to subjective evaluation, we compare the proposed MSHCDI-Net against prevailing methods on LOL-v1 [17] and LOL-v2 [29]. PSNR and SSIM are employed to quantitatively assess the performance of the algorithms. As shown in Table 1, the proposed method achieves the best PSNR and SSIM on LOL-v1. For LOL-v2-real, it obtains the best SSIM and the second-best PSNR, while for LOL-v2-synthetic, it ranks second in both metrics. We can achieve the highest average PSNR and SSIM across the three datasets. This indicates that the proposed method provides more balanced and consistent performance under different low-light conditions. In addition, no-reference image quality metrics, namely Natural Image Quality Evaluator (NIQE) [30] and the Perceptual Image Quality Evaluator (PIQE) [31], are also adopted to further evaluate the perceptual quality of the enhanced images. As illustrated in Table 2, the proposed method continues to demonstrate competitive performance across these metrics. This balanced performance can be attributed to the proposed hybrid CNN–Transformer architecture and cross-domain feature fusion strategy, which jointly enhance local detail preservation and global illumination consistency.

thumbnail
Table 1. Quantitative comparison on LOL datasets. Optimal metrics are bolded, and suboptimal metrics are underlined.

https://doi.org/10.1371/journal.pone.0352326.t001

thumbnail
Table 2. Evaluation of no-reference metrics. Optimal metrics are bolded, and suboptimal metrics are underlined.

https://doi.org/10.1371/journal.pone.0352326.t002

To verify the effectiveness of the proposed MSHCDI-Net, we analyzed the average growth rates and reduction rates of key quantitative metrics (PSNR, SSIM, NIQE, PIQE), and the results are summarized in Table 3. Table 3 presents the relative improvement rates of MSHCDI-Net compared with all existing comparative methods, which are calculated based on the data obtained from Tables 1 and 2. The experimental results confirm the effectiveness of our proposed design: benefiting from the dual-branch architecture of MSHCDI-Net, it achieves obvious improvements compared with the traditional single-branch architecture. Specifically, it realizes a 42.05% increase in PSNR and a 30.79% increase in SSIM, as well as a 20.21% reduction in NIQE and a 71.88% reduction in PIQE, compared with KinD with a CNN architecture; compared with LLFormer with a Transformer architecture, it achieves an 8.13% increase in PSNR and a 7.23% increase in SSIM, as well as an 18.69% reduction in NIQE and a 5.15% reduction in PIQE; meanwhile, relying on the deep cross-domain feature fusion capability of MSHCDI-Net, it achieves a 6.20% increase in PSNR and a 2.22% increase in SSIM, as well as a 10.79% reduction in NIQE and a 45.93% reduction in PIQE, compared with SNR-Net. Although HVI-CIDNet shows strong performance on several full-reference metrics in Table 1; however, its no-reference results in Table 2 are not as competitive as those of MSHCDI-Net. In comparison, MSHCDI-Net achieves the best average PSNR and SSIM, as well as lower average NIQE and PIQE than HVI-CIDNet. This further suggests that the proposed method provides a more balanced performance in terms of reconstruction accuracy and perceptual quality.

thumbnail
Table 3. Relative improvement (%) of the proposed method compared with existing methods based on the average metrics reported in Tables 1 and 2. Positive values indicate improvement, while negative values indicate degradation.

https://doi.org/10.1371/journal.pone.0352326.t003

4.4 Ablation study of key components

The proposed framework comprises three key components: 1) Cross-Domain Feature Fusion (CFF) module, 2) Color Restoration (CR) module, and 3) Long-Distance Feature Extraction (LDFE) module. To verify the effectiveness of each key module, ablation experiments are conducted by removing one module at a time, and the results are presented in Table 4.

thumbnail
Table 4. Performance comparison of different models. Optimal metrics are bolded, and suboptimal metrics are underlined.

https://doi.org/10.1371/journal.pone.0352326.t004

As shown in Table 4, the complete MSHCDI-Net achieves the optimal performance across all metrics (PSNR: 22.24, SSIM: 0.848, NIQE: 11.35, PIQE: 4.06), which is significantly superior to the variants with any single module removed. Specifically, the network realizes effective multi-scale feature interaction through the combined operation of the LDFE module (global) and the SDFE module (local); the removal of LDFE (w/o LDEF) leads to the lowest PSNR (19.45) and SSIM (0.766), confirming its critical role in global feature extraction. The CFF module effectively fuses global and local information, and its absence (w/o CFF) results in reduced PSNR (19.58) and SSIM (0.782), demonstrating the necessity of cross-domain fusion for feature complementarity. The CR module enhances low-light image quality through robust color restoration, and the variant without CR (w/o CR) shows worse color-related performance, as evidenced by the higher NIQE (12.67) compared to the complete model.

Specifically, the CFF module captures and fuses fine-grained local details with a broader global context, which explains the performance degradation when it is removed. Meanwhile, the CR module recovers natural and accurate colors that are degraded under low-light conditions. As illustrated in Fig 13, the inclusion of the CR module results in markedly improved color restoration, which is particularly evident in the red-boxed regions encompassing the shared bicycle (blue box) and the electric bicycle. In the second row of the figure, the CR module enables the network to reconstruct more vivid and natural colors, which is consistent with the optimal PIQE (4.06) of the complete model in Table 4, further verifying the effectiveness of the CR module.

thumbnail
Fig 13. The comparison between the results with CR and without the CR module, as illustrated in the magnified regions, the model with CR enables a more effective preservation of the image’s color information.

https://doi.org/10.1371/journal.pone.0352326.g013

Furthermore, a systematic ablation study on the perceptual loss weight () was conducted on the LOL-v2 dataset, with three settings: (no perceptual loss), (over-weighted), and (final setting; results in Table 5). Unlike existing fixed-weight strategies, we determined the suitable via ablation to balance objective metrics (PSNR/SSIM), subjective visual perception, and training stability, addressing the trade-off bias between objective fidelity and perceptual quality in prior work.

thumbnail
Table 5. Ablation study on perceptual loss weight on the LOL-v2 dataset. Optimal metrics are bolded, and suboptimal metrics are underlined.

https://doi.org/10.1371/journal.pone.0352326.t005

Experimental results show achieves the best overall PSNR/SSIM performance, outperforming and . While improves no-reference perceptual metrics (lower NIQE/PIQE), it causes significant drops in PSNR/SSIM—attributed to overemphasis on visual texture perception at the expense of pixel-level fidelity, deviating from pixel reconstruction goals. Additionally, leads to unstable training due to imbalanced loss function gradients, disrupting smooth convergence and final performance. This validates the rationality of , offering a reference for loss function design in LLIE. In summary, an appropriate perceptual loss weight can balance the objective metrics and visual perception effect while ensuring stable training.

It should be noted that in Chapter 3 of this study, experiments such as feature visualization (Fig 6), attention map analysis (Fig 8), and convolutional kernel size optimization (Fig 10) are conducted to further verify the effectiveness and design rationality of the proposed modules. These experiments complement the ablation experiments in this section and jointly support the rationality and effectiveness of the proposed framework.

Beyond the ablation analysis of key components and loss function parameters, we further analyze the computational complexity and inference efficiency of the proposed model to verify its practicality. We attempt to balance efficiency and performance via a patch-based processing strategy while maintaining acceptable enhancement performance, aiming to alleviate the common issue that high-performance models tend to have high computational complexity and poor practicality.

To verify the practicality of the proposed model, we analyze its computational complexity and inference efficiency in detail. All experiments are conducted on a single NVIDIA RTX 4070 Ti GPU with 12 GB of video memory. A patch-based processing strategy is adopted, where the core patch size is set to with an overlap of 200, to accommodate the input image size of . The proposed model contains 21.74 M trainable parameters, and the computational complexity for a patch is 72.12 GFLOPs. Such a patch-based inference strategy effectively alleviates the efficiency pressure caused by the high computational load. Experimental results demonstrate that the average inference time for a single low-light image is merely 0.3620 seconds. In summary, the model achieves a reasonable trade-off between performance, parameter scale, and computational complexity, which not only reflects the technical innovation of this work but also guarantees its practical application value. In future work, we will further optimize the lightweight design of the model to facilitate its wider deployment.

4.5 Generalization of the proposed method

Data-driven algorithms typically exhibit a certain dependency on training samples. To evaluate the generalization capability of the proposed method, we directly tested on 83 randomly collected low-light images from natural scenes. The corresponding results are illustrated in Fig 14. In the first row, the output of KinD displays obvious noise, while ther comparative methods demonstrate various limitations. In the second row, evident purple artifacts can be observed along the edges in the results produced by EnlightenGAN, LLFormer, SNR-Net, and LEDNet, as indicated by the red boxes. Additionally, KinD and HVI-CIDNet suffer from insufficient denoising and inadequate brightness enhancement, respectively. In the third row, KinD, EnlightenGAN, and LLFormer produce noticeable noise and artifacts in the enhanced images, while LEDNet and HVI-CIDNet fail to adequately restore brightness. In contrast, the proposed method delivers stable enhancement performance across all tested scenes.

thumbnail
Fig 14. A comparison of generalization capability is presented by testing datasets from different domains.

As illustrated in the enlarged region, the results of SNR-Net exhibit a significant amplification of noise. In contrast, the enhancement effects of LLFormer and LEDNet are not particularly pronounced, with the results appearing noticeably darker. The proposed algorithm, however, yields results that are much closer to the ground truth.

https://doi.org/10.1371/journal.pone.0352326.g014

4.6 Limitation of the proposed framework

The proposed method demonstrates clear advantages in contrast enhancement and detail preservation. However, glow artifacts are still present, as illustrated in Fig 15. This issue has been largely overlooked in the current low-light image enhancement (LLIE) literature. Notably, the artifacts may pose significant safety risks when LLIE techniques are deployed in safety-critical applications, such as autonomous robotic navigation and self-driving vehicles. Addressing this limitation will be a key focus of our future research.

thumbnail
Fig 15. In the results presented in the figure, glow artifacts are clearly visible in the red – framed area, and there are also a small number of black artifacts around it.

https://doi.org/10.1371/journal.pone.0352326.g015

5. Conclusion remarks and discussion

In this paper, a novel low-light image enhancement network is proposed, which integrates Convolutional Neural Networks (CNNs) with Transformer architectures. Specifically, MSHCDI-Net consists of a Short-Distance Feature Extraction (SDFE) module and a Long-Distance Feature Extraction (LDFE) module, enabling superior restoration of global and local illumination characteristics. Additionally, the Cross-Domain Feature Fusion (CFF) module reduces semantic discrepancies between the outputs of the two feature extraction modules through an iterative residual framework, thereby improving overall image quality. The Color Restoration (CR) module is also introduced to enhance color fidelity, resulting in more natural and visually pleasing outcomes. Experimental results show that MSHCDI-Net alleviates the limitations of traditional approaches in capturing long-range dependencies and recovering fine details by leveraging the strengths of both CNNs and Transformers.

References

  1. 1. Wu J, Ding B, Zhang B, Ding J. A Retinex-based network for image enhancement in low-light environments. PLoS One. 2024;19(5):e0303696. pmid:38787895
  2. 2. Li C, Zhu J, Bi L, Zhang W, Liu Y. A low-light image enhancement method with brightness balance and detail preservation. PLoS One. 2022;17(5):e0262478. pmid:35639677
  3. 3. Eramian M, Mould D. Histogram equalization using neighborhood metrics. The 2nd Canadian Conference on Computer and Robot Vision (CRV’05). IEEE; 2005. p. 397-–404.
  4. 4. Land EH. The retinex theory of color vision. Sci Am. 1977;237(6):108–28. pmid:929159
  5. 5. Zhou M, Leng H, Fang B, Xiang T, Wei X, Jia W. Low-light image enhancement via a frequency-based model with structure and texture decomposition. ACM Trans Multimedia Comput Commun Appl. 2023;19(6):1–23.
  6. 6. Zheng C, Yao Y, Ying W, Wu S. Single image de-raining by multi-scale Fourier Transform network. PLoS One. 2025;20(3):e0315146. pmid:40100892
  7. 7. Chen C, Chen Q, Xu J, Koltun V. Learning to see in the dark. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2018. p. 3291–300.
  8. 8. Li Y, Wei X, Liao X, Zhao Y, Jia F, Zhuang X, et al. A deep retinex-based low-light enhancement network fusing rich intrinsic prior information. ACM Trans Multimedia Comput Commun Appl. 2024;20(11):1–23.
  9. 9. Vaswani A, Shazeer N, Parmar N, Uszkoreit J, Jones L, Gomez AN. Attention is all you need. Adv Neural Inf Process Syst. 2017;30.
  10. 10. Wang Z, Cun X, Bao J, Zhou W, Liu J, Li H. Uformer: A general u-shaped transformer for image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2022. p. 17683–93.
  11. 11. Zamir SW, Arora A, Khan S, Hayat M, Khan FS, Yang MH. Restormer: efficient transformer for high-resolution image restoration. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR); 2022. p. 5728–39.
  12. 12. Wang T, Zhang K, Shen T, Luo W, Stenger B, Lu T. Ultra-high-definition low-light image enhancement: a benchmark and transformer-based method. AAAI. 2023;37(3):2654–62.
  13. 13. Yan Q, Feng Y, Zhang C, Pang G, Shi K, Wu P, et al. Hvi: a new color space for low-light image enhancement. Proceedings of the Computer Vision and Pattern Recognition Conference; 2025. p. 5678–87.
  14. 14. Zamir SW, Arora A, Khan S, Hayat M, Khan FS, Yang MH, et al. Learning enriched features for real image restoration and enhancement. In: Computer Vision–ECCV 2020: 16th European Conference, Glasgow, UK, 2020 Aug 23–28, Proceedings, Part XXV 16. Springer; 2020. p. 492–511.
  15. 15. Jobson DJ, Rahman Z, Woodell GA. Properties and performance of a center/surround retinex. IEEE Trans Image Process. 1997;6(3):451–62. pmid:18282940
  16. 16. Jobson DJ, Rahman Z, Woodell GA. A multiscale retinex for bridging the gap between color images and the human observation of scenes. IEEE Trans Image Process. 1997;6(7):965–76. pmid:18282987
  17. 17. Wei C, Wang W, Yang W, Liu J. Deep retinex decomposition for low-light enhancement. arXiv:180804560 [Preprint]. 2018.
  18. 18. Zhang Y, Zhang J, Guo X. Kindling the darkness: a practical low-light image enhancer. In: Proceedings of the 27th ACM International Conference on Multimedia; 2019. p. 1632–40.
  19. 19. Jiang Y, Gong X, Liu D, Cheng Y, Fang C, Shen X, et al. EnlightenGAN: deep light enhancement without paired supervision. IEEE Trans Image Process. 2021;30:2340–9. pmid:33481709
  20. 20. Dosovitskiy A, Beyer L, Kolesnikov A, Weissenborn D, Zhai X, Unterthiner T, et al. An image is worth 16x16 words: transformers for image recognition at scale. arXiv:201011929 [Preprint]. 2020.
  21. 21. He K, Chen X, Xie S, Li Y, Dollár P, Girshick R. Masked autoencoders are scalable vision learners. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2022. p. 16000–9.
  22. 22. Bi C, Qian W, Cao J, Wang X. LightingFormer: transformer-CNN hybrid network for low-light image enhancement. Comput Graph. 2024;124:104089.
  23. 23. Xu L, Hu C, Zhang B, Wu F, Cai Z. Swin transformer and ResNet based deep networks for low-light image enhancement. Multimed Tools Appl. 2023;83(9):26621–42.
  24. 24. Xu X, Wang R, Fu CW, Jia J. Snr-aware low-light image enhancement. Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition; 2022. p. 17714–24.
  25. 25. Ronneberger O, Fischer P, Brox T. U-net: convolutional networks for biomedical image segmentation. Medical Image Computing and Computer-assisted Intervention–MICCAI 2015: 18th International Conference, Munich, Germany, 2025 Oct 5–9, proceedings, part III 18. Springer; 2015. p. 234–41.
  26. 26. Lai WS, Huang JB, Ahuja N, Yang MH. Deep laplacian pyramid networks for fast and accurate super-resolution. Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition; 2017. p. 624–32.
  27. 27. Johnson J, Alahi A, Fei-Fei L. Perceptual losses for real-time style transfer and super-resolution. Computer Vision–ECCV 2016: 14th European Conference, Amsterdam, The Netherlands, 2016 Oct 11–14, 2016, Proceedings, Part II 14. Springer; 2016. p. 694–711.
  28. 28. Zhou S, Li C, Change Loy C. Lednet: Joint low-light enhancement and deblurring in the dark. European Conference on Computer Vision. Springer; 2022. p. 573–89.
  29. 29. Yang W, Wang W, Huang H, Wang S, Liu J. Sparse gradient regularized deep retinex network for robust low-light image enhancement. IEEE Trans Image Process. 2021;30:2072–86. pmid:33460379
  30. 30. Mittal A, Soundararajan R, Bovik AC. Making a “completely blind” image quality analyzer. IEEE Signal Process Lett. 2013;20(3):209–12.
  31. 31. Venkatanath N, Praneeth D, Bh MC, Channappayya SS, Medasani SS. Blind image quality evaluation using perception based features. 2015 Twenty First National Conference on Communications (NCC). IEEE; 2015. p. 1–6.