Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Underwater multi-sensor information fusion for salient object detection

  • Yan Mou,

    Roles Software, Validation, Visualization, Writing – original draft

    Affiliation School of Computer Science and Technology, Shandong Technology and Business University, Yantai, Shandong, China

  • Zhaolong Gao ,

    Roles Conceptualization, Formal analysis, Methodology, Validation

    gaozl@sdtbu.edu.cn

    Affiliation School of Computer Science and Technology, Shandong Technology and Business University, Yantai, Shandong, China

  • Jinjiang Li

    Roles Formal analysis, Resources, Validation

    Affiliation School of Computer Science and Technology, Shandong Technology and Business University, Yantai, Shandong, China

Abstract

Underwater salient object detection is a critical task in computer vision, relying heavily on data from underwater sensors, with wide-ranging applications in object tracking, content-aware editing, and object recognition. To tackle the challenges inherent in underwater multimodal information fusion, this paper introduces a novel underwater salient object detection framework based on an information cross-fusion network. The proposed approach integrates a cross-attention feature injection module and an information embedding module to facilitate efficient multimodal feature aggregation and refinement across both channel and spatial dimensions. By modeling the complementarity between RGB and depth data at global and local scales, these modules enhance the representation of salient regions while effectively suppressing background noise. Furthermore, the architecture employs multi-level and multimodal information fusion, which mitigates the effects of depth-related noise and reduces uncertainty in predictions. Extensive experiments conducted on multiple underwater datasets demonstrate that the proposed method achieves superior performance compared to state-of-the-art approaches, highlighting its efficacy in multimodal feature integration and salient object detection.

Introduction

Underwater salient object detection aims to identify the most conspicuous objects or regions in underwater images [13]. Underwater salient object detection faces unique challenges, including light attenuation, color distortion, water scattering, and the blurring of object shapes and textures [4]. Meanwhile, the reliance on data from underwater sensors, such as RGB cameras and depth sensors, introduces complexities related to sensor noise and modality misalignment. Effectively addressing these challenges requires robust fusion techniques to integrate information from multi-sensor.

With the advancement of deep learning techniques, RGB-based underwater object detection has achieved improvements in both accuracy and speed [57]. With the advancement of data-driven approaches, the construction of the USOD10K dataset —the first large-scale underwater RGB-D benchmark—has provided a solid foundation for training robust models across diverse and complex scenarios. Building upon this, researchers have explored more sophisticated fusion architectures. For instance, Wang et al. proposed [8], which utilizes a hierarchical cross-modality attention network to effectively suppress underwater noise and generate more accurate saliency maps by refining multi-modal interactions. To address the issue of poor visibility, [9] introduced the FocusAugment model, which leverages blurriness guidance to differentiate between multi-focus and low-focus regions, thereby enhancing the diversity of training samples. Furthermore, late-breaking studies have shifted towards addressing extreme underwater degradation. Recent models such as [10] employ a cross-scale interaction strategy to maintain boundary integrity under severe light attenuation. The method proposed in [11] optimizes multimodal feature interaction and enhancement through a two-stage training strategy. It further introduces a cross-scale learning strategy to promote coarse-to-fine feature fusion, thereby alleviating indistinct object boundaries in underwater vision tasks. By incorporating these hierarchical and attention-based strategies, contemporary methods have significantly reduced the uncertainty inherent in underwater multi-sensor data. However, optical distortions, water patterns, and the lack of geometric information limit the practical applications of RGB-based methods [12,13]. Incorporating depth information into the underwater object detection process has proven to be an effective solution [1416]. Depth images, compared to RGB images, provide valuable information about object shapes, depths, and other geometric features [1720]. These geometric features are particularly useful in underwater scenarios, as they help address occlusion issues and low visibility. By combining complementary information from depth and RGB images, more comprehensive underwater object detection can be achieved [2129].

Despite its advantages, fully leveraging the complementary nature of RGB and depth images remains a challenging task due to their inherent differences [3035]. Additionally, depth images may contain substantial noise due to the limited detection range and imaging conditions of depth cameras. [3638] Traditional methods primarily focus on effectively fusing multimodal information using dual-branch architectures to extract RGB and depth image features separately [3942]. While these approaches provide solid solutions for multimodal information fusion, they struggle to ensure the effective alignment of RGB and depth information [4346], especially in complex underwater environments. Attempts to reduce sensitivity to depth information have been made, but implicit interactions between RGB features and depth information often lead to reduced model efficiency [4751]. To summarize, contemporary underwater RGB-D fusion frameworks are hindered by three major challenges. First, underwater depth maps often suffer from quality degradation caused by backscattering and sensor limitations, reducing the reliability of cross-modal guidance. Second, significant modality discrepancies between RGB and depth images introduce severe spatial and channel-wise alignment ambiguity, limiting effective information interaction. Third, existing attention mechanisms generally compress either spatial or channel dimensions, leading to cross-dimensional context loss and insufficient modeling of dense global correlations required for accurate boundary perception.

In this paper, we propose an Information Cross-Fusion Network (ICFN) for multimodal fusion in underwater object detection. Our model introduces cross-attention feature injection (CAFI) and information embedding (IEM) modules to achieve significant improvements in RGB and depth information fusion. Specifically, CAFI module precisely calibrates the features of different modalities at spatial and channel levels, fully leveraging the complementary nature of modalities. Moreover, IEM module combines channel attention and spatial attention to efficiently encode global features and support multi-scale learning. This design enhances the network’s robustness against depth noise while significantly improving the accuracy of feature alignment and fusion. The main contributions of this paper are as follows:

  1. We present an information cross-fusion network for underwater object detection, which utilizes a dual-branch architecture to capture multi-modal information while effectively mitigating the inherent noise in depth images.
  2. The proposed information embedding module employs a dual attention mechanism, interleaving spatial and channel attention, to extract critical features.
  3. The cross-attention feature injection module facilitates the effective integration of RGB and depth features through global pooling.

Proposed method

Architecture overview

We propose a CAFI and an IEM to extract and integrate salient cues from RGB and depth images. These modules are strategically embedded across multiple scales within the architecture to ensure robust feature fusion and refinement. As shown in Fig 1, the proposed framework comprises three core components. The dual-branch encoder independently extracts features from RGB and depth modalities, with ResNet50 serving as the backbone network (Fig 1(a)). The CAFI (Fig 1(e)) facilitates precise feature alignment and interaction across modalities, mitigating misalignment issues while enhancing the complementary fusion of RGB and depth features. Meanwhile, the IEM (Fig 1(b)) captures multi-level attention features, preserving both spatial and channel dependencies, and seamlessly integrates them with the initial feature representations to improve segmentation accuracy.

thumbnail
Fig 1. The overall framework of our proposed ICFN model.

(a) Overall architecture. (b) IEM. (c) Decoding module. (d) Residual module. (e) CAFI.

https://doi.org/10.1371/journal.pone.0354804.g001

Cross-attention feature injection module

While RGB and depth images have the potential to complement each other and boost feature representation in various tasks, the inherent noise in depth maps, caused by light scattering, water turbidity, and sensor limitations, can negatively impact network performance when directly fused with RGB features. To mitigate these challenges, we propose a CAFI to enable effective interaction between multimodal features, as illustrated in Fig 1(e). Unlike conventional global average pooling that collapses the entire spatial distribution into a single descriptor, the proposed directional pooling strategy preserves anisotropic structural responses along horizontal and vertical directions. Since underwater backscattering noise is typically locally distributed and spatially inconsistent, directional average pooling statistically suppresses these high-frequency perturbations while maintaining long-range structural continuity of salient objects. Furthermore, the CAFI does not rely solely on pooled depth features. Instead, RGB features with clearer structural boundaries are jointly injected through cross-modal fusion and recalibrated using a convolution. This process enables the network to recover object boundary consistency and compensate for the potential over-smoothing effect introduced by average pooling, thereby achieving more robust multimodal feature interaction under underwater degradation.

This module performs one-dimensional feature encoding to aggregate information along both horizontal and vertical dimensions. By doing so, it captures long-range dependencies across spatial dimensions, facilitating precise localization of key objects. Specifically, given the RGB feature map and the depth feature map , we utilize an average pooling operation to encode and align features along horizontal and vertical axes, respectively:

(1)

where, and refer to the average pooling operations applied along the vertical and horizontal dimensions, respectively. To clarify, the feature map is generated by aggregating information along the vertical dimension (resulting in H = 1), while is obtained by aggregating along the horizontal dimension (W = 1). Once these directional features are extracted, we combine all four features and process them through a convolutional layer to produce the final output representation:

(2)

where, signifies the concatenation operation along the spatial axis, while denotes the resulting spatial feature map.

Information embedding module

Existing attention mechanisms often compress spatial or channel dimensions, potentially leading to the loss of contextual information. Furthermore, isolating the learning of spatial or channel attention without considering their interdependence limits the model’s capacity for feature representation. To overcome these challenges, we introduce an IEM that integrates spatial and channel attention directly into multimodal feature maps, producing attention features that match the original feature map dimensions. As illustrated in Fig 1(b), this module incorporates two complementary mechanisms: spatially embedded channel attention and channel-embedded spatial attention. By cross-learning these two attention types, the module effectively combines spatial and channel encodings to harness their strengths for improved performance. Moreover, the proposed module enables simultaneous computation of spatial and channel attention without collapsing one dimension to accommodate the other.

In traditional channel attention mechanisms, spatial information is often compressed using global average pooling or global max pooling. However, this compression approach limits the ability to represent spatial dimensions comprehensively, resulting in suboptimal feature modeling. To address this limitation, we propose integrating spatial attention into channel attention for enhanced global context modeling. As shown in Fig 1(b), the input multimodal feature is first processed through two convolutional layers, producing two feature maps, and , both with dimensions . The dimensions of are reshaped to , while undergoes transformation into a single-channel feature map via a convolution. Subsequently, the features are normalized using the Softmax function, and a matrix multiplication is performed between and to derive the spatial embedding matrix, formally expressed as:

(3)

The resulting feature map is then processed through three sequential convolutional layers to refine its channel-wise representation. To summarize, the operations in the channel attention branch can be formally represented as:

(4)

where, represents the Sigmoid activation function. From Equation (3), it can be observed that the channel attention branch output integrates and . Unlike traditional methods that directly compress spatial information, we abstract spatial information into a feature matrix, enabling it to be seamlessly incorporated into the channel attention map through a learnable process.

In the spatial attention branch, the input feature is first fed into two convolutional layers, producing two feature maps: and . The feature map is then reshaped to , while undergoes global average pooling and global max pooling to extract spatial information. The resulting pooled features are refined using an MLP and subsequently combined via element-wise addition. Finally, a convolution is applied to fuse the features derived from the different pooling strategies. The computation can be formally expressed as:

(5)

where denotes the channel-wise feature descriptor. To normalize to the range [0,1], we employ the Softmax function.

The channel information embedding matrix is then obtained via matrix multiplication:

(6)

where is reshaped from the original feature map. Prior to matrix multiplication, is implicitly flattened along the channel dimension. The resulting feature encodes the aggregated channel information.

The reshaped feature map has dimensions . To enhance spatial attention, we further include features derived from global average pooling (GAP) and global max pooling (GMP), denoted as and , respectively, with their channel dimensions reduced to a single channel. These features are then fused using a convolutional layer, and the final spatial attention map is obtained by applying the Sigmoid activation function. The overall computation is formally represented as:

(7)

To compress and learn features across multiple dimensions, we utilize convolutional layers. However, as global pooling inherently discards significant spatial information, we integrate and to restore and complement the lost spatial context. As outlined in Equations (6) and (7), we extract global channel-level contextual information and inject channel attention features into the spatial attention map at each location, leveraging dense global correlations to merge the feature vectors across channels.

By uniting the outputs of the two branches, the module provides a richer and more holistic set of attention features, which significantly improves segmentation accuracy.

(8)

The feature map is forwarded to the decoder via skip connections. Simultaneously, is fused with and and then propagated back to the respective encoders, emphasizing critical features for enhanced representation.

(9)

Loss function

To enhance multi-scale feature learning and facilitate stable optimization, we employ a deep supervision strategy by generating four saliency maps from different decoder stages, as illustrated in Fig 1(a). The overall training objective is defined as:

(10)

where denotes the weight for each stage. Following common practice, we set for all stages. represents the discrepancy between the i-th prediction and the ground truth. For each stage, we combine the Binary Cross-Entropy (BCE) loss and the Intersection over Union (IoU) loss:

(11)

where denotes the sigmoid-normalized saliency prediction from the i-th stage and is the corresponding ground truth. The pixel-wise BCE loss is defined as:

(12)

where is a small constant to avoid numerical instability. To further enhance structural consistency, we adopt the IoU loss to measure the global overlap between prediction and ground truth:

(13)

By integrating these two complementary terms, the proposed loss function effectively balances pixel-wise accuracy and global structural consistency, enabling the network to capture both fine-grained details and coherent object-level structures.

Experiments

Dataset

The USOD10K dataset is a large-scale benchmark tailored for underwater salient object detection, consisting of 10,255 underwater images spanning 12 distinct underwater scenarios and 20 salient object categories. These scenarios cover diverse underwater conditions, including varying levels of turbidity, illumination, and object occlusion, reflecting real-world complexities. The inclusion of 20 object categories, ranging from marine organisms to man-made structures, ensures a broad coverage of salient object types typically encountered underwater. Each image is paired with its corresponding depth map and boundary annotations, offering a multimodal perspective that supports robust feature learning and performance evaluation.

Implementation details

Our experiments were conducted on the USOD10K dataset. During training, RGB and depth image pairs were randomly cropped into patches of size . Parameter updates were performed using the Adam optimizer with a batch size of 4 and an initial learning rate of . The learning rate was progressively reduced using a cosine decay strategy, reaching a minimum of by the end of training. For a fair comparison, all deep learning-based methods were retrained on the USOD10K dataset under their default configurations, and results were evaluated using a unified evaluation framework.

Evaluation metrics

To comprehensively evaluate model performance, we employ the following four key metrics. Structural Similarity Measure () measures the structural resemblance between the predicted segmentation map and the ground truth by combining luminance, contrast, and structural components.

(14)

where, and represent the object-aware and region-aware structural similarity, respectively, with set to 0.5.

The weighted F-measure () balances precision and recall by introducing a weighting factor, effectively mitigating the impact of class imbalance within the dataset.

(15)

where, represents the effectiveness of the detection, denotes the weighted precision, and denotes the weighted recall.

Adaptive E-measure () captures both fine-grained pixel-level details and high-level image-level consistency.

(16)

where, h and w represent the height and width of the segmented result image, respectively. is the enhanced alignment matrix.

Mean Absolute Error (MAE) offering an intuitive reflection of prediction deviations and the model’s overall error magnitude.

(17)

where, represents the ground truth, and represents the predicted value.

Experimental results

Comparison with SOTA method.

We conducted a comprehensive comparison of our proposed method against 16 state-of-the-art methods. Both quantitative evaluation and qualitative analysis consistently highlight the superior performance of our approach. (F3Net [52], DANet [53], DASNet [54], BTSNet [21], MFNet [39], HAINet [55], D3Net [56], PSGLoss [57], CSNet [12], TCUSOD [58], CrossFuse [1], LESOD [59], HENet [60], MAGNet [61], CATNet [62], CPNet [63]).

As shown in Table 1, our method achieves the best performance on the and the , underscoring its ability to capture both global image structure and fine-grained details. This is primarily due to the introduction of a cross-fusion attention mechanism, which dynamically emphasizes salient object regions while suppressing background noise. Such a mechanism proves particularly effective in complex underwater conditions, addressing issues like uneven illumination, occlusions, and boundary ambiguity. For the , our method outperforms approaches like CSNet, highlighting its strength in achieving a precise balance between precision and recall. Additionally, the integration of depth information significantly enhances the model’s robustness in detecting underwater salient objects, contributing to its superior Mean Absolute Error (MAE) performance on the USOD10K dataset.

thumbnail
Table 1. Performance comparison on USOD10k. The best indicator is shown in bold.

https://doi.org/10.1371/journal.pone.0354804.t001

Fig 2 illustrates the qualitative performance of our proposed method compared with various cutting-edge approaches on the USOD10K dataset. The results clearly demonstrate that our method consistently outperforms others across diverse underwater scenes and salient object categories. Our method’s segmentation outputs exhibit a high degree of agreement with the ground truth (GT), particularly excelling in target region completeness and boundary precision. For instance, our method effectively preserves the integrity of object regions while minimizing omissions and overflows (as seen in the first and second rows of Fig 2). In more challenging underwater conditions, the proposed method produces smoother and more precise object boundaries, significantly improving the retention of fine-grained details (Fig 2, third and fourth rows). In contrast, methods like PSGLoss and CrossFusion struggle to suppress background noise, resulting in confusion between target objects and the background. By leveraging advanced feature extraction and deep multimodal information fusion, our method achieves a clear separation between salient objects and the background, yielding more accurate and reliable segmentation results.

Complexity comparison.

To evaluate the computational efficiency of the proposed method, we compare the number of parameters, FLOPs, and inference speed (FPS) with several representative RGB-D SOD models, as reported in Table 2. The proposed model contains 308.58M parameters and requires 20.63G FLOPs. Although our method introduces more parameters than existing lightweight models and several recent RGB-D SOD approaches, it achieves the lowest FLOPs among the compared methods. In particular, the proposed network reduces computational cost compared with CATNet (29.11G FLOPs) and CPNet (25.16G FLOPs), demonstrating that the designed feature interaction strategy can effectively enhance representation capability without introducing excessive computational overhead. In terms of inference speed, our method achieves 35.16 FPS, which is comparable to CATNet (36.47 FPS) and substantially faster than CPNet (21.35 FPS). These results indicate that the proposed network achieves a favorable trade-off between detection accuracy and computational efficiency. Considering its superior detection performance together with competitive FLOPs and inference speed, the proposed method provides an effective solution for RGB-D salient object detection.

thumbnail
Table 2. Complexity comparison of various models.

https://doi.org/10.1371/journal.pone.0354804.t002

Ablation study

The performance analysis of our proposed modules is summarized in Table 3. The Base model serves as the foundation, consisting of a ResNet-based dual-branch encoder-decoder architecture. The incremental addition of the decoder module (Dec.), IEM, and CAFI demonstrates the individual contributions of each module to the overall performance. Please note that the structure of the decoder module includes Fig 1(c) and 1(d). The baseline model alone delivers subpar segmentation results, particularly struggling with feature reconstruction and complex object boundaries. The improved decoder module enhances feature recovery but shows limited ability to refine intricate edge details. The introduction of the IEM effectively incorporates richer global and contextual information, significantly improving the representation of salient regions, thereby boosting structural similarity and detection accuracy. When CAFI is added, the network excels in modeling dependencies between RGB and depth features, reinforcing the separation of salient objects from background noise. This module enhances both structural integrity and fine-detail retention, further improving segmentation results. Finally, multi-scale supervision reduces errors across all evaluation metrics, demonstrating the network’s ability to achieve highly precise salient object detection while significantly mitigating the impact of noise in underwater environments.

thumbnail
Table 3. Performance comparison of different modules.

https://doi.org/10.1371/journal.pone.0354804.t003

Ablation study on IEM

To evaluate the efficacy of the proposed IEM, we conducted a series of ablation experiments by isolating its internal components and comparing them with the established CBAM module. The quantitative results are summarized in Table 4. The results indicate that the standard CBAM, which employs a sequential spatial and channel attention structure, achieves an of 0.8712. Our individual components—the Channel Branch () and the Spatial Branch ()—already exhibit superior performance compared to CBAM, suggesting that our specific design for underwater feature embedding is more robust than traditional attention mechanisms. The integration of both branches into the full IEM leads to a significant performance leap, achieving the highest of 0.9240 and of 0.9685. Compared to the Spatial Branch alone, the full IEM reduces the MAE significantly from 0.0301 to 0.0182. This sharp improvement demonstrates that our interlocking mechanism—which mutually embeds spatial and channel information—creates a crucial synergistic effect. By leveraging cross-dimensional correlations, the IEM effectively suppresses persistent backscattering noise and recalibrates object boundaries, producing much sharper and more accurate saliency maps than simple additive or sequential attention structures like CBAM.

Ablation study on hierarchical design.

To justify the rationality of the four-tier (Layers 1–4) hierarchical design in ICFN, we conducted ablation experiments by varying the network depth, as summarized in Table 5. The results reveal a clear evolutionary trend in feature representation. The 2-Layer and 3-Layer variants yield sub-optimal performance, particularly in terms of MAE and . This is attributed to the limited receptive fields of shallower architectures, which lack the high-level semantic guidance necessary to distinguish salient objects from heavy underwater backscattering noise. Specifically, the four-tier design enables a collaborative mapping between spatial fineness and semantic robustness. The deepest layers (Layers 3–4) capture abstract, global semantic anchors that are essential for robust object localization (reflected in the significant rise of ), while the shallower layers (Layers 1–2) provide the high-resolution spatial details required for boundary refinement. The transition from a 3-layer to a 4-layer structure results in a drastic MAE reduction to 0.0182, confirming that Layer 4 is the “sweet spot” for bridging the gap between low-level textures and high-level global context. This hierarchical evolution ensures that the ICFN achieves a synergistic balance, maintaining both structural integrity and precise edge delineation in complex underwater environments.

thumbnail
Table 5. Ablation study on hierarchical network depth.

https://doi.org/10.1371/journal.pone.0354804.t005

Limitation analysis.

While the proposed ICFN achieves competitive performance across standard benchmarks, it still exhibits certain limitations in extremely degraded underwater environments, as illustrated by two representative failure cases in Fig 3.

thumbnail
Fig 3. Two representative failure cases of our model.

https://doi.org/10.1371/journal.pone.0354804.g003

Case 1 (Fig 3(a)) – Saliency Boundary Overflow. In this scenario, the target is heavily camouflaged within a low-contrast and cluttered background in the RGB image, while the foreground boundary and surrounding obstacles are closely attached and exhibit highly similar geometric characteristics in the depth map. Although the proposed framework is designed to exploit long-range spatial dependencies and complementary multimodal information, the severe ambiguity between foreground and background makes reliable discrimination particularly challenging. Consequently, misleading contextual responses may be introduced during feature aggregation and multimodal fusion, causing the predicted saliency region to slightly extend beyond the true object boundary. This failure case indicates that the proposed model still encounters difficulties in accurately separating complex foreground-background structures when spatial and geometric boundaries are heavily entangled.

Case 2 (Fig 3(b)) – Partial Attenuation and Context Blending. This example represents a more challenging situation in which both RGB and depth modalities suffer from severe degradation. As observed in the depth map, the salient diver exhibits substantial structural omission and is degraded into an ambiguous gradient distribution, while the surrounding reef regions generate strong but misleading geometric responses. Meanwhile, underwater scattering significantly weakens the semantic contrast of the target in the RGB image. Consequently, the degraded depth information may provide inaccurate structural guidance during multimodal fusion, while the weakened visual cues further increase ambiguity in target localization. The combined effect of these unreliable cross-modal cues results in an incomplete saliency prediction, where only part of the target is activated and false-positive responses remain in the surrounding background regions. This failure case suggests that the network remains vulnerable when different modalities are degraded in highly asymmetric ways and still lacks sufficient capability to adaptively assess the reliability of conflicting cross-modal information under extreme underwater conditions.

These failure cases suggest that current underwater RGB-D salient object detection models remain partially constrained by adverse imaging conditions and the risk of error propagation across modalities. To address these limitations, future work will focus on incorporating dynamic data-quality evaluation strategies to adaptively down-weight unreliable modalities, introducing modality-reliability assessment mechanisms to improve robustness under sensor degradation, and designing stronger boundary-preserving constraints to further suppress background leakage. We believe these directions are promising for enhancing the robustness and generalization ability of underwater multimodal saliency detection systems.

Conclusion

In this paper, we introduced the ICFN with two novel components: the CAFI and the IEM. These components effectively harness the complementary nature of RGB and depth information, achieving precise underwater salient object detection through enhanced feature interaction and representation. By incorporating cross-scale learning strategies and deep supervision, our approach captures salient features across multiple scales, significantly improving detection accuracy and robustness. Experimental results on the USOD dataset demonstrate substantial performance gains, showcasing the effectiveness and superiority of the proposed method in addressing underwater salient object detection challenges. Despite its superior performance, the model has certain limitations. The dual-branch interaction and multi-scale attention mechanisms lead to relatively high computational complexity, posing challenges for real-time deployment on hardware-constrained underwater platforms. Furthermore, the model’s efficacy remains somewhat sensitive to the initial quality of the depth maps in extremely turbid environments. In the future, we aim to explore lightweight architecture designs and model compression techniques to improve inference efficiency without sacrificing accuracy.

References

  1. 1. Li H, Wu X-J. CrossFuse: A novel cross attention mechanism based infrared and visible image fusion approach. Information Fusion. 2024;103:102147.
  2. 2. Zhao W, Xie S, Zhao F, He Y, Lu H. Metafusion: Infrared and visible image fusion via meta-feature embedding from object detection. 2023;13955–65.
  3. 3. Chen Y, Liu Y, Lu M, Fu L, Yang F. Multi-consistency for semi-supervised medical image segmentation via diffusion models. Pattern Recognition. 2025;161:111216.
  4. 4. Zhu J, Cai W, Zhang M, Lin Y, Liu M. Saliency detection for underwater moving object with sonar based on motion estimation and multi-trajectory analysis. Pattern Recognition. 2025;158:111043.
  5. 5. Zhang F, Bian H, Ge W, Wei M. Exploiting Deep Matching and Underwater Terrain Images to Improve Underwater Localization Accuracy. IEEE Geosci Remote Sensing Lett. 2023;20:1–5.
  6. 6. Huang Z, Zhao Y, Li J, Liu Y. Bgman: Boundary-Prior-Guided Multi-scale Aggregation Network for skin lesion segmentation. Int J Mach Learn & Cyber. 2024;16(1):721–40.
  7. 7. Li J, Feng X, Hua Z. Low-Light Image Enhancement via Progressive-Recursive Network. IEEE Trans Circuits Syst Video Technol. 2021;31(11):4227–40.
  8. 8. Wang Y, Li W, Wen H, Yu Z, Xue Y, Li H. HCMANet: Hierarchical Cross-Modality Attention Network for Underwater Salient Object Detection. In: 2024 IEEE Smart World Congress (SWC), 2024. 790–7. https://doi.org/10.1109/swc62898.2024.00136
  9. 9. Peng Y-T, Lin Y-C, Peng W-Y, Liu C-Y. Blurriness-Guided Underwater Salient Object Detection and Data Augmentation. IEEE J Oceanic Eng. 2024;49(3):1089–103.
  10. 10. Zhao G, Zhang K, Wang L, Zhao W, Zhang W. CIDNet: Cross-Scale Interference Mining Detection Network for underwater object detection. Knowledge-Based Systems. 2025;324:113902.
  11. 11. Yuan G, Song J, Li J. IF-USOD: Multimodal information fusion interactive feature enhancement architecture for underwater salient object detection. Information Fusion. 2025;117:102806.
  12. 12. Cheng M-M, Gao S-H, Borji A, Tan Y-Q, Lin Z, Wang M. A Highly Efficient Model to Study the Semantics of Salient Object Detection. IEEE Trans Pattern Anal Mach Intell. 2022;44(11):8006–21. pmid:34437058
  13. 13. Dong Z, Wang M, Wang Y, Zhu Y, Zhang Z. Object Detection in High Resolution Remote Sensing Imagery Based on Convolutional Neural Networks With Suitable Object Scale Features. IEEE Trans Geosci Remote Sensing. 2020;58(3):2104–14.
  14. 14. Hua X, Cui X, Xu X, Qiu S, Li Z. Weakly Supervised Underwater Object Real-time Detection Based on High-resolution Attention Class Activation Mapping and Category Hierarchy. Pattern Recognition. 2025;159:111111.
  15. 15. Wang S, Zhang X, Ren L, Li J. HCT-Net: hybrid CNN-transformer network with multi-scale feature aggregation and progressive decode for medical image segmentation. Int J Mach Learn & Cyber. 2026;17(2).
  16. 16. Liu K, Li T, Peng D. Aerial Image Object Detection Based on RGB-Infrared Multibranch Progressive Fusion. IEEE Trans Geosci Remote Sensing. 2025;63:1–14.
  17. 17. Fan D-P, Zhai Y, Borji A, Yang J, Shao L. BBS-Net: RGB-D Salient Object Detection with a Bifurcated Backbone Strategy Network. Lecture Notes in Computer Science. Springer International Publishing. 2020. 275–92. https://doi.org/10.1007/978-3-030-58610-2_17
  18. 18. Tang W, He F, Liu Y. YDTR: Infrared and Visible Image Fusion via Y-Shape Dynamic Transformer. IEEE Trans Multimedia. 2023;25:5413–28.
  19. 19. Fan G, Yao Z, Gan M. Illumination-aware and structure-guided transformer for low-light image enhancement. Computer Vision and Image Understanding. 2025;252:104276.
  20. 20. Ju Y, Dong J, Chen S. Recovering Surface Normal and Arbitrary Images: A Dual Regression Network for Photometric Stereo. IEEE Trans Image Process. 2021;30:3676–90. pmid:33705315
  21. 21. Zhang W, Jiang Y, Fu K, Zhao Q. BTS-Net: Bi-Directional Transfer-And-Selection Network for RGB-D Salient Object Detection. In: 2021 IEEE International Conference on Multimedia and Expo (ICME), 2021. 1–6. https://doi.org/10.1109/icme51207.2021.9428263
  22. 22. Su X, Li J, Hua Z. Transformer-Based Regression Network for Pansharpening Remote Sensing Images. IEEE Trans Geosci Remote Sensing. 2022;60:1–23.
  23. 23. Yang Y, Yuan G, Li J. SFFNet: A Wavelet-Based Spatial and Frequency Domain Fusion Network for Remote Sensing Segmentation. IEEE Trans Geosci Remote Sensing. 2024;62:1–17.
  24. 24. Fang X, Jiang M, Zhu J, Shao X, Wang H. M2rnet: Multi-modal and multi-scale refined network for rgb-d salient object detection. Pattern Recognition. 2023;135:109139.
  25. 25. Xu C, Duan P, Li J. FRF-SEDNet: feature reassembly and refined differential edge-aware network based on stable diffusion. Int J Mach Learn & Cyber. 2026;17(2).
  26. 26. Ju Y, Jian M, Wang C, Zhang C, Dong J, Lam K-M. Estimating High-Resolution Surface Normals via Low-Resolution Photometric Stereo Images. IEEE Trans Circuits Syst Video Technol. 2024;34(4):2512–24.
  27. 27. Ju Y, Shi B, Chen Y, Zhou H, Dong J, Lam K-M. GR-PSN: Learning to Estimate Surface Normal and Reconstruct Photometric Stereo Images. IEEE Trans Vis Comput Graph. 2024;30(9):6192–207. pmid:37922172
  28. 28. Feng Y, Ma L, Meng X, Zhou F, Liu R, Su Z. Advancing Real-World Image Dehazing: Perspective, Modules, and Training. IEEE Trans Pattern Anal Mach Intell. 2024;46(12):9303–20. pmid:38896519
  29. 29. Ma L, Ma T, Xu C, Liu J, Fan X, Luo Z, et al. Learning With Self-Calibrator for Fast and Robust Low-Light Image Enhancement. IEEE Trans Pattern Anal Mach Intell. 2025;47(10):9095–112. pmid:40622830
  30. 30. Zheng L, Hu T, Zhu J. Underwater Sonar Target Detection Based on Improved ScEMA-YOLOv8. IEEE Geosci Remote Sensing Lett. 2024;21:1–5.
  31. 31. Gao T, Niu Q, Zhang J, Chen T, Mei S, Jubair A. Global to Local: A Scale-Aware Network for Remote Sensing Object Detection. IEEE Trans Geosci Remote Sensing. 2023;61:1–14.
  32. 32. Wang H, Sun S, Ren P. Underwater Color Disparities: Cues for Enhancing Underwater Images Toward Natural Color Consistencies. IEEE Trans Circuits Syst Video Technol. 2024;34(2):738–53.
  33. 33. Fan G, Zhou Y, Zhou J, Ju Y, Chen G-Y, Li J, et al. DCD-UIE: Decoupled Chromatic Diffusion Model for Underwater Image Enhancement. IEEE Trans Image Process. 2026;35:449–64. pmid:41525629
  34. 34. Fan G, Hu S, Zhou J, Gan M, Chen CLP. Color and texture count alike: An underwater image enhancement method via dual-attention fusion. Information Fusion. 2026;127:103780.
  35. 35. Ju Y, Shi B, Jian M, Qi L, Dong J, Lam K-M. NormAttention-PSN: A High-frequency Region Enhanced Photometric Stereo Network with Normalized Attention. Int J Comput Vis. 2022;130(12):3014–34.
  36. 36. Wang H, Zhang Z, Gao J, Hu W. A-teacher: Asymmetric network for 3d semi-supervised object detection. 14978–87. 2024.
  37. 37. Su J-N, Fan G, Gan M, Chen G-Y, Guo W, Chen CLP. Revealing the Dark Side of Non-Local Attention in Single Image Super-Resolution. IEEE Trans Pattern Anal Mach Intell. 2024;46(12):11476–90. pmid:39255176
  38. 38. Jin J, Jiang Q, Wu Q, Xu B, Cong R. Underwater Salient Object Detection via Dual-Stage Self-Paced Learning and Depth Emphasis. IEEE Trans Circuits Syst Video Technol. 2025;35(3):2147–60.
  39. 39. Piao Y, Wang J, Zhang M, Lu H. MFNet: Multi-filter Directive Network for Weakly Supervised Salient Object Detection. In: 2021 IEEE/CVF International Conference on Computer Vision (ICCV), 2021. 4116–25. https://doi.org/10.1109/iccv48922.2021.00410
  40. 40. Zhang J, Liu H, Yang K, Hu X, Liu R, Stiefelhagen R. CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation With Transformers. IEEE Trans Intell Transport Syst. 2023;24(12):14679–94.
  41. 41. Nie B, Lu W, Feng Y, Gao H, Lin K. Removing multi-path echoes in underwater 3D reconstruction via multi-view consistency. Pattern Recognition Letters. 2025;189:48–55.
  42. 42. Li C, Qu Z, Wang S, Liu L. A method of cross-layer fusion multi-object detection and recognition based on improved faster R-CNN model in complex traffic environment. Pattern Recognition Letters. 2021;145:127–34.
  43. 43. Li K, Wang D, Hu Z, Zhu W, Li S, Wang Q. Unleashing channel potential: Space-frequency selection convolution for sar object detection. 17323–32. 2024.
  44. 44. Huang Z, Li J, Hua Z, Fan L. Underwater Image Enhancement via Adaptive Group Attention-Based Multiscale Cascade Transformer. IEEE Trans Instrum Meas. 2022;71:1–18.
  45. 45. Zhang G, Chen J, Gao G, Li J, Liu S, Hu X. Safdnet: A simple and effective network for fully sparse 3d object detection. 14477–86. 2024.
  46. 46. Fu Z, Li J, Chen Z, Ren L. DmADs-Net: dense multiscale attention and depth-supervised network for medical image segmentation. Int J Mach Learn & Cyber. 2024;16(1):523–48.
  47. 47. Ma W, Wu Y, Zhu H, Zhao W, Wu Y, Hou B, et al. Adaptive Feature Separation Network for Remote Sensing Object Detection. IEEE Trans Geosci Remote Sensing. 2024;62:1–17.
  48. 48. Tao H, Yuan G, Li H, Li J. MIGDUN: Multi-stage interactive guidance deep unfolding network for pansharpening remote sensing images. Neurocomputing. 2026;670:132527.
  49. 49. Fan G, Zhou S, Hua Z, Li J, Zhou J. LLaVA-based semantic feature modulation diffusion model for underwater image enhancement. Information Fusion. 2026;126:103566.
  50. 50. Ju Y, Lam K-M, Xie W, Zhou H, Dong J, Shi B. Deep Learning Methods for Calibrated Photometric Stereo and Beyond. IEEE Trans Pattern Anal Mach Intell. 2024;46(11):7154–72. pmid:38607717
  51. 51. Wang C, Gao Z, Li J. CGCCE-Net: Change-guided cross correlation enhancement network for remote sensing building change detection. Information Sciences. 2026;742:123320.
  52. 52. Wei J, Wang S, Huang Q. F³Net: Fusion, Feedback and Focus for Salient Object Detection. AAAI. 2020;34(07):12321–8.
  53. 53. Zhao X, Zhang L, Pang Y, Lu H, Zhang L. A Single Stream Network for Robust and Real-Time RGB-D Salient Object Detection. Lecture Notes in Computer Science. Springer International Publishing. 2020. 646–62. https://doi.org/10.1007/978-3-030-58542-6_39
  54. 54. Zhao J, Zhao Y, Li J, Chen X. Is Depth Really Necessary for Salient Object Detection?. In: Proceedings of the 28th ACM International Conference on Multimedia, 2020. 1745–54. https://doi.org/10.1145/3394171.3413855
  55. 55. Wu Z, Allibert G, Meriaudeau F, Ma C, Demonceaux C. HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awareness. IEEE Trans Image Process. 2023;32:2160–73. pmid:37027289
  56. 56. Fan D-P, Lin Z, Zhang Z, Zhu M, Cheng M-M. Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarks. IEEE Trans Neural Netw Learn Syst. 2021;32(5):2075–89. pmid:32491986
  57. 57. Yang S, Lin W, Lin G, Jiang Q, Liu Z. Progressive Self-Guided Loss for Salient Object Detection. IEEE Trans Image Process. 2021;30:8426–38. pmid:34606454
  58. 58. Li G, Liu Z, Chen M, Bai Z, Lin W, Ling H. Hierarchical Alternate Interaction Network for RGB-D Salient Object Detection. IEEE Trans Image Process. 2021;30:3528–42. pmid:33667161
  59. 59. Zhong M, Sun J, Wang F, Sun F. LESOD: Lightweight and efficient network for RGB-D salient object detection. Pattern Recognition. 2026;171:112103.
  60. 60. Gao H, Wang F, Wang M, Sun F, Li H. Highly Efficient RGB-D Salient Object Detection With Adaptive Fusion and Attention Regulation. IEEE Trans Circuits Syst Video Technol. 2025;35(4):3104–18.
  61. 61. Zhong M, Sun J, Ren P, Wang F, Sun F. MAGNet: Multi-scale Awareness and Global fusion Network for RGB-D salient object detection. Knowledge-Based Systems. 2024;299:112126.
  62. 62. Sun F, Ren P, Yin B, Wang F, Li H. CATNet: A Cascaded and Aggregated Transformer Network for RGB-D Salient Object Detection. IEEE Trans Multimedia. 2024;26:2249–62.
  63. 63. Hu X, Sun F, Sun J, Wang F, Li H. Cross-Modal Fusion and Progressive Decoding Network for RGB-D Salient Object Detection. Int J Comput Vis. 2024;132(8):3067–85.