Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Enhancing precision in lymphoma detection with novel deep transformer-based neural networks

Abstract

Lymphoma appears as swollen lymph nodes and weakened immune-protective tissues, frequently resulting in tiredness and loss of weight. Improving the outlook of this malignancy includes using computer-assisted analysis of Positron Emission Tomography (PET) pictures, which identify changes in metabolism. This article presents an Automatic Pre-Segmentation Model (APSM) that uses the Swin Transformer (ST). The APSM accurately separates inputs by recognizing pixel differences caused by changes in metabolism in various tissues and lymph nodes. Training the Swin Transformer system for classification and identification happens simultaneously, focusing mainly on the lymph node area. The model effectively divides the Lymphoma area by examining differences in patterns between regional features and changes in pixels. This segmentation model combines transformer network training to simultaneously learn fractal variations and feature changes, helping to adjust the relationships between training and testing inputs. The segmentation model’s effectiveness comes from its capability to stop training the matching transformer network when it identifies new deviations, alterations, or both. The proposed model achieved 12.68% higher segmentation accuracy, 13.38% improved precision, and reduced overhead, error, and segmentation time by 12.73%, 9.27%, and 10.23%, respectively, outperforming existing methods.

1. Introduction

An uptick in lymphoma cases is observed globally, with 544,352 new instances of non-Hodgkin lymphoma and 83,087 instances of Hodgkin’s lymphoma reported in 2020. High-income nations experienced more cases, while low-income countries had higher mortality rates [1]. Lymphomas are one of the various hematologic cancers. Prognosis and therapy depend on accurately determining the sickness stage and examining histological findings. When treating patients with lymphoma, Positron Emission Tomography (PET) in conjunction with Computed Tomography (CT) is an often-utilized diagnostic modality [2]. Because CT provides detailed anatomic information and PET is sensitive in identifying lymphoma areas, the two methods work well together for better diagnosis and treatment [3]. PET/CT imaging can provide more clarity about the regions of the body that are impacted by lymphoma [4]. Clinical and laboratory parameters used in setting, restaging, and tracking therapy are complemented by the complementary nature of the metabolic and anatomic knowledge obtained from a PET-CT inspection, making it an indispensable part of the treatment of patients [5]. The degree to which PET-CT imaging may prove useful in a given patient’s treatment will depend on the characteristics of that patient’s lymphoma type and its clinical manifestations [6].

A watershed approach with automatic marker control is commonly used to segment a chosen lymph node. The specification of internal and exterior markers is necessary for this method. It was demonstrated that the segmentation task performance depended on the markers chosen [7,8]. Then, the interior and exterior markers are identified using the distorted contour from the baseline scan and the registration of the baseline and follow-up scans [9]. Lymph nodes are frequently surrounded by soft tissues that are difficult to distinguish based only on intensity value. It might be challenging to automatically segment lymph nodes on serial images and consistently separate them from other anatomic structures [10]. The method uses data from baseline images circled by radiologists to provide information about the position of lymph nodes in the images [11]. Utilizing enough structure-level data from the baseline scan enables an informed restriction on the search region for the target lymph node in the new scan, thereby mitigating the surrounding soft tissue difficulty [8,12]. The baseline scan extracts tissue surrounding the lymph node, which is then mapped onto the follow-up scan. Consequently, narrowing down the target lymph node’s search region enhances the outcomes of the automated segmentation process [2,13].

PET/CT analysis using machine learning requires a feature extraction process that converts the image information into a low-dimensional feature vector. The possibility of information loss limits this procedure, which depends on an expert understanding of feature extraction techniques [14]. Therefore, feature design performs less well when working with large and heterogeneous information sets. On the other hand, DL algorithms can immediately analyze data with high dimensions, such as PET/CT images, which gets over the limits brought on by information loss and does away with the requirement for manual feature engineering [15,16]. DL methods perform better in identifying high-volume PET/CT imaging investigations than classic machine learning algorithms due to their practical advantage. CT was recorded with PET images [17]. The CT and PET scan information was combined using a weighted fusion technique. A 3D auto-encoder algorithm also extracts deep learning features (DF) from PET and the fused image. Good performance is obtained using the fusion technique and a suitable automated segmentation technique [16,18]. The main contributions of the paper are:

  • An automatic pre-segmentation model using a Swin Transformer detects lymphoma based on pixel distribution and variation.
  • Fractal, minimal, and maximum deviation detection from pixel variations and feature changes to effectively improve precision.
  • Source-based experimental analysis with different experimental stage descriptions and conditional outputs.
  • Comparative study aided by methods, metrics, and variants for the proposed model’s efficiency assessment.

The remaining part of the paper is subdivided into the following sections: Section 2 explains the existing model of identifying lymphoma disease in Related works; Section 3 describes the proposed work APSM with ST; Section 4 reports experimental analysis, whereas Section 5 gives comparative analysis; the conclusion of the study is drawn in Section 6 and the study ends with section 7 suggesting future works.

2. Related works

Li et al. [19] developed a leukaemia classification on pet imaging using adaptive assessing and scalable distance regularized level set evolution (AW-SDRLSE). A novel dynamic annular mask determines the average intensity in the surrounding internal and external areas. Ninety cases of actual PET data are used to assess the AW-SDRLSE. The method enhances the lymphoma classification. Wang et al. [20] proposed a Lymphoma Segmentation by Utilising the Spatial-Temporal Correlation. A weighted Dice loss with stable gradient and self-adaptive parameters is used to steady the training procedure. The “UNet” technique creates recurrent dense Siamese decoder architecture. The method maintains extreme categorization effectiveness while reducing the deduction period. Liu et al. [21] introduced a combined lymphoma nodules division and prognosis prediction using multitask convolutional neural networks. The suggested approach shares the picture attributes learned from one task, which helps the learning process of the other task. The approach uses baseline FDG-PET scans to segment lymphoma lesions and predict prognosis. The method uses baseline FDG-PET scans to achieve combined lymphoma nodules division.

As an improved version of [20], Shi et al. [22] suggested a U-Net for automatic lymphoma segmentation in whole-body PET/CT scans. A generative adversarial network (AMC-GAN) is an auxiliary U-Net branch for anatomical-metabolic consistency. Using co-aligned whole-body PET/CT data, AMC-GAN specifically learns representations of normal anatomical and metabolic information. The method enhances the lymphoma classification performance. Zhu et al. [23] evaluated a boundary-optimized system for melanoma localization directed by a cruciform architecture. Semi-automated techniques are paired with human-added information, like limit boxes or tumour position points. The Lymphoma division network (CGBS-Net) is led by a cruciform topology and optimized for boundaries. The approach yields encouraging segmentation outcomes. Regardless of the boundary, an evidence network-based proposal is provided by Huang et al. [24]; who developed a segmenting lymphoma from 3d pet-ct images with a deep evidence network. Semantic feature vectors are extracted from 3D inputs by the feature extraction module using an encoder-decoder structure. The evidence layer computes a belief function at each voxel assessing the unpredictability of the existence. The developed approach enhances the effectiveness of segmentation.

Huang et al. [25] proposed a weakly guided multiple-scale characteristic similarity-based lymphoma separation in PET/CT images. A weakly supervised deep learning approach is used for autonomous lymphoma division to decrease the dependency on precisely labelled datasets. The Atrous Spatial Pyramid Pooling (ASPP) module fuses image features retrieved from several convolutional layers. The suggested approach can lessen the need for expert annotations in lymphoma segmentation. This weakly guided network issues are suppressed using Wang et al. [26] Whole-body lymphoma segmentation based on PET/CT using deep neural networks. Reweighting loss functions are used to train the backbone initially. The prior shift layer uses estimated prognosis reliability to irregularly change prior education information to a more illuminating group. The method enhances the sensitivity and efficacy.

Somaratne et al. [27] suggested a multi-site one-class categorization of follicular lymphoma using generative adversarial networks (GAN). GAN has recently been effectively applied to picture synthesis. The GAN-based method reduced the variations in whole slide images between sizable public data archive sites. The method increases the efficiency. Unlike one-class categorization, Luo et al. [28] evaluated a multi-atlas boundary-aware, context-coordination, UNet-like technique for tumour segmentation. The multi-atlas boundary-aware (MABA) module focuses on unclear regions between tumours and adjacent tissues to acquire probable tumour boundaries. The module is built on a gradient, uncertainty, and level set atlas. The method enhances the accuracy level. Luga et al. [29] developed a thorax lymph node identification and division from CT data. Using this data, fourfold cross-validation was used to train a fully convolutional neural network based on 3D foveal patches. Larger LNs in the instruction set had a higher identification rate than smaller LNs. The method performs excellently overall in the detection process. Blanc-Durand et al. [30] proposed a fully automated division of widespread big B cell lymphoma tumours on 3D FDG-PET/CT. A 5-fold cross-validation approach was employed for instruction with the initial cohort. PET/CTs were used to train a 3D U-net architecture with two input channels for PET and CT. The proposed approach improves the repeatability of TMTV assessments in lymphoma patients.

This proposal is a modified and improved version of [29] proposed by Perry et al. [31], which introduced a deep-learning image-based method for directly detecting high-grade B-cell lymphomas. A brand-new deep learning technology that uses scanned images of biopsy slides to diagnose DHLs and THLs directly. The analysis establishes the viability of using AI to determine DH/TH events. The method enhances the sensitivity and specificity.

Wang et al. [32] suggested combining the extraction of feature maps with the reuse of hierarchical feature maps. A gated convolutional module (GCM) is combined with UNet architecture to form Memory-Net. The cell memories in the GCM form an information highway and the hidden states of GCUs act as feature maps. The method reduces the computational cost. Aghamohammadi et al. [33] evaluated an encoding method for a two-path convolutional neural network for segmenting liver and tumours. Local Direction of Gradient (LDOG) is proposed to illustrate several important aspects within the image. The suggested encoded picture performs exceptionally well in identifying the liver’s border, even in areas near the organs that touch. The method achieves higher precision and effectiveness of segmentation.

Segmentation of lymphoma region from a whole body scan such as PET or CT requires defensive feature extraction as presented in [24,25]. However precise feature maps as in [32] reduce the computational cost through pixel-based selection. Besides, the single layer [27] neural network or dedicated network concepts as in [20,22,29] rely on pixel distribution that improves the segmentation rate. Apart from this, if the distribution detection due to feature variation occurs, then the overhead increases; hence, the layered assessments result in errors. To address such issues from the primary pixel distribution, this article introduces a pre-segmentation model using a Swin Transformer. This paradigm performs independent operations for segmentation and detection, along with variations and changes between different distributions. As the processes are independent, interrupting or mapping less prevents multiple feature assessments. This, in turn, reduces the complexity of handling multi-sized images.

The article introduces an APSM that employs the ST. By accounting for pixel discrepancies brought on by metabolic changes in different organs and lymph nodes, the APSM reliably separates inputs. A simultaneous process of training the Swin Transformer system for recognition and classification occurs, with the lymph node region as the primary emphasis. The model separates the lymphoma area by looking for patterns varying across regions and pixel changes. With transformer network training, this segmentation model can adapt the relationships between testing and training inputs by learning fractal variations and feature changes simultaneously. When the segmentation model detects new deviations, changes, or both, it may cease training the matching transformer network, which is the key to its efficacy.

3. Proposed automatic pre-segmentation model using swin transformer

Lymphoma region segmentation and detection have been pursued to identify and control failed immunity-protective tissues and enlarged lymph node conditions. This identifiable condition leads to weight loss and fatigue. PET image processing output addresses the pixel changes in features and is processed for better cancer-affected region identification. By validating the segmentation and region detection for computing the maximum deviation and changes in pixels based on PET/CT images. The region detection makes it difficult to meet the extracted feature attributes by identifying the lymph node size and fractal deviations used for training the Swin Transformer network. Based on the lymph node size and fractal deviations, the appropriate diagnosis is made to control the growth of cancer cells. Due to metabolism effects across different tissues and lymph nodes, APSM and Swin Transformer models are used to handle the critical situations of lymphoma cancer in the human body. The lymphoma region is segmented independently by computing the accuracy and precision of region features and pixel changes using the Swin Transformer network. The objective of precise lymphoma region identification from the human body with extracted features used for identifying the variations and maximum fractal deviations is consecutively analyzed. In Fig 1 the proposed Automatic Pre-segmentation Model is illustrated.

thumbnail
Fig 1. Illustration of the proposed automatic pre-segmentation model.

https://doi.org/10.1371/journal.pone.0329261.g001

Different lymphoma-causing conditions can be taken for identifying the precise cancer-affected region from the patients based on pixel changes. In this case, the pixel changes, feature changes, and fractal deviations are trained to adapt the correlation between testing and training inputs. In this scenario, the lymphoma caused by fractal deviations between the pixel changes and region features is to maximize the region detection precision with less overhead and detection time. From the identified regions, the maximum deviation is observed to address complex issues in region detection and variation analysis to reduce false rate occurrence. The continuous monitoring of lymph node size and fractal changes in the patients leads to false rates and improves the segmentation and region detection accuracy. The training of the same transformer network is pursued and terminated from the instance with associated feature attributes and its variations observation. The proposed model operates between fractal deviations and feature changes for maximum region segmentation and detection. In this model, the extracted features attribute and identified variations are used to identify the root cause of lymphoma.

Feature extraction techniques are used to gather information that could show the frequency of lymphoma. This work investigated the efficacy of multistage and multidimensional fractal geometry with colour channels and colour models for lymphoma tissue image classification. Structures that display self-similarity at many scales are the focus of fractal geometry. This idea has applications in medical imaging for analysing lymphoma and other malignancies with complicated forms and textures, which often have fractal-like borders. Fractal analysis at several scales allows for capturing fine and coarse information in the structure. To measure how complicated a structure is fractal dimension. By computing FD at various scales, the irregularities and roughness of lymphoma tumour borders may be captured. This allows for a more thorough description of how the fractal dimensions are distributed throughout the tumour area. It encapsulates the fact that fractal features fluctuate across the tumour.

There are numerous phases to developing an automated pre-segmentation model for lymphoma utilizing PET/CT scans to separate the variations and ROIs within the pictures properly. Magnify PET and CT scans to a significant degree. Ensure the pictures are co-registered so the functional and anatomical data are synchronised. Use thresholding methods to isolate lymphoma-related high-uptake areas in PET scans.

Further, the main goal of handling PET/CT images for identifying the lymph node size and fractal deviation is to reduce the complexity in region segmentation and thereby increase the region detection rate. The APSM uses ST to segment the input images based on the pixel changes, thus reducing failures and lags when segmenting such regions. The ST output is used to classify the maximum deviation and changes identified instances for addressing root causes of cancer by adapting the testing and training inputs continuously. We propose an Automatic pre-segmentation model that joints the outputs of maximum deviations and changes observed from the regions with Swin Transformer.

3.1 Feature extraction and discussion

Extracted feature attributes have been analyzed to detect variations in complex regions with high rates under distinguishable input elements. In this feature extraction is performed with input PET/CT images, we assume that the feature belongs to PET images , therefore the pixel changes are represented as .

In this analysis, the extracted feature is smaller than the variation detection in such regions. In this scenario, assume that the input segmentation is performed in this model based on pixel changes; it means if the variations do not occur in any region that image is not important to process, and that images show lymphoma disease does not affect that particular patient. Similarly, if the variations addressed in any regions will be terminated and the proper diagnosis recommendation to that patient. First, the variations identified images are processed using Swin Transformer. Different variations observed from the region may appear on the segmentation rate . Each lymph node size and feature changes conditions from the input images contain region segmentation time is validated independently. Based on the analysis, the fractal deviations with feature changes are continuously computed. In this proposed model, we also consider the maximum deviation in each region. For the analysis, the average detection time for region for the first PET image is computed as

(1)(2)

Where

(3)

And

(4)

Where, the variable means region detection rate based on the pixel changes to identify the variations using the proposed model and Swin Transformer. The probability of addressing complex situations in identifying the feature variations is expressed as in any terminated region, the fraction of the next image is processed. Instead, the lymph node size is too big (as high as ), that images take several minutes to find the pixel changes and fractal deviations in that complex region. The feature extraction process and change detection processes are illustrated in Fig 2.

In the above Fig 2 representation, a sample image from the dataset is used to represent the feature detection and extraction. The extracted features are verified for such that under different . Therefore is identified between successive pixels within provided is eased. The is performed if is satisfied for different such that accuracy is improved. The variable illustrates the average delay observed from the traditional lymphoma image analysis experiences for providing the same diagnosis recommendations or adding additional features to the images and then computing the image processing sequence. Therefore, the average delay is computed as

(5)

In equation (5), the variable denotes sequential image processing with the segmentation time and detection time is validated. The objective condition is performed to minimize the false rate. The pseudo-code of changes detection in any is given in Algorithm 1.

Algorithm 1: Changes Detection in

3.2 Variation detection

The complex problem of identifying lymphoma causes in any region suppresses variations in which segmentation and detection are simultaneously analyzed for precise decision-making done using input images. Each lymph node may differ in size, color, intensity, etc. based on the pixel changes observed from the PET images are further analyzed for providing treatment. The diagnosis recommendation is provided to all the lymphoma-caused patients using Swin Transformer with processing rate . The complex problem in region segmentation and detection process will lead to multiple considerations for handling this disease spread. We assume that segmentation of the affected region from the image is used to compute the maximum deviations from the instance. For this purpose, the ST and final pixel variation output-based changes are observed and compared with the existing model for precise region detection. By validating the region features and pixel changes between the fractal deviations is defined as the addition of segmentation and detection rate of all features in such region is

(6)

In equation (6), the variable determines the region features observed from the input image for addressing variations in any region based on for making better decisions to provide the diagnosis. If represents the pixel changes based on variation detection observed at different regions. For example, shows up the region detection precision with processing time and overhead, the number of pixel changes per unit of time is equal to 7% of the number of observed from the instance is estimated. The variation due to the detected region and its maximum estimation is presented in Fig 3.

thumbnail
Fig 3. Variation due to detected region and maximum estimation.

https://doi.org/10.1371/journal.pone.0329261.g003

The variation detection process utilizes to for validation. This validation requires and constraint sanctification such that the failing case generates . This highlights the pixels with variations successively. In the contrary process, the variation reflecting pixel is detected. This is used for training through until post the next sequence. The process is pursued until the variation is suppressed under and conditions (Fig 3).

3.3 Pixel changes in identified region

Based on the pixel changes, the problem location is identified, and the fractal deviations and feature changes are made using Swin Transformer to adapt the correlation. It is too difficult to find the precise region where the lymph node size may vary for all the patients, and providing a diagnosis also changes. In particular, the two conditions are followed to provide an appropriate diagnosis for lymphoma cancer: First, analyze the image, verify if the variation is happening, and help the affected patients with good treatment. Second, if maximum deviation is observed in any lymph node between the identified regions outputs high overhead and processing time. For instance, prescriptions are provided to the infected patients, and frequently going to the nearby medical centre for continuous health checks is the better solution for reducing lymphoma growth.

In this model, region detection and segmentation are performed to identify precise regions based on lymph node size and fractal deviations that may or may not correlate with the segmentation model. The transformer network trains feature changes and fractal deviations to address complex conditions in lymphoma detection based on PET images in different instances. The design goal of this model is to improve the detection accuracy and precision with less overhead. The training of the matching transformer network is terminated until a new change deviation observation or both observations. The proposed APS model formulation is estimated as

(7)

Such that

(8)(9)(10)(11)(12)

Based on the above equations, the condition is defined for training the ST network for detection and segmentation sequentially for addressing the lymphoma disease. If denotes the lymphoma region detection. The different prognosis of lymphoma cancer is improved using the proposed model and ST based on pixel changes and region features in any region. The condition represents the variations addressed at sequences for all the images. The region segmentation and detection time are computed for maximum fractal deviation and changes identification observation at the infection-located region for providing precise diagnosis. The pixel changes detection process in the identified region using Swin Transformer is presented below.

The inputs are observed for and pixel features from the . Depending on the condition the between the successive pixels is identified. In this case, the condition failing pixels is identified as from which the extraction is performed for . In this extraction, the observed pixels are identified as the changes in any . Such changes are required for meeting suppressing further complexities (Fig 4). The maximum changes based on variation detection pseudo code are presented in Algorithm 2.

Algorithm 2: Detection

3.4 Swin transformer in region detection

A hierarchical vision transformer called the Swin Transformer, which uses a shifted windowing method, may be very useful in an automated lymphoma pre-segmentation model that uses PET/CT data. To manage high-resolution vision tasks, the Swin Transformer (Shifted Window Transformer) partitions the input picture into non-overlapping local windows and calculates self-attention in each window. The shifted window technique provides cross-window linkages to improve the model’s computational efficiency and capacity to capture global context. Gather exquisite, co-registered CT and PET scans. The intensity levels should be normalized. resize photos into manageable patches that meet the input specifications of the Swin Transformer and resize them to good quality. To approximate where the lymphoma is located, thresholding or region expansion is utilized, using two classic segmentation approaches. The model’s starting point or preliminary guidance. Segment the PET/CT scans inputted as patches and insert them into vectors. The PET/CT scans extract multiscale and multidimensional characteristics using the Swin Transformer as a foundation. For better boundary accuracy and to deal with class imbalance, use a mix of segmentation-specific loss functions like Dice loss and cross-entropy loss in your model. Smooth down the segmentation mask’s edges and fine-tune it using operations like erosion and dilation. Determine how well the segmentation worked by calculating several metrics such as the Jaccard index, precision, recall, and F1-score. Swin Transformer’s hierarchical structure is essential to detect lymphoma areas that differ substantially in size and shape since it collects parameters at several scales. The automatic pre-segmentation of lymphoma in PET/CT images is made possible by Swin Transformer’s computational efficiency, global context awareness, and strong feature extraction capabilities. Better lymphoma diagnosis and treatment planning are made possible by this method’s increased accuracy and robustness in lymphoma segmentation.

From the instance, the feature extraction, false rate, and overhead are sequentially computed based on using ST for lymphoma region segmentation and detection. The probability of pixel changes is computed sequentially and is given as

(13)

Where

(14)

As per equations (13) and (14), the continuous lymphoma region segmentation and detection is pursued based on observing the maximum deviation and changes for adapting the correlation between testing and training inputs. Therefore, there is less false rate observed from the instance and hence the precise detection is made for both conditions. Based on the region segmentation and detection, the new deviation or change is observed from and the precision of region detection is computed as

(15)

In equation (15), the high precision detection of lymphoma region is to satisfy minimum deviation and less overhead is valid for identifying segmentation changes. Based on the fractal deviations, the variation is identified due to metabolism effects across multiple tissues and lymph nodes. The multiple lymph nodes and tissues observed from the current metabolism measure used for identifying variations and overhead are reduced through the Swin Transformer network. The input segmentation uses extracted region features and pixel changes comparing the transformer network to prevent false rates provided to lymphoma-affected patients. The high accuracy and precision of region detection help to identify infected regions to achieve better output. Hence, the root cause and pixel changes are identified to achieve successful PET image processing with less overhead. Contrarily, the final region segmentation and detection output used for maximum deviation and changes identification is the optimal condition, and therefore, the segmentation time, processing time, and detection time for lymphoma based on PET/CT image processing results in a false rate. Therefore, the maximum deviation observed between the identified regions is used to improve detection precision and reduce the false rate. The lymph node is continuously segmented until it identifies the maximum deviation and changes. Here, the segmentation and detection rate are used to achieve decision-making and better output. Therefore, the false rate identified pixel changes when matching the transformer network with the final output to provide optimal diagnosis to the affected people.

4. Experimental analysis

The experimental analysis presents the discussion using MATLAB outputs image inputs [34] and proposed models’ correlation. First, the data source is explained; whole-body PET/CT Scan image inputs are used for experimental analysis. This dataset uses 501 input images obtained at 200mAs reference dosage at 120kV tube voltage post 60 mins of IV. The image sizes are consecutively 1x1, 2x2, 4x4, 8x8, and 16x16, extracted from a larger image of 400x400 sizes. From the model’s correlation, the output obtained and its statistical analysis is discussed below.

4.1. Analysis-I: variation and regions

The optimal condition for deviation is shows up less variation under three epochs. This requires a high convergence for and low for . Therefore the number of epochs and training recurrences are decided from Fig 5. Followed by this Analysis II presents the region detection under .

4.2. Analysis-II: region detection based on

The region detection is performed using and inputs combined using conditions. Therefore for and , the analysis is presented in the above Fig 6. This is performed for 10 from the original input. The experimental outcomes are tabulated and graphically represented for in the above. The regions represented above are the expressing ones that are distinguished from the precision region. The final precision region and its best error are presented in Analysis III.

4.3. Analysis-III: precision region detection

In Fig 7 above, the region detected by satisfying the conditions presented in Fig 6 is presented. For example, the consideration is about 6 regions identified for which the training, validation, and testing outputs for 3 epochs are analyzed. In this representation process, the best solution and convergence are cumulatively identified unlike the conditional analysis and regions presented. The precision region exhibits some changes in detecting lymphoma that is different from the deviation observed regions.

5. Results, discussion and comparative analysis

The comparative analysis uses segmentation accuracy, precision, overhead, error, and segmentation time metrics. The features (1–14) and regions (5) are varied for analyzing the metrics above. For an effective comparative analysis, the existing AW-SDRLSE [19], DFE + ES [24], and PSR-Nets [26] methods are considered along the proposed APSM-ST.

The current approaches often provide PET pictures with inferior spatial resolution and greater noise levels when compared with CT scans. Lack of proper integration might result in subpar performance in feature extraction and segmentation, preventing the advantages of multimodal imaging from being fully realized. A model’s clinical value is limited if it does well on the training set but fails to segregate lymphoma in fresh patient data correctly. Hence this paper compared AW-SDRLSE [19], DFE + ES [24], and PSR-Nets [26] and this article analyses the lymphoma segmentation using PET/CT images.

5.1. Segmentation accuracy

In this proposed model, the Swin Transformer is used for performing continuous region segmentation and detection process for improving the diagnosis rate and lymphoma detection rate based on variation analysis shown in Fig 8.

The error occurred due to high metabolism effects addressed across different tissues and lymph nodes observed from the input PET images to achieve high segmentation accuracy. The identified variations are mitigated using the APSM and transformer network to reduce the growth of lymph node size for disease-causing intervals. The extracted features from PET/CT images are sequentially processed to achieve maximum detection precision with less overhead and error. The consecutive region features and pixel changes are trained based on the fractal deviations to reduce error occurrence. To address the above complex problems, the proposed model is used to identify lymphoma disease-infected regions based on the maximum deviation and changes. This achieves high segmentation accuracy at the time of identifying the variations between the regions that are confined unanimously through the proposed model. The segmentation accuracy is improved by 12.68% and 13.75% for the varying features and sizes, respectively.

5.2. Precision

In this proposed model using ST is to satisfy high region detection precision based on the pixel changes identified across various regions in any time interval represented as in Fig 9. The minimum or maximum variations are detected from the extracted features using Swin Transformer to improve the segmentation rate. The pixel changes and region features are accurately identified for lymphoma region segmentation based on the deviation identification. In this article, the ST network trains feature changes and fractal deviations are processed unanimously to adapt the correlation between testing and training inputs at different instances. The APSM is used to identify lymphoma disease causing reason and controlling the infection spread based on feature extraction. The maximum fractal deviation observed between the lymphoma-detected regions is pursued using the proposed model at any region. The proposed model’s conditions are computed to satisfy high segmentation accuracy and detection precision. The detection precision is high compared to the other factors in this model. The precision is hiked by 13.38% and 14.81% for the features and sizes of the proposed APSM.

5.3. Overhead

The proposed model used Swin Transformer for lymphoma-affected region detection precision to satisfy a high segmentation rate with less overhead for preventing the error occurrence at any region shown in Fig 10. Identifying variations observed from the extracted features leads to high error occurrence; the considerable features are changed to appropriate pixel attributes using the transformer network. Therefore, the lymph node size is accurately identified to provide appropriate diagnosis recommendations. Based on the maximum and minimum deviations, the pixel changes are classified to detect and segment lymphoma regions in the input PET/CT images. The proposed model first segments the input in this model based on pixel changes and variations to improve the accuracy of segmentation and detection rate. By validating the precise segmentation and region detection based on maximum deviation and pixel changes observed from the PET/CT images. The precise region detection is difficult to meet, and the maximum deviation relies on the lymph node size and fractal deviations using the Swin Transformer network. The features extracted from given input images are processed in any region at different time intervals. The proposed model is used to satisfy less overhead. Overhead is reduced by 12.73% and 11.27% by the proposed model for different features and sizes.

5.4. Error

In this proposed model, the maximum deviation is addressed concerning the sequence of segmentation changes and region features to improve the detection rate for better decision-making shown in Fig 11.

The continuous training of the Swin Transformer network is pursued for precise region segmentation, and detection is performed simultaneously to adapt the correlation. The pixel changes may differ for each lymph node based on extracted feature attributes; the observed image is processed using ST to make accurate and appropriate diagnosis recommendations. In this article, the training of the matching transformer network is terminated until a new change or deviation from the instance across various regions is to prevent errors and overhead. In this scenario, segmentation and detection are performed to reduce errors and overheads and maximize the precision of region detection. The maximum/minimum fractal deviations are identified and segregated from the training inputs and testing to improve the segmentation accuracy. Instead, the variation analysis and minimum deviation control the lymphoma disease. Hence, fewer errors are satisfied using this model and ST. The proposed APSM reduces error by 9.27% for the features and 11.05% for the sizes compared to the other methods.

5.5. Segmentation time

This proposed model aided in better decision-making of lymphoma region detection without errors and overheads to satisfy less detection time and thereby reduce detection time compared to the other factors represented in Fig 12. The variations are identified from the disease-infected regions to reduce maximum deviations and changes between the region features and pixel changes are observed to improve detection precision with less overhead. This proposed model identifies the complex problems observed from sequential image processing. The abovementioned variations are addressed using ST based on the fractal deviations and feature changes. The training of the same transformer network is terminated using the proposed model to perform precise region segmentation and detection. The proposed model notices the frequency fluctuations in its associated features to reduce errors and overheads. The above problems are difficult to identify; based on the extracted features regions and changes, additional features are added to reduce the maximum deviation. Therefore, the proposed model satisfies less segmentation time. As Compared to the other methods, the segmentation time is reduced by 10.23% and 11.14% under varying features and sizes.

5.6 Confusion matrix

The visualization of the confusion matrix draws attention to the superior segmentation performance of the APSM-ST model that was developed. Not only does it have the highest true positive (780) and true negative (1100) numbers, but it also has the fewest incorrect classifications (20 false positives and 45 false negatives), which indicates that it has exceptional precision and recall. The APSM-ST consistently minimises the number of misclassifications while maintaining balanced detection across object and background classes. This is in comparison to other models such as PSR-Nets, DFE + ES, and AW-SDRLSE. This not only strengthens the model’s robustness and dependability in the process of segmenting complex picture regions, but it also makes it a more effective solution for high-accuracy image segmentation jobs in real-time applications.

In the comparison Table 1, the performance of four different segmentation models—AW-SDRLSE, DFE + ES, PSR-Nets, and the proposed APSM-ST—is illustrated across many assessment parameters. These metrics include segmentation accuracy, precision, computational overhead, error rate, and segmentation duration. The APSM-ST algorithm consistently achieves superior results across all metrics and region sizes. It achieves the highest accuracy (up to 93.05%), maximum precision (0.9678), lowest overhead (0.2189 seconds), minimal error (0.0588), and the quickest processing time (1.217 seconds). These findings support the resilience of the proposed model and demonstrate that it is suitable for accurate and efficient medical image segmentation Fig 13. Furthermore, they show the potential of the model for real-time applications that have high reliability and little resource utilisation.

thumbnail
Table 1. Comparative performance analysis of segmentation models across various metrics.

https://doi.org/10.1371/journal.pone.0329261.t001

6. Conclusion

This study presents an automated pre-segmentation model to improve the precision of identifying lymphoma in PET/CT scans. Using a Swin Transformer, the model can segment and detect lymphoma in whole-body PET image analysis. It accomplishes accurate detection of pixel changes that lack increasing complexity or generate false positives, guaranteeing great precision in region detection which is important for managing lymphoma. The methodology uses a step-by-step process of decision-making and calculation to fight against lymphoma sickness effectively. Teaching the matching transformer network allows for effective region detection, with completed examples of the network recognized under different input elements. The model correctly identifies lymphoma disease in various areas by considering differences in range characteristics and pixels detected during PET image analysis. The comparison shows notable enhancements: segmentation accuracy rises by 12.68% and precision by 13.38%. Moreover, the model decreases overhead, error rates, and division time by 12.73%, 9.27%, and 10.23% respectively for various features.

7. Future works

However, initial segmentation procedures, such as categorization and detection, are influenced by differences in lymph node diameters. Differences in mistakes occur due to the different widths of areas, affecting the distribution of pixels in sequence. A method called regressive segmentation is suggested to address this problem. This method examines pixel distribution separately according to the size of the region. This method seeks to tackle issues related to pre-segmentation to improve the accuracy of lymphoma diagnosis in PET/CT images.

References

  1. 1. Frood R, Willaime JMY, Miles B, Chambers G, Al-Chalabi H, Ali T, et al. Russell Frood1, 2, Julien M Y Willaime3, Brad Miles4, Greg Chambers1, H’ssein Al-Chalabi1, 5, Tamir Ali6, Natasha Hougham7, Naomi Brooks4, George Petrides6, Matthew Naylor6, Daniel Ward6, Tom Sulkin7, Richard Chaytor7, Peter Strouhal4, Chirag Patel1 and Andrew F. Scarsbrook1, 2. 2024.
  2. 2. Mustaqim T, Fatichah C, Suciati N. Deep Learning for the Detection of Acute Lymphoblastic Leukemia Subtypes on Microscopic Images: A Systematic Literature Review. IEEE Access. 2023.
  3. 3. Korsholm K, Overbeck N, Dias AH, Loft A, Andersen FL, Fischer BM. Impact of Reduced Image Noise on Deauville Scores in Patients with Lymphoma Scanned on a Long-Axial Field-of-View PET/CT-Scanner. Diagnostics (Basel). 2023;13(5):947. pmid:36900090
  4. 4. Lisson CS, Lisson CG, Achilles S, Mezger MF, Wolf D, Schmidt SA, et al. Longitudinal CT Imaging to Explore the Predictive Power of 3D Radiomic Tumour Heterogeneity in Precise Imaging of Mantle Cell Lymphoma (MCL). Cancers (Basel). 2022;14(2):393. pmid:35053554
  5. 5. Maccioni F, Calabrese A, Manganaro L, de Felice C, Cardaccio S, Lopez M, et al. MRI versus CT and PET/CT in the preoperative assessment of Hodgkin and non-Hodgkin lymphomas. Hemato. 2021;2(4):635–44.
  6. 6. Naguib MM, Botros SM, Louka AL, Hussein RS. Role of PET/CT in initial evaluation of lymphoma patients. Egyptian J Radiology and Nuclear Medicine. 2021;52(1):1–9.
  7. 7. Milara E, Gómez-Grande A, Tomás-Soler S, Seiffert AP, Alonso R, Gómez EJ, et al. Bone marrow segmentation and radiomics analysis of [18F]FDG PET/CT images for measurable residual disease assessment in multiple myeloma. Comput Methods Programs Biomed. 2022;225:107083. pmid:36044803
  8. 8. Altini N, Prencipe B, Cascarano GD, Brunetti A, Brunetti G, Triggiani V, et al. Liver, kidney and spleen segmentation from CT scans and MRI with deep learning: A survey. Neurocomputing. 2022;490:30–53.
  9. 9. Keijzer K, Niezink AG, de Boer JW, van Doesum JA, Noordzij W, van Meerten T, et al. Semi-automated 18F-FDG PET segmentation methods for tumor volume determination in Non-Hodgkin lymphoma patients: a literature review, implementation and multi-threshold evaluation. Computational and Structural Biotechnology Journal. 2023.
  10. 10. Abdel-Nabi H, Ali M, Awajan A, Daoud M, Alazrai R, Suganthan PN, et al. A comprehensive review of the deep learning-based tumor analysis approaches in histopathological images: segmentation, classification and multi-learning tasks. Cluster Computing. 2023;1–41.
  11. 11. Løndalen A, Blakkisrud J, Revheim M-E, Madsbu UE, Dahle J, Kolstad A, et al. FDG PET/CT parameters and correlations with tumor-absorbed doses in a phase 1 trial of 177Lu-lilotomab satetraxetan for treatment of relapsed non-Hodgkin lymphoma. Eur J Nucl Med Mol Imaging. 2021;48(6):1902–14. pmid:33196921
  12. 12. Huang B, Sollee J, Luo YH, Reddy A, Zhong Z, Wu J, et al. Prediction of lung malignancy progression and survival with machine learning based on pre-treatment FDG-PET/CT. EBioMedicine. 2022;82.
  13. 13. Zhang X, Chen L, Jiang H, He X, Feng L, Ni M, et al. A novel analytic approach for outcome prediction in diffuse large B-cell lymphoma by [18 F] FDG PET/CT. European J Nuclear Medicine and Molecular Imaging. 2021;1–13.
  14. 14. Tram NK, Chou TH, Janse SA, Bobbey AJ, Audino AN, Onofrey JA, et al. Deep learning of image-derived measures of body composition in pediatric, adolescent, and young adult lymphoma: association with late treatment effects. European Radiology. 2023;:1–9.
  15. 15. Frood R, Clark M, Burton C, Tsoumpas C, Frangi AF, Gleeson F, et al. Utility of pre-treatment FDG PET/CT-derived machine learning models for outcome prediction in classical Hodgkin lymphoma. Eur Radiol. 2022;32(10):7237–47. pmid:36006428
  16. 16. Karimdjee M, Delaby G, Huglo D, Baillet C, Willaume A, Dujardin S, et al. Evaluation of a convolution neural network for baseline total tumor metabolic volume on [18F]FDG PET in diffuse large B cell lymphoma. Eur Radiol. 2023;33(5):3386–95. pmid:36600126
  17. 17. Ferrández MC, Golla SSV, Eertink JJ, de Vries BM, Lugtenburg PJ, Wiegers SE, et al. An artificial intelligence method using FDG PET to predict treatment outcome in diffuse large B cell lymphoma patients. Sci Rep. 2023;13(1):13111. pmid:37573446
  18. 18. Kornaropoulos EN, Zacharaki EI, Zerbib P, Lin C, Rahmouni A, Paragios N. Joint Deformable Image Registration and ADC Map Regularization: Application to DWI-Based Lymphoma Classification. IEEE J Biomed Health Inform. 2022;26(7):3151–62. pmid:35239496
  19. 19. Li S, Jiang H, Li H, Yao Y-D. AW-SDRLSE: Adaptive Weighting and Scalable Distance Regularized Level Set Evolution for Lymphoma Segmentation on PET Images. IEEE J Biomed Health Inform. 2021;25(4):1173–84. pmid:32841130
  20. 20. Wang M, Jiang H, Shi T, Yao Y-D. HD-RDS-UNet: Leveraging Spatial-Temporal Correlation Between the Decoder Feature Maps for Lymphoma Segmentation. IEEE J Biomed Health Inform. 2022;26(3):1116–27. pmid:34351864
  21. 21. Liu P, Zhang M, Gao X, Li B, Zheng G. Joint lymphoma lesion segmentation and prognosis prediction from baseline FDG-PET images via multitask convolutional neural networks. IEEE Access. 2022;10:81612–23.
  22. 22. Shi T, Jiang H, Wang M, Diao Z, Zhang G, Yao YD. Metabolic Anomaly Appearance Aware U-Net for Automatic Lymphoma Segmentation in Whole-Body PET/CT Scans. IEEE J Biomedical and Health Informatics. 2023.
  23. 23. Zhu X, Jiang H, Diao Z. CGBO-Net: Cruciform structure guided and boundary-optimized lymphoma segmentation network. Comput Biol Med. 2023;153:106534. pmid:36608464
  24. 24. Huang L, Ruan S, Decazes P, Denœux T. Lymphoma segmentation from 3D PET-CT images using a deep evidential network. Int J Approximate Reasoning. 2022;149:39–60.
  25. 25. Huang Z, Guo Y, Zhang N, Huang X, Decazes P, Becker S, et al. Multi-scale feature similarity-based weakly supervised lymphoma segmentation in PET/CT images. Comput Biol Med. 2022;151(Pt A):106230. pmid:36306574
  26. 26. Wang M, Jiang H, Shi T, Wang Z, Guo J, Lu G, et al. PSR-Nets: Deep neural networks with prior shift regularization for PET/CT based automatic, accurate, and calibrated whole-body lymphoma segmentation. Comput Biol Med. 2022;151(Pt A):106215. pmid:36306584
  27. 27. Somaratne UV, Wong KW, Parry J, Laga H. The use of generative adversarial networks for multi-site one-class follicular lymphoma classification. Neural Comput & Applic. 2023;35(28):20569–79.
  28. 28. Luo S, Jiang H, Wang M. C2BA-UNet: A context-coordination multi-atlas boundary-aware UNet-like method for PET/CT images based tumor segmentation. Comput Med Imaging Graph. 2023;103:102159. pmid:36549193
  29. 29. Iuga A-I, Carolus H, Höink AJ, Brosch T, Klinder T, Maintz D, et al. Automated detection and segmentation of thoracic lymph nodes from CT using 3D foveal fully convolutional neural networks. BMC Med Imaging. 2021;21(1):69. pmid:33849483
  30. 30. Blanc-Durand P, Jégou S, Kanoun S, Berriolo-Riedinger A, Bodet-Milin C, Kraeber-Bodéré F, et al. Fully automatic segmentation of diffuse large B cell lymphoma lesions on 3D FDG-PET/CT for total metabolic tumour volume prediction using a convolutional neural network. European J Nuclear Medicine and Molecular Imaging. 2021;48:1362–70.
  31. 31. Perry C, Greenberg O, Haberman S, Herskovitz N, Gazy I, Avinoam A, et al. Image-Based Deep Learning Detection of High-Grade B-Cell Lymphomas Directly from Hematoxylin and Eosin Images. Cancers (Basel). 2023;15(21):5205. pmid:37958379
  32. 32. Wang M, Jiang H. Memory-Net: Coupling feature maps extraction and hierarchical feature maps reuse for efficient and effective PET/CT multi-modality image-based tumor segmentation. Knowledge-Based Systems. 2023;265:110399.
  33. 33. Aghamohammadi A, Ranjbarzadeh R, Naiemi F, Mogharrebi M, Dorosti S, Bendechache M. TPCNN: Two-path convolutional neural network for tumor and liver segmentation in CT images using a novel encoding approach. Expert Systems with Applications. 2021;183:115406.
  34. 34. A whole-body FDG-PET/CT dataset with manually annotated tumor lesions (FDG-PET-CT-Lesions). Available from: https://wiki.cancerimagingarchive.net/pages/viewpage.action?pageId=93258287.