Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Deep learning-based respiratory muscle segmentation as a potential imaging biomarker for respiratory function assessment

  • Insung Choi ,

    Contributed equally to this work with: Insung Choi, Zepa Yang

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Software, Supervision, Visualization, Writing – original draft, Writing – review & editing

    Affiliations Department of Integrative Medicine, Major in Digital Healthcare, Yonsei University College of Medicine, Seoul, Republic of Korea, Department of Radiology, Korea University Guro Hospital, Seoul, Republic of Korea

  • Juwhan Choi,

    Roles Data curation, Validation

    Affiliation Division of Pulmonary, Allergy, and Critical Care Medicine, Department of Internal Medicine, Korea University Guro Hospital, Seoul, Republic of Korea

  • Hwan Seok Yong,

    Roles Project administration, Validation

    Affiliation Department of Radiology, Korea University Guro Hospital, Seoul, Republic of Korea

  • Zepa Yang

    Contributed equally to this work with: Insung Choi, Zepa Yang

    Roles Conceptualization, Formal analysis, Investigation, Methodology, Resources, Supervision, Writing – review & editing

    yangzepa@korea.ac.kr

    Affiliation Department of Radiology, Korea University Guro Hospital, Seoul, Republic of Korea

Abstract

Respiratory diseases significantly affect respiratory function, making them a considerable contributor to global mortality. The respiratory muscles play an important role in disease prognosis; as such, quantitative analysis of the respiratory muscles is crucial to assess the status of the respiratory system and the quality of life in patients. In this study, we aimed to develop an automated approach for the segmentation and classification of three types of respiratory muscles from computed tomography (CT) images using artificial intelligence. With a dataset of approximately 600,000 thoracic CT images from 3,200 individuals, we trained the model using the Attention U-Net architecture, optimized for detailed and focused segmentation. Subsequently, we calculated the volumes and densities from the muscle masks segmented by our model and performed correlation analysis with pulmonary function test (PFT) parameters. The segmentation models for muscle tissue and respiratory muscles obtained dice scores of 0.9823 and 0.9688, respectively. The classification model, achieving a generalized dice score of 0.9900, also demonstrated high accuracy in classifying thoracic region muscle types, as evidenced by its F1 scores: 0.9793 for the pectoralis muscle, 0.9975 for the erector spinae muscle, and 0.9839 for the intercostal muscle. In the correlation analysis, the volume of the respiratory muscles showed a strong correlation with PFT parameters, suggesting that respiratory muscle volume may serve as a potential novel biomarker for respiratory function. Although muscle density showed a weaker correlation with the PFT parameters, it has a potential significance in medical research.

Introduction

The lungs are essential organs responsible for respiration to sustain life. Diseases that impair lung function pose a significant threat to patient health. Specifically, conditions such as Chronic Obstructive Pulmonary Disease (COPD) and asthma have serious implications for a patient’s quality of life (QoL). According to World Health Organization (WHO) statistics from 2020, diseases such as COPD, lower respiratory infection, and lung cancer rank among the top 10 leading causes of death worldwide. COPD and lower respiratory infections can be particularly severe, consistently ranking as the 3rd and 4th leading causes of death, respectively [1].

A variety of respiratory diseases, such as COPD, asthma, pulmonary fibrosis, tuberculosis, bronchiectasis, and lung cancer are driven by diverse mechanisms, including lung inflammation, excessive bronchial reactions, fibrosis, infection, and structural changes. These conditions can lead to a gradual decline in respiratory function [25], which may reduce oxygen saturation and lead to hypoxia. This condition, in turn, can limit the energy supply to muscles, potentially causing sarcopenia [6], and trigger a cascade of health issues including impaired respiratory and cardiac functions, diminished QoL, and increased mortality rates [2, 3, 7, 8].

Patients with respiratory diseases often undergo pulmonary function tests (PFTs) to monitor their respiratory system status. PFTs include various diagnostic techniques such as spirometry, diffusing capacity tests, lung volume assessments, and bronchodilator tests [9, 10]. Although PFTs offer valuable insights into the abnormal patterns displayed in diverse respiratory diseases, their interpretation can vary owing to the choice of reference standards and the use of somewhat arbitrary cut-off values [11]. Moreover, there are instances in which patients maintain their QoL even when negative structural changes occur in the lungs, possibly because of enhanced respiratory muscle function [8, 1215], leading to symptom relief [16]. Therefore, to achieve accurate monitoring of the respiratory system, the analysis of PFT results should incorporate not only the clinical context and reference standards [11], but also a comprehensive approach that includes the introduction of additional biomarkers to assess respiratory muscle function. Such biomarkers may encompass the volume and density of respiratory muscles and the thickness and density of the diaphragm, as measured using thoracic CT scans. These parameters have the potential to enhance the diagnosis and monitoring of respiratory diseases, because they provide valuable insights into the correlation between a decline in respiratory muscle function and progression of respiratory conditions [17]. Consequently, these parameters can play a crucial role in adjusting patient treatment plans and predicting disease prognosis, thereby providing significant information for clinical decision-making [18, 19].

A significant correlation has previously been found between skeletal muscle mass loss and pulmonary health [18, 19], particularly in patients with COPD and asthma. The American Thoracic Society/European Respiratory Society (ATS/ERS) stated in 1999 that a decline in skeletal muscle volume is the primary cause of severe disability in patients with COPD [20]. McDonald et al. observed that, as COPD progresses through the Global Initiative for Chronic Obstructive Pulmonary Disease (GOLD) stages, the area of the pectoralis muscle, part of the respiratory muscles, tends to decrease. This suggests it could be a useful noninvasive marker to assess respiratory muscle impairment [21]. Moreover, skeletal muscle loss in patients with COPD has been confirmed as an independent predictor of mortality [22]. Similarly, research on asthma patients has revealed that those with lower muscle mass tend to have more blocked airways and a higher risk of severe exacerbation [23]. Patients with higher-density respiratory muscles show reduced respiratory symptoms, such as breathlessness upon exercise [24, 25]. Therefore, the precise measurement and analysis of these respiratory muscles are vital for predicting disease prognosis and formulating appropriate treatment plans.

Computed tomography (CT) is a versatile tool used to diagnose various human diseases. One of its advantages is its capability for the quantitative volumetric assessment of the anatomy of patients, making it particularly useful for quantifying respiratory muscles. However, traditional approaches generally involve in-slice measurement techniques This process involves finding a specific cross-sectional slice using biomarkers or physiological indicators and measuring the area and distribution of Hounsfield units (HU) in that slice. Cruz-Jentoft et al. advocated this approach, suggesting that the muscle area in a single slice at the level of the third lumbar vertebra (L3) was highly correlated with the whole-body muscle mass and could thus serve as a surrogate for muscle quantification [26]. Zhi et al. indicated that the muscle area measured at the T12 could serve as a substitute for L3 and act as an independent predictor of hospital mortality among older patients with COPD admitted to intensive care units [27]. Kim et al. [7] measured the cross-sectional area of the pectoralis muscle in a single slice immediately above the aortic arch and found a moderate correlation between the pectoralis muscle area and total skeletal muscle mass.

Although single axial slice-based methods for measuring muscle mass are convenient and time-efficient, they cannot provide comprehensive three-dimensional volumetric information of the region of interest. Consequently, the quantitative metrics derived from these single-slice images may not accurately assess the organs under study.

With rapid advancements in medicine, artificial intelligence-based segmentation technologies are gaining attention, particularly in the automatic segmentation of complex muscle areas that serve as quantitative measurement standards [2830]. Technologies that utilize CT images have been explored for various organs. For example, Hiasa et al. introduced a Bayesian U-Net model for gluteal and thigh muscle segmentation, incorporating uncertainty metrics from the training process to identify less reliable segmentation predictions [28]. Through active learning, this model refined the accuracy in these areas. Qadri et al. employed a stacked sparse autoencoder (SSAE) for spine segmentation using subdivided CT image patches to illustrate the efficacy of the SSAE in localized tasks [29]. Chen et al. presented a lung-dense attention network with residual spatial attention and gated channel attention mechanisms [30]. By assigning weights to the pulmonary regions, this model outperformed traditional segmentation methods in the lung areas.

This study aimed to develop an automated approach for the segmentation of three types of respiratory muscles (the pectoralis, erector spinae, and intercostal muscles) from CT images using artificial intelligence techniques. Furthermore, this study proposes an intuitive approach for calculating the volume and density of segmented respiratory muscles. Using the measured volume and density, the study also investigated the correlation with the PFT elements to explore the potential of respiratory function biomarkers.

Materials and methods

Study design

This retrospective study was conducted in compliance with the Helsinki Declaration and was approved by the Institutional Review Board (IRB) of Korea University Guro Hospital (IRB No.: 2022GR0185, 2018GR0179, and 2021GR0335). The datasets, collected from the IRB-approved research, were accessed from September 22, 2021, to June 21, 2022. Authors had no access to information that could identify individual participants during or after data collection. The need to obtain informed consent was waived by the Institutional Review Board due to the retrospective nature of the study.

The datasets used in this study included all Korean fat and muscle mass data constructed by the National Information Society Agency (NIA) [31] and anonymized thoracic CT images of patients with respiratory diseases and healthy individuals collected at Korea University Guro Hospital. A concise overview of the datasets is presented in Table 1. A detailed description of the data can be found in the section entitled "Detailed Description of the Dataset”.

thumbnail
Table 1. Summary of datasets and corresponding IRB numbers.

https://doi.org/10.1371/journal.pone.0306789.t001

The segmentation and classification of the respiratory muscles were conducted using the empirically modified Attention U-Net model, divided into the following three specialized stages: muscle tissue segmentation, respiratory muscle segmentation, and respiratory muscle classification. Fig 1 presents the workflow of this study. The performance of the model was validated using machine-learning metrics and visual assessments by radiologists. The volume and density of the respiratory muscles were calculated using pixel-based methods by analyzing the areas within the muscle regions identified on the binary masks. To examine the correlation between these measurements and PFT parameters, we employed the scipy.stats.spearmanr function from the SciPy library (version 1.9.0), utilizing the Spearman’s rank correlation method. Two NVIDIA V100 GPUs provided by NIA and an NVIDIA RTX A6000 from the Korea University Guro Hospital were utilized to train the machine-learning models. The deep learning framework employed was PyTorch version 1.10.2.

thumbnail
Fig 1. Overview of the experimental workflow.

(a) The Muscle Tissue Segmentation Model. The model for segmenting all muscle tissues from thoracic CT scans. (b) Comprehensive Respiratory Muscle Segmentation Model. This model processes CT images to produce comprehensive respiratory muscle masks by fine-tuning the model depicted in (a), which includes freezing the first three layers of the encoder. (c) Respiratory Muscle Classification Model. This model classifies individual respiratory muscle masks from the Comprehensive Respiratory Muscle Mask.

https://doi.org/10.1371/journal.pone.0306789.g001

Detailed description of the dataset

The imaging data utilized in this study comprised 512×512 pixel DICOM images and corresponding 512×512 pixel muscle tissue masks. Muscle tissue segmentation model data were derived from Korean fat and muscle mass data, previously established by the NIA, and used with ethical approval from the IRB of Korea University Guro Hospital (Table 1, Dataset ID: D1). The dataset was meticulously curated by first selecting individuals based on their daily living capabilities and primary symptoms, followed by a secondary selection of healthy individuals based on the PET/CT imaging results. A total of 3,000 individuals, whose CT data were devoid of noise and artifacts, and without any significant underlying diseases, were selected for this study. The selected data were anonymized to remove sensitive information and randomly sampled for cross-validation by two radiologists to ensure that only data with 100% agreement of specialist opinions were included. The finalized dataset was processed using an annotation tool to mask the muscle regions, which were then extracted in NII and TIF formats.

To train the model responsible for segmenting and classifying respiratory muscle areas from thoracic CT scans, we utilized CT images from Korea University Guro Hospital. This dataset, approved for use by Guro Hospital’s IRB (Table 1, Dataset ID: D2), comprised data from 202 individuals, including patients with various respiratory diseases, including COPD and asthma, and healthy individuals. Patients with severe underlying conditions or complicated muscle mass measurements were excluded from the study. The selected images were anonymized, and sensitive data were excluded and checked for compliance with the international standards of medical imaging. For the annotation process of our study, the pectoralis, erector spinae, and intercostal muscles within all CT images were manually annotated by three experienced radiologists. The quality and accuracy of the annotated masks were confirmed through a consensus reached during meetings of the three radiologists, where every mask was thoroughly reviewed and refined. Table 2 shows the detailed characteristics of the datasets.

thumbnail
Table 2. General characteristics of patient data for distribution of the respiratory muscles.

https://doi.org/10.1371/journal.pone.0306789.t002

To further assess the utility and validate the performance of our respiratory muscle segmentation and classification model, we employed an additional dataset from Korea University Guro Hospital (Table 1, Dataset ID: D3). This dataset comprised CT scans from 1,674 individuals aged between 40–80 years, without pre-existing respiratory muscle masks. This facilitated the analysis of the relationship between elements of the PFT and respiratory muscles, as well as the exploration of the distribution of total respiratory muscle volume across various age and sex groups. The specific characteristics of this dataset are detailed in Table 3.

thumbnail
Table 3. General characteristics of patient data for the distribution of respiratory muscles.

https://doi.org/10.1371/journal.pone.0306789.t003

Deep learning for respiratory muscle segmentation and classification in CT

The muscle tissue segmentation model in this study was trained using a NIA dataset to segment all the muscle tissues within the thoracic region. Image preprocessing was conducted to enhance the muscle distribution clarity and increase the robustness of the model. This included creating a 3-channel input image by combining images based on distinct HU ranges, as used by radiologists in clinical settings for muscle localization [3234]. These channels comprised the original DICOM images (-1024 HU to 3071 HU), images considering the HU ranges for muscles and fat (-250 HU to 150 HU), and those below the muscles and fat HU range (below 250 HU). The methodology is illustrated in Fig 2a. Additionally, image augmentation techniques, such as horizontal flipping and rotation, were applied without compromising the intrinsic features of the CT images.

thumbnail
Fig 2. Schematic of the 3-channel image generation process.

(a) Process of creating input image data for the muscle tissue segmentation and respiratory muscle segmentation models (b) Process of Creating Input Image Data for Respiratory Muscle classification model.

https://doi.org/10.1371/journal.pone.0306789.g002

The muscle tissue segmentation model employed the Attention U-Net architecture (Fig 3), which is known for its effectiveness in medical image segmentation [35]. This architecture integrates attention gates to focus on target areas and enhance the segmentation precision. A sigmoid activation function was used in the output layer for binary classification of the pixels (Fig 1). The training data were divided in an 8:2 ratio for training and testing, using dice loss as the loss function. For model training, the Adam optimizer was used with epochs set to 100 and a batch size of 8. The initial learning rate was set to 0.0001, and if there was no improvement in dice loss for three consecutive epochs, the learning rate was reduced by 70%. Post-processing steps, including noise removal from the respiratory muscle masks using OpenCV, were performed to eliminate connected components below a certain size.

thumbnail
Fig 3. Attention U-Net architecture.

The unit model was designed with six layers of each encoder/decoder, and the attention gates were joined within the decoder. These gates operate in conjunction with the feature maps from both the encoder and decoder, which are transmitted via skip connections.

https://doi.org/10.1371/journal.pone.0306789.g003

Chest CT images from Korea University Guro Hospital were used to train the model to segment and classify respiratory muscle areas from thoracic CT scans. Of the 202 patients, 150 had complete labeling of the three types of respiratory muscles (pectoralis, intercostal, and erector spinae muscles), each accompanied by three mask images per DICOM image. To address the lack of labels in the remaining data, an active learning approach was adopted during the training process of the respiratory muscle segmentation model [36]. Initially, the muscle tissue segmentation model was fine-tuned using data from 150 labeled patients. To preserve pre-learned weights and biases for common features, we froze the first three layers of the encoder. This allowed the model to learn high-level semantic information like the structure of the respiratory muscles. Subsequently, the fine-tuned model predicted the respiratory muscle areas in subsets of the 52 unlabeled patients. Experts then refined the predicted masks, using the corresponding probability maps as a reference. Once the new masks were obtained, the accumulated data were used to retrain the model from scratch, thereby enhancing the performance of the respiratory muscle segmentation model. This process was repeated until all unlabeled data were processed. Data preprocessing techniques, dataset division, loss functions, optimizer, learning rate and post-processing of prediction data consistently followed the methods used in muscle tissue segmentation model training, because of the common goal of binary muscle segmentation. Epochs and batch size were set at 50 and 4, respectively. The respiratory muscle classification model categorized the segmented results of the comprehensive respiratory muscle model into three classes. Although the training data remained the same as in the respiratory muscle segmentation model, the input image processing differed. The input image comprised a uniformly segmented respiratory muscle mask, an image considering the HU range for muscles and fat (-250 HU to 150 HU), and an original DICOM image (-1024 HU to 3071 HU), forming a multichannel structure (Fig 2b). The input labels were assigned unique pixel values for different muscle classes to differentiate them from the segmentation model. Pixel values in overlapping muscle areas prioritized the pectoralis and erector spinae muscles over the intercostal muscles. The training data were split in an 8:2 ratio for training and testing. The same Attention UNet architecture was employed for muscle classification, which was expedited by the proven efficacy of the architecture on the same dataset. However, a softmax activation function was used at the output layer for multiclass classification, and generalized dice loss was employed during training [37, 38]. The optimizer, learning rate, epoch, and batch size were applied identically to those used in the respiratory muscle segmentation.

Model performance evaluation

The segmentation and classification performance of the proposed model were evaluated in both numerical and empirical perspective ways. First, machine learning metrics such as the Dice Similarity Coefficient score and the Generalized Dice Similarity Coefficient score were applied to evaluate the segmentation model, while precision, recall, and F1 score metrics were employed to assess the classification model. Second, experienced radiologists visually assessed the segmentation results by assigning quantitative scores ranging from 1 to 10, based on criteria such as slice- and volume-based accuracy and under/over-segmentation.

Additional experimental analysis

After consulting respiratory specialists, closely related PFT indicators were selected for correlation analysis between respiratory muscle volume and density measurements and PFT variables. For the correlation analysis, we utilized the PFT information acquired within three months of the CT scan date and conducted a Spearman’s rank correlation. The volume and density of the respiratory muscles were calculated using the predictive masks generated by the segmentation and classification models presented in this paper. The volume was determined based on mask pixels and slice thickness, while the density was calculated using the HU values corresponding to each pixel.

Furthermore, the distribution of the total volume of respiratory muscles across age groups and gender was investigated to assess the diverse research applicability of the proposed muscle measurement methodology.

Results

Respiratory muscle segmentation and classification

The segmentation results for the respiratory muscles obtained using the proposed methodology are shown in Figs 4 and 5. The dice scores for the muscle tissue segmentation model and respiratory muscle segmentation model on the test set were 0.9823 and 0.9688, respectively, with dice loss values of 0.0177 and 0.0312, respectively. The generalized dice score for the three types of respiratory muscle classification models was 0.9930, with a generalized dice loss of 0.0070. For the classification model, the dice scores for the pectoralis, erector spinae, and intercostal muscles were 0.9794, 0.9976, and 0.9839, with corresponding loss values of 0.0206, 0.0024, and 0.0161, achieving a generalized dice score of 0.9900. The model’s classification performance, indicated by F1 scores, was 0.9793 for the pectoralis muscle, 0.9975 for the erector spinae muscle, and 0.9839 for the intercostal muscle. Details related to the model’s classification performance metrics are presented in Table 4.

thumbnail
Fig 4. Model predictions of three-dimensional respiratory muscle segmentation.

(Pectoralis Major Muscles: Red, Intercostal Muscles: Blue, Erector Spinae Muscles: Green): (a) Example of Successful Segmentation, (b) Example of Inadequate Segmentation. Compared to a case of successful segmentation, there is a relative lack of continuity between the Intercostal Muscles and the Erector Spinae Muscles.

https://doi.org/10.1371/journal.pone.0306789.g004

thumbnail
Fig 5. Muscle segmentation results on axial slices of thoracic CT scans.

In each image, the upper section represents the ventral aspect, while the lower section depicts the dorsal aspect. The first row illustrates the upper part of the thorax, with the second and third rows progressively moving towards the lower part. (Pectoralis Muscles: Red, Intercostal Muscles: Blue, Erector Spinae Muscles: Green).

https://doi.org/10.1371/journal.pone.0306789.g005

thumbnail
Table 4. Classification performance metrics for each respiratory muscle: Precision, recall, F1 score, and overall accuracy.

https://doi.org/10.1371/journal.pone.0306789.t004

According to visual evaluations by radiology experts, the accuracy score of the model for respiratory muscle segmentation ranged from 8 to 9 on a 10-point scale, indicating generally favorable assessments. Regarding the segmentation errors, the rate of insufficient muscle segmentation was higher than the converse rate. Considering the expert interpretations and the overall score for all criteria, the segmentation performance for the intercostal muscles was comparatively lower; however, the proposed respiratory muscle segmentation method ultimately demonstrated good performance. The results of the visual evaluation are shown in Table 5.

Additional experimental analysis

Further analyses investigated the correlations between the estimated volumes and densities of the pectoralis, erector spinae, and intercostal muscle regions with parameters from the PFT. These parameters, outlined in Table 6, include forced vital capacity (FVC), inspiratory capacity (IC), vital capacity (VC), forced expiratory volume in one second (FEV1), total lung capacity (TLC), forced expiratory volume in six seconds (FEV6), and the diffusing capacity of the lungs for carbon monoxide (DLCO). The selection of PFT indicators for inclusion was based on advice from pulmonary specialists, ensuring their significant relevance to respiratory conditions. The volumes and densities of these three types of respiratory muscles were calculated based on the dataset provided by Korea University Guro Hospital (referenced as Table 1, Dataset ID: D3). Results of these calculations are presented in Table 7.

thumbnail
Table 7. Quantitative analysis of respiratory muscle volume and density based on the proposed models.

https://doi.org/10.1371/journal.pone.0306789.t007

Factors within the respiratory muscles that exhibited a strong correlation with the PFT components were the volumes of the pectoralis and erector spinae muscles, especially the volume of the pectoralis muscles, which showed strong correlations with all selected PFT components. Overall, the density of the pectoralis muscles and volume of the intercostal muscles exhibited moderate correlations with the PFT components, whereas the density of the erector spinae muscles and intercostal muscles showed relatively weaker correlations. From the standpoint of respiratory muscle elements, PFT parameters that displayed strong correlations mainly included FVC, IC, and VC, whereas the correlations with FEV1, TLC, FEV6, and DLCO varied depending on the specific respiratory muscle factors.

Utilizing the total volume data of respiratory muscles detailed in Table 7, Figs 6 and 7 depict the distribution across various age groups (40–80 years) and sexes, respectively. As the age increased, the volume of the respiratory muscles decreased. Within each age group, males exhibited a greater total volume of respiratory muscles than females.

thumbnail
Fig 6. Distribution of average respiratory muscle volume by age group and sex.

(Male: Blue, Female: Pink).

https://doi.org/10.1371/journal.pone.0306789.g006

thumbnail
Fig 7. Distribution of respiratory muscle volume by age group and sex.

(Male: Blue, Female: Pink).

https://doi.org/10.1371/journal.pone.0306789.g007

Discussion

In this study, we developed a deep-learning-based respiratory muscle segmentation and classification model capable of quantifying the volume and density of respiratory muscles from CT images. For the accurate analysis of the characteristics and structure of respiratory muscles, in CT images, it is necessary to acquire information from all slices. This is essential because features, including muscle morphology or the muscle-to-fat ratio, are likely to vary across the entire set of slices. Relying solely on representative slices for muscle measurement does not consider such heterogeneity, potentially leading to an inaccurate reflection of the overall characteristics of the tissue. Therefore, the volume and density measurement techniques of the respiratory muscles proposed through our model serve as a meaningful approach for more accurate quantification of muscle attributes.

We selected the Attention U-Net for respiratory muscle segmentation because of its superior performance over other state-of-the-art methods in prior research that focused on pectoralis muscle segmentation in CT-based studies [39]. To address the scarcity of labeled data in the medical domain, we chose to employ a muscle tissue segmentation model that was trained on a large dataset. This strategic choice allowed us to significantly enhance the performance of our respiratory muscle segmentation by fine-tuning the muscle tissue segmentation model with a smaller scale dataset related to respiratory muscle segmentation.

In this study, two reasons prompted the adoption of separate segmentation and classification models to individually segment the three types of respiratory muscles in the CT images. First, we aimed to improve performance by constructing specialized models for each task. The respiratory muscle segmentation model was optimized to distinguish between the muscle and background, thereby reducing the complexity of the problem. The respiratory muscle classification model focuses solely on a finer categorization within the respiratory muscles. In doing so, we managed to mitigate the complexity of the problem and enhance the model performance. Second, the introduction of a modular model design ensures the functional independence of each model, thus providing a flexible foundation for its application in various medical research contexts. For instance, in situations requiring the segmentation or classification of other thoracic muscles, the modular design of separate models can enhance research efficiency. Indeed, our goal extends beyond respiratory muscles, with the aim of encompassing the segmentation and classification of a broad range of thoracic muscles, which motivated our choice for a modular model design approach.

The experimental analysis focused on exploring the correlations between PFT parameters and the respiratory muscles’ volume and density, as well as muscle volume variations across gender and age groups, aiming to identify patterns and trends rather than statistical significance. In a study examining the correlation between PFT parameters and the volume and density of respiratory muscles, respiratory muscle volume showed strong correlations with PFT parameters including FVC, IC, VC, FEV1, TLC, FEV6, and DLCO. PFT parameters play a pivotal role in the diagnosis of a wide range of respiratory diseases, particularly in evaluating respiratory function. Therefore, our analysis indicates the potential of using the quantitative volume of the respiratory muscles as a biomarker for the assessment of respiratory function. This finding offers a novel approach to overcome the limitations of existing PFT methodologies.

The correlation between respiratory muscle density and PFT results was relatively weak. However, Nachit et al. reported a significant association between intramuscular fat deposition and mortality risk [40]. Therefore, we anticipate that respiratory muscle density could be utilized in future studies to assess the prognosis in patients with various diseases, including respiratory illnesses.

If the proposed algorithm is used to obtain sex-specific, year-wise, and age-wise muscle distributions over a designated period, it could facilitate the exploration of diseases that correlate with muscle distribution trends. As such, we believe that the accumulated muscle data could contribute to the discovery of new biomarkers and aid in other clinical studies related to trends in muscle distribution.

Despite the advantages of the methods and findings proposed in this study, some limitations should be highlighted. One significant challenge was the 3 mm slice thickness of our CT dataset, hindering the accurate segmentation of fine structures such as the diaphragm. The loss of continuity and clarity in sagittal plane imaging necessitated the exclusion of the diaphragm from our study scope despite its critical role in respiration. In future work, we aim to develop rule-based algorithms for diaphragm segmentation using thinner CT slices to overcome this limitation. Additionally, this study’s reliance on a dataset from a specific hospital may limit the generalizability of our findings. Variations in imaging protocols across CT scanners could also impact model performance. The observed weak correlation between muscle density and PFT parameters also underscores the need for further validation. Finally, focusing only on static images omits the dynamic nature of muscle function during respiration, suggesting that future studies should incorporate multimodal data for a more comprehensive analysis.

Conclusion

In this study, we developed a deep-learning-based model for the segmentation and classification of respiratory muscles, and further verified its capability to measure the volume and density of respiratory muscles precisely in CT images. Although the model demonstrated limitations in being optimized for a specific protocol, the quantified volume of the respiratory muscles showed a correlation with various PFT elements related to respiratory capacity. Additionally, the density of the respiratory muscles suggests high applicability in the field of medical research. These quantified metrics for respiratory muscles have the potential to serve as new biomarkers that can be applied in the diagnosis and treatment of respiratory diseases, as well as foundational data for subsequent research across various diseases and conditions.

References

  1. 1. World Health Organization. The top 10 causes of death; 2020. (https://www.who.int/news-room/fact-sheets/detail/the-top-10-causes-of-death).
  2. 2. Knuiman MW, James AL, Divitini ML, Ryan G, Bartholomew HC, Musk AW. Lung function, respiratory symptoms, and mortality: results from the Busselton Health Study. Ann Epidemiol. 1999;9: 297–306. pmid:10976856
  3. 3. Tantucci C, Modina D. Lung function decline in COPD. Int J Chron Obstruct Pulmon Dis. 2012;7: 95–99. pmid:22371650
  4. 4. Schelling G, Stoll C, Vogelmeier C, Hummel T, Behr J, Kapfhammer HP, et al. Pulmonary function and health-related quality of life in a sample of long-term survivors of the acute respiratory distress syndrome. Intensive Care Med. 2000;26: 1304–1311. pmid:11089757
  5. 5. Yohannes AM, Baldwin RC, Connolly M. Mortality predictors in disabling chronic obstructive pulmonary disease in old age. Age Ageing. 2002;31: 137–140. pmid:11937477
  6. 6. Vermeeren MA, Schols AM, Wouters EF. Effects of an acute exacerbation on nutritional and metabolic profile of patients with COPD. Eur Respir J. 1997;10: 2264–2269. pmid:9387951
  7. 7. Kim YS, Kim EY, Kang SM, Ahn HK, Kim HS. Single cross-sectional area of pectoralis muscle by computed tomography—correlation with bioelectrical impedance based skeletal muscle mass in healthy subjects. Clin Physiol Funct Imaging. 2017;37: 507–511. pmid:26668097
  8. 8. Kovarik M, Joskova V, Patkova A, Koblizek V, Zadak Z, Hronek M. Hand grip endurance test relates to clinical state and prognosis in COPD patients better than 6-minute walk test distance. Int J Chron Obstruct Pulmon Dis. 2017;12: 3429–3435. pmid:29238187
  9. 9. Gold WM, Koth LL. Pulmonary function testing. Murray Nadel’s Textbook Respir Med. 20150403 ed2016: 407-35.e18.
  10. 10. Ranu H, Wilde M, Madden B. Pulmonary function tests. Ulster Med J. 2011;80: 84–90. pmid:22347750
  11. 11. Berry CE, Wise RA. Interpretation of pulmonary function test: issues and controversies. Clin Rev Allergy Immunol. 2009;37: 173–180. pmid:19305954
  12. 12. Duruturk N, Acar M, Doğrul MI. Effect of inspiratory muscle training in the management of patients with asthma: a randomized controlled trial. J Cardiopulm Rehabil Prev. 2018;38: 198–203. pmid:29652761
  13. 13. Scherer TA, Spengler CM, Owassapian D, Imhof E, Boutellier U. Respiratory muscle endurance training in chronic obstructive pulmonary disease: impact on exercise capacity, dyspnea, and quality of life. Am J Respir Crit Care Med. 2000;162: 1709–1714. pmid:11069801
  14. 14. Özdal M. Acute effects of inspiratory muscle warm-up on pulmonary function in healthy subjects. Respir Physiol Neurobiol. 2016;227: 23–26. pmid:26903486
  15. 15. Sánchez Riera H, Montemayor Rubio T, Ortega Ruiz F, Cejudo Ramos P, Del Castillo Otero D, Elias Hernandez T, et al. Inspiratory muscle training in patients with COPD: effect on dyspnea, exercise performance, and quality of life. Chest. 2001;120: 748–756. pmid:11555505
  16. 16. Leelarungrayub J, Pinkaew D, Puntumetakul R, Klaphajone J. Effects of a simple prototype respiratory muscle trainer on respiratory muscle strength, quality of life and dyspnea, and oxidative stress in COPD patients: a preliminary study. Int J Chron Obstruct Pulmon Dis. 2017;12: 1415–1425. pmid:28553094
  17. 17. Vimal G, Kolek V, Jaskova J. Respiratory muscle assessment in acute exacerbation of chronic obstructive pulmonary disease and its role as a potential biomarker. Biomed Pap Med Fac Univ Palacky Olomouc Czech Repub. 2012;156: 302–311. pmid:23073515
  18. 18. Moon SW, Choi JS, Lee SH, Jung KS, Jung JY, Kang YA, et al. Thoracic skeletal muscle quantification: low muscle mass is related with worse prognosis in idiopathic pulmonary fibrosis patients. Respir Res. 2019;20: 35. pmid:30767787
  19. 19. Bye A, Sjøblom B, Wentzel-Larsen T, Grønberg BH, Baracos VE, Hjermstad MJ, et al. Muscle mass and association to quality of life in non-small cell lung cancer patients. J Cachexia Sarcopenia Muscle. 2017;8: 759–767. pmid:28493418
  20. 20. American Thoracic Society/European Respiratory Society. ATS/ERS Statement on respiratory muscle testing. Am J Respir Crit Care Med. 2002;166: 518–624. pmid:12186831
  21. 21. McDonald MLN, Diaz AA, Ross JC, Estepar RSJ, Zhou L, Regan EA, et al. Quantitative computed tomography measures of pectoralis muscle area and disease severity in chronic obstructive pulmonary disease: a cross-sectional study. Ann Am Thorac Soc. 2014;11: 326–334. pmid:24558953
  22. 22. Schols AM, Slangen J, Volovics L, Wouters EF. Weight loss is a reversible factor in the prognosis of chronic obstructive pulmonary disease. Am J Respir Crit Care Med. 1998;157: 1791–1797. pmid:9620907
  23. 23. Zhang S, Zhang X, Deng K, Wang C, Wood LG, Wan H, et al. Reduced skeletal muscle mass is associated with an increased risk of asthma control and exacerbation. J Clin Med. 2022;11. pmid:36498815
  24. 24. Crisafulli E, Costi S, Fabbri LM, Clini EM. Respiratory muscles training in COPD patients. Int J Chron Obstruct Pulmon Dis. 2007;2: 19–25. pmid:18044062
  25. 25. Kim J, Park JH, Yim J. Effects of respiratory muscle and endurance training using an individualized training device on the pulmonary function and exercise capacity in stroke patients. Med Sci Monit. 2014;20: 2543–2549. pmid:25488849
  26. 26. Cruz-Jentoft AJ, Bahat G, Bauer J, Boirie Y, Bruyère O, Cederholm T, et al. Sarcopenia: revised European consensus on definition and diagnosis. Age Ageing. 2019;48: 16–31. pmid:30312372
  27. 27. Zhi J, Shan Q, Liang L, Liu H, Huang H. Low skeletal muscle area as a prognostic marker for chronic obstructive pulmonary disease in elderly patients admitted to ICU. Sci Rep. 2019;9: 19117. pmid:31836824
  28. 28. Hiasa Y, Otake Y, Takao M, Ogawa T, Sugano N, Sato Y. Automated muscle segmentation from clinical CT using Bayesian U-net for personalized musculoskeletal modeling. IEEE Trans Med Imaging. 2020;39: 1030–1040. pmid:31514128
  29. 29. Qadri SF, Lin H, Shen L, Ahmad M, Qadri S, Khan S, et al. CT-based automatic spine segmentation using patch-based deep learning. Int J Intell Syst. 2023;2023: 1–14.
  30. 30. Chen Y, Feng L, Zheng C, Zhou T, Liu L, Liu P, et al. LDANet: automatic lung parenchyma segmentation from CT images. Comput Biol Med. 2023;155: 106659. pmid:36791550
  31. 31. Korean Ministry of Science ICT. Korean Fat and Muscle mass; 2020. (https://www.aihub.or.kr/aihubdata/data/view.do?currMenu=115&topMenu=100&aihubDataSe=data&dataSetSn=232).
  32. 32. Buzug TM. Computed tomography from photon statistics to modern cone-beam CT. 1st ed. Berlin Heidelberg: Springer; 2008.
  33. 33. Chougule, Vikas Narayan et al. “Clinical Case Study: Spine Modeling for Minimum Invasive Spine Surgeries (MISS) using Rapid Prototyping”. Proceedings of 10th International Conference on Precision, Meso, Micro and Nano Engineering (COPEN 10). (2017).
  34. 34. Long DE, Villasante Tezanos AG, Wise JN, et al. A guide for using NIH Image J for single slice cross-sectional area and composition analysis of the thigh from computed tomography. PLoS One. 2019;14(2):e0211629. pmid:30730923
  35. 35. Zhao Z, Chen H, Li J, Wang L. Boundary attention U-net for kidney and kidney tumor segmentation. Annu Int Conf IEEE Eng Med Biol Soc. 2022;2022: 1540–1543. pmid:36085739
  36. 36. Nath V, Yang D, Landman BA, Xu D, Roth HR. Diminishing uncertainty within the training pool: active learning for medical image segmentation. IEEE Trans Med Imaging. 2021;40: 2534–2547. pmid:33373298
  37. 37. Crum WR, Camara O, Hill DL. Generalized overlap measures for evaluation and validation in medical image analysis. IEEE Trans Med Imaging. 2006;25: 1451–1461. pmid:17117774
  38. 38. Sudre CH, Li W, Vercauteren T, Ourselin S, Jorge Cardoso M. Generalised dice overlap as a deep learning loss function for highly unbalanced segmentations. Deep Learn Image Anal Multimodal Learn Clin Decis Support. 2017;2017: 240–248. pmid:34104926
  39. 39. Yang Z, Choi I, Choi J, Jung J, Ryu M, Yong HS. Deep learning-based pectoralis muscle volume segmentation method from chest computed tomography image using sagittal range detection and axial slice-based segmentation. PLOS ONE. 2023;18: e0290950. pmid:37669295
  40. 40. Nachit M, Horsmans Y, Summers RM, Leclercq IA, Pickhardt PJ. AI-based CT body composition identifies myosteatosis as key mortality predictor in asymptomatic adults. Radiology. 2023;307: e222008. pmid:37191484