Peer Review History

Original SubmissionJune 3, 2024
Decision Letter - Priti Chaudhary, Editor

PONE-D-24-22363Development and Utilization of 3D Anatomy Education Content using Metaverse and XR for Remote Telemedicine EducationPLOS ONE

Dear Dr.  Ahn, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Aug 16 2024 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org . When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols . Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols .

We look forward to receiving your revised manuscript.

Kind regards,

Priti Chaudhary, M.S.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please note that PLOS ONE has specific guidelines on code sharing for submissions in which author-generated code underpins the findings in the manuscript. In these cases, we expect all author-generated code to be made available without restrictions upon publication of the work. Please review our guidelines at https://journals.plos.org/plosone/s/materials-and-software-sharing#loc-sharing-code and ensure that your code is shared in a way that follows best practice and facilitates reproducibility and reuse.

3. Please note that funding information should not appear in any section or other areas of your manuscript. We will only publish funding information present in the Funding Statement section of the online submission form. Please remove any funding-related text from the manuscript.

4. We note that your Data Availability Statement is currently as follows: All relevant data are within the manuscript and its Supporting Information files.

Please confirm at this time whether or not your submission contains all raw data required to replicate the results of your study. Authors must share the “minimal data set” for their submission. PLOS defines the minimal data set to consist of the data required to replicate all study findings reported in the article, as well as related metadata and methods (https://journals.plos.org/plosone/s/data-availability#loc-minimal-data-set-definition).

For example, authors should submit the following data:

- The values behind the means, standard deviations and other measures reported;

- The values used to build graphs;

- The points extracted from images for analysis.

Authors do not need to submit their entire data set if only a portion of the data was used in the reported study.

If your submission does not contain these data, please either upload them as Supporting Information files or deposit them to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of recommended repositories, please see https://journals.plos.org/plosone/s/recommended-repositories.

If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent. If data are owned by a third party, please indicate how others may request data access.

5. When completing the data availability statement of the submission form, you indicated that you will make your data available on acceptance. We strongly recommend all authors decide on a data sharing plan before acceptance, as the process can be lengthy and hold up publication timelines. Please note that, though access restrictions are acceptable now, your entire data will need to be made freely accessible if your manuscript is accepted for publication. This policy applies to all data except where public deposition would breach compliance with the protocol approved by your research ethics board. If you are unable to adhere to our open data policy, please kindly revise your statement to explain your reasoning and we will seek the editor's input on an exemption. Please be assured that, once you have provided your new statement, the assessment of your exemption will not hold up the peer review process.

Additional Editor Comments:

Authors are required to reply all the queries, raised by both the reviewers.

Please add the document related to Ethical waiver from Institutional Ethics Committee/ Research Advisory Committee.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: N/A

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: introduction: informative but the main aim of the research should be briefly addressed at its end

methedology: presented with detailed structure

results: great effort is recognized adressing short video for the actual usage of the system would have been a marked

result.

- addressing any reviews of the users either students or professors would have been a plus OR it may be a

complementary research work???!!!

discussion: though it is clear that it is a denovo system but i would have prefered to compare it to other 3d systems that

may be used in teaching anatomy, or address its advantages to well known 2d systems and so on

Reviewer #2: Dear author

I really appreciate the effort done in replicating the twin model and the sophistication of methodology listed, but I have a few questions that I couldn't get past regarding the delivered manuscript

1- Where is the "Korean Standard Full-body Cadaver in metaverse", all what was described was merely bone scans, no flesh, no organs, no full body

2- You mentioned that this project was assessed by a cohort of medical professionals and students from Ewha Woman’s University and 40 other nursing schools in Korea, where is this assessment

3- The name of the study implies the use of metaverse/XR technology to replace traditional teaching with its limitations, why the need for a 3D printing model for bones of the body from the start

4- What's the importance of 3D printing for the bone scans, despite the fact that plastic models deliver a reasonable accuracy for this particular point that alleviates the need for a 3D print of it.

Apart of these comments, the rational is acceptable, the methodology is detailed and properly enlisted, but no field studies were added to assess the validity of the proposed tool in anatomical education

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean? ). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy .

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/ . PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org . Please note that Supporting Information files do not need this step.

Attachments
Attachment
Submitted filename: Manuscript_PlosOne.docx
Revision 1

Reviewer #1:

1. introduction: informative but the main aim of the research should be briefly addressed at its end

Thank you for your comment.

The main purpose of the study has been added at the end of the introduction.

L116:

In essence, this research aims to pioneer XR anatomy education developing a 3D DT of a KSMC in the metaverse, introducing transformative and collaborative approaches to current challenges and future possibilities in medical education and telemedicine.

2. methodology: presented with detailed structure

Thank you for your comment regarding the detailed structure of the methodology section. We have made further enhancements to the clarity and comprehensiveness of the "Materials and Methods" section to ensure it accurately conveys the process and techniques used in developing the 3D Digital Twin Cadaver and the accompanying XR content for the metaverse platform.

Before revision of the version methodology structure is as follows.

MATERIALS AND METHODS

From Cadaver to a 3D Digital Twin Cadaver

Collecting and Scanning

Refining and Retopologizing the Mesh for Accuracy

Optimizing Polygons

Architecture for the metaverse platform to Facilitate a 3D digital twin

HoloLens 2

Developing a Metaverse Platform and Adding Interactivity

Development of XR contents

The revised methodology structure is as follows:

MATERIALS AND METHODS

From Cadaver to a 3D Digital Twin Cadaver

Collecting and Scanning

Refining the Mesh

Retopologizing the mesh

Optimizing Polygons

The architecture to facilitate the 3D DT in metaverse

HoloLens 2

Developing a Metaverse Platform

Developing real-time interaction features between users

Enhancing XR content with remote rendering

Pilot test feedback

3. results: great effort is recognized addressing short video for the actual usage of the system would have been a marked

We sincerely appreciate your suggestion and believe that a video can be an effective supplement to our Manuscript.

L414:

A short video showcases few moments from pilot tests and provides a walkthrough of the developed Metaverse platform and the 3D DT of the KSMC, called ‘Skeletomy.’ This video, included as supplementary material, provides an immersive experience from various perspectives. Two users are featured in the video: the main user (female) is shown from a 1st person perspective, and the secondary user (male) is shown in 3rd person perspective. Together, they demonstrate real-time collaboration features as they interact with the same 3D digital twin (DT) of the Korean Standard Male Cadaver (KSMC). Through this video, viewers also get a chance to immerse themselves in an indirect experience of learning with the KSMC and to envision a new virtual era for applications in anatomy education and telemedicine.

4. Result.- addressing any reviews of the users either students or professors would have been a plus OR it may be a complementary research work???!!!

Per your suggestion, we added some quotes and comments from anonymous reviews and feedback that we gathered from students, professors, and professionals in the medical field. We agree that adding these would enhance the solidity of this article.

Consequently, we have included several anonymous reviews and feedback—not only highlighting honest pros and cons but also offering perspectives on potential improvements for complementary research.

L246:

Pilot test feedback

The Metaverse platform and the 3D DT content developed in our study underwent a thorough process of gathering pilot test feedback from anonymous participants in the medical field, including company employees, students and professors from medical and nursing schools. This feedback was collected through an open-ended survey covering general inquiries and interests, evaluations of quality and potential adoptability, and suggestions for further improvements. No participants were required to answer all categories, resulting in some respondents addressing one, two, or all of the topics.

L317:

Pilot test feedback

Group of anonymous college professors

College professors expressed interest in the applicability of the Metaverse platform across different departments. Majority of their inquiries focused on how the platform could be integrated into school curricula and whether additional content developments would occur to accommodate specific medical departments like ophthalmology, dentistry, cardiology or even veterinary medicine.

Group of anonymous students

A participant in an open-ended survey among nursing students who engaged with our program remarked, “Memorizing bone structures from a single diagram has always been a challenge for me. That’s why my friends and I always draw diagrams and color them to memorize them for exams. This metaverse program, however, is very fun interacting with each part of the bone. It’s like floating bones with quiz cards.” Numerous students expressed appreciation for the interactive elements and the capability for real-time collaboration. Another student noted, “When it comes to learning anatomy, I think it’s crucial for us to quiz each other and make the learning process more efficient. However, during the COVID-19 restrictions, it was extremely difficult for us to study because none of us were able to study in groups. If we had been provided with this program, I believe it would have been much easier and more enjoyable to have a group of our classmates join a session together to interact with the same cadaver in real-time.”

Group of anonymous corporate guests

Although the research and pilot testing were not specific intended for buyers, many corporate guests expressed interest in the pricing of available content on the platform and the overall timeline for the development of the upcoming contents. Meanwhile, some corporate guests were particularly fascinated by the originality of the content and wanted to know if major companies or organizations were already using it. Some reported frequent lags between movements in the scene, which may be due to the quality of internet speed depending on the environment’s connection. This highlights the need for optimize the connection between the platform and the internet to ensure a seamless user experience, regardless of internet speed and stability.

Feedback from the demo session at a medicine conference

Feedback from the demo session at an medicine conference highlights the ultimate benefits and necessity of the platform in fields that require an accurate understanding of human anatomy, such as Oriental medicine, particularly acupuncture. Users found that viewing the human skeleton in 3D improved comprehension and teaching performances. They expressed fascination with the interactive features that allowed them to zoom in, zoom out, and rotate the skeletal model. All participants at the demo session were optimistic about this research, envisioning potential collaboration between Western and Asian medicine to form a creative, integrated solution in medical field.

AR elements have been evaluated as effective in improving learners' concentration and immersion. This is a huge advantage in educational settings, promoting better engagement and understanding.

The platform's potential to replace traditional hands-on methods using live cadaver dissections or physical models was highly praised for its efficiency. Users highlighted benefits such as cost savings, solving hygiene issues and easing constraints in the physical practice environment.

5. discussion: though it is clear that it is a denovo system but i would have prefered to compare it to other 3d systems that may be used in teaching anatomy, or address its advantages to well known 2d systems and so on

We are grateful for the insightful feedback provided by the reviewer. Your comment highlighted the importance of contextualizing our de novo 3D system within the broader landscape of anatomical teaching tools. In response, we have added a comparative analysis to the discussion section of our manuscript.

Specifically, we have included a comparison of our 3D system with other 3D models, such as physical 3D printed models used in cardiology and otolaryngology training, and with VR and AR technologies. This addition emphasizes the tactile advantages and immersive experiences offered by these systems (25, 26, 27).

Additionally, we addressed the advantages of our 3D system compared to traditional 2D systems, highlighting its ability to provide a more comprehensive and interactive understanding of anatomical structures, which is often lacking in 2D representations.

L359:

In the development and application of our novel de novo 3D system for anatomical education, it is important to compare its efficacy and advantages against other established 3D and 2D systems used in teaching anatomy. Although our system presents unique features, understanding its relative performance is crucial for assessing its potential impact.

Physical 3D printed models, such as those utilized in cardiology training, offer valuable feedback and interactive experiences that enhance the learning process. Studies have demonstrated that these models can significantly aid in developing a practical understanding of complex anatomical structures (25). For example, physical models allow learners to engage in hands-on manipulation, which is instrumental in reinforcing spatial relationships and anatomical details.

In the field of otolaryngology, 3D printed models created from cadaveric temporal bones, derived from micro-CT scans, are employed for surgical training. These models highlight the advantages of tactile interaction, providing a more immersive and practical training experience (26). Such models help trainees appreciate the texture and physicality of anatomical structures, which can be crucial for surgical precision and technique.

Further, research on virtual reality (VR) and augmented reality (AR) systems reveals their potential in enhancing spatial understanding and increasing student engagement. VR and AR technologies offer immersive experiences that can complement traditional learning methods by providing dynamic and interactive visualizations of anatomical structures (27). These technologies allow learners to explore and manipulate 3D models in a virtual environment, which can be particularly beneficial for complex anatomical education.

When compared to traditional 2D systems, our de novo 3D system offers several distinct advantages. Traditional 2D images, such as those found in textbooks or standard medical illustrations, often fail to convey the spatial relationships and depth of anatomical structures effectively. This limitation can hinder a learner's ability to grasp the three-dimensional nature of anatomy, which is essential for understanding spatial orientation and performing clinical procedures.

In contrast, our 3D system provides a comprehensive, three-dimensional perspective of anatomical structures, allowing users to interact with and view models from multiple angles. This capability enhances spatial comprehension and offers a more intuitive understanding of anatomical relationships. Moreover, unlike static 2D images, the dynamic and interactive nature of 3D models facilitates a deeper engagement with the material, supporting more effective learning and retention.

25. Chetan D, Valverde I, Yoo S-J. 3D Printed Models in Cardiology Training. COLLEGE OF CARDIOLOGY FOUNDATION 2024;3.

26. Lähde S, Hirsi Y, Salmi M, Mäkitie A, Sinkkonen ST. Integration of 3D-printed middle ear models and middle ear prostheses in otosurgical training. BMC Medical Education. 2024.

27. Zulfiqar F, Raza R, Khan MO, Arif M, Alvi A, Alam T. Augmented Reality and its Applications in Education: A Systematic Survey. IEEE Access. 2023;11:143250-71.

Reviewer #2:

I really appreciate the effort done in replicating the twin model and the sophistication of

methodology listed, but I have a few questions that I couldn't get past regarding the delivered

manuscript

6. Where is the "Korean Standard Full-body Cadaver in metaverse", all what was described was merely bone scans, no flesh, no organs, no full body

Thank you for your valuable comments. As noted, our current research is focused on the initial phase of creating a digital twin from the bone scan of a Korean male cadaver. At this stage, the 3D dataset includes only the bone structures, and does not yet incorporate flesh, organs, or other body parts. Future studies are planned to include these additional anatomical features.

To clarify, the primary goal of this research is to explore complementary approaches for enhancing anatomy education and expanding telemedicine applications. While the initial phase concentrates on the bone data, subsequent research will aim to develop a more comprehensive full-body model.

L100:

Key aspects include the use HoloLens 2 Augmented Reality Head-Mounted Display (AR HMD) technology and real-time cloud rendering for an immersive and interactive educational experience. Initial 3D datasets, comprising extensive anatomical information for each bone, were obtained through the 3D scanning of a full-body cadaver of a Korean male origin. This initial study focuses on the digital twin created from the bone scan of the Korean cadaver, with complementary studies planned to include flesh, organs, and other body parts.

7. You mentioned that this project was assessed by a cohort of medical professionals and students from Ewha Woman’s University and 40 other nursing schools in Korea, where is this assessment.

Thank you for pointing that out.

Since our experiment gathered only open-ended surveys and anonymous feedback from students, professors, and professionals in the medical field, we have revised and specified the part that originally stated “cohort” to “open-ended survey” and “feedback.” Anonymous feedback and quotes have been added to strengthen the validity and clarity of our findings. Accordingly, to ensure anonymity the previously mentioned introduction, “from Ewha Woman’s University and 40 other nursing schools,” has been revised to “from medical professionals and students from nursing schools.”

L136:

Once the 3D DT of the KSMC was successfully imported into the developed Metaverse platform, the pilot test feedback was gathered from anonymous participants in the medical field, including company employees, students and professors from medical and nursing schools. They included open-ended survey from interests, evaluations and adoptability, and suggestions for improvements, which will be found throughout the article. No participants were required to answer all categories but required to answer at least one.

L317:

Pilot test feedback

Group of anonymous college professors

College professors expressed interest in the applicability of the Metaverse platform across different departments. Majority of their inquiries focused on how the platform could be integrated into school curricula and whether additional content developments would occur to accommodate specific medical departments like ophthalmology, dentistry, cardiology or even veterinary medicine.

Group of anonymous students

A participant in an open-ended survey among nursing students who engaged with our program remarked, “Memorizing bone structures from a single diagram has always been a challenge for me. That’s why my friends and I always draw diagrams and color them to memorize them for exams. This metaverse program, however, is very fun interacting with each part of the bone. It’s like floating bones with quiz cards.” Numerous students expressed appreciation for the interactive elements and the capability for real-time collaboration. Another student noted, “When it comes to learning anatomy, I think it’s crucial for us to quiz each other and make the learning process more efficient. However, during the COVID-19 restrictions, it was extremely difficult for us to study because none of us were able to study in groups. If we had been provided with this program, I believe it would have been much easier and more enjoyable to have a group of our classmates join a session together to interact with the same cadaver in real-time.”

8. The name of the study implies the use of metaverse/XR technology to replace traditional teaching with its l

Attachments
Attachment
Submitted filename: Reviewer_comments_PlosOne_20240805_v1.docx
Decision Letter - Priti Chaudhary, Editor

Anatomy Education Potential of the First Digital Twin of a Korean Cadaver

PONE-D-24-22363R1

Dear Dr.Sohyun Ahn,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice will be generated when your article is formally accepted. Please note, if your institution has a publishing partnership with PLOS and your article meets the relevant criteria, all or part of your publication costs will be covered. Please make sure your user information is up-to-date by logging into Editorial Manager at Editorial Manager®  and clicking the ‘Update My Information' link at the top of the page. If you have any questions relating to publication charges, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Priti Chaudhary, M.S.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Formally Accepted
Acceptance Letter - Priti Chaudhary, Editor

PONE-D-24-22363R1

PLOS ONE

Dear Dr. Ahn,

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now being handed over to our production team.

At this stage, our production department will prepare your paper for publication. This includes ensuring the following:

* All references, tables, and figures are properly cited

* All relevant supporting information is included in the manuscript submission,

* There are no issues that prevent the paper from being properly typeset

If revisions are needed, the production department will contact you directly to resolve them. If no revisions are needed, you will receive an email when the publication date has been set. At this time, we do not offer pre-publication proofs to authors during production of the accepted work. Please keep in mind that we are working through a large volume of accepted articles, so please give us a few weeks to review your paper and let you know the next and final steps.

Lastly, if your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

If we can help with anything else, please email us at customercare@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Priti Chaudhary

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .