Peer Review History

Original SubmissionJanuary 17, 2022
Decision Letter - Hanna Landenmark, Editor

PONE-D-22-01564Work time allocation at primary health care level in two regions of AlbaniaPLOS ONE

Dear Dr. Muho,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

 Please see the comments of one reviewer below. Please note that we have only been able to secure a single reviewer to assess your manuscript. We are issuing a decision on your manuscript at this point to prevent further delays in the evaluation of your manuscript. Please be aware that the editor who handles your revised manuscript might find it necessary to invite additional reviewers to assess this work once the revised manuscript is submitted. However, we will aim to proceed on the basis of this single review if possible.  Please submit your revised manuscript by Aug 14 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Hanna Landenmark

Staff Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The objective of this study is to assess the work-time allocation patterns of PHC workers in two regions of Albania and to compare the patterns between doctors and nurses and between urban and rural facilities. This study offers valuable insight on work-time patterns of doctors and nurses in urban and rural settings, in the two regions of Albania where the research took place.

I have the following comments, questions and suggestions:

1. For some activities the differences between rural and urban facilities are rather small, but the authors report that one group spends more time on the activity than the other group. For example: line 230: “meetings (3.4% versus 3.3%)”. It is recommended that the size of the differences is also taken into account.

2. Related to the previous comment, the observations are based on a sample. Is it not possible to calculate confidence intervals around the point estimates?

3. The authors mention several limitations. It would be interesting to discuss more the implications of the limitations for the results. To what extent can the limitations influence the result?

4. In each of the two study regions, nine health centers were included and at the health center level, one doctor, one nurse and one nurse at the affiliated health post-ambulatory. This should result in 54 HWs (2*9*3=54). However only 48 HWs participated in the study. Could be clarified which category of HWs are missing and why? I suggest to split in table 1 the category nurses in 'nurses at the health center' and 'nurses located at the affiliated health post-ambulatories'.

5. The added value of figure 2 escapes me since this information can also be found in table 2. Furthermore, the legend of figure 2 stated a category that cannot be found in the figure.

6. Table 2 is very important, however, the presentation of the categories is not clear. For example, the categories ‘other’, ‘meetings’, ‘administration’ are mentioned several times.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Wim Peersman

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Response to the first reviewer's comment: We acknowledge this comment and agree. Consequently reworded the respective section. We indicate now that for a number of categories differences between urban and rural being small, but also indicate those categories where differences are being observed (lines 234-242).

Response to the second reviewer's comment: Thank you for bringing this important point to our attention. We now have calculated the confidence intervals for each of the categories of activities for doctors and nurses, in urban and rural settings, respectively. So not to overload the tables and to keep them well understandable, the confidence intervals are presented into three new tables as supporting information (reflected in the lines 508-513) under the titles: S4 Table, S5 Table, S6 Table. In text citation referring to the confidence intervals in supporting information are added (lines 212-213, 233, 241-242).

Response to the third reviewer's comment: We agree with the reviewer. Consequently we updated the limitation section accordingly (lines 326-327, 332-333, 337, 341-342) and hope it meets the reviewer’s requests.

Response to the fourth reviewer's comment: Thank you for this valid point and for the suggestion. We updated in the revised version of the manuscript table 1 and the narrative of the sampling so to better clarify why there is only 48 HWs and not 54. Indeed, there are only two urban health post ambulatories sampled per region, thus there are four nurses less from these facilities (changes in the lines 115-116). Further, we split the category nurses in four sub-categories in Table 1 i.e.: ‘nurses at urban health center’, ‘nurses at rural health center’, ‘nurses at urban health post-ambulatories’ and ‘nurses at rural health post-ambulatories’ (line 179).

Response to the fifth reviewer's comment: We would like to acknowledge reviewer’s observation about the similarities that figure 2 and table 2 present. However, we believe that figure 2 adds to the clarity and visibility of our manuscript, making it easy for the reader to interpret the data. We hope it being acceptable to keep both tables included. Further, apologies for the typo in the legend. The category of activity from the legend of figure 2 the reviewer refers to in the comment, has been replaced accordingly (from ‘Direct patient care’ to ‘Service provision to users’).

Response to the sixth reviewer's comment: We thank the reviewer for this observation. We believe that this information can be found under the ‘Data collection section’ and we tried to further clarify it by adding an explanatory sentence (see lines 148-150). Further, we placed a footnote under Table 2 (lines 207-209) and we hope it meets the reviewer’s requests.

Response to the first journal's requirement: Requirement acknowledged. We reviewed our reference list and there is no article that has been retracted so far. However, we did noticed that in the first submission we had missed to number one of the references (reference number 41, line 483). Subsequently, all the references after this one in the reference list, increased their number by one. Only one change was made in the text due to this (line 311).

Response to the second journal's requirement: We thank the editor for bringing this point to our attention. We added a header to table 4 (line 248) in order to make the reading of the table more understandable.

Attachments
Attachment
Submitted filename: Response to reviewers.docx
Decision Letter - Dragan Pamucar, Editor

PONE-D-22-01564R1Work time allocation at primary health care level in two regions of AlbaniaPLOS ONE

Dear Dr. Muho,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Oct 27 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Dragan Pamucar

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: (No Response)

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: My comments have only been partially answered.

Comment 2 (concerning the confidence intervals): in the tables S4, S5, S6, the point estimate is a percentage and the confidence intervals are proportions. It would be more clear to report the confidence intervals also as a percentage.

Comment 4 (concerning the number of HWs that participated): table 1 is very clear, but is it possible that the narrative is not entirely correct?

Comment 5 (concerning figure 2): the legend of figure 2 stated a category (‘main category’) that cannot be found in the figure.

Reviewer #2: This Manuscript is good and quite innovative. It clears the clarity of the reader. It is well structured and well written. The author does an excellent job of presenting a highly technical and complicated process in an easy-to-understand manner.

Although here are few of the observations:

1. To have an unbiased view in the paper, there should be some discussions of the various other work measurement methods like MOST, MTM-1, etc.

2. The discussion and conclusions should be extended with more future work discussion and comparison of related literature findings with above methods.

3. Justify the reason for choosing the proposed methodology.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Wim Peersman

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 2

Response to reviewer 1:

1- Thank you for bringing this point to our attention. We have now changed the confidence intervals in the table S4, S5, S6, from proportions to percentages.

2-We agree with the reviewer. Consequently we updated the study sampling section accordingly (line 122) and hope it meets the reviewer’s requests.

3- We would like to acknowledge reviewer’s observation on the difference between figure 2 and its legend. The typo in the legend has been removed.

Response to reviewer 2:

We thank the reviewer for recognizing the innovation and the clarity of the manuscript.

1- The concern of the reviewer is well acknowledged. Accordingly we have extended introduction section and provide reference to the methods for analyzing work processes (MOST and MTM), (lines 60-65). We also provide a rational why these methods were not the most suitable for addressing the research questions.

2- Thank you for bringing this aspect to our attention. The discussion has been updated accordingly, providing future work recommendations (lines 313-314).

3- This a valid point and thus thanks for raising this point. We have added a rational why a time motion method was considered the best approach for analyzing worktime allocation patterns at PHC level (lines 74-76).

Journal requirements response:

1- Requirement acknowledged. We reviewed our reference list and there is no article that has been retracted so far.

Additionally, to compile with the second reviewer’s comments about presenting other methods applied for studying work processes, we added four new references supporting the updated sections (references number 16, 17, 18, 19, lines 422-429). Subsequently, all the references after these ones in the reference list, increased their number by four. Changes were made throughout the text due to this (lines 62, 64, 67, 69, 71, 74, 82, 83, 85, 86, 90, 130, 270-272, 278, 287, 288, 291, 296, 301, 307, 314, 321, 322, 327, 335).

Decision Letter - Dragan Pamucar, Editor

Work time allocation at primary health care level in two regions of Albania

PONE-D-22-01564R2

Dear Dr. Muho,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Dragan Pamucar

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: Thanks for making changes. All comments have been addressed by the authors in this version of manuscript.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Wim Peersman

Reviewer #2: No

**********

Formally Accepted
Acceptance Letter - Dragan Pamucar, Editor

PONE-D-22-01564R2

Work time allocation at primary health care level in two regions of Albania.

Dear Dr. Muho:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Dragan Pamucar

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .