Peer Review History

Original SubmissionDecember 2, 2022
Decision Letter - Jaume Garcia-Segarra, Editor

PONE-D-22-32907Get the happiness out – An online experiment on the causal effects of positive emotions on givingPLOS ONE

Dear Dr. Anja Köbrich Leon,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. We have heard from two reviewers; one recommends a minor revision, and the other one a major revision. Both have raised concerns that you can address in your revision. After reading the paper myself, I think you can improve the paper by following the reviewers' suggestions. If you refrain from implementing specific requests, please explain why you do so.

Even though the paper's status is "major revision required," and I cannot guarantee anything, it is also true that I can foresee a straightforward path to acceptance.

Please submit your revised manuscript by 11/04/2023. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jaume Garcia-Segarra

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1.Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at 

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.Please provide additional details regarding participant consent. In the Methods section, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

3. Please ensure that you include a title page within your main document. We do appreciate that you have a title page document uploaded as a separate file, however, as per our author guidelines (http://journals.plos.org/plosone/s/submission-guidelines#loc-title-page) we do require this to be part of the manuscript file itself and not uploaded separately.

Could you therefore please include the title page into the beginning of your manuscript file itself, listing all authors and affiliations.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear authors,

When I started reading the abstract and the article I was turned off by the unclarity of the language and numerous mistakes (see examples below). Luckily, this seems to be a problem only at the beginning of the paper as the later part is much more clear and polished. So overall, after I finished reading the article, I think that it is interesting and deserves a publication.

However, I do have one pount regarding the design that I believe should be discussed. I wonder why the authors first announced the donation possibility and then introduced the stimuli. As this this leaved people more time between the announcement of donation possibility and the actual donation, this might have led people to use some kind of a self-control mechanism. As documented in (Exley & Petrie, 2016, 2018) leaving people time to deliberate leads people to look for excuses not to donate. To sum up: the stimuli should have been placed before the announcement of the donation decision.

Regarding the results by treatment, I do not really buy the crowding out effect. I guess the results do not survive MHT?

Heterogeneity: I am not especially convinced by the way the heterogeneity analysis is presented. I think you should just repeat your main specifications for the separate samples. If you have convergence problems, maybe simple linear estimations (in all Tables) would be a good alternative. The way you change the estimation method and the outcome variable it is difficult to compare the main estimation to the heterogeneity analysis.

Here are some comments on writing at the beginning of the article:

“Anticipated and experienced emotions related to the decision context are a driving

force for pro-social behavior.” Really? Where does this statement come from? Economists define other motives as driving force for charitable giving…

“dispositional affect” is a persistent trait and it does not square with induced emotions.

Please rewrite: “We provide field experimental evidence on causal effects of affective

primes, which aim to strengthen the social bond between donor and recipient, and

primes that aim to trigger positive cognitive processes are particularly useful in raising

donations to the target charity.”

“These effects tend depend on individual characteristics.”

“Second, charities eliciting positive incidental emotions without worrying about spillover to other charities.”

p. 20 (1) instead of (!)

Other related papers: (Wichman & Chan, 2022)

References:

Exley, C., & Petrie, R. (2016). Finding Excuses to Decline the Ask: A Field Experiment. 1–30. https://doi.org/10.2139/ssrn.2743207

Exley, C., & Petrie, R. (2018). The impact of a surprise donation ask. Journal of Public Economics, 158, 152–167. https://doi.org/10.1016/J.JPUBECO.2017.12.015

Wichman, C. J., & Chan, N. W. (2022). Preheating prosocial behavior.

Reviewer #2: Thank you for the opportunity to review this manuscript. I have experience both doing experimental research as well as reviewing many experimental studies. Overall, I find this study rigorous and its design and analysis. I do have some questions, largely from a clarity standpoint, to improve it's contribution to the literature.

1) Theory.

*The introduction discusses the theories of interest for this study, but without definition. To me, not being familiar with this area of psychology research, the intro was largely unintelligible to me, and I had to read the longer lit review more carefully to understand your framework.

*It seems to me that one of the big questions underpinning this line of inquiry is the causal direction - are happier people more likely to give, or does giving make you happy? I think you are trying to get at the former, by eliciting/reminding people of feelings of happiness before asking them to give. However, it still remains to be seen if those who did share a happy memory were more likely to give - can you qualitatively review the statements from the written task? But then, does having an easily recalled happy memory (does that actually make you happier?) make you more likely to give?

*I'm unsure about the option to give to the other environmental group, theoretically. What is that testing, or not testing?

2) Method.

*I couldn't really picture the setting/design of this experiment, and I read the appendix. Are these people who were coming to the crowdfunding platform to make a contribution to one of the asks there (and thus already primed to give? - this may explain why they were much more likely to give over Bekkers, 2017). Were they then asked to complete this survey before they were able to access the crowdfunding projects? Can you clarify this?

*I'm not sure what this as a "field experiment" over a standard "survey (lab style) experiment". There are pros and cons with each. Perhaps clarify that?

*I have gotten used to seeing a graphic showing the treatment assignments in these types of papers (i.e. what happens when people enter the experiment).

*Did you give people the opport8unity to opt out of the survey and continue to the crowdfunding platform? If so, can you describe the potential impact of selection bias in this situation?

*Were the informed of the 5 Euro prior to starting the experiment? I'm not sure how that 'mitigates' the "experimenter demand effects". (p. 4).

3) Implications.

*The findings for this study seem important for understanding the various psychological mechanisms to incentivize volunteering, but I'd like to see some discussion about what the practical implications might be for practitioners. Asking donors to engage in some activity prior to giving may help spur these attitudes, but could also lead many, many donors to stop the process of completing a donation. CAn you

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 1

Thank you very much for taking the time to give us guidance on improving our study “Get the happiness out – An online experiment on the causal effects of positive emotions on giving”.

We value your thoughtful comments highly. We tried to incorporate them into the text and to respond to them as fully as possible. Please find our detailed responses to your suggestions below. You will find our direct responses to each suggestion (in italics) below. We worked through all of the comments and remarks, and we think that our paper has improved significantly as a result of us following them. We have revised our paper substantially: some parts have been rewritten or supplemented, and others have been dropped.

A detailed, point-by-point response to the raised questions can be found in the files titled "Response to Reviewer."

Attachments
Attachment
Submitted filename: Priming Response to Reviewer 2_final.docx
Decision Letter - Jaume Garcia-Segarra, Editor

PONE-D-22-32907R1Get the happiness out – An online experiment on the causal effects of positive emotions on givingPLOS ONE

Dear Dr. Anja Köbrich Leon,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. We have received a report on your manuscript. The reviewer is satisfied with your improvement. There is only a suggestion for reorganizing the sections. Thus, consider this letter as a conditional acceptance of your paper. Please, answer the request of the reviewer. If you refrain from implementing the changes, explain what reasons drive your decision. The manuscript will not come back to the referees.

Please submit your revised manuscript by Jun 30 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.
  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.
  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jaume Garcia-Segarra

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: Thank you for the opportunity to review this revision. The paper is in good shape now. However, the order of sections seemed odd - limitations the last paragraph, hypotheses after research design. I would structure the paper 1) Intro 2) Literature Review 3) Hypotheses 4) Research Design 5) Findings - Descriptive Statistics, then Analysis 6) Discussion 7) Conclusion

Don't forget to really focus on the contribution your paper makes to the literature.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Revision 2

Dear Mr. Garcia-Segarra, dear Referee

Thank you again very much for taking the time to give us guidance on improving our paper “Get the happiness out – An online experiment on the causal effects of positive emotions on giving”. We value your and the reviewer’s thoughtful comments highly.

In response to the reviewer's suggestions, we have made the necessary adjustments to address his concerns regarding the structure of the paper. Furthermore, we have conscientiously revised the discussion and conclusion sections, ensuring meticulous alignment with the prescribed criteria set forth by PlosOne. Additionally, we have explicitly addressed our contributions within these sections.

We greatly appreciate your valuable input and continued support.

Sincerely,

Attachments
Attachment
Submitted filename: Rebuttal letter to Reviewer 2.docx
Decision Letter - Jaume Garcia-Segarra, Editor

Get the happiness out – An online experiment on the causal effects of positive emotions on giving

PONE-D-22-32907R2

Dear Dr. Köbrich-Leon,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Jaume Garcia-Segarra

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: This paper is clearly laid out and written, and was easy to follow. I think the revisions have brought it a long way.

It seems to me that a lot of the additional analysis was provided to make sure the authors had something to say even in the face of null results based on their original hypotheses. I don't necessarily think all this is needed, but I will leave that to the editors to determine.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

**********

Formally Accepted
Acceptance Letter - Jaume Garcia-Segarra, Editor

PONE-D-22-32907R2

Get the happiness out – An online experiment on the causal effects of positive emotions on giving

Dear Dr. Köbrich Leon:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Jaume Garcia-Segarra

Academic Editor

PLOS ONE

Open letter on the publication of peer review reports

PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.

We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.

Learn more at ASAPbio .