Peer Review History
| Original SubmissionAugust 15, 2021 |
|---|
|
PONE-D-21-26393 Social Reputation Influences on Liking and Willingness-to-Pay for Artworks: A Multimethod Design Using Behavioral, Physiological, and Psychometric Measures PLOS ONE Dear Dr. Spee, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. The two reviewers coincide in that the manuscript has merits, the research idea is sound, and the text is well written. However, they also describe several concerns and suggestions to improve the manuscript. These comments should be addressed before the manuscript is ready for publication. Let me highlight the most relevant elements from the reviews. First, R1 offers an alternative explanation for the results: can the data be explained by a preference for the middle-position? This is an important issue that must be discussed and addressed. If this possibility was not taken into account, it will posit serious limitations to the conclusions. Both reviewers coincide on asking for more information about several aspects of the study: R1 needs a better justification for some of the variables/measures, and for the use of cluster analyses techniques, while R2 suggests a more comprehensive literature review and gives some references. I think these suggestions are highly pertinent. Thus, I would encourage you to rewrite the Introduction section to include some additional references, and to revise the rest of the sections to provide a good justification for the measures and analyses. It would be advisable to try to highlight those aspects of the research that are new or original (as R1 comments, some of the results seem trivial/obvious at first glance). I appreciate the inclusion of sensitivity analyses. However, as R2 indicates, it would be good to have a description of how the sample size was chosen (constraints, goals...). Decision: I am rejecting the manuscript and inviting to resubmit a revised version that addresses the concerns raised by the two reviewers. ============================== Please submit your revised manuscript by Jan 06 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Fernando Blanco Academic Editor PLOS ONE Journal requirements: When submitting your revision, we need you to address these additional requirements. 1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 2. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability. Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized. Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access. We will update your Data Availability statement to reflect the information you provide in your cover letter. 3. Please amend the manuscript submission data (via Edit Submission) to include author Christoph Eisenegger. 4. Please include your full ethics statement in the ‘Methods’ section of your manuscript file. In your statement, please include the full name of the IRB or ethics committee who approved or waived your study, as well as whether or not you obtained informed written or verbal consent. If consent was waived for your study, please include this information in your statement as well. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Partly Reviewer #2: Yes ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: No ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: No ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: Social Reputation Influences on Liking and Willingness-to-Pay for Artworks: A Multimethod Design Using Behavioral, Physiological, and Psychometric Measures The research reports a novel study examining the willingness-to-pay and liking for artworks, in private and public conditions. Public choices were made in the context of either an art expert or pricing expert and the artworks had an aesthetic and pricing value specified by the relevant experts. The findings show that public willingness-to-pay choices were more influenced by the presumed presence of a pricing expert, whereas liking choices were not, appearing to be more of a personal decision. In addition, willingness-to-pay was influenced by the apparent value of the artwork and liking was also influenced by their apparent aesthetic quality. While the work has a number of merits it also has some issues that prevent me from recommending publication in its current form. Some of the findings do not seem to contribute greatly to the field. The finding that people are willing to pay more for (apparently) more valuable artworks is not particularly surprising. Similarly, the influence of expert opinions of the aesthetic liking of artworks is not a novel finding (see Kirk et al., 2009, as cited by the authors in the introduction). However, the use of hormonal data certainly adds an interesting element to the research. However, the rationale for the inclusion of the ‘Behavioral Activation and Anxiety Scale as Choice Predictors’ needed to be stronger. The ‘explorative inclusion’ of the LSAS anxiety scale appears overly speculative and it wasn’t clear what this added to the study. A major concern is the design and task that was used. An item’s position has an influence on whether it will be chosen, with there being a bias/preference to choose middle options (Valenzuela & Raghubir, 2009; Atalay et al. 2012) and it is often important to control for effects of position when a choice is made from similar options. Unfortunately in this design the effect of position was not controlled for because the middle artwork always had an artistic value and price that was in the middle, and so it is not possible to disambiguate the effect of position from the effect of the artwork’s attributes (artistic/price) on the liking/willingness-to-pay choices. The Means from table 1 are all close to the neutral value (2). Does this indicate frequent choice of the middle artwork? As the authors note, these means show that there was not much effect of condition. In relation to the effect of position how often was each artwork (in each position) chosen? This information does not seem to be included in the tables provided. It is also not clear from the manuscript why a middle option was used in the design. It is not clear from the description what it added and how it enabled a comparison of the key variables of monetary value/aesthetic quality, when the left/right options already did this. In addition, there is substantial evidence that participants have a bias to look at the middle item (e.g. Tatler, 2007) and the eye tracking results show this expected middle looking bias in terms of more looks and last looks. The literature on the middle position and choice, and gaze behaviour, is not referred to and should be included (e.g. Atalay et al., 2012; van der Laan, et al., 2015). The possible impact of these effects on the results should also be considered in detail. In particular, it is possible that the gaze results predicted choice because the participants were looking more at the middle artwork. That is, was it an effect of position rather than artwork? The width of the artworks varied (height was kept constant), how were the authors sure that the participants were looking at a particular artwork, when the width varied from one trial to the next? How was the region of interest controlled? Why was a cluster analysis used for the hormonal analysis, rather than a regression? What was the rationale of creating two groups rather than treating hormone levels as a continuous variable? Participants were asked to make two choices on a trial: liking/willingness-to-pay. It is not clear from the information provided whether participants could choose the same artwork for both choices or had to choose a different artwork. The authors should include the task instructions for clarity. Fig S2 in supplementary Materials – did not seem to be included Table 2 – Eye tracking analysis. Were these analyses corrected for multiple comparisons? Line 154 – ‘group group’ References: Atalay, A., Bodur, H., & Rasolofoarison, D. (2012). Shining in the center: Central gaze cascade effect on product choice. Journal of Consumer Research, 39(4), 848–866.https://doi.org/10.1086/665984 Kirk U, Skov M, Hulme O, Christensen MS, Zeki S. Modulation of aesthetic value by semantic context: An fMRI study. Neuroimage. 2009; 44(3): 1125-1132. doi: 10.1016/j.neuroimage.2008.10.009 Tatler, B. W. (2007). The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distributions. Journal of Vision, 7(14), 4. https://doi.org/10.1167/7.14.4 Valenzuela, A., & Raghubir, P. (2009). Position-based beliefs: The center-stage effect. Journal of Consumer Psychology, 19(2), 185–196. https://doi.org/10.1016/j.jcps.2009.02.011 van der Laan, L., Hooge, I. T., de Ridder, D. T., Viergever, M., & Smeets, P. A. (2015). Do you like what you see? The role of first fixation and total fixation duration in consumer choice. Food Quality and Preference, 39, 46–55. https://doi.org/10.1016/j.foodqual.2014.06.015. Reviewer #2: The MS states in line 307 "Whereas representational paintings might be expected to have a higher, positive correlation between price and artistic quality". There is a debate about 'what' is artistic quality. As artistic quality is not a quality of the object but an individual assessment. I suggest to reframe the as perceived or assessed artistic quality. In line 58, authors discuss about "scholarly discussions of judgment and taste". In my opinion, MS would improve with the addition of modern empirically based discussion of judgement and taste. There were even updates and criticisms of the Eysenck model of judgement cited in 19 (see 10.1016/j.paid.2017.05.041 , https://doi.org/10.1111/bjop.12427, https://doi.org/10.1111/bjop.12440, 10.1093/oxfordhb/9780198824350.013.40). Also, would be interesting to cite more recent views of neuroaesthetics and empirical aesthetics references (see https://doi.org/10.1016/j.cub.2018.06.004 and https://doi.org/10.1016/j.tics.2014.03.003) In my opinion, the use of "personality" to refer to BIS and BAS could be misleading. Maybe, changing to "personality" to "individual differences" or traits could improve the clarity of the study. Also, in line with my previous comment, I think that referring to validated scales as "psychometric" is also misleading. Psychometrics usually refers to scientific study of psychological constructs measurement and assessment, while it is related to scale development, is not constrained to it. Authors state (line 394) that "Despite the discrete (1-2-3) choice options, once averaged across trials, the responses were normally distributed. This was confirmed by a Shapiro-Wills test, which found no deviation from normality (liking: W = .985, p = .197, wtp: W = .991, p = .591)". In general, I think that the analysis would benefit from linear mixed modelling as variation from participants and stimuli could be modelled (see 10.2190/6780-361T-3J83-04L1). Mixed models are specially suitable for empirical aesthetics research as stimuli (usually artworks) are a complex source of variability which not taken into account when using ANOVAs and t.test. Also, I would suggest to update the current plots to a more informative ones with, at least, participant level information instead of point estimates with CI (see https://doi.org/10.1371/journal.pbio.1002128) I value the effort of authors to be clear and honest about the exploratory stage of the study presented, the sensitivity analysis and the no a priori power determination. However I think that including the practical sample size determination (was budget?) would complete the "Participants" section. Regarding the eye tracking results, authors interpretation of data is "Studies have resoundingly shown that individuals spend more time looking at artworks which they find aesthetically appealing and which they liked most (in term of total fixation, see, e.g., [49, 51-54]; or along longer fixation, see [50]). Moreover, participants appear to fixate the preferred image when reaching the decision-moment [53-54]." . But, there are other factors like complexity, interpretability, etc of the stimuli which could play a role (see 10.1177/0301006615596882, 10.1371/journal.pone.0037285). Maybe, taking into account other explanations could improve the MS. Do authors ensured that participants were naïve regarding art knowledge? Were any measure of it taken? Note: I don't feel validated to assess the procedure, methods and results from the endocrinological part of the study. Guido Corradi ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: Yes: Guido Corradi [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
PONE-D-21-26393R1 Social Reputation Influences on Liking and Willingness-to-Pay for Artworks: A Multimethod Design Investigating Choice Behavior along with Physiological Measures and Motivational Factors PLOS ONE Dear Dr. Spee, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. Since you have successfully incorporated all of the reviewers' comments, I will not further send this paper for review. Reviewer 1 has pointed out a few minor changes that must be addressed. Concerning the comment on the possibility that position can affect the results, I agree with this reviewer in that this explanation cannot be ruled out completely. Thus, I encourage you to reword the corresponding sentence in the manuscript, to make it clear that this limitation exists. Once these minor changes are made, I will be ready to accept the manuscript. Congratulations. Please submit your revised manuscript by Apr 21 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. Please include the following items when submitting your revised manuscript:
If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter. If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols. We look forward to receiving your revised manuscript. Kind regards, Fernando Blanco Academic Editor PLOS ONE Journal Requirements: Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice. [Note: HTML markup is below. Please do not edit.] Reviewers' comments: Reviewer's Responses to Questions Comments to the Author 1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation. Reviewer #1: (No Response) Reviewer #2: All comments have been addressed ********** 2. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes ********** 3. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes ********** 4. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: No Reviewer #2: Yes ********** 5. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes ********** 6. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: I have now read the revised version of the manuscript. The authors have done a good job with the revisions and have largely addressed my concerns. The additional introductory information has provided a stronger rationale for the research and a fuller explanation of its novelty and importance. Line 517-522. Although I am largely persuaded by the data (line 517-522) that position did not affect choice, I do not think it can be entirely discounted. Although the artworks were randomly allocated to position, the value labelling of an artwork in the left and right positions (Left, high-artistic: Right, high-monetary) remained the same throughout the task. Position was confounded with the value labelling of the artworks and ideally the position of the value labels should have been counterbalanced. This is relevant because, in addition to a preference for items in the center, there are also perceptual asymmetries, with a body of work finding that visual information on the left-side carries greater weight/importance when making a perceptual judgement (e.g. Nicholls et al. 1999, https://doi.org/10.1016/S0028-3932(98)00074-8). While I think the data suggest an effect of value labelling for particular positions may not have been a problem, it is not certain. Consequently, I think the statement (line 770-773) that ‘an effect of position could be ruled out’ is too strong. This should be attenuated to something like ‘The effect of position with respect to choice may be unlikely…’ Minor points Line 143 – ‘greatly less’, should this be ‘less’. Line 146, ‘have shown to be more vulnerability to reputation influences’ should be ‘…..more vulnerable….’ Line 765 “landing position, see for further reading [80, 97-99])”. Including the following reference in this list is appropriate as it examined the effects of position on the choice of artworks and also used triplets of similar artworks while measuring eye tracking (Kreplin et al. 2014, https://doi.org/10.1016/j.actpsy.2014.08.003). Congratulations on an interesting study. Reviewer #2: All the comments have been adressed. The authors did a good job. ********** 7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: No Reviewer #2: Yes: Guido Corradi [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 2 |
|
Social Reputation Influences on Liking and Willingness-to-Pay for Artworks: A Multimethod Design Investigating Choice Behavior along with Physiological Measures and Motivational Factors PONE-D-21-26393R2 Dear Dr. Spee, We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements. Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication. An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. Kind regards, Fernando Blanco Academic Editor PLOS ONE Additional Editor Comments (optional): -Please ensure that the figures are readable in the next technical-checking stages. In the current PDF they look blurry. -Typos: "because both the paintings" (L778) to "because both paintings" Reviewers' comments: |
| Formally Accepted |
|
PONE-D-21-26393R2 Social Reputation Influences on Liking and Willingness-to-Pay for Artworks: A Multimethod Design Investigating Choice Behavior along with Physiological Measures and Motivational Factors Dear Dr. Spee: I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. If we can help with anything else, please email us at plosone@plos.org. Thank you for submitting your work to PLOS ONE and supporting open access. Kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Fernando Blanco Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .