Peer Review History
| Original SubmissionJune 21, 2019 |
|---|
|
PONE-D-19-17641 Do the Shuffle: Using shuffled play to explore reasons for music listening PLOS ONE Dear Neta Spiro, Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process. In particular, the mixed methods design of your study needs to be specified and integration needs to be addressed. It is recommended that you integrate your quantitative and qualitative findings narratively and via a joint display. Furthermore, the novel contribution of your work should be elucidated. We would appreciate receiving your revised manuscript by 11 January 2020. When you are ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file. If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. To enhance the reproducibility of your results, we recommend that if applicable you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols Please include the following items when submitting your revised manuscript:
Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out. We look forward to receiving your revised manuscript. Kind regards, Sarah E.P. Munce, PhD Academic Editor PLOS ONE Journal Requirements: 1. When submitting your revision, we need you to address these additional requirements. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at http://www.journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and http://www.journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf Additional Editor Comments (if provided): Thank you for your submission to PLOS ONE. Please review and address all of the comments of the individual reviewers. In particular, the authors need to specify the mixed methods design of this study and integrate the findings of the qualitative and quantitative components (narratively and via joint display). The authors should also clearly elucidate the novel contribution of this work. Comments to the Author 1. Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: No Reviewer #4: Partly ********** 2. Has the statistical analysis been performed appropriately and rigorously? Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes Reviewer #4: Yes ********** 3. Have the authors made all data underlying the findings in their manuscript fully available? The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes Reviewer #4: Yes ********** 4. Is the manuscript presented in an intelligible fashion and written in standard English? PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here. Reviewer #1: Yes Reviewer #2: Yes Reviewer #3: Yes Reviewer #4: Yes ********** 5. Review Comments to the Author Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters) Reviewer #1: In this paper the authors examined factors that lead individuals to download and/or listen to specific music selections. Rather than responding to pre-selected music examples or selecting their own music examples, participants responded to two pieces that were generated by their device’s “shuffle” feature. This was an innovative design twist that allowed for a potentially richer set of data, tapping into choices that at once represented the participants’ own volition yet did not necessarily represent their strongest preferences. Overall, I found this to be an interesting paper that nicely balanced precision necessary for survey inquiry with the more natural context-dependent reality of personal music choices. As suggested by the authors, the findings were not ground-breaking in their novelty; rather, they underscored the fluidity and diversity of the personal music listening experience. I do have several comments and suggestions for the authors. These are largely focused on aspects needing greater clarity or consistency, however, as such, are consequential for helping the reader to understand and interpret the data and interpretation presented. 1. Abstract - The title/abstract makes reference to both exploring “reasons for music listening” and the innovative aspect of the shuffle play method. Each of these issues receives different emphases throughout the paper making it somewhat unclear exactly which is the main focus of the paper. Was the main takeaway the insight into listening or the viability of the method? 2. Abstract – To what degree might “because they like it” subsume the various other more fine-grained motivations usually associated with music listening (e.g., mood regulation)? Is “liking” really a different category of reason or a broader umbrella term used by the participants to describe a range of listening experiences? 3. P. 3, line 46 – “of the time” seems a bit vague. Does this refer to any time? Some specific subset of time? 4. P. 5, line 112 – This is unclear. Was shuffle or travelling the largest category? Category of what? 5. P. 6, line 121 – Here and throughout, I am not sure this represents a “mixed methods” approach as formally defined by sources such as Creswell (2010). The use of both closed- and open-ended questions provided two different types of data, however both were the result of a large-scale survey method (and, in fact, both gathered from the same group of people, using the same instrument, at the same time). Consider using a different term to convey use of this mixed response type. 6. Table 1 – This breakdown of the sample is confusing as the different subsamples have not yet been explained in the report. The note is only marginally helpful because it references a survey item not yet presented in the method. 7. Table 1 - The diverse array of countries represented is impressive, however the vast majority of the participants are associated with the UK. This should be discussed in the limitations section; the potential impact of this imbalance is worth some speculative commentary in the discussion and should be taken into account when interpreting the results. 8. Tables 1 & 2 – For the data presented in tables 1 and 2, is there a particular need to disaggregate the sample into two groups? Differences between the two groups are not discussed among the results nor are potential relationships between the n=70 subsample and their response. Thus, the two groups may not warrant detail here. 9. Throughout much of the second portion of the paper the language was quite confusing between the responses participants provided and the participants themselves. For instance, if I understand the method correctly (p. 11, lines 169-170), each participant generated two shuffled tracks and provided a different set of responses for each. a. On this point, did the participants complete a full questionnaire for one track and then begin anew for the second track? Or did they generate the two tracks and then provide two responses to each survey item? b. P. 14, line 252 – Beginning around this point, the data refer to “participants” (for example, here it reads “50% of people responded negatively”). But the unit of analysis is responses to tracks, correct? Presuming that 50% of people did not respond negatively to both tracks, how many negative responses were there? c. P. 15, line 296 - Again confusing. Each participant answered four open questions twice! d. P. 27, line 561 – “13.6% of participants”…again confusing in its reference to participants rather than responses. e. Overall, please reconcile language like this throughout. 10. P. 13 – The section on coding and analysis was confusing. a. Line 222 - Were codes chosen from among those created? Were the initial codes created before this step? What do you mean by “initial review of the data”? b. Line 227- “had more codes”; Do you mean “assigned more codes”? Do these refer to the L3 codes? c. Line 228 - Do you mean that 66% of Coder 3’s codes were in agreement with those of Coder 2? Does this account for missing codes? In other words, did the two coders assign different codes in the remaining 34% of the cases IN ADDITION TO the number of cases in which Coder 3 did not assign a code. The level of agreement is really rather low as it is, and would be considerably (arguably unacceptably) lower if “missing” codes are over and above this figure. d. Line 230 – “memos were written to explicate”; I understand the reference to memos, but how were they used to accomplish this purpose? 11. P. 14, Lines 243-244 - This is confusing. Each participant wrote about two tracks, correct? Following from this, what % of the track-skippers were repeat offenders? 12. P. 14, Line 249 - Again, these numbers seem to be referring to individuals when each set of track data represents 1/2 of each participant’s contribution. (Also, please indicate if and how often you included responses from participants who only evaluated one track.) 13. P. 15, line 270 -- It would be useful to remind readers here that these data only refer to the responses of 70 participants. 14. P. 24, line 471 -- It should be pointed out that this finding emerged from a smaller subset of participants. Given this significant limitation, I am wondering whether this finding should occupy such a prominent placement among the results. 15. There are several uses of the term “methodology” throughout the discussion. I think of this term as referencing the collective set of methods used in a given discipline or research tradition. Within the scope of a single study, might the more basic “method” be more accurate? 16. P. 26, line 521-522 -- Might this be a reflection of the shuffle aspect? This may be particularly so in light of self-selection as the top listening approach. 17. P. 27, lines 563-564 -- This might be worth some extra emphasis given the high percentage of participants who used Spotify. 18. Figure 2 -- Does the rank of this response call into question the completeness of the item? Were one or more vital responses left out? Do your data provide evidence of what these might include? Reviewer #2: This is a nicely done study which builds on the work of others (particularly the fourth author) and makes a modest but worthwhile contribution to the literature. The "shuffle play" method itself is interesting and worthwhile, but in connection with the results reported herein shows a limitation to the study: the question of "why did I download this track?" gets answered in terms of artist/genre, but clearly that broad determination does not indicate how much a track would be preferred or meaningful to the listener; there's a two-stage preference sort here, with artist/genre as a first, quite rough cut, and actual listening choice/preference/response a the second, more fine-grained filter. This points out the relatively indiscriminate nature of seeking out and using online information of any kind, not limited to music. In any qualitative study it's hard to know how to present the results to be both brief enough for publication and deep enough to be informative and to dispel questions of bias, intentional or unintentional, in how the results are being reported. I'd personally like more examples of responses, even if only in the most oft-used categories (musical characteristics, change of feelings, etc). It would also be really interesting to get more on the _negative_ responses and, if possible, on what tracks were skipped! This method could be quire illuminating relative to the normal "preferred" and "self-chosen" music methods but the 'contrary' side--pieces which were disliked or skipped--needs to be fleshed out more for this to be the case. Reviewer #3: I agree that this is a novel method that provides some new insights -- in particular, insights regarding the importance of associations of tracks to information outside of the music itself. See however comments below regarding a potential distortion with regard to intrretation of this finding Regarding the reporting of data -- I found it curious that the authors did not take advantage of the opportunity to describe differences between musicians and non-musicians -- this data appears to be available Lines 235-236. Using Tableau, I wasn't sure whether the modifications I was making to the filters were having an impact on the visualized data because of the proportion of each subpopulation in the total sample or whether it reflected the unique views of the population remaining after filtering. I wonder if using proportions would be more informative. Lines 254-255, Possible missing details -- change to? "some of the participants who responded NO then went on to describe ..." Lines 313-315. for me at least, "relationship with a track" does not connote anything about emotion, regardless of what the piece is -- this is about my history with the band, song, or my associations with it -- hence, I don't see this contradicting the quantitative ranked data regarding "why I choose to listen". This interpretation seems like a bit of a distortion. I believe this point appears in different places in the manuscript --- abstract and discussion -- should be reconciled throughout Lines 455-458. the authors note that the ability to get insights about music that listeners do not like is a unique opportunity afforded by the shuffle methodology. but this is hardly the most effective means of getting this info - - they could have asked people to name and defend tracks they'll especially dislike. The authors should consider emphasizing that this is more of a "fringe" benefit of the method rather than something it is ideally designed to address Reviewer #4: "Do the Shuffle: Using shuffled play to explore reasons for music listening" is an exciting title that piqued my curiosity. A laudable contribution to research in music on why people download and listen to music, and which aspects of music listening experiences are people prioritize while listening to music on their devices. I am surprised to see the names of the authors on the page, making me question the blindness of this review. The abstract is clear and answers the purpose of the study. I am curious about the tact that people download music because they like it – Seems to highlight the emotion of liking. Earlier, the authors state that participants use "sound and musical features" to characterize music and associate the music with their context "over ... emotional responses". "Therefore, how their prioritize music seems to contradict why the music is downloaded in the first place — an interesting dilemma. The introduction: A well-posited argument, the authors emphasize the importance of self-chosen music for research, music fit and context, functions of music listening, and music preference. They address the gaps in previous studies – music is preselected for participants — the importance of self-chosen music in the new technological era. Arguing that listeners today "carry their music with them," the authors use Shuffle Play an app that allows for the flexibility of listening choices, to collect data. The App is distinct because it places ownership in the hands of the listener while also allowing for a chance. In their introduction, the authors defend their arguments answering why they chose to research self-directed listening in the first place. Aims and Questions: Aim to use a "mixed methods approach" to answering two questions: first, why people download and listen to music, and second, which aspects of the music listening experiences are prioritized by people listening to music on their devices. Methods: Design: Even though the researchers tell us that they are using a mixed-methods approach, we do not know what kind of mixed methods approach. In mixed-methods, researchers collect both quantitative and qualitative data. Therefore, the plan may have combined methods, but the design is either, for example, Explanatory, sequential, convergent, or complex with embedded core designs. I encourage the researchers to read: Creswell, J. W., & Creswell, J. D. (2018). Research design: Qualitative, quantitative, and mixed methods approaches (5th ed.). Thousand Oaks, CA: Sage. They are using only a survey questionnaire for this purely descriptive study. Are the authors suggesting that Shuffle play is the qualitative part of their data collection? Participants: The authors have a robust sample size (n.322). Excellent. It will be interesting to find out why 2/3rds are female, not sure how the authors will discuss this later. Interesting that they came from different countries. How was the sample accessed? Were they invited to participate? From a conference. Not sure about the representative sample argument – if we have single-digit representations from some countries. Using snowballing techniques from authors networks (See Procedure) does not make this representative. Shuffle play: This has loads of potential for future research. I am not sure if I can call this qualitative data collection, primarily as a questionnaire, is also used to ask descriptive questions. Results: Associations, as the most influential type of response then, describing characteristics of a soundtrack and finally evaluation of the participant relationship, or familiarity with the music. How participants responded to music-related directly to their emotions – that is, they liked it. My final thoughts: While this is a very promising study, it might be best for the authors to position it as a descriptive study using two forms of data collections- one through direct survey and other through online survey within a listening app. More work is needed to support the explanation of your methods. ********** 6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files. If you choose “no”, your identity will remain anonymous but your review may still be made public. Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy. Reviewer #1: Yes: Steven J. Morrison Reviewer #2: No Reviewer #3: No Reviewer #4: No [NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files to be viewed.] While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org. Please note that Supporting Information files do not need this step. |
| Revision 1 |
|
Do the Shuffle: Exploring reasons for music listening though shuffled play PONE-D-19-17641R1 Dear Dr. Spiro, We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it complies with all outstanding technical requirements. Within one week, you will receive an e-mail containing information on the amendments required prior to publication. When all required modifications have been addressed, you will receive a formal acceptance letter and your manuscript will proceed to our production department and be scheduled for publication. Shortly after the formal acceptance letter is sent, an invoice for payment will follow. To ensure an efficient production and billing process, please log into Editorial Manager at https://www.editorialmanager.com/pone/, click the "Update My Information" link at the top of the page, and update your user information. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org. If your institution or institutions have a press office, please notify them about your upcoming paper to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, you must inform our press team as soon as possible and no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org. With kind regards, Sarah E.P. Munce, PhD Academic Editor PLOS ONE Additional Editor Comments (optional): Reviewers' comments: |
| Formally Accepted |
|
PONE-D-19-17641R1 Do the Shuffle: Exploring reasons for music listening through shuffled play. Dear Dr. Spiro: I am pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department. If your institution or institutions have a press office, please notify them about your upcoming paper at this point, to enable them to help maximize its impact. If they will be preparing press materials for this manuscript, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org. For any other questions or concerns, please email plosone@plos.org. Thank you for submitting your work to PLOS ONE. With kind regards, PLOS ONE Editorial Office Staff on behalf of Dr. Sarah E.P. Munce Academic Editor PLOS ONE |
Open letter on the publication of peer review reports
PLOS recognizes the benefits of transparency in the peer review process. Therefore, we enable the publication of all of the content of peer review and author responses alongside final, published articles. Reviewers remain anonymous, unless they choose to reveal their names.
We encourage other journals to join us in this initiative. We hope that our action inspires the community, including researchers, research funders, and research institutions, to recognize the benefits of published peer review reports for all parts of the research system.
Learn more at ASAPbio .