https://orcid.org/0000-0002-7286-396X
Figures
Abstract
Background
Sensory perception is a temporal phenomenon highly present in food evaluation. Over the last decades, several sensory analysis methods have been developed to determine how our processing of the stimuli changes during tasting. These methods differ in several parameters: how attributes are characterized (intensity, dominance or applicability), the number of attributes evaluated, the moment of sample characterization (simultaneously with the tasting in continuous or discrete time, retrospectively), the required panel (trained subjects or consumers), etc. At the moment, there is no systematic review encompassing the full scope of this topic. This article presents the protocol for conducting a scoping review on multi-attribute temporal descriptive methods in sensory analysis in food science.
Methods
The protocol was developed according to the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) extension for Scoping Reviews checklist. The research question was "how have multi-attribute temporal descriptive methods been implemented, used and compared in sensory analysis?". The eligibility criteria were defined using the PICOS (Population, Intervention, Comparator, Outcome, Study design) framework. This protocol details how the articles of the final review will be retrieved, selected and analyzed. The search will be based on the querying of two academic research databases (Scopus and Web of Science). The main topics reported in research involving sensory analyses methods will be identified and summarized in a data extraction form. This form (detailed in the protocol) will be used to report pertinent information regarding the objectives of the review. It could also be reused as a guideline for carrying out and reporting results of future research in a more standardized way. A quality appraisal process was derived from literature. It will be applied on the included articles of the review, and could also be re-used to ensure that future publications meet higher quality levels. Finally, for the sake of transparency, the limitations of the protocol are discussed.
Citation: Visalli M, Galmarini MV (2022) Multi-attribute temporal descriptive methods in sensory analysis applied in food science: Protocol for a scoping review. PLoS ONE 17(7): e0270969. https://doi.org/10.1371/journal.pone.0270969
Editor: Nobuyuki Sakai, Tohoku University: Tohoku Daigaku, JAPAN
Received: February 23, 2022; Accepted: June 22, 2022; Published: July 26, 2022
Copyright: © 2022 Visalli, Galmarini. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: No datasets were generated or analysed during the current study. All relevant data from this study will be made available upon study completion.
Funding: The author(s) received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
1. Introduction
1.1. Background
As a result of mastication, bolus formation, contact with saliva and body temperature, food and beverage perception changes during oral processing and for this reason it is considered a temporal phenomenon. Sensory analysis aims at understanding the sensory perception of products by measuring subject responses. Thus, several temporal methods have been developed in the past 50 years trying to capture, study, describe and quantify these changes in perception. These methods and their main characteristics are listed in Table 1. One main reference is cited for each, in case the reader needs further detail and information.
The time lapse studied goes mostly from the moment in which the product gets in contact with the mouth until some seconds after swallowing. That is to say, the time it takes for a person to evaluate one intake of the product (e.g., one sip, one bite). However, food and beverage consumption has another temporality: bite after bite (or sip after sip) perception can also change due to cumulative sensory phenomenon. This type of temporality (multi-intake or full portion evaluation) was only recently studied and, even though many of the methods could be applied to this, only a few have been used.
Time Intensity (TI) [1] was the first temporal method developed. It measures (by means of a scale) the intensity of one given attribute over a continuous period of time. It was conceived as a sort of temporal version of the Quantitative Descriptive Analysis [12] but allowing only to measure one attribute at a time. TI has long been the temporal method of reference, but it presents several limitations: measuring only one descriptor at a time, which results in halo-dumping effect [3]. Moreover, the "signature" effect [13] (evaluators have a characteristic shape of the curve) requires a higher training to reduce variability and obtain curves that respond to product characteristics and not to individual differences, resulting also in panellist fatigue [14]. All other temporal methods have been developed trying to compensate for these limitations.
As in every quantitative method, the use of scales calls for trained assessors. But, unlike other Descriptive Analysis techniques, TI requires a higher concentration since the evaluator needs to be focused on the perception and changes in intensity for the given attribute over a period of time. This higher concentration and the continuous temporal manner of the measurement requires some extra training in comparison. In addition to the extra training sessions to manage this, measuring only one attribute increases the number of sessions needed if a multi-attribute temporal description of the product is required.
Aiming at reducing the number of sessions to attempt a description with more than one attribute, Dual Time Intensity (DATI, [5]) and Multi Attribute Time Intensity (MATI, [8]) were developed. But they were not widely implemented, probably due to the difficulty of the task: quantifying different attributes over continuous scales at the same time. Discontinuous time alternatives have been proposed to simplify the process and enable the recording of intensities within a single bite or sip (“single-intake”) at uniform intervals steps or at specific moments using Intensity Variation Descriptive Methodology (IVDM, [2]), Discontinuous Time-Intensity (DTI, [3]), or Progressive Profile (PP, [4]), or over repeated or consecutive consumptions (“multiple-intakes”) using Sequential Profile (SP, [7]).
Methods developed after this tried to simplify the task by recording only qualitative data. Temporal Dominance of Sensations (TDS, [6]) introduced the concept of dominance (different from intensity) asking the subject to choose (from a given list) the sequence of dominant sensations. As a matter of fact, when TDS was first presented, panelists were also asked to rate the intensity of the chosen attributes. But, as it was soon deemed too difficult and the intensity scoring was disused. Temporal Check-All-That-Apply (TCATA, [9]) was developed as an alternative to TDS registering the presence/absence (“applicability”) of all attributes along time. TCATA added the time dimension to the static Check-All-That-Apply (CATA) method [15]. After having been used with trained panels, TDS and TCATA were gradually more and more used with consumer panels allowing also to better understand preferences in addition to product description.
The newest methods, changed from the simultaneous tasting-evaluating paradigm and proposed a retrospective measure, describing the product right after tasting but taking into account the perceived temporality. Attack-Evolution-Finish (AEF, [10]) methods summarize perception as a sequence of 3 attributes corresponding to 3 subjective periods: “Attack”, “Evolution” and “Finish”. FC-AEF [11] mixed static Free-Comment method [16], AEF and applicability, allowing the subjects to characterize their temporal perception using their own words instead of predefined list of descriptors.
1.2. Rationale for conducting the review
As can be seen in Table 1, many temporal methods have been developed over the years. Despite their differences, they all aim at measuring the same phenomenon. In food science, [17] highlighted that the most important challenge for new methodologies for sensory characterization is the identification of their limitations. Although it was referring to non-temporal DA, it also applies to temporal descriptive methods. It has not been clearly established yet in which situations methodologies provide equivalent information and when their application is or is not recommended. [18] recently pointed out: “Many (sensory and statistical) methods are developed and deployed, but they are rarely compared exhaustively and objectively with alternative existing methods. Why would I adopt any new method when I have something that currently (seemingly) addresses the same task in a similar way? What benefit does it bring, and is it important enough for me to bother? How can I make findings actionable to inform product design?”.
However, to date, no such exhaustive comparison of the multi-attribute temporal sensory methods exists. Indeed, the searching methodology described in this article allowed finding several reviews on the subject, but none of them addresses all the existing multi-attribute temporal descriptive methods. Moreover, as it can be observed in Table 2, there is no systematic review on the topic.
[13, 19] are obviously no longer up to date. [20, 22] mainly focus on applications in food oral processing research. [21, 23, 24] only reviewed studies related to TDS. By way of comparison, more than 350 articles (without TI) will be considered for inclusion in the review using the protocol described in this article.
Thus, the relevance of conducting a systematic review of the academic research on temporal sensory methods seems established to set guidelines based on scientific evidence. To overcome the limitations of the previous reviews, it is necessary to include all the temporal methods, with the exception of TI which is singular in the sense that it is the only one which characterizes a single attribute. As the heterogeneous nature of the studies was not amenable to a more precise systematic review, a scoping review will be carried out.
1.3. Objectives
The objectives of this review, in accordance with [25] are:
- to map the scientific literature to make an exhaustive and objective inventory of the methods available for multi-attribute temporal descriptive sensory analysis of food products,
- to clarify working definitions and inform practices in the field,
- to summarize findings and recommendations based on (i) and (ii) and to identify research gaps in the existing literature,
- to disseminate research findings.
A specific focus will be accorded to methodology and articles comparing methods.
2. Materials and methods
The protocol was drafted in order to ensure that the scoping review will be conformed to the Preferred Reporting Items for Systematic reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) Checklist [26].
This section was organized based on the five stages of a scoping review [27]:
- identification of the research question,
- identification of relevant databases and literature,
- selection of articles,
- data extraction,
- summarization, interpretation and dissemination of the results.
Each stage is more detailed below in line with the objectives of the current scoping review.
2.1. Identification of the research question
2.1.1. Main research question and sub-questions.
The main research question is: "how have multi-attribute temporal descriptive methods been implemented, used and compared in sensory analysis?"
The main research sub-questions concern:
Method and protocol
- What temporal sensory methods (and their variants) were used?
- What characterizes the method(s)?
- Which product categories were evaluated using the methods?
- What were the reported limitations, advantages and disadvantages of each method?
- How were the methods compared in terms of advantages and disadvantages?
- Are there any remaining unanswered questions related to the method and protocol implemented?
Data analysis
- How was the data collected with these methods analyzed?
- How was performance (accuracy, discrimination, repeatability, reproducibility) measured?
- How were the methods compared in terms of their performances?
- Are there any remaining unanswered questions related to data analysis?
Contribution to existing scientific knowledge
- In which scientific fields (food science, psychology, etc.) were these methods applied?
- What type of temporal information was obtained with these methods?
- Did this information provide additional knowledge compared to other sensory (static measures, liking, etc.) or instrumental measures?
- Was the contribution used by other researchers? (quality, number of citations)
Demographics of the research
- What are the geographical and historical coverages of the methods?
- What are the main journals and authors implied?
- Is the scientific area FAIR? (standardization of meta-data, open access, open data, ethical, etc.)
2.1.2. Inclusion and exclusion criteria.
The PICO(S) (Population, Intervention, Comparator, Outcome, Study design) eligibility criteria [28] for inclusion will be as follows:
Population.
Any human panel (trained or semi-trained panelists, consumers) will be eligible for inclusion, without any limitation on its composition.
Intervention.
Any study aiming to evaluate the sensory properties of food or drink using a multi-attribute temporal descriptive method will be relevant for inclusion. Any methodological article related to temporal data collection or statistical analysis of multi-attribute temporal descriptive methods will also be eligible for inclusion.
TI studies will be included at the identification and screening phases to present the magnitude of the use and study of the method in comparison to the multi-attribute temporal ones. However, they will not be considered thereafter for inclusion.
Studies exclusively related to temporality of preferences or emotions without consideration to product sensory descriptions will not be considered for inclusion.
Study design.
All types of study design will be eligible for inclusion.
To ensure that the articles will be available for the future readers of the review, only peer-reviewed articles having a DOI will be eligible for inclusion. In order to avoid article duplication reviews, opinion papers, congress proceedings, doctoral thesis and book chapters will be excluded. Only articles written in English will be considered.
Literature search will include published works until January 16, 2022.
2.2. Identification of relevant databases and literature
2.2.1. Information sources.
The following databases were searched: Scopus, Web of Science Core Collection (WOS), and Google scholar [29]. Only Scopus and WOS were retained (see 2.2.2 for details on this choice). Furthermore, we will search the reference lists and citing articles of included studies and related systematic reviews.
2.2.2. Search strategy.
The Peer Review of Electronic Search Strategies (PRESS) [30] checklist was used to help constructing and validating the search strategy.
First, keywords were listed according to the PICOS criteria. No keyword related to population, comparators, outcomes and study design were added. Keywords related to intervention were identified, including the names of the published temporal methods (Table 1) established based on the knowledge of the authors: “progressive profile/profiling”, “sequential profile/profiling”, “temporal dominance of sensations”, “TDS”, “temporal check all that apply”, “TCATA”, “T-CATA”, “attack evolution finish”. Although TI was outside the scope of this research, the keywords “time intensity” and “time-intensity” were added to retrieve references related to DATI and MATI, but also to potentially detect articles citing TI and to get an idea of the bibliographic volume related to this method. Keywords referring to multiple intakes were also added: “multi”, “multiple”, “bite”, “sip”, “intake”. The wildcard character (*) was used (when applicable) to ensure that variations of each keyword were found. The proximity operator was also preferred (when possible) to the “AND” operator to limit the number of results of the query.
Second, Scopus and WOS were queried on title, abstract and keywords, then results were quickly screened. The test query allowed to notice that the name of the method was not always present in the title, abstract or keywords. Thus, new generic keywords related to temporal perception of sensations (“temporal”, “dynamic”, “perception”, “description” and “sensory analysis”) were added and their combinations added to the search. The test query also allowed to identify major “subject areas” in Scopus (Agricultural and Biological Sciences; Chemistry; Psychology) and “research areas” in WOS (Food science; Chemical analytics; Psychology). They were later used to limit the number of results of the query.
Third, previous reviews related to the research question were identified (see Table 2). It allowed to check if the queries enabled to retrieve all cited references. To this end, no restriction on the type of article was added in the search. Several iterations were needed to refine the queries in WOS and Scopus. It was concluded that, with this search criteria, Google Scholar did not bring new references, and it was therefore not added as a database.
2.2.3. Research equations.
The following research equations were retained for each database:
Scopus
TITLE-ABS-KEY(
(("progressive" PRE/1 "profil*")
OR ("sequential" PRE/1 "profil*")
OR ("dynamic" PRE/1 "profil*")
OR ("time" near/1 "intensity")
OR ("time-intensity")
OR ("temporal" AND "dominance" AND "sensation*")
OR ("TDS")
OR ("temporal" AND "check" AND "all" AND "that" AND "apply")
OR ("TCATA")
OR ("T-CATA")
OR ("attack evolution finish")
OR ("intensity variation descriptive methodology")
OR ("temporal" PRE/1 "profil*")
OR ("temporal" PRE/1 "perception")
OR ("temporal" PRE/1 "description")
OR ("temporal" AND "sensory analysis")
OR ("temporal method*")
OR ("dynamic" PRE/1 "perception")
OR ("dynamic" PRE/1 "description")
OR ("multi*" PRE/1 "sip*")
OR ("multi*" PRE/1 "bite*")
OR ("multi*" PRE/1 "intake*")
) AND (
LIMIT-TO (SUBJAREA, "CHEM")
OR LIMIT-TO (SUBJAREA, "AGRI")
OR LIMIT-TO (SUBJAREA, "PSYC")
)
WOS
TS = (
("progressive" NEAR/1 "profil*")
OR ("sequential" NEAR/1 "profil*")
OR ("dynamic" NEAR/1 "profil*")
OR ("time" NEAR/1 "intensity")
OR ("time-intensity")
OR ("TI")
OR ("temporal" AND "dominance" AND "sensation*")
OR ("TDS")
OR ("temporal" AND "check" AND "all" AND "that" AND "apply")
OR ("TCATA")
OR ("T-CATA")
OR ("attack evolution finish")
OR ("intensity variation descriptive methodology")
OR ("temporal" NEAR/1 "profil*")
OR ("temporal" NEAR/1 "perception")
OR ("temporal" NEAR/1 "description")
OR ("temporal" AND "sensory analysis")
OR ("temporal method*")
OR ("dynamic" NEAR/1 "perception")
OR ("dynamic" NEAR/1 "description")
OR ("multi*" NEAR/1 "sip*")
OR ("multi*" NEAR/1 "bite*")
OR ("multi*" NEAR/1 "intake*")
)
2.3. Selection of articles
Following the search, all identified records will be collated into Mendeley citation manager and duplicates removed. The process of study selection will be presented using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses extension for Scoping Reviews (PRISMA-ScR) [31] as in Fig 1.
The two authors will independently screen (i) the titles and (ii) abstracts retrieved from the database search for potentially eligible studies. The full texts of these studies will be obtained and further screened for eligibility based on the inclusion and exclusion criteria. Corresponding authors will eventually be contacted to retrieve articles not available. Potential disagreements regarding eligibility will be resolved through discussion and consensus. Reasons for exclusion of full-text assessed articles will be reported in the PRISMA diagram.
The articles cited in the reviews and included articles will be manually screened to look for potential relevant missing articles. The articles citing the included articles will be retrieved using Scopus and screened in the same way. The additional references not retrieved by the research equations will be reported in the PRISMA diagram.
2.4. Extraction of relevant information and critical appraisal
2.4.1. Extraction of article metadata.
The meta-data will be reported as exported from the databases.
2.4.2. Identification of generic standards for reporting researching involving temporal sensory methods.
A strategy was defined to identify relevant data in the most exhaustive way. As no comparable review exists, it was not possible to rely on previous similar research. Many standards have been developed to report quantitative or qualitative research using specific designs, but no guideline corresponded to the designs used for the studies that will be included in the review. Indeed, most of them used quasi-experimental research designs. “Quasi-experimental research is similar to experimental research in that there is manipulation of an independent variable. It differs from experimental research because either there is no control group, no random selection, no random assignment, and/or no active manipulation.” [32]. For product-oriented questions, the independent variable (the product) was most often studied using within-subject (counterbalanced or randomized) experimental designs, with no control group. For subject or method-oriented questions, factorial designs still with no control group were mostly used.
Thus, generic standards adapted for this review were identified from “Journal Article Reporting Standards for Quantitative Research in Psychology: The APA Publications and Communications Board Task Force Report” (JARS) [33]. Applicable topics were identified from JARS (from part “Information Recommended for Inclusion in Manuscripts That Report New Data Collections Regardless of Research Design"). Some topics were renamed or grouped to be more consistent with the nomenclatures used in the articles in our area of interest. The expected content of each topic was completed based on literature when necessary. The result is summarized in Table 4.
2.4.3. Definition of specific standards for reporting researching involving temporal sensory methods.
50 articles (called hereafter "test articles") identified thanks to the database query (see 2.2.3) were randomly selected, then read. Following this reading, new topics specific to sensory analyses studies were identified. To facilitate the work of extraction following the reading of each article, a data extraction form was derived from Tables 3 and 4. To objective the topics of Table 4, the extraction form was constructed as a list of topic-related questions. When possible, the use of closed questions was preferred to maximize the agreement between the reviewers and facilitate quantitative analysis of the data in the final review. When possible, a list of pre-determined answers was suggested (the list could be extended during the final evaluation process). When the content of the information was not related to one of the identified research questions but the presence/absence of the information still relevant to be reported for other purpose, the predetermined answers were “yes”, “no” or “not applicable”. The result is summarized in Table 5.
Items marked with an asterisk (*) are mandatory (except for statistical oriented articles) for the article to be considered for quality appraisal (see section 2.4.5).
The two authors will independently fill in the data extraction form materialized by an Excel sheet (that will be included as a supplementary material in the final review). As the nature of the answers is mainly objective, the differences in reporting will be resolved by checking the article until agreement between the 2 reviewers.
2.4.4. Evaluation of completeness of data form.
Once the data extraction for an article is filled, its completeness will be evaluated. Answers “no” and “not reported” will count as 0 while other answers will count as 1 for the purpose of summing across topics of Table 4. Nine completeness indicators will be computed in this way: “Introduction” (0 to 4), “Materials and methods/participants” (0 to 10), “Materials and methods/products” (0 to 7), “Materials and methods/attributes” (0 to 6), “Materials and methods/research design” (0 to 5), “Material and methods/data collection” (0 to 10), “Material and methods/data analysis” (0 to 6), “Results” (0 to 5), “Discussion” (0 to 5).
The evaluation of the completeness will not require any subjective judgment as it will be based on consensual answers of Table 5. Thus, the completeness indicators will be automatically computed based on the data extraction form thanks to an Excel formula.
2.4.5. Critical appraisal.
Only peer-reviewed articles will be included in the final scoping review. Nonetheless, some authors stress the importance of a thorough quality assessment in scoping reviews [44, 45]. To achieve this objective, 7 quality indicators (QI) were chosen according to [46]. It should be noted that only the articles that have the information identified as mandatory (see Table 5) will be evaluated in this stage. The articles that do not comply with this condition will be retained but marked as “not evaluated”.
To help the reviewer in their assessments, the QI were divided in topic-related questions summarized in Table 6.
The reviewers’ involvement will be added for the sake of transparency about the neutrality of the appraisal (it will be answered “yes” if at least one the reviewers is or was personally involved in the work or with the authors, considering this as potential bias in the quality appraisal).
The two reviewers (R1 and R2) will independently answer to all topic-related questions, each having 3 possible answers, “yes”, “no” and “can’t tell” (Critical Appraisal Skills Program [47]). Then, the final judgement will be obtained as follows:
- Step 1. For each topic-related question:
R1 “yes” + R2 “yes” = “yes”
R1 “yes” + R2 “can’t tell” = “probably yes”
R1 “can’t tell” + R2 “can’t tell” = “can’t tell”
R1 “no” + R2 “can’t tell” = “probably no”
R1 “no” + R2 “no” = “no”
R1 “yes” + R2 “no” = “disagreement”
Reasons for giving “no” as an answer will have to be justified.
- Step 2. For the Quality Item the least favorable evaluation among the topic-related final evaluations will be retained.
For example, if reviewer 1 answered “yes” to QI6a while reviewer 2 answered “can’t tell”, QI6a final evaluation will be “probably yes”. If the 2 reviewers answered “can’t tell” to QI6b, QI6a final evaluation will be “can’t tell”. Considering the answers to parts a and b of QI6, its final evaluation will be “can’t tell”.
No overall score quality evaluation (taking into account the seven QI) will be made, and all articles will be included whatever their score. Indeed, these scores will only reflect a quality level related to the research question of this review, and the final appraisal will be to the discretion of the future readers of the scoping review. The evaluation of each article consisted in as a 3-steps procedure (read below):
- Extraction of information (63 items) using the extraction form
- Automatic evaluation of the completeness of the reporting (9 indicators)
- Critical appraisal (7 indicators)
Fig 2 summarizes the evaluation process that was refined and tested on the 50 test articles. The modifications to this evaluation process, if any, will be described in the final scoping review.
3. Results
Tables and figures will be produced to summarize most of the extracted data presented in Table 5. A narrative synthesis organized into themes reflecting the scoping review objectives will also be presented. Both descriptive statistics and narrative synthesis will be supported by a qualitative analysis.
4. Discussion
The proposed scoping review resulting from the present protocol aims at summarizing how multi-attribute temporal descriptive methods have been implemented, used and compared in sensory analysis. This review will help the sensory analysts choose the appropriate method according to their needs (e.g. product description, product discrimination, oral processing behavior) and adopt the best practices. Moreover, this review will allow to identify the areas where additional research and/or validation is necessary.
This protocol presents a detailed methodology for conducting the review. The publication of this protocol presents several advantages. The protocol has been reviewed thanks to expert feedbacks, ensuring its transparency and validity. The data extraction form and the quality appraisal flowchart can be adapted and reused for other areas of research, particularly in a young science such as sensory and consumer science. This protocol could also be used as checklists to ensure no important information has been forgotten when writing new articles in this field. Indeed, the training exercise on the first 50 articles showed a great heterogeneity in the way the details of the studies are reported. This protocol would help standardizing the way the results of research are reported, which is important with the emergence of open science. Moreover, the authors would also point out that despite the fact that only peer-reviewed articles have been included, several studies do not meet the quality requirements that should be expected. This could be due to a lack of information or validated sources in the field. This protocol could also be used as a guideline for reviewing research manuscripts, or at least to point out the need for defining consensual criteria among journals. Finally, this protocol will promote the use of systematic reviews in science to inform the debate and improve the quality of future research.
Limitations in this protocol have to be reported. The research strategy largely depends on the name of the temporal methods. Therefore, the authors may have missed new or little-known temporal methods. Moreover, in order to limit the number of retrieved articles by the database queries, only specific subject areas (Scopus) or research areas (WOS) have been investigated. Again, it could result in missing articles published in annex research fields such as mathematics or computer science. However, these two limits are not that serious, because it is likely that the missed articles cite or have been cited by at least once one of the articles retrieved through the database queries. The additional references identified this way will be reported in the PRISMA diagram. The research has been limited to articles published in English language. A first look on the geographic distribution of the included studies suggests that it is not a concern. Only peer-reviewed articles have been considered for inclusions, which is debatable. This choice was made for the sake of feasibility and reproducibility. Moreover, it is unlikely that the excluded articles could have met the quality criteria, and the corpus of included publications is supposed large enough to answer to the research questions. Finally, only two databases have been queried. In a first time, Google Scholar was considered, but except for gray literature this database did not bring additional references. This seems to suggest that it was sufficient, considering all the limitations mentioned above.
References
- 1. Lee WEI, Pangborn M. Time–intensity: The temporal aspects of sensory perception. Food Technol. 1986;40:78–82.
- 2. Gordin hh. Intensity variation descriptive methodology: devlopment and application of a new sensory evaluation technique. J Sens Stud. 1987;2(3):187–98.
- 3. Clark CC, Lawless HT. Limiting response alternatives in time-intensity scaling: An examination of the halo-dumping effect. Chem Senses. 1994;19(6):583–94. pmid:7735838
- 4. Jack FR, Piggott JR, Paterson A. Analysis of Textural Changes in Hard Cheese during Mastication by Progressive Profiling. J Food Sci. 1994;59(3):539–43.
- 5. Duizer LM, Bloom K, Findlay CJ. Dual-attribute time-intensity sensory evaluation: A new method for temporal measurement of sensory perceptions. Food Qual Prefer. 1997 1;8(4):261–9.
- 6. Pineau N, Schlich P, Cordelle S, Mathonnière C, Issanchou S, Imbert A, et al. Temporal Dominance of Sensations: Construction of the TDS curves and comparison with time–intensity. Food Qual Prefer. 2009;20(6):450–5.
- 7. Methven L, Rahelu K, Economou N, Kinneavy L, Ladbrooke-Davis L, Kennedy OB, et al. The effect of consumption volume on profile and liking of oral nutritional supplements of varied sweetness: Sequential profiling and boredom tests. Food Qual Prefer. 2010;21(8):948–55.
- 8. Kuesten C, Bi J, Feng Y. Exploring taffy product consumption experiences using a multi-attribute time–intensity (MATI) method. Food Qual Prefer. 2013;30(2):260–73.
- 9. Castura JC, Antúnez L, Giménez A, Ares G. Temporal Check-All-That-Apply (TCATA): A novel dynamic method for characterizing products. Food Qual Prefer. 2016;47:79–90.
- 10. Visalli M, Mahieu B, Thomas A, Schlich P. Concurrent vs. retrospective temporal data collection: Attack-evolution-finish as a simplification of Temporal Dominance of Sensations? Food Qual Prefer. 2020;85:103956.
- 11. Mahieu B, Visalli M, Thomas A, Schlich P. Using Free-Comment with consumers to obtain temporal sensory descriptions of products. Food Qual Prefer. 2020;86:104008.
- 12.
Stone H, Sidel JL. 6—Descriptive Analysis. In: Sensory Evaluation Practices (Third Edition). 3rd ed. Elsevier Academic Press; 2004. p. 377.
- 13. Dijksterhuis G, Eilers P. Modelling time-intensity curves using prototype curves. Food Qual Prefer. 1997;8(2):131–40.
- 14. Dijksterhuis GB, Piggott JR. Dynamic methods of sensory analysis. Trends Food Sci Technol. 2000;11(8):284–90.
- 15. Buck D, Kemp SE. Check-All-That-Apply and Free Choice Description. Descr Anal Sens Eval [Internet]. 2017;579–607.
- 16.
Symoneaux R, Galmarini M V. Open-Ended Questions. In: VARELA P, ARES G, editors. Novel techniques in sensory characterization and consumer profiling. CRC Press.; 2014. p. 401.
- 17. Ares G. Methodological challenges in sensory characterization. Curr Opin Food Sci [Internet]. 2015;3:1–5.
- 18. Meyners M. Controversy regarding relevance and rigor of Sensometrics for industrial applications. In: Sensometrics 2020 –E3S. 2020.
- 19. Cliff M, Heymann H. Development and use of time-intensity methodology for sensory evaluation: A review. Food Res Int. 1993;26(5):375–85.
- 20. Foster KD, Grigor JMV, Cheong JN, Yoo MJY, Bronlund JE, Morgenstern MP. The Role of Oral Processing in Dynamic Sensory Perception. J Food Sci. 2011 Mar;76(2):R49–61. pmid:21535784
- 21. Di Monaco R, Su C, Masi P, Cavella S. Temporal Dominance of Sensations: A review. Trends Food Sci Technol. 2014;38(2):104–12.
- 22. Devezeaux de Lavergne M, Van de Velde F, Stieger M. Bolus matters: the influence of food oral breakdown on dynamic texture perception. Food Funct. 2017;8(2):464–80. pmid:27713955
- 23. Schlich P. Temporal Dominance of Sensations (TDS): a new deal for temporal sensory analysis. Curr Opin Food Sci. 2017;15:38–42.
- 24. Fiszman S, Tarrega A. The dynamics of texture perception of hard solid food: A review of the contribution of the temporal dominance of sensations technique. J Texture Stud. 2018;49(2):202–12. pmid:28547772
- 25. Daudt HML, Van Mossel C, Scott SJ. Enhancing the scoping study methodology: A large, inter-professional team’s experience with Arksey and O’Malley’s framework. BMC Med Res Methodol. 2013;13(1):1–9. pmid:23522333
- 26. Tricco AC, Lillie E, Zarin W, O’Brien KK, Colquhoun H, Levac D, et al. PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation. Ann Intern Med. 2018;169(7):467–73. pmid:30178033
- 27. Arksey H, O’Malley L. Scoping studies: towards a methodological framework. https://doi.org/101080/1364557032000119616. 2007;8(1):19–32.
- 28. Popping the (PICO) question in research and evidence-based practice. Appl Nurs Res. 2002;15(3):197–8. pmid:12173172
- 29. Martín-Martín A, Orduna-Malea E, Thelwall M, Delgado López-Cózar E. Google Scholar, Web of Science, and Scopus: A systematic comparison of citations in 252 subject categories. J Informetr. 2018;12(4):1160–77.
- 30. McGowan J, Sampson M, Salzwedel DM, Cogo E, Foerster V, Lefebvre C. PRESS Peer Review of Electronic Search Strategies: 2015 Guideline Statement. J Clin Epidemiol. 2016;75:40–6. pmid:27005575
- 31. Page MJ, McKenzie JE, Bossuyt PM, Boutron I, Hoffmann TC, Mulrow CD, et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. PLOS Med [Internet]. 2021;18(3):e1003583. pmid:33780438
- 32.
Abraham I, MacDonald K. Quasi-Experimental Research. In: Encyclopedia Of Nursing Research. Springer Publishing Company; 2011.
- 33. Appelbaum M, Cooper H, Kline RB, Mayo-Wilson E, Nezu AM, Rao SM. Journal article reporting standards for quantitative research in psychology: The APA Publications and Communications Board task force report. Am Psychol. 2018;73(1):3. pmid:29345484
- 34. O’Brien BC, Harris IB, Beckman TJ, Reed DA, Cook DA. Standards for reporting qualitative research: A synthesis of recommendations. Acad Med. 2014;89(9):1245–51. pmid:24979285
- 35. Hays JC. Eight Recommendations for Writing Titles of Scientific Manuscripts. Public Health Nurs. 2010;27(2):101–3. pmid:20433663
- 36. Ishida Y, Shimizu T, Yoshikawa M. An analysis and comparison of keyword recommendation methods for scientific data. Int J Digit Libr. 2020;21(3):307–27.
- 37. Penders B. Ten simple rules for responsible referencing. PLOS Comput Biol. 2018;14(4):e1006036. pmid:29649210
- 38. Norris JM, Plonsky L, Ross SJ, Schoonen R. Guidelines for Reporting Quantitative Methods and Results in Primary Research. Lang Learn. 2015;65(2):470–6.
- 39. Stone H, Bleibaum RN, Thomas HA. Test Strategy and the Design of Experiments. Sens Eval Pract. 2012;117–65.
- 40. Heale R, Twycross A. Validity and reliability in quantitative studies. Evid Based Nurs. 2015;18(3):66–7. pmid:25979629
- 41. Brand A, Allen L, Altman M, Hlava M, Scott J. Beyond authorship: attribution, contribution, collaboration, and credit. Learn Publ. 2015;28(2):151–5.
- 42.
The food classification and description system FoodEx 2 (revision 2). EFSA Support Publ. 2017 Mar 7;12(5).
- 43. Barton A, Hayward L, Richardson CD, McSweeney MB. Use of different panellists (experienced, trained, consumers and experts) and the projective mapping task to evaluate white wine. Food Qual Prefer.;83:103900.
- 44. Carroll C, Booth A. Quality assessment of qualitative evidence for systematic review and synthesis: Is it meaningful, and if so, how should it be performed? Res Synth Methods. 2015;6(2):149–54. pmid:26099483
- 45. Verhage A, Boels D. Critical appraisal of mixed methods research studies in a systematic scoping review on plural policing: assessing the impact of excluding inadequately reported studies by means of a sensitivity analysis. Qual Quant. 2017;51(4):1449–68.
- 46. Dixon-Woods M, Shaw RL, Agarwal S, Smith JA. The problem of appraising qualitative research. BMJ Qual Saf. 2004;13(3):223–5. pmid:15175495
- 47. Long HA, French DP, Brooks JM. Optimising the value of the critical appraisal skills programme (CASP) tool for quality appraisal in qualitative evidence synthesis: https://doi.org/101177/2632084320947559. 2020;1(1):31–42.