Contextual factors (CFs) represent a potential therapeutic tool to boost physiotherapy outcomes, triggering placebo effects. Nevertheless, no evidence about the use of CFs among physical therapists is currently available.
To investigate the use of CFs and the opinion of Italian physical therapists specialized in Orthopaedic Manual Therapy (OMTs) on their therapeutic benefits.
A 17-item questionnaire and 2 clinical vignettes assessed the perspective of OMTs on the adoption of CFs in daily clinical practice. The target population was composed of 906 OMTs. An online survey was performed in 2016 using SurveyMonkey Software. Data were analyzed by descriptive and inferential statistics.
A total of 558 volunteers (61.6% of the target OMT population) participated in the study. Half of the participants (52.0%) claimed to use CFs frequently in their practice. More of 50% of OMTs valued the therapeutic significance of CFs for different health problems as determined by a combined psychological and physiological effect. OMTs considered the use of CFs ethically acceptable when they exert beneficial therapeutic effects and their effectiveness has emerged in previous clinical experiences (30.6%). They disagreed on the adoption of CFs when they are deceptive (14.1%). Moreover, OMTs did not communicate the adoption of CFs to patients (38.2%), and CFs were usually used in addition to other interventions to optimize clinical responses (19.9%). Psychological mechanisms, patient’s expectation and conditioning were believed to be the main components behind CFs (7.9%).
Considering that the data collected were self-reported and retrospective, recall and response biases may limit the internal and external validity of the findings.
Citation: Rossettini G, Palese A, Geri T, Fiorio M, Colloca L, Testa M (2018) Physical therapists’ perspectives on using contextual factors in clinical practice: Findings from an Italian national survey. PLoS ONE 13(11): e0208159. https://doi.org/10.1371/journal.pone.0208159
Editor: Allison P. Squires, New York University, UNITED STATES
Received: June 29, 2017; Accepted: November 13, 2018; Published: November 30, 2018
Copyright: © 2018 Rossettini et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Data Availability: All relevant data are within the paper and its Supporting Information files.
Funding: The authors received no specific funding for this work.
Competing interests: The authors have declared that no competing interests exist.
Contextual factors (CFs) have been proposed in the scientific literature as an emerging topic. These are multidimensional aspects of the therapeutic encounter (provider, patient, patient-provider relationship, treatment and setting) capable of producing biological and psychological responses that can trigger positive or negative clinical outcomes by placebo and nocebo effects. Placebo effects have been associated with the optimal use of CFs, whereas nocebo has been associated with a negative context surrounding the clinical encounter. Different psychological theories based upon expectations and learning processes have been put forward as the fundamentals mechanisms of CFs effects, whilst specific neurotransmitters such as endogenous cholecystokinin, opioid, endocannabinoid, vasopressin, and dopamine have been documented as orchestrating the neurobiology behind their clinical effect.
Although the use of CFs as triggers of placebo and nocebo effects has been studied for many years in medicine, they have been introduced in physical therapy only recently . Clinically, CFs symbolize the psycho-social component of the physiotherapy treatment capable of modulating patients’ symptoms[7,8]. Available randomized controlled trials have reported the positive effect of CFs on musculoskeletal conditions such as low back pain[9–12], neck pain and shoulder pain. Patients’ expectations with regard to a treatment[10,13], the physical therapist’s verbal suggestions associated with treatment[9,14], and the enhanced therapeutic alliance between the patient and the physical therapist[11,12] have all been documented as improving outcomes in different domains such as pain, disability, expectation and satisfaction[15–17].
Despite the increased interest in the use of CFs also in some clinical trials[9–14], no data have been published to date on physical therapists’ perspectives harnessing CFs in routine clinical practice. On the contrary, available surveys have investigated the use of placebos in specific groups of healthcare providers in Europe, America and the Middle East  documenting an overall use of them ranging from 17.0% to 80.0% among physicians[19–36], and from 51.0% to 100.0% among nurses[22,37–39].
Clinical implementation and perspectives about CFs use have been suggested as a priority field of investigation in different professional healthcare groups, such as physical therapists. In fact, physical therapists establish a one-to-one relationship with the patient, following the clinical pathway alongside and, more directly, influencing their experience and degree of satisfaction. Among these professionals, physical therapists specialized in Orthopaedic Manual Therapy (OMTs) represent a professional group to be investigated because their clinical practice is widely pervaded by CFs. Therefore, within this area of medicine we decided to explore the clinical behaviours, definition, frequency of use, beliefs, ethical and communication implications, circumstances of application and mechanism of actions of CFs in a nationwide sample of Italian OMTs.
Materials and methods
A quantitative exploratory web-based cross-sectional survey herein reported according to the Checklist for Reporting Results of Internet E-Surveys (CHERRIES) guidelines and to STrengthening the Reporting of OBservational Studies in Epidemiology (STROBE) was performed at the University of Genoa (Italy) between October and December 2016. Ethical approval was obtained from the Liguria Clinical Experimental Ethics Committee (P.R.236REG2016, approved on 19/07/2016).
Participants and setting
A nationwide sample of Italian physical therapists specialized in OMTs was the target population identified from the complete email database of the Master in Rehabilitation of Musculoskeletal Disorders (MRDM) of Genoa University (n = 906). This advanced educational program captures almost the totality of the Italian physical therapists specialized as OMTs; moreover, it represents the oldest academic post-graduate program in manual therapy in Italy, based upon the standards established by the International Federation of Orthopaedic Manipulative Physical Therapists.
Within the established population, we included those OMTs who: a) had a valid e-mail account, b) understood the Italian language; and c) were working as clinicians at the time of the survey. Considering previous surveys on placebos which showed that a likely response rate would range from 40.0% to 60.0%[19–21,25,26,36], we expected approximately 363 to 544 overall responses from the population of 906 OMTs. The application of these predicted values to the formula for estimating the sample size for a single population proportion with the population proportion set at 50.0%, which is the most conservative value to be applied, produced a two-sided 95.0% confidence level within three to four percentage points of the true value and a relative standard error ranging from 2.7 to 4.1.
Questionnaire development and pre-testing
A survey tool made of questions and clinical vignettes was developed using distinct and iterative steps. Items from the existing surveys on placebo were extracted from the literature. Moreover, two clinical vignettes were derived and adapted from a recent survey on placebo. Clinical vignettes represent written case scenarios on fictitious patients: they are adopted for measuring the clinical behavior of health providers by asking participants to report what their behavior would be[49,50].
The initial list included 17 questions and 2 clinical vignettes that were critically evaluated for face and content validity by a panel of 6 experts with extensive experience in placebo and survey design (a physician, a psychologist, a nurse, and three physical therapists). These experts worked independently and then agreed on the final list by proving feedback on content accuracy, wording, question order and survey structure. Adjustments were progressively included by considering the feedback that emerged. When full agreement among experts was achieved, a preliminary version of the survey made of 17 questions and 2 clinical vignettes was self-administered and piloted in a convenient sample of 10 OMTs (North, n = 4; Centre, n = 3; South of Italy, n = 3).
Once the pilot stage was over, a telephone debriefing session was performed. The panel of experts conducted one-to-one interviews among the sample of 10 OMTs on the possible difficulties encountered when doing the survey (e.g., identifying questions that required further explanation, wording that was too difficult to read or that respondents seemed to find confusing) and the OMTs’ experience in answering the questions. Overall, the outcome of the pilot stage was satisfactory; therefore, no changes nor comments were necessary. Namely, the sample reported that questions and clinical vignettes were not ambiguous; wording was easy and simple to be understood and the self-administered experience was good.
A self-administered questionnaire (translated into English, S1 File and in original language S2 File) divided into 3 sections (A, B and C) was used. The socio-demographic variables were investigated by 2 open-ended questions (e.g., age) and 5 closed multiple-choice questions (e.g., gender, geographic region) in section A. Two clinical vignettes, structured as closed multiple-choice questions, were included in section B:
- the first vignette was on the use of transcutaneous electrical nerve stimulation (TENS) in a patient with low back pain and high positive expectations towards this treatment based on previous encouraging experience. OMTs were asked to undertake a decision in this situation in which the use of TENS did not present contraindications and in absence of any evidence of efficacy;
- the second vignette was focused on an in-patient clinical case with shoulder pain positively responding when the active TENS was replaced by a sham TENS. Additionally, OMTs were asked to draw a conclusion on the efficacy and effectiveness of sham TENS.
The last section (section C) lists 10 closed questions. More specifically, six questions were single-choice questions exploring the knowledge of CFs, including the definition (e.g., ‘How would you define the therapeutic role of CFs?’), the frequency of CF use (answers from ‘never’ to ‘many times’) and the case-by-case frequency of CF use (Likert from 0 ‘never’ to 4 ‘daily’, and ‘I was not aware of it was a CF capable to influence therapeutic outcome’). The section explored also participants’ CFs belief (Likert from 0 ‘not at all’ to 4 ‘a lot of’) and the potential beneficial effects of CFs (e.g., ‘What are the potential effects of CFs in the following health problems?’). In the remaining 4 questions, multiple responses were allowed to describe the ethical implications perceived in using CFs (e.g., ‘The use of CFs for therapeutic purposes can be considered ethically acceptable when.…’), communication implications about CFs (e.g., ‘How do you communicate to the patient the use of CFs at the end of treatment?’), the circumstances under which they are applied (e.g., ‘Under what circumstances would you use CFs?’), and the possible mechanisms of action (e.g., ‘What mechanism of action can explain the effect of CFs?’). Overall, the term ‘contextual factor’ was preferred to ‘placebos’, as suggested in previous studies[26, 50].
Data collection procedure
The SurveyMonkey (Survey-Monkey, Palo Alto, California, www.surveymonkey.com) online survey tool was used. The survey was administered over an eight-week period between 14th October 2016 and 14th December 2016. After permission was obtained from MRDM of Genova University, all OMTs were contacted by blast email . An email containing the survey and a brief note outlining (a) the aim of the study, (b) data handling (anonymity), (c) the informed consent statement, and (d) the invitation to complete the survey, was delivered. Specifically, the statement within the email informed that by clicking on the survey link, respondents were providing their consent to participate in the study.
Two email reminders were sent 2 and 4 weeks after the initial contact to encourage those who did not participate in the survey. 10 to 15 minutes were needed to complete the survey, corresponding to the completion time found to optimize response rates in online surveys. Participation was voluntary and no incentives were offered to participants; there was the option to decline to answer specific questions or to leave the entire questionnaire blank. Participants were able to review or change responses using a back button before submitting their answers.
Data were downloaded and stored in an encrypted computer, and only the project manager had access to the information during all stages of the study. Participants were ensured that their identities would not be disclosed to investigators. All data were de-identified (name and email address) to maintain confidentiality and data protection.
Survey data were downloaded from SurveyMonkey into Excel spreadsheets and reviewed for accuracy and missing values. A questionnaire was considered incomplete if > 20.0% of data were missing .
For questions allowing only one choice, descriptive statistics (mean, standard deviation) were used for continuous variables by calculating also confidence intervals (CI) at 95%, while absolute frequencies and percentages were applied to dichotomous, nominal, and ordinal variables. Age and years of clinical experience were transformed into ordinal variables considering a decade as variable levels for the analysis of correlations, as described below. For those questions with more than one choice, absolute frequency and percentages were calculated for every combination of responses given by each participant. For example, considering that the fields (n) asked in the domain ‘Ethic’ were four with dichotomous responses (r), we did not calculate the absolute frequency of the four possible fields but of their 16 combinations, given by the formula r∧n, to better describe the responses given by each participant.
The presence of any relationship between the individual characteristics (section A of the survey) and the responses given (sections B and C of the survey) was investigated with Cramer’s V which is a measure of strength and direction of association derived from chi-square statistics. Only correlation values higher > 0.60 were deemed acceptable and, therefore, here reported.
The five response options for the domains of frequency of use (‘never’, ‘around once per year’, ‘around once per month’, ‘around once per week’, ‘daily’) and beliefs about CFs (‘not at all’, ‘few’, ‘enough’, ‘much’, ‘a lot of’) were converted into a five-point Likert scale ranging from 0 (‘never’ and ‘not at all’) to 4 (‘daily’ and ‘very much’) in order to have an average distribution of the two domains and to analyze the relationship between the frequency of use and the associated beliefs about CFs using Spearman’s rho. R software was used for data analysis with the packages psych and ggplot2.
Out of the 906 invited OMTs, a total of 571 responded (63.0%). Thirteen incomplete surveys were excluded from data analysis, leaving 558 questionnaires to be considered as valid (61.6%) for the analysis. The majority of OMTs (n = 329; 59.0%; 95%CI 54.7–63.0) were male, and their average age was 30.5 ± 6.5 years. 72% of participants (n = 400; 95%CI 67.7–75.3) lived in the North of Italy.
Participants reported a mean of 6.8 ± 5.7 years of clinical experience. A high proportion worked 31–45 hours/week (n = 316; 56.6%; 95%CI 52.4–60.8) as private practitioners (n = 433; 77.6%; 95%CI 73.9–80.9) in the musculoskeletal field (n = 472; 84.6%; 95%CI 81.3–87.4). The respondents’ demographics are described in Table 1.
Definition of CFs
The majority of OMTs defined CFs as ‘an intervention without a specific effect for the condition being treated, but with a possible aspecific effect’ (n = 407; 72.9%; 95%CI 69.0–76.5). Instead, the minority of OMTs identified CFs as ‘a sham treatment used as control tests for safety and efficacy of active treatment’ (n = 20; 3.6%; 95%CI 2.3–5.6) and as ‘a harmless or inert intervention’ (n = 19; 3.4%; 95%CI 2.1–5.4).
The remaining participants considered CFs as ‘an intervention that has a special effect through known physiological mechanisms’ (n = 112; 20.1%; 95%CI 16.9–23.7).
Clinical vignette 1
The most frequently chosen solution to the first vignette was ‘to deliver TENS’ (n = 169; 30.3%; 95%CI 26.5–34.3). The least frequent answer instead was ‘to tell the patient that low back pain would resolve itself in a few days’ (n = 4; 0.7%; 95%CI 0.2–1.9). The overall overview of data is reported in Fig 1.
A: to deliver TENS, B: to tell the patient that low back pain would resolve itself in a few days, C: to suggest the possibility of delivering TENS if the clinical condition fails to improve, D: to advise a follow-up appointment in the following days, E: to advise a different treatment commonly used for low back pain, F: try to convince the patient of the uselessness of TENS.
Clinical vignette 2
The most frequent answer to the second vignette was: ‘the positive attention of the healthcare team leads to decreased pain’ (n = 114; 20.4%; 95%CI 17.2–24.1), while the least frequent one was ‘the patient provides the response expected by the physical therapist’ (n = 5; 0.9%; 95%CI 0.3–2.2). Globally, the single items and their combinations are presented in Fig 2.
A: pain is not organic but psychological, B: the patient is very suggestible, C: the natural decrease of pain intensity, D: the patient provides the response expected by the physical therapist, E: the positive attention of the healthcare team leads to decreased pain.
Frequency of use
The frequency of use presented a mean of 3.04 (95%CI 3.00–3.07) on a five-point Likert scale, indicating a higher adoption of CFs among participant OMTs. Overall, 52% of OMTs (n = 290; 95%CI 47.7–56.2) claimed to use the CFs ‘many times’ in their clinical practice. The remaining reported the use as ‘often’ (n = 112; 20.1%; 95%CI 16.9–23.7), ‘at least once’ (n = 126; 22.6%; 95%CI 19.2–26.3), and ‘never’ (n = 30; 5.4%; 95%CI 3.7–7.7).
As for the specific adoption of CFs, the most used CFs were: ‘verbal communication’ (mean = 3.6; 95%CI 3.5–3.7), ‘patient-centered approach’ (mean = 3.6; 95%CI 3.5–3.7) and ‘empathetic therapeutic alliance with the patient’ (mean = 3.6; 95%CI 3.5–3.7). The least used CFs were (in descending order): an ‘adequate environmental architecture’ (mean = 2.4; 95%CI 2.2–2.5), ‘adequate design’ (mean = 2.2; 95%CI 2.1–2.4), the ‘uniform’ (mean = 2.2; 95%CI 2.0–2.3) and the ‘professional reputation’ (mean = 1.7; 95%CI 1.6–1.9). A complete report on CF use is presented in Table 2.
Three CFs presented a bimodal response modality in terms of ‘daily’ (the ‘uniform’: n = 215; 38.5%; 95%CI 34.5–42.7; an ‘adequate environmental architecture’: n = 219; 39.2%; 95%CI 35.2–43.4; ‘an adequate design’: n = 207; 37.1%; 95%CI 33.1–41.3) and ‘never’ (‘the uniform’: n = 180; 32.3%; 95%CI 28.4–36.3; an ‘adequate environmental architecture’: n = 147; 26.3%; 95%CI 22.8–30.2; an ‘adequate design’: n = 167; 29.9%; 95%CI 26.2–33.9).
An analysis on the participants’ characteristics performed to understand the reason causing this kind of bimodal distribution revealed dependence on the workplace. In particular, the OMTs working in the private sector at the time of the survey used these CFs more frequently (an ‘adequate environmental architecture’: mean = 2.5, 95%CI 2.4–2.6; an ‘adequate design’: mean = 3.2, 95%CI 3.1–3.3) as compared to OMTs working in hospitals (an ‘adequate environmental architecture’: mean = 2.0, 95%CI 1.8–2.1; an ‘adequate design’: mean = 2.8, 95%CI 2.7–2.9) and in residential care settings (an ‘adequate environmental architecture’: mean = 2.0, 95%CI 1.8–2.1; an ‘adequate design’: mean = 2.7, 95%CI 2.5–2.8).
Moreover, a more frequent use of ‘the uniform’ was adopted by OMTs working in the private sector (mean = 2.2, 95%CI 2.1–2.4) and in hospitals (mean = 2.1, 95%CI 2.0–2.3) as compared to those who were working in residential care (mean = 1.7, 95%CI 1.6–1.8).
The mean score of beliefs was 2.79 out of 5 (95%CI 2.77–2.82), thus denoting a substantial level of conviction towards CFs among OMTs.
In detail, the most believed CFs were (in descending order): ‘the empathetic therapeutic alliance with the patient’ (mean = 3.5; 95%CI 3.4–3.6), ‘the patient-centered approach’ (mean = 3.4; 95%CI 3.4–3.5), ‘the verbal communication’ (mean = 3.3; 95%CI 3.3–3.4). The least believed CFs were (in descending order): ‘the professional reputation’ (mean = 2.4; 95%CI 2.3–2.5), ‘the adequate environmental architecture’ (mean = 2.2; 95%CI 2.1–2.3), ‘the adequate design’ (mean = 2.1; 95%CI 2.0–2.2), and ‘the uniform’ (mean = 1.6; 95%CI 1.5–1.7). An overall description of beliefs towards CFs is presented in Table 3.
Overall, ‘physiological and psychological’ effects were the most chosen by OMTs caring after various health problems such as chronic pain (n = 436, 78.1%; 95%CI 74.4–81.4) and insomnia (n = 345; 61.8%; 95%CI 57.6–65.8). The ‘psychological’ effect was predominantly reported for oncological (n = 274; 49.1%; 95%CI 44.9–53.3) and emotional disorders (n = 232; 41.6%; 95%CI 37.5–45.8). OMTs identified as ‘no benefit’ the therapeutic effects behind several health conditions such as infectious (n = 229; 41.0%; 95%CI 36.9–45.3) and immune/allergic problems (n = 167; 29.9%; 95%CI 26.2–33.9). No health problem was selected for having an exclusively ‘physiological’ effect. An overall report of therapeutic effects is presented in Table 4.
The most frequent response on the ethical use of CFs was ‘it exerts beneficial psychological effects’ (n = 155; 27.8%; 95%CI 24.1–31.7) and its combination with the response ‘clinical experience has shown the effectiveness’ (Fig 2). The least selected item was ‘the other therapies are over’ (n = 8; 1.4%; 95%CI 0.7–2.9) and its combinations with the other items as presented in Fig 3.
A: it exerts beneficial psychological effects, B: the other therapies are over, C: the patient wants or expects this treatment, D: effectiveness shown by clinical experience.
The adoption of CFs was instead considered non-ethical when ‘based on deception’ (n = 79; 14.1%; 95%CI 11.4–17.4) and its combinations with other items as reported in Fig 4. Differently, the least frequent selected answer was when ‘legal problems arise’ (n = 4; 0.7%; 95%CI 0.2–1.9) and its combinations with other items (Fig 4).
When asked about communication and CFs, participants reported a higher frequency of ‘do not say anything’ (n = 213; 38.2%; 95%CI 34.1–42.4). The least frequent chosen item was: ‘it is a treatment without a specific effect’ (n = 2; 0.4%; 95%CI 0.1–1.4). Overall, the combinations of responses are reported in Fig 5.
A: it is a treatment that can help and will not hurt, B: it is an effective treatment, C: it is a treatment without a specific effect, D: it is a treatment that induces a psychological change, E: it can help but you are not sure about its effect, F: do not say anything.
Circumstances of CFs application and mechanism of action
As for the circumstances of CFs application, the most frequent item was ‘as an adjunct to other physical therapy interventions to optimize the clinical responses’ (n = 111; 19.9%; 95%CI 16.7–23.5) and its combinations with the response ‘to calm the patient’.
The least frequent answers were four items: ‘as a result of unjustified and constant demands for physiotherapy interventions’ (n = 1; 0.2%; 95%CI 0.0–1.2), ‘when all other therapies are over’ (n = 1; 0.2%; 95%CI 0.0–1.2), ‘as a diagnostic tool to differentiate between psychological and physiological problems’ (n = 1; 0.2%; 95%CI 0.0–1.2), ‘to control pain’ (n = 1; 0.2%; 95%CI 0.0–1.2). Globally, the combinations of responses are presented in Fig 6.
A: as a result of unjustified and constant demands for physiotherapy interventions, B: to calm the patient, C: when all other therapies are over, D: as an adjunct to other physical therapy interventions to optimize the clinical responses, E: for non-specific problems, F: to stop patient’s complaints, G: as a diagnostic tool to differentiate between psychological and physiological problems, H: to control pain, I: to gain time.
In terms of mechanism of action behind CFs, OMTs selected heterogeneous responses. The most frequent option was ‘psychological factor’ (n = 13; 2.3%; 95%CI 1.3–4.1) and its combination with the items ‘conditioning’ and ‘patient’s expectation’ (Fig 7). The least frequent answer was ‘suggestibility’ (n = 1; 0.2%; 95%CI 0.0–1.2). However, most of the observed frequencies reported by OMTs represented combinations of different answers as presented in Fig 7.
Correlation between variables
The correlation between the overall frequency and the overall beliefs about CFs was weak (rho = 0.45; p<0.001). Moreover, positive weak associations with Spearman’s rho ≥ 0.40 were found for the following items: uniform (rho = 0.48; p<0.001), patient’s expectation and preference (rho = 0.44; p<0.001), positive attitudes and optimistic behavior (rho = 0.43; p<0.001), and non-verbal communication (rho = 0.40; p<0.001).
For the other items, the correlation between the frequency of use and the beliefs of each CF was poor with Spearman’s rho < 0.40 as presented in Fig 8.
No significant correlations (Cramer’s V < 0.60) were found between demographic characteristics (section A of the survey) and the responses given (sections B and C of the survey).
To the best of our knowledge, this is the first study that evaluates awareness on CFs among physical therapists specialized in OMTs. The main finding of our research identifies CFs as an aspecific therapeutic intervention capable of influencing patients’ clinical outcome. Moreover, our results suggest that OMTs used and believed in the effectiveness of CFs mainly because of the psychological and physiological therapeutic effects for different healthcare conditions.
As emerged from clinical vignette 1, almost 60% of participants applied TENS. This data inform us about the positive attitude of Italian OMTs towards patients’ expectations in the choice of treatment immediately or after a few days. Indeed, patients’ expectations has been recognized an emerging area of interest in orthopedic physical therapy, representing a CF capable of increasing the likelihood of clinical success in low back pain. On the contrary, 40% of participants refused TENS or offered an alternative treatment, thus mirroring the physiotherapists’ behavior reported in previous worldwide surveys[57,58]. Globally, these findings suggest that Italian OMTs consider patients’ expectations as an important therapeutic tool to be integrated in the decision-making process.
Various responses in terms of frequency emerged from clinical vignette 2. The majority of OMTs identified the positive attention of the healthcare team as an explanation for the reduction of pain. This data confirms the importance of the attitude of physical therapists and its influence on musculoskeletal pain, so it should be applied in the clinical context to maximize clinical outcomes[11,15]. Instead, other participants reported an improvement in symptoms connected to the non-organic origin of symptoms, patient’s suggestibility, the natural course of pathology and the patient’s desire to please the physical therapist for their caring. Emerging evidence suggests that these psychobiological components are relevant and have an impact on patients’ pain experience[56,59,60], therefore there is the need to consider and measure these outcomes in patients to potentially enhance the therapeutic effects of CFs in clinical practice.
Although previous studies have not been conducted in the field of orthopaedic physical therapy, some considerations can be made when comparing our results with a similar survey performed among other healthcare professions[19–39]. Similarly to previous surveys among physicians[25,28,29,32], almost 70.0% of OMTs defined CFs as an intervention without a specific effect, but with a possible non-specific effect. These findings reveal that physical therapists conceptualize the context around the treatment as an incidental element that can occur during treatment instead of a powerful therapeutic tool capable of influencing patients’ outcome. This vision could be related to the limited knowledge in academic education on the neurophysiological mechanism underpinning the therapeutic effects of CFs capable of influencing clinical outcomes.
At all levels, Italian OMTs reported a high frequency of application of CFs in their daily practice and a strong belief in the actual therapeutic value of CFs, in line with previous studies among physicians[19–34] and nurses[22,37–39].
In detail, the most used and believed CFs were the ones most closely related to patient-physical therapy interaction, representing soft-skills capable of strengthening the patients’ engagement in the therapeutic relationship and to predict the outcome in musculoskeletal physical therapy. These CFs embody a milestone of caring also among nurses. Indeed, in hospital wards nurses spend a significant amount of time with patients, touching them and providing a positive message (e.g., “this pill will decrease your pain”), thus creating the optimal condition for a good therapeutic relationship and for clinical improvement. Instead, physicians often overwork and have less time for interacting and engaging with patients, thus reducing the positive therapeutic effects of CFs.
Overall, professional reputation resulted in the least adopted and believed CF and this may depend on a specific lack of knowledge on its clinical relevance. In fact, professional reputation is identified as an undiscovered variable behind the complex concept of professional identity in physical therapy , even though it is currently not included in the national academic curriculum as compared to other elements (e.g., verbal and non-verbal communication). Therefore, there is a need to increase awareness about this CF among physiotherapists, representing an emerging element of personal branding and marketing position.
Some specific CFs (e.g., uniform, adequate design and environmental architecture) were overall least believed in, but they were adopted by OMTs with a bimodal frequency (‘daily’ vs ‘never’). The uniform (e.g., white coat) was adopted more in the private sector and in hospitals compared to residential care, representing a CF often imposed in specific settings and the choice of a physical therapist to influence patient’s perception. Moreover, OMTs working in private practice focused more frequently on design and architecture, thus investing economic resources to improve the environment and influence therapeutic outcomes. Instead, in hospitals and in residential care, the low adoption of these CFs may be related to the specificity of these clinical settings, where these elements (e.g., colors of the room, windows and skylights) symbolize infrastructural elements which are not modifiable as compared to music, fragrances or temperature. Therefore, there is a need to direct health policies towards renovating architecture and environmental design with the aim of improving the overall healthcare process and patients’ satisfaction.
As for the therapeutic effect of CFs, OMTs believed in ‘psychological and physiological’ effects for most health problems (e.g., pain conditions), thus mirroring a trend previously reported by nurses and physicians who believed in predominantly subjective or a mixture of subjective and objective effects[21,25,27,29,32–35,37]. Less frequently and for other specific clinical conditions, OMTs reported a variety of therapeutic effects as ‘psychological’ (e.g., in oncological conditions) and ‘no benefit’ (e.g., in infectious conditions), depending on the specific health problems considered. Overall, this finding suggests that different effects could explain the therapeutic value of CFs, offering the opportunity to assess them in future research on placebo, nocebo and contextual effect.
OMTs considered the use of ethical implications of CFs as acceptable to enhance positive psychological effects when the clinical experience shows their effectiveness. However, when CFs are based upon deception, they should be avoided to preserve trust between patient and physical therapist, thus highlighting the importance of an ethical application of CFs in the therapeutic session. As reported in previous surveys, nurses[22,37] and physicians[19–22,24–29,31–35] were also in favor of the use of placebos and they rarely considered placebos as not allowed or as a treatment that is never permissible.
Furthermore, as previously documented[19,20,22,24–26,29,32–35,37,39], our participants were not used to communicate the adoption of CFs to their patients, nor to inform them that context is an effective addition to the treatment, capable of helping without hurting. The need to disclose to the patient the use of a placebo intervention during the informed consent process is still being debated among clinicians and researchers; however, open-label adoption of a placebo is capable of positively influencing therapeutic outcomes in chronic low back pain and it is appreciated by patients.
As clinical indications, OMTs mostly attributed to CFs a therapeutic role in calming patients and as an added strategy to physical therapy interventions, meeting the vision of nurses[22,37] and physicians[20,22,25,27,33] on this topic. Instead, differently from our participants, other healthcare providers offered variable indications, thus embracing placebos predominantly to gain a therapeutic advantage, to satisfy the patient’s request, to avoid conflicts, to distinguish organic from psychogenic problems, to control pain, to treat non-specific symptoms, or use when all other interventions have been ineffective[19–22,24,25,27,31–37]. This finding remarks the value of CFs and the need to integrate them in orthopedic physical therapy to enhance therapeutic outcomes. In clinical practice a constant adoption of CFs (e.g., relaxing music, soft light and reassuring voice) along with the best evidence-based treatment, offers OMTs the opportunity to manage patients’ symptoms (e.g., fear, avoidance, anxiety) commonly associated with musculoskeletal pain.
Moreover, OMTs presented a multifaceted point of view on the mechanisms of action, reporting as most frequent the combination of patient’s expectations, conditioning and psychological factors. This heterogeneity can reflect a lack of knowledge toward the topic as already reported by other healthcare providers[22,24,25,27,28,31,32,34,35], thus suggesting the need of educational efforts on CFs and on placebo and nocebo effects.
The lack of correlations between frequency of use and beliefs can be interpreted under different perspectives: first, OMTs can have some constraints in their clinical practice (e.g., time pressure with a high number of cases to be treated in reduced time) which limit the frequency of CF use despite their beliefs; moreover, their practice may use an evidence-based approach for specific interventions despite general beliefs, thus undermining the implementation of CFs. In this case, improving their preparation by supporting their general beliefs with evidence-based knowledge could be useful.
Strengths and weaknesses of the study
A high response rate was achieved (61.6%) as compared to previous studies on placebos (from 40.0% to 60.0%)[19–21,25,26], confirming the willingness of Italian OMTs to participate in the survey. A specific group of Italian physical therapists with OMT specializations (n = 906) who are educated to manage mainly musculoskeletal disorders in the private healthcare sector was involved. Therefore, their responses may differ from those of non-specialized physical therapists or from those of other physical therapy specialists[33,75]. Moreover, the are of Italy where respondents are based (North vs Centre and South), less than 10 years of clinical practice, and the majority working full-time may have influenced the participants’ adoption and beliefs of CFs as a therapeutic tool[33,75].
A survey tool was adopted to understand the perspectives of the target population. The questionnaire included different items (e.g., close-ended questions) to increase the likelihood of capturing the complexity of the phenomena under study. Clinical vignettes were used despite their validity being recently questioned in favor of standardized patients as a measure to assess the clinical behavior of physiotherapists[78–80]. However, our methodological choice was based on the impossibility to have a standardized patient for a national online survey, thus mimicking a modus operandi previously reported in placebo survey performed on healthcare providers.
Given that data were self-reported and retrospective in nature, recall bias can threaten the validity of the findings. Despite the assurance of anonymity, some participants may have misreported their use of CFs.
Implications for clinicians, policymakers and researchers
A wide use of CFs in physical therapy practice has emerged among Italian OMTs. To ensure appropriate competence, awareness, and the ethical use of the context, this issue should be included in physical therapy graduate and postgraduate study programs and in professional lifelong learning courses. The research on CFs in physical therapy has to be considered in its early stages. Therefore, further quantitative studies evaluating knowledge, uses, and aptitudes on CFs among non-specialized physical therapists across different countries, are strongly recommended. Moreover, studies comparing CFs beliefs, perspectives, and use among healthcare workers are also suggested. To develop a more comprehensive understanding of the phenomena, there is also a need to investigate patients’ perceptions of CFs in physical therapy practice as well as clinicians’ subjective experience of placebo and nocebo effects.
S1 File. The questionnaire: “Knowledge about contextual factors among Italian physical therapists specialized in manual therapy (OMTs)”.
S2 File. Il questionario: “Conoscenza dei fattori di contesto tra i fisioterapisti italiani specializzati in terapia manuale ortopedica (OMTs)”.
- 1. Lucassen P, Olesen F. Context as a drug: some consequences of placebo research for primary care. Scand J Prim Health Care. 2016;34(4): 428–433. pmid:27978780
- 2. Di Blasi Z, Harkness E, Ernst E, Georgiou A, Kleijnen J. Influence of context effects on health outcomes: a systematic review. Lancet. 2001;357(9258): 757–762. https://doi.org/10.1016/S0140-6736(00)04169-6 pmid:11253970
- 3. Carlino E, Benedetti F. Different contexts, different pains, different experiences. Neuroscience. 2016;338: 19–26. pmid:26827944
- 4. Carlino E, Frisaldi E, Benedetti F. Pain and the context. Nat Rev Rheumatol. 2014;10(6): 348–355. pmid:24567065
- 5. Wager TD, Atlas LY. The neuroscience of placebo effects: connecting context, learning and health. Nat Rev Neurosci. 2015;16(7): 403–418. pmid:26087681
- 6. Testa M, Rossettini G. Enhance placebo, avoid nocebo: How contextual factors affect physiotherapy outcomes. Man Ther. 2016;24: 65–74. pmid:27133031
- 7. Bishop MD, Torres-Cueco R, Gay CW, Lluch-Girbés E, Beneciuk JM, Bialosky JE. What effect can manual therapy have on a patient’s pain experience? Pain Manag. 2015;5(6): 455–64. pmid:26401979
- 8. Miciak M, Gross DP, Joyce A. A review of the psychotherapeutic “common factors” model and its application in physical therapy: the need to consider general effects in physical therapy practice. Scand J Caring Sci. 2012;26(2): 394–403. pmid:21913950
- 9. Bialosky JE, George SZ, Horn ME, Price DD, Staud R, Robinson ME. Spinal manipulative therapy-specific changes in pain sensitivity in individuals with low back pain (NCT01168999). J Pain. 2014;15(2): 136–148. pmid:24361109
- 10. Bishop MD, Bialosky JE, Cleland JA. Patient expectations of benefit from common interventions for low back pain and effects on outcome: secondary analysis of a clinical trial of manual therapy interventions. J Man Manip Ther. 2011;19(1): 20–5. pmid:22294850
- 11. Ferreira PH, Ferreira ML, Maher CG, Refshauge KM, Latimer J, Adams RD. The therapeutic alliance between clinicians and patients predicts outcome in chronic low back pain. Phys Ther. 2013;93(4): 470–8. pmid:23139428
- 12. Fuentes J, Armijo-Olivo S, Funabashi M, Miciak M, Dick B, Warren S, et al. Enhanced therapeutic alliance modulates pain intensity and muscle pain sensitivity in patients with chronic low back pain: an experimental controlled study. Phys Ther. 2014;94(4): 477–89. pmid:24309616
- 13. Bishop MD, Mintken PE, Bialosky JE, Cleland JA. Patient expectations of benefit from interventions for neck pain and resulting influence on outcomes. J Orthop Sports Phys Ther. 2013;43(7): 457–65. pmid:23508341
- 14. Riley SP, Bialosky J, Cote MP, Swanson BT, Tafuto V, Sizer PS, et al. Thoracic spinal manipulation for musculoskeletal shoulder pain: Can an instructional set change patient expectation and outcome? Man Ther. 2015;20(3): 469–74. pmid:25543999
- 15. Hall AM, Ferreira PH, Maher CG, Latimer J, Ferreira ML. The influence of the therapist-patient relationship on treatment outcome in physical rehabilitation: a systematic review. Phys Ther. 2010;90(8): 1099–110. pmid:20576715
- 16. Hush JM, Cameron K, Mackey M. Patient satisfaction with musculoskeletal physical therapy care: a systematic review. Phys Ther. 2011;91(1): 25–36. pmid:21071504
- 17. O’Keeffe M, Cullinane P, Hurley J, Leahy I, Bunzli S, O’Sullivan PB, et al. What Influences Patient-Therapist Interactions in Musculoskeletal Physical Therapy? Qualitative Systematic Review and Meta-Synthesis. Phys Ther. 2016;96(5): 609–22. pmid:26427530
- 18. Fassler M, Meissner K, Schneider A, Linde K. Frequency and circumstances of placebo use in clinical practice—a systematic review of empirical studies. BMC Med. 2010;8: 15. pmid:20178561
- 19. Fassler M, Gnadinger M, Rosemann T, Biller-Andorno N. Use of placebo interventions among Swiss primary care providers. BMC Health Serv Res. 2009;9: 144. pmid:19664267
- 20. Howick J, Bishop FL, Heneghan C, Wolstenholme J, Stevens S, Hobbs FD, et al. Placebo use in the United kingdom: results from a national survey of primary care practitioners. PloS One. 2013;8(3): e58247. pmid:23526969
- 21. Hróbjartsson A, Norup M. The use of placebo interventions in medical practice—a national questionnaire survey of Danish clinicians. Eval Health Prof. 2003;26(2): 153–65. pmid:12789709
- 22. Nitzan U, Lichtenberg P. Questionnaire survey on use of placebo. BMJ. 2004;329(7472): 944–6. pmid:15377572
- 23. Linde K, Friedrichs C, Alscher A, Wagenpfeil S, Meissner K, Schneider A. The use of placebo and non-specific therapies and their relation to basic professional attitudes and the use of complementary therapies among German physicians—a cross-sectional survey. PloS One. 2014;9(4): e92938. pmid:24695272
- 24. Meissner K, Hofner L, Fassler M, Linde K. Widespread use of pure and impure placebo interventions by GPs in Germany. Fam Pract. 2012;29(1): 79–85. pmid:21808072
- 25. Sherman R, Hickner J. Academic physicians use placebos in clinical practice and believe in the mind-body connection. J Gen Intern Med. 2008;23(1): 7–10. pmid:17994270
- 26. Tilburt JC, Emanuel EJ, Kaptchuk TJ, Curlin FA, Miller FG. Prescribing “placebo treatments”: results of national survey of US internists and rheumatologists. BMJ. 2008;337: a1938. pmid:18948346
- 27. Babel P. Use of placebo interventions in primary care in Poland. Med Princ Pract. 2013;22(5): 484–8. pmid:23899813
- 28. Baldwin MJ, Wartolowska K, Carr AJ. A survey on beliefs and attitudes of trainee surgeons towards placebo. BMC Surg. 2016;16(1): 27. pmid:27118280
- 29. Raz A, Campbell N, Guindi D, Holcroft C, Déry C, Cukier O. Placebos in clinical practice: comparing attitudes, beliefs, and patterns of use between academic psychiatrists and nonpsychiatrists. Can J Psychiatry. 2011;56(4): 198–208. pmid:21507276
- 30. Vijapura S, Laferton JA, Mintz D, Kaptchuk TJ, Wolfe D. Psychiatrists’ Attitudes Toward Non-Pharmacologic Factors Within the Context of Antidepressant Pharmacotherapy. Acad Psychiatry. 2016;40(5): 783–9. pmid:26646406
- 31. Wartolowska K, Beard DJ, Carr AJ. Attitudes and beliefs about placebo surgery among orthopedic shoulder surgeons in the United Kingdom. PloS One. 2014;9(3): e91699. pmid:24632880
- 32. Harris CS, Campbell NK, Raz A. Placebo Trends across the Border: US versus Canada. PloS One. 2015;10(11): e0142804. pmid:26606749
- 33. Kermen R, Hickner J, Brody H, Hasham I. Family physicians believe the placebo effect is therapeutic but often use real drugs as placebos. Fam Med. 2010;42(9): 636–42. pmid:20927672
- 34. Shah KN, Panchal DJ, Vyas BM, Patel VJ. Use of placebo: knowledge, attitude and practice among medical practitioners. Indian J Med Sci. 2009;63(10): 472–3. pmid:19901489
- 35. Hassan T, Fauzi M, Hasan D. Perceptions of Placebo Therapy Among Health Practitioners in Jazan Region of Saudi Arabia. Int J Health Sci (Qassim). 2011;5(1): 45–9.
- 36. Kampermann L, Nestoriuc Y, Shedden-Mora MC. Physicians’ beliefs about placebo and nocebo effects in antidepressants–an online survey among German practitioners. PloS One. 2017;12(5): e0178719. pmid:28562635
- 37. Baghcheghi N, Koohestani HR. Placebo use in clinical practice by nurses in an Iranian teaching hospital. Nurs Ethics. 2011;18(3): 364–73. pmid:21558112
- 38. Berthelot JM, Maugars Y, Abgrall M, Prost A. Interindividual variations in beliefs about the placebo effect: a study in 300 rheumatology inpatients and 100 nurses. Joint Bone Spine. 2001;68(1): 65–70. pmid:11235784
- 39. Unver S, Yildirim M, Unal E. Placebo effect of saline in pain management: compared study with hemodialysis and non-hemodialysis nurses’ experiences. Agri. 2013;25(4): 156–62. pmid:24264550
- 40. Scholte M, Calsbeek H, Nijhuis-van der Sanden MW, Braspenning J. Quality of physical therapy from a patient’s perspective; factor analysis on web-based survey data revealed three dimensions on patient experiences with physical therapy. BMC Health Serv Res. 2014;14: 266. pmid:24942662
- 41. Coronado RA, Bialosky JE. Manual physical therapy for chronic pain: the complex whole is greater than the sum of its parts. J Man Manip Ther. 2017;25(3): 115–117. pmid:28694673
- 42. Eysenbach G. Improving the Quality of Web Surveys: The Checklist for Reporting Results of Internet E-Surveys (CHERRIES). J Med Internet Res. 2004;6(3): e34. pmid:15471760
- 43. von Elm E, Altman DG, Egger M, Pocock SJ, Gøtzsche PC, Vandenbroucke JP, et al. Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. BMJ. 2007;335(7624): 806–808. pmid:17947786
- 44. Rossettini G, Rondoni A, Schiavetti I, Tezza S, Testa M. Prevalence and risk factors of thumb pain in Italian manual therapists: An observational cross-sectional study. Work. 2016;54(1): 159–69. pmid:27061697
- 45. Bologna Working Group. A Framework for Qualifications of the European Higher Education Area [Internet]. Copenhagen: Danish Ministry of Science, Technology and Innovation; 2005 [cited 21/01/2017]. http://ecahe.eu/w/images/7/76/A_Framework_for_Qualifications_for_the_European_Higher_Education_Area.pdf
- 46. Beeton K, Langendoen J, Maffey L, Pool J, Hoke AP, Rivett D, et al. Educational Standards in orthopaedic manipulative therapy [Internet]. 2008 [updated 2013; cited 20/01/2017]. http://www.ifompt.org/site/ifompt/files/pdf/XXIFOMPTEducStandardsIMDocMerged.pdf.
- 47. National Statistical Service. Sample Size Calculator [Internet]. Australia: Australian Bureau of Statistics; 2017 [cited 20/01/2017]. http://www.nss.gov.au/nss/home.nsf/pages/Sample+size+calculator
- 48. de Leeuw D, Hox J, Dillman D. International Handbook of Survey Methodology (European Association of Methodology Series). 1st ed. New York: Taylor and Francis group; 2008.
- 49. Converse L, Barrett K, Rich E, Reschovsky J. Methods of Observing Variations in Physicians’ Decisions: The Opportunities of Clinical Vignettes. J Gen Intern Med. 2015;30 Suppl 3: S586–94. pmid:26105672
- 50. Veloski J, Tai S, Evans AS, Nash DB. Clinical vignette-based surveys: a tool for assessing physician practice variation. Am J Med Qual. 2005;20(3): 151–7. pmid:15951521
- 51. Fan W, Yan Z. Factors affecting response rates of the web survey: A systematic review. Comput Human Behav. 2010;26(2): 132–139.
- 52. Lau C, Chitussi D, Elliot S, Giannone J, McMahon MK, Sibley KM, et al. Facilitating Community-Based Exercise for People With Stroke: Cross-Sectional e-Survey of Physical Therapist Practice and Perceived Needs. Phys Ther. 2016;96(4): 469–78. pmid:26294684
- 53. R Development Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Foundation for Statistical Computing; 2015.
- 54. Revelle W. psych: Procedures for Psychological, Psychometric, and Personality Research. Evanston, Illinios: Northwestern University; 2016.
- 55. Wickham H. ggplot2: elegant graphics for data analysis. New York: Springer-Verlag; 2009.
- 56. Rossettini G, Carlino E, Testa M. Clinical relevance of contextual factors as triggers of placebo and nocebo effects in musculoskeletal pain. BMC Musculoskelet Disord. 2018;19(1): 27. pmid:29357856
- 57. Li LC, Bombardier C. Physical therapy management of low back pain: an exploratory survey of therapist approaches. Phys Ther. 2001;81(4): 1018–1028. https://doi.org/10.1093/ptj/81.4.1018 pmid:11276184
- 58. Ladeira CE, Cheng MS, da Silva RA. Clinical Specialization and Adherence to Evidence-Based Practice Guidelines for Low Back Pain Management: A Survey of US Physical Therapists. J Orthop Sports Phys Ther. 2017;47(5): 347–358. pmid:28257618
- 59. Lipsitt DR, Joseph R, Meyer D, Notman MT. Medically Unexplained Symptoms: Barriers to Effective Treatment When Nothing Is the Matter. Harv Rev Psychiatry. 2015;23(6): 438–48. pmid:26378814
- 60. Horing B, Weimer K, Muth ER, Enck P. Prediction of placebo responses: a systematic review of the literature. Front Psychol. 2014;5: 1079. pmid:25324797
- 61. Paterson C, Dieppe P. Characteristic and incidental (placebo) effects in complex interventions such as acupuncture. BMJ. 2005;330(7501): 1202–5. pmid:15905259
- 62. Miciak M, Mayan M, Brown C, Joyce AS, Gross DP. The necessary conditions of engagement for the therapeutic relationship in physiotherapy: an interpretive description study. Arch Physiother. 2018;8: 3. pmid:29468089
- 63. Bentley M, Stirling C, Robinson A, Minstrell M. The nurse practitioner-client therapeutic encounter: an integrative review of interaction in aged and primary care settings. J Adv Nurs. 2016;72(9): 1991–2002. pmid:26876765
- 64. Cannarella Lorenzetti R, Jacques CHM, Donovan C, Cottrell S, Buck J. Managing difficult encounters: understanding physician, patient, and situational factors. Am Fam Physician. 2013;87(6): 419–425. pmid:23547575
- 65. Hammond R, Cross V, Moore A. The construction of professional identity by physiotherapists: a qualitative study. Physiotherapy. 2016;102(1): 71–7. pmid:26048723
- 66. A.I.FI. La formazione “core” del fisioterapista [Internet]. 2008. https://aifi.net/wp-content/uploads/2013/01/corecompetencecorecurriculum.pdf.
- 67. Philbrick JL, Cleveland AD. Personal branding: building your pathway to professional success. Med Ref Serv Q. 2015;34(2): 181–9. pmid:25927510
- 68. Petrilli CM, Mack M, Petrilli JJ, Hickner A, Saint S, Chopra V. Understanding the role of physician attire on patient perceptions: a systematic review of the literature—targeting attire to improve likelihood of rapport (TAILOR) investigators. BMJ Open. 2015;5(1): e006578. pmid:25600254
- 69. Sahoo D, Ghosh T. Healthscape role towards customer satisfaction in private healthcare. Int J Health Care Qual Assur. 2016;29(6): 600–613. pmid:27298059
- 70. Zadeh R, Sadatsafavi H, Xue R. Evidence-Based and Value-Based Decision Making About Healthcare Design: An Economic Evaluation of the Safety and Quality Outcomes. HERD. 2015;8(4): 58–76. pmid:26123968
- 71. Blease C, Colloca L, Kaptchuk TJ. Are open-Label Placebos Ethical? Informed Consent and Ethical Equivocations. Bioethics. 2016;30(6): 407–14. pmid:26840547
- 72. Colloca L. Informed Consent: Hints From Placebo and Nocebo Research. Am J Bioeth. 2015;15(10): 17–9. pmid:26479094
- 73. Carvalho C, Caetano JM, Cunha L, Rebouta P, Kaptchuk TJ, Kirsch I. Open-label placebo treatment in chronic low back pain: a randomized controlled trial. Pain. 2016;157(12): 2766–2772. pmid:27755279
- 74. Ortiz R, Chandros Hull S, Colloca L. Patient attitudes about the clinical use of placebo: qualitative perspectives from a telephone survey. BMJ Open. 2016;6(4): e011012. pmid:27044586
- 75. A.I.FI. Ecco il censimento AIFI: in Italia 65.000 fisioterapisti [Internet]. 2017 [cited 16th January 2018]. https://aifi.net/censimento-aifi-italia-65mila-fisioterapisti/.
- 76. Peek K, Carey M, Sanson-Fisher R, Mackenzie L. Physiotherapists’ perceptions of patient adherence to prescribed self-management strategies: a cross-sectional survey of Australian physiotherapists. Disabil Rehabil. 2017;39(19): 1932–1938. pmid:27558622
- 77. Schmidt WC. World-Wide Web survey research: Benefits, potential problems, and solutions. Behav Res Methods Instrum Comput. 1997;29(2): 274–279.
- 78. Brunner E, Probst M, Meichtry A, Luomajoki H, Dankaerts W. Comparison of clinical vignettes and standardized patients as measures of physiotherapists’ activity and work recommendations in patients with non-specific low back pain. Clin Rehabil. 2016;30(1): 85–94. pmid:25652442
- 79. Peabody JW, Luck J, Glassman P, Dresselhaus TR, Lee M. Comparison of vignettes, standardized patients, and chart abstraction: a prospective validation study of 3 methods for measuring quality. JAMA. 2000;283(13): 1715–22. pmid:10755498
- 80. Siminoff LA, Rogers HL, Waller AC, Harris-Haywood S, Esptein RM, Carrio FB, et al. The advantages and challenges of unannounced standardized patient methodology to assess healthcare communication. Patient Educ Couns. 2011;82(3): 318–24. pmid:21316182