Skip to main content
Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Use of IMMPACT domains in clinical trials of acupuncture for chronic pain: A methodological survey

  • Lauren Giustti Mazzei ,

    Contributed equally to this work with: Lauren Giustti Mazzei, Cristiane de Cássia Bergamaschi, Marcus Tolentino Silva, Silvio Barberato Filho, Izabela Fulone, Mariana Del Grossi Moura, Caio Guimaraes, Luciane Cruz Lopes

    Roles Conceptualization, Data curation, Formal analysis, Investigation, Methodology, Resources, Validation, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Pharmaceutical Sciences Graduate Program, University of Sorocaba, Sorocaba, State of São Paulo, Brazil

  • Cristiane de Cássia Bergamaschi ,

    Contributed equally to this work with: Lauren Giustti Mazzei, Cristiane de Cássia Bergamaschi, Marcus Tolentino Silva, Silvio Barberato Filho, Izabela Fulone, Mariana Del Grossi Moura, Caio Guimaraes, Luciane Cruz Lopes

    Roles Conceptualization, Investigation, Methodology, Visualization, Writing – original draft, Writing – review & editing

    Affiliation Pharmaceutical Sciences Graduate Program, University of Sorocaba, Sorocaba, State of São Paulo, Brazil

  • Marcus Tolentino Silva ,

    Contributed equally to this work with: Lauren Giustti Mazzei, Cristiane de Cássia Bergamaschi, Marcus Tolentino Silva, Silvio Barberato Filho, Izabela Fulone, Mariana Del Grossi Moura, Caio Guimaraes, Luciane Cruz Lopes

    Roles Data curation, Formal analysis, Methodology, Software, Writing – original draft, Writing – review & editing

    Affiliation Pharmaceutical Sciences Graduate Program, University of Sorocaba, Sorocaba, State of São Paulo, Brazil

  • Silvio Barberato Filho ,

    Contributed equally to this work with: Lauren Giustti Mazzei, Cristiane de Cássia Bergamaschi, Marcus Tolentino Silva, Silvio Barberato Filho, Izabela Fulone, Mariana Del Grossi Moura, Caio Guimaraes, Luciane Cruz Lopes

    Roles Investigation, Resources, Writing – original draft, Writing – review & editing

    Affiliation Pharmaceutical Sciences Graduate Program, University of Sorocaba, Sorocaba, State of São Paulo, Brazil

  • Izabela Fulone ,

    Contributed equally to this work with: Lauren Giustti Mazzei, Cristiane de Cássia Bergamaschi, Marcus Tolentino Silva, Silvio Barberato Filho, Izabela Fulone, Mariana Del Grossi Moura, Caio Guimaraes, Luciane Cruz Lopes

    Roles Conceptualization, Investigation

    Affiliation Pharmaceutical Sciences Graduate Program, University of Sorocaba, Sorocaba, State of São Paulo, Brazil

  • Mariana Del Grossi Moura ,

    Contributed equally to this work with: Lauren Giustti Mazzei, Cristiane de Cássia Bergamaschi, Marcus Tolentino Silva, Silvio Barberato Filho, Izabela Fulone, Mariana Del Grossi Moura, Caio Guimaraes, Luciane Cruz Lopes

    Roles Conceptualization, Investigation, Methodology

    Affiliation Pharmaceutical Sciences Graduate Program, University of Sorocaba, Sorocaba, State of São Paulo, Brazil

  • Caio Guimaraes ,

    Contributed equally to this work with: Lauren Giustti Mazzei, Cristiane de Cássia Bergamaschi, Marcus Tolentino Silva, Silvio Barberato Filho, Izabela Fulone, Mariana Del Grossi Moura, Caio Guimaraes, Luciane Cruz Lopes

    Roles Conceptualization, Investigation, Methodology, Software

    Affiliation Pharmaceutical Sciences Graduate Program, University of Sorocaba, Sorocaba, State of São Paulo, Brazil

  • Luciane Cruz Lopes

    Contributed equally to this work with: Lauren Giustti Mazzei, Cristiane de Cássia Bergamaschi, Marcus Tolentino Silva, Silvio Barberato Filho, Izabela Fulone, Mariana Del Grossi Moura, Caio Guimaraes, Luciane Cruz Lopes

    Roles Conceptualization, Investigation, Methodology, Project administration, Supervision, Visualization, Writing – original draft, Writing – review & editing

    luciane.lopes@prof.uniso.br

    Affiliation Pharmaceutical Sciences Graduate Program, University of Sorocaba, Sorocaba, State of São Paulo, Brazil

Abstract

Acupuncture is one of the therapeutic resources used for the management of chronic pain. Variability in outcome measurements in randomized clinical trials of non-oncologic chronic pain (RCT-NOCP) generates inconsistencies in determining effects of treatments. The objective of this survey was to assess the adherence to the recommendations made by the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) in the measurement of RCT-NOCP of acupuncture. This methodological research made a systematic search for eligible studies from different sources of information. Eligible studies included those with number of patients ≥100, who randomized and allocated patients with chronic non-oncologic pain to be treated with acupuncture or with “sham” acupuncture, or non-acupuncture. This research included the recommendations for IMMPACT in the measurement of RCT-NOCP: presence of outcomes pain, physical function, emotional state and improvement perception of patient, the source of the outcome information pain and the tools used to measure such domains. From a total of 1,386 studies, 24 were included in this survey. Eleven studies presented low risk of bias. Pain outcome was measured in 23 studies, physical function in 22 studies, emotional state in 14 studies and improvement perception of patient in one study. As for the pain outcome, the patient was the information source in 50% of the studies. The measurement tools recommended for IMMPACT were included in eight studies (35%) that evaluated pain, one study that evaluated the emotional state (7%), and one study that evaluated the improvement perception and satisfaction of patient. It was observed that studies which did not adhere to the recommendations had more favorable results for acupuncture in the outcome pain. This study concludes that randomized clinical trials that used acupuncture to manage chronic pain failed to adhere to IMMPACT recommendations. Clinical societies and IMMPACT do not share the same recommendations. This fact reflects in the diversity of outcomes and instruments adopted in the studies, making it difficult to compare the results.

Introduction

Pain is defined by the International Association for the Study of Pain as an unpleasant sensory and emotional experience associated with real or potential tissue damage [1]. Chronic pain is a complex symptom, with challenges for evaluation and management, both in clinical trials and in clinical practice [2]. It is estimated that 19% of the global population have chronic pain, and its management increases the development of new technologies and more effective treatments [3; 4].

Non-oncologic chronic pain (NOCP) is a public health problem, spending around 22% of primary health expenditures worldwide. The national costs in the United States are around $17.8 billion annually with pain medication. About 29% of American population takes five or more medications per day [5]. According to the STOP-PAIN Canadian project published in 2010, the average monthly cost of a person with chronic pain in health services waiting list for multidisciplinary pain treatment was $1,462 (CDN), and 95% of total expenses were paid by private financing [6].

A wide range of management strategies, both pharmacological and non-pharmacological, are available for chronic pain. The challenge is to understand the large published evidence for different treatments and define when and where to use them to get the best long-term results for the patient [3].

The guidebook published by the International Association for the Study of Pain for pain treatment in resource-poor conditions offers a tool to those who deal with people in economic poverty, living in developing countries and facing obstacles to acquire the necessary medicines for NOCP management. To control the chronic pain the guide suggests, besides drugs, the use of complementary resources such as acupuncture, therapeutic massages and other modalities, considering they have lower costs and less side effects [7]. Considering the prevalence of similar scenarios, the World Health Organization (WHO) has launched a Traditional Medicine strategy aiming to broaden the concepts of the competent authorities in regard to health’s improvement and patient’s autonomy [8].

The search for international guidelines that use acupuncture for the NOCP management in the adult population results in few findings and conflicting recommendations. Among the guidelines consulted, the recommendation to use acupuncture to several painful conditions is based on poor quality evidence due to variability in the methods of randomized clinical trials (RCT) [912]. In addition, these guidelines do not discriminate the power of recommendation, with the exception of Canada’s guidelines (evidence level "C": it recommends considering acupuncture in the chronic pain management) and Scotland (evidence level "A": it strongly recommends acupuncture for short-term pain relief in chronic low back pain and osteoarthritis) [10; 12].

Although considered the gold standard of primary studies for intervention evaluation, RCT with adequate randomization and blinding may not provide the best approach for developing a strong evidence base for pain management if its outcomes and assessment tools are not suitable [13]. These limitations have been recognized internationally, leading to the development of the Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) in 2003.

This initiative brought together 27 experts from various universities, government agencies and the pharmaceutical industry in 2003 and generated a consensus, updated in 2008, with a core of four endpoint domains that should be considered in RCT’s for chronic pain [14], as well as their ideal instruments of measurement: pain intensity, evaluated by numerical scale of 0–10 or visual analogue scale; physical function, evaluated by the Multidimensional Inventory for Pain or Summary Inventory of Pain; emotional state, assessed by the Beck Depression Inventory or Mood Profile; and whole perception of patient improvement as assessed by the Global Impression of Patient Change questionnaire [15].

Besides the evaluation limitations and trial design, concerns were raised about how methods of analysis can outweigh clinically important positive outcomes, or overestimate the treatment effects. Multiple outcomes are often needed to properly evaluate the benefits of pain management, and sensitivity adjustments are required because if only the average of the results is considered, it may depict an ineffective treatment without taking into account the potential of effectiveness when the results are analyzed in subgroups [15].

The establishment of a standard set of outcome domains in RCT on chronic pain has several merits. It encourages researchers to consider chronic pain as a complex phenomenon that affects patients in multiple levels, protects against polarization of selective outcomes, which is a common problem throughout medical literature, and make it easier to perform systematic and meta-analyzes reviews, which allow researchers to provide estimates of the most accurate treatment effects by sharing common outcome data in individual trials [16].

This research checked out the adherence to IMMPACT recommendations in the measurement of RCT-NOCP of acupuncture. The verification of compliance with IMMPACT recommendations in RCT-NOCP allows greater transparency in decisions regarding the use of acupuncture as a viable alternative in this clinical condition.

Methods

Research design and question

This is a methodological inquiry study of RCT that used acupuncture for the treatment of NOCP. The PICO question of this study is: Did the RCT with NOCP patients treated with acupuncture compared to sham or non-acupuncture the measures results follow recommended by IMMPACT? The study protocol was published in the journal BMJ Open with identification number DOI: 10.1136/bmjopen-2016-014904 [17].

Search sources

The systematic review by Vickers and partners selected 31 clinical trials obtained by means of a search in the bases chosen until December 2010. Additional research was carried out on the same bases, considering studies published until August 2017. Data sources included: Cumulative Index to Nursing and Allied Health Literature (CINAHL), Excerpt Medical Database (EMBASE), Medical Literature Analysis and Retrieval System Online (MEDLINE), Latin American and Caribbean Literature in Health Sciences (Lilacs), Allied and Complementary Medicine Database, Web of Science and Cochrane Central Registry of Controlled Trials, without language restrictions. The main terms "Chronic pain" and "Acupuncture" indexed in the Medical Subject Headings (MeSH) system were combined. First of all, it was searched for the isolated terms and their synonyms, and then was performed a second search, combining and crossing terms. The list of references or citations found in secondary studies has been checked to identify possibly eligible studies.

Criteria and eligibility determination of studies

Outline.

RCTs, whose number of patients was equal to or greater than 100. The date of recruitment of the first participant was not an eligibility criterion, differing from what has been stated in our protocol already published, to broaden the capture of studies, as described in detail previously [17].

Clinical condition.

Patients aged 18 years or older with NOCP. The eligible pain conditions were: osteoarthritis, chronic or recurrent headaches, specific and nonspecific shoulder pains, and non-specific back or neck pain. For shoulder, back and neck pain, the pain episode should be at least four weeks. For osteoarthritis or headaches, the duration of pain was not necessary, since both are chronic in nature.

Intervention.

Studies that included a group of patients treated with acupuncture, where acupuncture points or trigger points were stimulated with acupuncture needles and another group in which patients were treated with acupuncture simulated or without acupuncture and studies where blinding was adequate.

Exclusion criteria.

Clinical trials with reports of neck or back pain associated with specific clinical conditions (eg. fractures resulting from osteoporosis).

Six reviewers, in pairs, independently assessed whether abstracts and titles met the eligibility criteria. Differences were resolved by consensus among all reviewers. To exclude duplicate articles, one reviewer analyzed all eligible articles and identified those who had one or more joint authors with the same title. In case of duplicate publication, we used the article with the most complete data.

Data extraction

We adopted an Excel® spreadsheet for extracting data from all six reviewers independently. The reviewers were calibrated by extracting at least three articles and then performed consensus, in pairs and independently. The calibration process occurred until standardization of the extracted data.

Another reviewer confirmed the extraction to ensure the consistency of the answers obtained between the collaborators, arbitrating in the disagreements when necessary.

The data collected were: author, date of publication, country of origin, journal impact factor, recruitment date of the first participant, presence of outcome domains IMMPACT and tools used to measure the domains of outcomes, acupuncture method, patient clinical condition and duration of treatment. In addition, the study verified whether the outcomes of the pain outcome were reported by the patient (RRP), whether they were reported by clinicians (RRC), whether the result was reported by a third person (RRT) or a combination of the three.

The number of articles that measured pain, physical function, emotional state and perceived improvement and patient satisfaction were quantified according to the IMMPACT recommendations. We also computed the number of IMMPACT domains that were served in order to generate a score between 0–4 points. The score was described on average, standard deviation, median and interquartile range.

The journals impact factor review was carried out in the Journal Citation Reports database, and the year adopted for the consultation was 2016. The data extracted were subsequently submitted to statistical analysis.

Risk of bias

A Cochrane’s tool modified version for bias risk assessment was used [18; 16]. The reviewers assessed the risk of bias for each clinical trial independently, regarding the following criteria: random sequence generation; allocation concealment; blinding of participants and personnel; blinding of outcome assessment; incomplete outcome data; selective reporting; and other biases.

The reviewers attributed as answer alternatives "definitely yes", "probably yes", "probably not" and "definitely not" for each of the domains [19]. Ultimately, "definitely yes" and "probably yes" were assigned as low risk of bias, while "definitely not" and "probably not" meant high risk of bias. The reviewers resolved disagreements through discussion, and a third person judged unresolved disagreements.

As described in the Cochrane Handbook for Systematic Reviews of Interventions, the bias risk assessment between studies can be judged to be low risk of bias when most studies are low risk in all seven domains and may be judged to be at high risk when the proportion of information from studies with high risk of bias is sufficient to affect the interpretation of results [16]. Review Manager Software version 5.3 was used to group bias-related risk data.

IMMPACT definitions endpoint domains and recommended measurement instruments

The four recommended IMMPACT domains in 2008 are pain, physical function, emotional state and improvement perception and patient satisfaction, as defined:

  1. Pain: includes several aspects of perception (eg. pain intensity, duration and frequency). The overall pain assessment examines how pain has changed during treatment. The recommended instruments for pain measurement are Visual Analog Scale or Numerical Rating Scale.
  2. Physical function: refers to the participant's ability to perform daily activities (eg, tasks, walking, travel and self-care), strength and endurance. The recommended instruments for measuring physical function are the Multidimensional Pain Inventory or the Brief Pain Inventory interference scales.
  3. Emotional status: refers to treatment associated with emotional distress (eg, depression, anxiety, anger, or irritability). The instruments recommended for measuring the patient's emotional state are the Beck Depression Inventory or the Profile of Mood States.
  4. Patient's perception of improvement and satisfaction with treatment: refers to the participant's feeling about the treatment (if they feel that the positive characteristics of the treatment outweigh the negative ones). The recommended instrument for measuring patient improvement and treatment satisfaction is the Patient Global Impression of Change scale.

The correct applicability of the instrument was also measured (if the domain report was reported by the patient, clinician or by third parties).

Statistical analysis

Year of publication, place of study, journal impact factor, and methodological quality assessment items (risk of bias) were evaluated descriptively.

The methodological survey protocol planned was the factors analysis associated with adherence to the IMMPACT domains by logistic regression, considering the domains of IMMPACT as dependent variables and the characteristics of the study as independent variables (year of publication, place of study, factor of periodic impact and items of methodological quality evaluation). Results were expressed as odds ratios with respective 95% confidence intervals (OR, 95% CI). All analysis were bilateral tests at a significance level of 0.05.

To explore the use of influence instruments recommended by IMMPACT on pain measurement, data from this outcome were pooled using meta-analysis. The standardized mean difference and 95% confidence interval were used as an effect measure. The random effects model proposed by DerSimonian and Laird was used [20]. The presence of heterogeneity was estimated by the calculation of I2.

The calculations were performed on STATA software version 14.2 and Review Manager version 5.3.

Results

There were 1.386 records, excluding duplicates. After selection of titles and abstracts, 1.318 records were excluded. Of the 68 articles that underwent full-text screening, 24 met the eligibility criteria (Fig 1).

thumbnail
Fig 1. Flowchart of search and selection of studies.

https://doi.org/10.1371/journal.pone.0231444.g001

Studies characteristics

Table 1 presents the characteristics of the included studies. The studies were mostly published in Germany [2135].

thumbnail
Table 1. Characteristics of included studies.

https://doi.org/10.1371/journal.pone.0231444.t001

Studies from China, England, Australia, the United States and nine studies from Germany reported a source of public funding [21; 22; 25; 27; 2931; 33; 35; 3640]. Studies from the United Kingdom, Korea and six studies from Germany have declared private funding [23; 24; 26; 28; 32; 34; 4143]; and one study, originating in Italy, did not state the source of funding [44].

From the 24 studies included, only half presented the protocol record number. The median impact factor of the journals in which the RCTs were published was 17.2 (4.21–20.78). The median sample size used for the primary analyzes in the trials was 231 (159.5–619.5).

The majority of patients included in these trials had chronic headache/migraine (n = 6) and osteoarthritis (n = 7). All the studies used traditional acupuncture, with the selection of points based on their energetic function for each clinical condition and considering the individual characteristics of the participants.

The type of control varied among the included studies: ten studies used sham acupuncture, with insertion of needles at sites that did not present acupuncture points [22; 25; 2732; 39; 41]; seven studies used a non-penetrating needle, simulating the treatment session at the same points selected for the intervention group [21; 23; 24; 36; 37; 42; 44], or simulated electrostimulation, with a stimulator that emits audio and video signals, but with deactivated cables [43]; four studies used the waiting list [26; 34; 35; 38], and two studies used usual care [33; 40]. The details of each included study are presented in Table 2.

thumbnail
Table 2. Characteristics of included studies and outcomes measured.

https://doi.org/10.1371/journal.pone.0231444.t002

The clinical trials included presented, in the general context, low risk of bias (Fig 2). In the criterion of allocation secrecy, a study presented high risk, since the allocation to the clinician occurred according to the availability of commitments and convenience for the patients [40], and four studies did not present the criterion with clarity [33; 35; 42; 44].

thumbnail
Fig 2. Summary of bias risk of individual studies.

https://doi.org/10.1371/journal.pone.0231444.g002

In six studies the authors did not clarify the blinding (or lack thereof) of outcome assessors [21; 22; 33; 35; 39; 44]. In one study there was no clarity as to whether outcomes were adequately reported due to the absence of protocol record in their trial [44], and a study for presenting incomplete outcome when compared to the methods reported in their protocol [22].

Seven studies presented high risk in the criterion of selective outcome [21; 25; 26; 29; 34; 43; 44]. In 5 studies, there was not found sufficient information for other sources of bias [25; 26; 29; 35; 44].

Outcomes domains recommended by IMMPACT and instruments used in included studies

The most commonly reported outcomes were pain and physical function. The participant's emotional state was assessed in 14 of the 24 studies, and the perception of improvement and patient satisfaction was addressed in only one study [37]. Of the included studies, 22 were published as of 2004, none referred to the IMMPACT recommendations published in 2003 and updated in 2008 (Table 3).

thumbnail
Table 3. Domains recommended by IMMPACT, instruments used in the included studies and source of information on the pain outcome.

https://doi.org/10.1371/journal.pone.0231444.t003

The endpoint pain was reported only by the patients in 12 of the 24 included studies (Table 3) [21; 23; 24; 27; 28; 31; 32; 35; 3941; 43].

In ten studies the outcome was reported by both, clinical and patient (43.4%) [22; 25; 26; 29; 33; 34; 3638; 42]. Only in one study were the results reported only by clinicians [30]. The source of the information was only described for the pain outcome, as the studies did not describe it for the other outcomes.

Pain.

Pain was the major outcome in 23 RCTs. In eight studies, the pain assessment instrument used was one of those recommended by IMMPACT, the Visual Analogue Scale [21; 25; 29; 30; 38; 39; 41; 43]. Three studies used as an evaluation instrument the Von Korff Chronic Pain Grade Scale (GCPS) [2224]. In six studies, Western Ontario and McMaster University Osteoarthritis Index (WOMAC) was the instrument used [31; 32; 34; 36; 37; 42]. A pain questionnaire that encompasses its intensity and number of days was adopted in two studies [26; 27]. Thomas et al. [40] adopted in their study the McGill pain questionnaire, while Witt et al. [33] used the Low Back Pain Rating Scale (LBPRS), Melchart et al. [28] used the German version of the Pain Disability Index (PDI), and Witt et al. [35] used the Wheeler scale.

Physical function.

None of the studies evaluating physical function used the instruments recommended by IMMPACT. The physical function was an outcome evaluated in 22 studies. Four studies used the Short-Form Health Survey-12 [2224; 31]. The Short-Form Health Survey-36 was the instrument adopted in five studies [25; 26; 28; 32; 37]. The Pain Disability Index (PDI) was used in studies by Linde et al. (2005) and Brinkhaus et al. [21], and the Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC) was used in four studies [34; 36; 38; 42]. Thomas et al. [40] used as an instrument of evaluation of physical function the Owestry Pain Index; White et al. [43] used the Neck Disability Index; Facco et al. [44] used the Migraine Disability Assessment Test (MIDAS); Liang et al. [39] used the Neuropathic Pain Questionnaire (NPQ) and Molsberger et al. [29] adopted physical tests to evaluate this function. The Hannover Functional Ability Questionnaire was adopted in two studies [33; 35].

Emotional state.

The patient’s emotional state was an outcome evaluated in 14 RCTs. The Short-Form Health Survey 12 and 36 were the instruments used in nine studies [2224; 26; 31; 34; 37; 39; 43].

Four studies used the Allgemeine Depressionsskala [21; 27; 28; 32]. The Beck Depression Inventory, recommended by IMMPACT, was used as instrument to measure the emotional state of patients only in the study by Cho et al [41].

Improvement perception and patient satisfaction.

The outcome perception of improvement and patient satisfaction with the treatment offered was evaluated only in a study conducted by Chen et al. [37], which used as evaluation instrument the Patient Global Impression of Change, recommended by IMMPACT.

Associated factors

No association was found between the publication’s year of studies, published until 2006 and from 2007 (OR = 0.75; IC 95%: 0.15–3.83; p = 0.72); the corresponding author’s country, whether or not belonging to the European continent (OR = 2.06; IC 95%: 0.28–15.36; p = 0.48), or of German origin (OR = 4.0; IC 95%: 0.69–23.09; p = 0.12); the impact of the publication period above 7 (OR = 1.0; IC 95%: 0.94–1.06; p = 0.88); the methodological quality, considering studies that met 6 or 7 critical evaluation criteria (OR = 1.4; IC 95%: 0.28–7.02; p = 0.862); and the publication of the study protocol OR = 1.04; IC 95%: 0.32–3.10; p = 0.68) (Table 4).

thumbnail
Table 4. Factors associated with adherence to the domains recommended by IMMPACT.

https://doi.org/10.1371/journal.pone.0231444.t004

Secondary analysis

Studies that did not adhere to the IMMPACT recommendations had favorable results for acupuncture in the pain outcome (MD = -1.03; IC 95%: -1.51; -0.56; I2 = 99%), while those who followed the recommendations did not have statistically significant differences (MD = -0.18; IC 95%: -0.48; 0.12; I2 = 86%) (Fig 3). To investigate this finding, subgroup analysis was performed considering the clinical condition (back pain, neck pain, osteoarthritis and low back pain), and stratified by the use of recommended scales for the measurement of pain. Studies in which the clinical condition was headache or migraine were not analyzed because none of these studies used a recommended instrument, and the shoulder pain condition was addressed in only one study.

thumbnail
Fig 3. Meta-analysis of the effect of acupuncture on pain stratified by the use of recommended scale or not.

https://doi.org/10.1371/journal.pone.0231444.g003

In studies where the clinical condition was back pain and osteoarthritis, the data suggests that the use of non-recommended scales may overestimate the effect of acupuncture on gauging pain, and in studies where the clinical condition was low back pain, the use of scales may underestimate the effect of acupuncture on pain (Figs 47).

thumbnail
Fig 4. Meta-analysis of the effect of acupuncture in patients with back pain stratified by the use of recommended scales or not.

https://doi.org/10.1371/journal.pone.0231444.g004

thumbnail
Fig 5. Meta-analysis of the effect of acupuncture in patients with osteoarthritis stratified by the use of recommended scales or not.

https://doi.org/10.1371/journal.pone.0231444.g005

thumbnail
Fig 6. Meta-analysis of the effect of acupuncture in patients with low back pain stratified by the use of recommended scales or not.

https://doi.org/10.1371/journal.pone.0231444.g006

thumbnail
Fig 7. Meta-analysis of the effect of acupuncture in patients with neck pain stratified by the use of recommended scales or not.

https://doi.org/10.1371/journal.pone.0231444.g007

Discussion

Summarizing of results

In this survey, it was observed that most of the RCT were published in Germany and developed with public funding. The sample size of the arms analyzed in the studies ranged from 40 to 1,753 patients, and the most prevalent clinical conditions being chronic headache or migraine and osteoarthritis treated exclusively with traditional acupuncture.

None of the studies published since 2004 explicitly mentioned the IMMPACT recommendations, though they met at least two of the four areas recommended by the initiative and only one study assessed the four domains. The most reported outcomes in the studies were pain and physical function.

For evaluation of pain outcome, one-third of the studies used one of the recommended instruments. It is important to note that only for this outcome, the clinical trials described the source of the information; it was mostly reported by patients or by clinicians and patients.

No study evaluating physical function used the recommended instruments, and for the emotional state outcome, only one study used a recommended instrument. The only study that evaluated the perception of improvement and patient satisfaction with the treatment used the scale recommended by IMMPACT.

Variables such as year of study publication, country of origin, impact factor of the journal, absence of risk of bias and previous publication of protocol did not present a statistically significant influence to adherence to the outcome domains recommended by IMMPACT.

The use of instruments not recommended by the Initiative seems to overestimate the acupuncture effect on the pain of the patients with back pain and osteoarthritis when compared with studies using a recommended instrument.

Relation with existing literature

The aim of IMMPACT recommendations was to provide baseline data to assess and compare the impact of treatments on symptoms, function, well-being and quality of life in the general health of patients with chronic pain [15].

The importance of considering these domains of outcomes is observed in a qualitative study that evaluated the patients' expectations for the outcomes of treatments based on complementary and alternative medicine. The authors pointed out that patients expect the proposed treatments to have an impact on pain, improvement of function and general well-being [45].

The low adherence to the recommendations is evidenced when the other data of this study were analyzed. After fifteen years of the first recommendation published by the Initiative, this study points out that among the 24 selected studies that used acupuncture as treatment for NOCP, only one of the four recommended outcome domains was addressed, and only 50% of them evaluated three outcomes among those recommended, pain and physical function being the most evaluated outcomes.

Failure to consider important outcomes to the patient may limit the validity and usefulness of clinical trials [46].

As far as sources of information are concerned, the results reported by the patient are particularly important for conditions involving symptoms such as pain and fatigue, where objective measures of patient perceptions are not available. Results reported by clinicians can be judged and underestimated [47]. In this survey, the endpoint pain was reported exclusively by the patients in 50% of the 24 included studies.

It was also possible to identify that the measurement instruments used were validated, but only eight studies used a recommended instrument when measuring pain and one study used a recommended instrument to assess the emotional state.

Although this survey has stratified studies by their used scales, analyzed the subgroups by clinical condition and explored associated variables, the results are statistically insignificant and very heterogeneous. Additionally, the use of scales not recommended in the measurement of the pain endorsement overestimates the effect of acupuncture when compared to studies using a recommended instrument under certain clinical conditions.

It is clear that the use of different scales in the measurement of the domains explored does not contribute to the clinical decision-making for or against the use of acupuncture in the control of NOCP.

A methodological survey explored adherence to IMMPACT recommendations in clinical trials that used opioids in the treatment of NOCP. The authors pointed out that more recent studies originating in North America and published in journals with high impact factor were more likely to adhere to the areas recommended by the Initiative. After 12 years of the first recommendation, the authors observed that there was no increase in the report of the recommended domains in temporal progression [48].

This propensity can also be observed in this survey, with a trend towards adherence to the areas recommended by studies from European countries, with low risk of bias and previous protocol publication, but these variables did not present significant results in the statistical analysis.

A systematic review with a meta-analysis of individual data from 17,992 patients with chronic pain pointed out that acupuncture is superior to placebo, with modest differences. The protocol of this review was well delineated, with eligibility criteria that sought to select good studies for extraction, such as those adopted in this study, but points as a possible limitation the multiple outcomes combination, measured at different times and with different instruments [49].

This limitation is reinforced in a review which points out that growing evidence supports the acupuncture use for chronic pain in many conditions as adjuvant in reducing the use of analgesic drugs. The authors emphasize as limitations the heterogeneity of the studies, not only in interventions or general characteristics of the population, but also the outcomes measured [50].

In international recommendations for specific clinical conditions, the principal instrument of evaluation indicated in cases of osteoarthritis recommended by the International Knee Documentation Committee is WOMAC; for chronic headache, the scale recommended by the International Headache Society is VAS; for neck pain, the Orthopedic Section of the American Physical Therapy Association recommends the use of NDI or the Patient-Specific Functional Scale; for back and lower back pain, the scales recommended by The American College of Physicians are VAS, ODI and Roland Morris Disability Questionnaire [5154].

IMMPACT does not discriminate the use of other specific and validated instruments to measure the recommended outcomes, but emphasizes that the use of the suggested instruments facilitates the systematic reviews conception and meta-analysis allowing more precise estimates of effects, favors the sharing of common results data, and protects RCT against bias from selective outcomes [15].

Initiative researchers, along with the Outcome Measures in Rheumatology group, support the adoption of recommendations in designing chronic pain RCT, noting that the use of a standard of valid measurement domains and instruments can accelerate the development of treatments and facilitate the comparison between studies, producing more robust results [55].

With the increase in the number of RCT-NOCP, attention and research on the methodological aspects adopted in the studies should increase, with the potential to improve the sensitivity of the trial, and, finally, to provide more significant evaluations of the treatments for this condition.

Limitations and strengths

The methods and sample size of the included studies in this research make it an important exploratory study, since it considered eligible high quality studies and a sample with a number greater than 100, with adequate blinding. The information sources consulted for systematic search did not include Asian bases and may represent possible losses in the studies capture.

The analysis adopted in this study did not identify factors associated with adherence to the IMMPACT recommendations. It is possible that other statistical methods might be used to extend the variables exploration and then identify factors that justify associative tendencies.

Clinical implications

The adoption of important outcomes in disease impact assessing on the patient's life and the standardization of instruments can ease the conception of results that are close to the truth, substantiated by more robust analysis.

There is a real need for a dialogue between clinical societies and IMMPACT in order to increase the strength of therapeutic recommendations in the NOCP treatment in different clinical conditions.

Conclusion

Studies that used acupuncture in the CNCD treatment did not adhere to the IMMPACT recommendations, which may favor the acupuncture performance in the pain outcome.

Acknowledgments

We thank Tais Freire Galvão, Silvio Barberato Filho, Izabela Fulone, Mariana Del Grossi Moura and Caio Guimaraes for their collaboration in the steps of sorting and extracting data and contributing to the manuscript preparation.

References

  1. 1. IASP. Classification of Chronic Pain. International Association for the Study of Pain 1994; 2ª ed.
  2. 2. Fairbanks CA, Goracke-Postle CJ. Neurobiological studies of chronic pain and analgesia: Rationale and refinements. European Journal of Pharmacology 2015;759:169–181. pmid:25818751
  3. 3. RNAO. Assessment and management of pain. Registered Nurses’ Association of Ontario. Rockville MD: Agency for Healthcare Research and Quality (AHRQ), 2013.
  4. 4. Abdulla A, Adams N, Bone M, Elliott AM, Gaffin J, Jones D, et al. Guidance on the management of pain in older people. Age and ageing 2013;42 Suppl 1:i1–57.
  5. 5. Rasu RS, Vouthy K, Crowl AN, Stegeman AE, Fikru B, Bawa WA, et al. Cost of pain medication to treat adult patients with nonmalignant chronic pain in the United States. Journal of Managed Care & Specialty Pharmacy 2014;20(9):921–928.
  6. 6. Guerriere DN, Choiniere M, Dion D, Peng P, Stafford-Coyte E, Zagorski B, et al. The Canadian STOP-PAIN project—Part 2: What is the cost of pain for patients on waitlists of multidisciplinary pain treatment facilities? Canadian Journal of Anaesthesia = Journal Canadien d'Anesthesie 2010;57(6):549–558. pmid:20414821
  7. 7. KOPF AP, B N. Guia para o tratamento da dor em contextos de poucos recursos. Associação Internacional para o Estudo da Dor. Seatle: IASP Press, 2010.
  8. 8. OMS. Estrategia de la OMS sobre medicina tradicional 2014–2023. Organización Mundial de la Salud 2013.
  9. 9. ASA ASoA. Practice guidelines for chronic pain management: An updated report by the American Society of Anesthesiologists Task Force on Chronic Pain Management and the American Society of Regional Anesthesia and Pain Medicine. Anesthesiology 2010;112(4):810–833. pmid:20124882
  10. 10. CPSO. Evidence-based recommendations for medical management of chronic non-malignant pain. College of Physicians and Surgeons of Ontario 2000.
  11. 11. Hooten WM, Timming R, Belgrade M, Gaul J, Goertz M, Haake B, et al. Assessment and management of chronic pain. National Guideline Clearinghouse 2011(7/13/2016):112.
  12. 12. SIGN. Management of chronic pain: A national clinical guideline. Scottish Intercollegiate Guidelines Network. Edinburgh: SIGN, 2013.
  13. 13. Dworkin RH, Turk DC, Peirce-Sandner S, Baron R, Bellamy N, Burke LB, et al. Research design considerations for confirmatory chronic pain clinical trials: IMMPACT recommendations. Pain 2010;149(2):177–193. pmid:20207481
  14. 14. Turk DC, Dworkin RH, Allen RR, Bellamy N, Brandenburg N, Carr DB, et al. Core outcome domains for chronic pain clinical trials: IMMPACT recommendations. Pain 2003;106(3):337–345. pmid:14659516
  15. 15. Dworkin RH, Turk DC, Wyrwich KW, Beaton D, Cleeland CS, Farrar JT, et al. Interpreting the clinical importance of treatment outcomes in chronic pain clinical trials: IMMPACT recommendations. The Journal of Pain: Official journal of the American Pain Society 2008;9(2):105–121.
  16. 16. Higgins JP, Green S. Cochrane handbook for systematic reviews of interventions, version [5.1.0](updated March 2011). The Cochrane Collaboration 2011.
  17. 17. Mazzei LG, Bergamaschi CC, Silva MT, Lopes LC. Use of IMMPACT domains in clinical trials of acupuncture for chronic pain: A protocol for a methodological survey. BMJ Open 2017;7(9).
  18. 18. Akl EA, Sun X, Busse JW, Johnston BC, Briel M, Mulla S, et al. Specific instructions for estimating unclearly reported blinding status in randomized trials were reliable and valid. Journal of clinical epidemiology 2012;65(3):262–267. pmid:22200346
  19. 19. Busse J, Guyatt G. Modification of Cochrane Tool to assess risk of bias in randomized trials, 2013.
  20. 20. Borenstein M, Hedges LV, Higgins JP, Rothstein HR. A basic introduction to fixed-effect and random-effects models for meta-analysis. Research synthesis methods 2010;1(2):97–111. pmid:26061376
  21. 21. Brinkhaus B, Witt CM, Jena S, Linde K, Streng A, Wagenpfeil S, et al. Acupuncture in patients with chronic low back pain: A randomized controlled trial. Archives of Internal Medicine 2006;166(4):450–457. pmid:16505266
  22. 22. Diener HC, Kronfeld K, Boewing G, Lungenhausen M, Maier C, Molsberger A, et al. Efficacy of acupuncture for the prophylaxis of migraine: A multicentre randomised controlled clinical trial. The Lancet Neurology 2006;5(4):310–316. pmid:16545747
  23. 23. Endres HG, Bowing G, Diener HC, Lange S, Maier C, Molsberger A, et al. Acupuncture for tension-type headache: A multicentre, sham-controlled, patient- and observer-blinded, randomised trial. The Journal of Headache and Pain, 2007;8(5):306–314. pmid:17955168
  24. 24. Haake M, Muller HH, Schade-Brittinger C, Basler HD, Schafer H, Maier C, et al. German Acupuncture Trials (GERAC) for chronic low back pain: Randomized, multicenter, blinded, parallel-group trial with 3 groups. Archives of Internal Medicine 2007;167(17):1892–1898. pmid:17893311
  25. 25. Irnich D, Behrens N, Molzen H, Konig A, Gleditsch J, Krauss M, et al. Randomised trial of acupuncture compared with conventional massage and "sham" laser acupuncture for treatment of chronic neck pain. BMJ 2001;322(7302):1574–1578. pmid:11431299
  26. 26. Jena S, Witt CM, Brinkhaus B, Wegscheider K, Willich SN. Acupuncture in patients with headache. Cephalalgia: An international journal of headache 2008;28(9):969–979.
  27. 27. Linde K, Streng A, Jurgens S, Hoppe A, Brinkhaus B, Witt C, et al. Acupuncture for patients with migraine: A randomized controlled trial. Jama 2005;293(17):2118–2125. pmid:15870415
  28. 28. Melchart D, Streng A, Hoppe A, Brinkhaus B, Witt C, Wagenpfeil S, et al. Acupuncture in patients with tension-type headache: randomised controlled trial. BMJ 2005;331(7513):376–382. pmid:16055451
  29. 29. Molsberger AF, Hubscher M, Schneider T, Gotthardt H, Drabik A. German randomized acupuncture trial for chronic shoulder pain (GRASP)—A pragmatic, controlled, patient-blinded, multi-centre trial in an outpatient care environment. Deutsche Zeitschrift fur Akupunktur 2011;54(1):35–36.
  30. 30. Molsberger AF, Mau J, Pawelec DB, Winkler J. Does acupuncture improve the orthopedic management of chronic low back pain -- A randomized, blinded, controlled trial with 3 months follow up. Pain 2002;99(3):579–587. pmid:12406534
  31. 31. Scharf HP, Mansmann U, Streitberger K, Witte S, Kramer J, Maier C, et al. Acupuncture and knee osteoarthritis: A three-armed randomized trial. Annals of Internal Medicine 2006;145(1):12–20. pmid:16818924
  32. 32. Witt C, Brinkhaus B, Jena S, Linde K, Streng A, Wagenpfeil S, et al. Acupuncture in patients with osteoarthritis of the knee: A randomised trial. Lancet (London, England) 2005;366(9480):136–143.
  33. 33. Witt C, Jena S, Brinkhaus B, Liecker B, Wegscheider K, Willich SN. Acupuncture in patients with osteoarthritis of the knee or hip: A randomized, controlled trial with an additional nonrandomized arm. Arthritis and Rheumatism 2006;54(11):3485–3493. pmid:17075849
  34. 34. Witt CM, Jena S, Brinkhaus B, Liecker B, Wegscheider K, Willich SN. Acupuncture for patients with chronic neck pain. Pain 2006;125(1–2):98–106. pmid:16781068
  35. 35. Witt CM, Jena S, Selim D, Brinkhaus B, Reinhold T, Wruck K, et al. Pragmatic randomized trial evaluating the clinical and economic effectiveness of acupuncture for chronic low back pain. American Journal of Epidemiology 2006;164(5):487–496. pmid:16798792
  36. 36. Berman BM, Lao L, Langenberg P, Lee WL, Gilpin AM, Hochberg MC. Effectiveness of acupuncture as adjunctive therapy in osteoarthritis of the knee: A randomized, controlled trial. Annals of internal medicine 2004;141(12):901–910. pmid:15611487
  37. 37. Chen LX, Mao JJ, Fernandes S, Galantino ML, Guo WS, LaRiccia P, et al. Integrating acupuncture with exercise-based physical therapy for knee osteoarthritis: A randomized controlled trial. Journal of Clinical Rheumatology 2013;19(6):308–316. pmid:23965480
  38. 38. Hinman RS, McCrory P, Pirotta M, Relf I, Forbes A, Crossley KM, et al. Acupuncture for chronic knee pain: A randomized clinical trial. Jama-Journal of the American Medical Association 2014;312(13):1313–1322.
  39. 39. Liang ZH, Zhu XP, Yang XB, Fu WB, Lu AP. Assessment of a traditional acupuncture therapy for chronic neck pain: A pilot randomised controlled study. Complementary Therapies in Medicine 2011;19:S26–S32. pmid:21195292
  40. 40. Thomas KJ, MacPherson H, Thorpe L, Brazier J, Fitter M, Campbell MJ, et al. Randomised controlled trial of a short course of traditional acupuncture compared with usual care for persistent non-specific low back pain. BMJ 2006;333(7569):623. pmid:16980316
  41. 41. Cho YJ, Song Y-K, Cha Y-Y, Shin B-C, Shin I-H, Park H-J, et al. Acupuncture for chronic low back pain: A multicenter, randomized, patient-assessor blind, sham-controlled clinical trial. Spine 2013;38(7):549–557. pmid:23026870
  42. 42. Foster NE, Thomas E, Barlas P, Hill JC, Young J, Mason E, et al. Acupuncture as an adjunct to exercise based physiotherapy for osteoarthritis of the knee: Randomised controlled trial. BMJ 2007;335(7617):436. pmid:17699546
  43. 43. White P, Lewith G, Prescott P, Conway J. Acupuncture versus placebo for the treatment of chronic mechanical neck pain: A randomized, controlled trial. Annals of Internal Medicine 2004;141(12):911–919. pmid:15611488
  44. 44. Facco E, Liguori A, Petti F, Zanette G, Coluzzi F, De Nardin M, et al. Traditional acupuncture in migraine: A controlled, randomized study. Headache 2008;48(3):398–407. pmid:17868354
  45. 45. Hsu C, Sherman KJ, Eaves ER, Turner JA, Cherkin DC, Cromp D, et al. New perspectives on patient expectations of treatment outcomes: Results from qualitative interviews with patients seeking complementary and alternative medicine treatments for chronic low back pain. BMC Complementary and Alternative Medicine 2014;14.
  46. 46. Turk DC, Dworkin RH, McDermott MP, Bellamy N, Burke LB, Chandler JM, et al. Analyzing multiple endpoints in clinical trials of pain treatments: IMMPACT recommendations. Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials. Pain 2008;139(3):485–493. pmid:18706763
  47. 47. Turk DC, Dworkin RH, Burke LB, Gershon R, Rothman M, Scott J, et al. Developing patient-reported outcome measures for pain clinical trials: IMMPACT recommendations. Pain 2006;125(3):208–215. pmid:17069973
  48. 48. Mulla SM, Maqbool A, Sivananthan L, Lopes LC, Schandelmaier S, Kamaleldin M, et al. Reporting of IMMPACT-recommended core outcome domains among trials assessing opioids for chronic non-cancer pain. Pain 2015;156(9):1615–1619. pmid:26020224
  49. 49. Vickers AJ, Cronin AM, Maschino AC, Lewith G, MacPherson H, Foster NE, et al. Acupuncture for chronic pain: Individual patient data meta-analysis. Archives of Internal Medicine 2012;172(19):1444–1453. pmid:22965186
  50. 50. Yin C, Buchheit TE, Park JJ. Acupuncture for chronic pain: an update and critical overview. Current Opinion in Anaesthesiology 2017;30(5):583–592. pmid:28719458
  51. 51. Blanpied PR, Gross AR, Elliott JM, Devaney LL, Clewley D, Walton DM, et al. Neck pain: Revision 2017. The Journal of Orthopaedic and Sports Physical Therapy 2017;47(7):A1–a83. pmid:28666405
  52. 52. Collins NJ, Misra D, Felson DT, Crossley KM, Roos EM. Measures of Knee Function: International Knee Documentation Committee (IKDC) Subjective Knee Evaluation Form, Knee Injury and Osteoarthritis Outcome Score (KOOS), Knee Injury and Osteoarthritis Outcome Score Physical Function Short Form (KOOS-PS), Knee Outcome Survey Activities of Daily Living Scale (KOS-ADL), Lysholm Knee Scoring Scale, Oxford Knee Score (OKS), Western Ontario and McMaster Universities Osteoarthritis Index (WOMAC), Activity Rating Scale (ARS), and Tegner Activity Score (TAS). Arthritis care & research 2011;63 Suppl 11:S208–228.
  53. 53. IHS. The International Classification of Headache Disorders, 3rd edition (beta version). Cephalalgia: An international journal of headache 2013;33(9):629–808.
  54. 54. Qaseem A, Wilt TJ, McLean RM, Forciea M, for the Clinical Guidelines Committee of the American College of P. Noninvasive treatments for acute, subacute, and chronic low back pain: A clinical practice guideline from the american college of physicians. Annals of Internal Medicine 2017;166(7):514–530. pmid:28192789
  55. 55. Taylor AM, Phillips K, Patel KV, Turk DC, Dworkin RH, Beaton D, et al. Assessment of physical function and participation in chronic pain clinical trials: IMMPACT/OMERACT recommendations. Pain 2016;157(9):1836–1850. pmid:27058676