Advertisement
Browse Subject Areas
?

Click through the PLOS taxonomy to find articles in your field.

For more information about PLOS Subject Areas, click here.

  • Loading metrics

Patient reported measures of informed consent for clinical trials: A systematic review

  • Katie Gillies ,

    Roles Conceptualization, Data curation, Formal analysis, Funding acquisition, Investigation, Methodology, Project administration, Resources, Supervision, Validation, Writing – original draft, Writing – review & editing

    k.gillies@abdn.ac.uk

    Affiliation Health Services Research Unit, University of Aberdeen, Foresterhill, Aberdeen, United Kingdom

  • Alexander Duthie,

    Roles Data curation, Formal analysis

    Affiliation Health Services Research Unit, University of Aberdeen, Foresterhill, Aberdeen, United Kingdom

  • Seonaidh Cotton,

    Roles Data curation, Writing – review & editing

    Affiliation Health Services Research Unit, University of Aberdeen, Foresterhill, Aberdeen, United Kingdom

  • Marion K. Campbell

    Roles Formal analysis, Funding acquisition, Investigation, Writing – review & editing

    Affiliation Health Services Research Unit, University of Aberdeen, Foresterhill, Aberdeen, United Kingdom

Patient reported measures of informed consent for clinical trials: A systematic review

  • Katie Gillies, 
  • Alexander Duthie, 
  • Seonaidh Cotton, 
  • Marion K. Campbell
PLOS
x

Abstract

Introduction

The subjective assessment of the adequacy of informed consent for clinical trials, and the potential difficulties associated with it, has led several studies to develop objective measures of informed consent for clinical trials. These objective measures of informed consent are often specific to a particular population or clinical condition and largely focus on understanding of (some or all of) the key elements of informed consent. Many of the developed tools are study-specific, but some validated measures exist. Of these validated measures, those which are reported by participants are of particular interest. Whether these objective tools conceptualize and measure informed consent in the same way is not known. As such, it is not clear whether meta-analyzing data from studies reporting different tools is worthwhile. The aim of this systematic review was to critically appraise the evidence on the overall conceptualisation and item content of validated patient reported measures of informed consent for clinical trials, and to identify core domains of potential importance for informed consent.

Methods

A systematic search of the literature was conducted to identify relevant articles that described the development, and/or validation, of patient-reported measures of adequacy of informed consent for randomised controlled trials. Data was synthesised by classifying the items identified into domains and sub-domains which were determined by the nomenclature reported in included studies. Both for descriptions of included studies and of the instruments reported in those studies, descriptive statistics were used to describe general information and instrument detail. A narrative synthesis of the instruments and their inter-related domains and subdomains was conducted to identify areas of both convergence and divergence.

Results

The search identified 8193 citations. After screening titles and abstracts, 29 full text articles were retrieved for further assessment. Of these 29, 14 complied with our pre-specified inclusion criteria with 15 not being eligible. Of the 14 instruments, three explicitly reported a theoretical or conceptual framework underpinning their development, a further three implicitly referred to the ‘conceptual dimensions of informed consent’ or ‘principles of research ethics’ as informing their development and eight reported no guiding theoretical framework. Only three of the 14 studies reported patient or public involvement in the development of the tool. One hundred and seventy nine items were included across the 14 instruments. The primary focus of the instruments was on understanding. Five core domains were identified which included: Autonomy; Consequences; Expectations; Purpose; and Individualisation. There was substantial variability in the coverage of different domains across measures.

Conclusions

This study demonstrated the variability in the theoretical underpinning, development and domain coverage of existing patient-reported measures of informed consent for clinical trials. The conceptualisation of informed consent could benefit from being extended from a narrow focus on understanding to include broader considerations of decision-making. Meaningful involvement of potential trial participants during development of measures critical for tool relevance is also lacking. The identification of the key domains relevant to all stakeholders which could be measured to assess the informed consent process for clinical trials is needed.

Introduction

Before patients can be recruited in to a clinical trial there is both a legal and ethical requirement that they have given their informed consent to be involved [1]. This ethical and juridical requirement, enshrined in the Declaration of Helsinki and other international regulations, was established as a mechanism to protect potential participants from any undue harm from research [1, 2]. In broad terms, informed consent for research covers aspects such as capacity, disclosure, understanding, voluntariness and permission [3]. Due to the randomised nature of clinical trials and the subsequent loss of treatment choice conferred within the design, the stakes for participants are often deemed higher than other research studies and as such the regulatory requirements become further prescriptive. The requirements are such that the informed consent ‘process’ for clinical trials usually includes both verbal and written information that explains (as a minimum) the purpose and aim of the trial, research procedures, anticipated risks and benefits, end of trial provisions, source of funding, potential conflicts of interest, and researchers institutional affiliation [1]. In addition, potential trial participants should be aware of their right to refuse participation and the ability to withdraw consent at any time. For consent to be considered valid, in accordance with existing regulatory frameworks, it must be voluntary, informed and with the individual providing consent having sufficient capacity to do so [1,2]. The Declaration of Helsinki states that ‘After ensuring that the potential subject has understood the information’ the researcher should seek the participant’s freely given informed consent [1]. In addition to the current guidance, the Clinical Trials Regulation (which will come into effect within the European Union in 2019) states that for consent to be valid ‘it shall be verified that the subject has understood the information’ [4]. However, the ‘what’ and ‘how’ of ensuring or verifying that consent is valid (i.e. informed, given voluntarily and by an individual with capacity) are not specified.

The concept of ‘informed consent’ (both for treatment and for research) is often interpreted differently and operationalized inconsistently [5, 6]. There is no universally agreed measure of “good” informed consent for clinical trials that might be used to objectively evaluate whether the potential participant has understood what trial participation means for them, or indeed ensured that all other considerations appropriate to ensure informed consent has been achieved have been met. A number of trial-specific, condition-specific and more generic measures of aspects of clinical trial informed consent do exist; however, they have been noted to have variable operationalisations of informed consent and are collected through a variety of mechanisms–some reported by the participant themselves; others not [6, 7].

In a previous study, Sand et al [7] provided a useful map of the range of measures available to measure understanding in informed consent; however, there has been no investigation to date of the underlying concepts captured by different measures of informed consent (and consequently which concepts may not currently be captured by these instruments), how these may relate to each other (and more broadly to informed consent) and hence how the choice of measure might influence the results of a study investigating the quality of informed consent.

We, therefore, undertook a systematic narrative review to:

  • critically appraise the evidence on the overall conceptualisation and item content of validated patient reported measures of informed consent for clinical trials; and
  • identify reported core domains of potential importance for informed consent.

Recognizing that the participants’ perspective is of utmost importance when considering whether the consent process was ‘good’ or not, we focused our review only on patient-reported measures of informed consent. A consent process can fulfill all of the legal imperatives to ensure consent is informed from a process perspective i.e. provision of information, discussion, etc. However, only by asking potential participants for their perspectives can judgements be made about whether or not consent was truly informed. The findings of our review are presented in this manuscript.

Methods

Search methods for identification of studies

The search strategies were designed by KG in collaboration with a Senior Information Scientist to identify relevant articles that described the development, and/or validation, of patient reported measures of informed consent for randomised controlled trials (RCTs). We supplemented the MEDLINE and EMBASE strategies with the filter described by Terwee and colleagues which identifies studies on measurement properties of measurement instruments [8]. The strategies for each of the databases are presented as text in S1 Appendix. We conducted searches for relevant studies on the following pre-specified databases:

  • MEDLINE (OvidSP) (1946 to 1st September 2016)
  • EMBASE (Ovid SP) (1980 to 2016 week 35)
  • CINAHL (OvidSP) (1960 to 1st September 2016)
  • PsycINFO (OvidSP) (1970 to 1st September 2016)

There were no language nor date restrictions. Table 1 presents number of studies identified in each database. We combined the results and removed duplicates. Reference lists of included papers were screened to identify further relevant publications.

Inclusion criteria.

The purpose of this review was to identify the items included in validated measures of RCT informed consent (we did not seek to evaluate the methodological quality of these measures). However, to ensure the methodology applied was rigorous we followed the COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) Protocol for systematic reviews of measurement properties [9]. The following inclusion criteria were applied:

  1. the instruments should aim to measure informed consent (or aspects of) in a clinical trial context;
  2. the study sample should contain potential trial participants;
  3. the study should include a questionnaire based measure (to include self-report, administered by interview; or by proxy);
  4. the aim of the study should be the development of a measurement instrument and evidence of the evaluation of one or more of its measurement properties;
  5. the study should be published as a full text original article;
  6. articles in all languages will be assessed for eligibility.

Exclusion criteria.

  1. Studies that reported study specific measures with no details on development or validation;
  2. Studies that measured informed consent for treatment or for research participation in a study other than an RCT;
  3. Trials or studies evaluating the effectiveness of informed consent interventions where a questionnaire is used to measure an endpoint (without describing the development of the tool in full).

Selection of studies.

One reviewer (KG) screened all identified titles and abstract with another reviewer (MC) screening a random 10% sample for consistency. Full text articles were assessed by one reviewer (KG) for inclusion and a random 30% sample was screened by another reviewer (MC) for consistency. Any disagreements on eligibility were discussed and consensus reached.

Data extraction and management

Data extraction forms and tables were generated for each stage of the extraction process to standardise the information recorded and aid analysis. All data extracted and presented relates to data pertaining to the study that reported the development and validation of an instrument to measure informed consent to clinical trials. One review author (KG) independently extracted data related to study characteristics (e.g. demographics of population, host trial detail, etc) and instrument characteristics (e.g. whether theoretically informed, number of items, etc) from each included study. This was checked by a second reviewer (SC) for accuracy. General data extraction categories were split into those relating to the context of the included informed consent study and those relating to the included informed consent instrument. Specifically these were:

  1. Included study characteristics: country; population; sample size; response rate; age; gender; ethnicity; employment status; and education status.
  2. Included instrument characteristics: name of instrument; theoretical/conceptual framework; construct assessed; time required to complete; recall period; dimensions; patient reported outcome; response options; ease of scoring and administration; mode of administration; sample items; and patient or public involvement in development.

Data extraction and coding relating specifically to content items (i.e. individual questions) of the instrument was conducted by two reviewers (KG and AD) independently with a random sample of papers (n = 5) assessed for consistency in overlap between reviewers (by KG). Any disagreements were resolved through discussion with a third reviewer (MC) if required. Data extraction was based on the following categories: name of the tool; concept of tool (verbatim from included study); items (verbatim from included study); construct being targeted by item (verbatim from included study); domain (as defined by review authors and informed by construct targeted); and sub-domain (as defined by review authors).

Data synthesis

The first step of data synthesis involved the coding of the items identified from the instruments of included studies into domains and sub-domains determined by the reviewers. This process followed many of the tenets of ‘directed’ content analysis [10]. Directed content analysis is guided by a structured approach that uses existing theory (or research) to identify the key concepts as initial coding categories [10]. Our initial proposed coding categories were thus informed by constructs identified from previously published regulatory guidance and existing research on informed consent. This was then supplemented by any additional constructs identified within the included manuscripts. The direct process of assigning appropriate codes to concepts discussed in manuscripts was primarily informed by consideration of how the authors reported the underlying construct. Initial allocation of codes was followed by discussion amongst two reviewers (KG and AD) to reach consensus on reviewer determined domains. This parallel coding process was carried out for 20 (11%) of the items with the remainder being coded independently by the two reviewers and results compared and discussed on completion. A third reviewer (MC) coded a random sample of 46% (n = 83) of the items to offer additional considerations and provide overall agreement on the coding categories. Items were then agreed across the main domains and sub-domains to provide an overall perspective of the conceptual framework emerging from these instruments.

Both for descriptions of included studies and of the instruments reported in those studies, descriptive statistics were used to describe general information and instrument detail. A narrative synthesis of the instruments and their inter-related domains and subdomains is presented.

Results

The search identified 8193 citations. After screening titles and abstracts, 29 full text articles were retrieved for further assessment. Of these 29, 14 complied with our pre-specified inclusion criteria and 15 were not eligible. Reasons for full text articles being deemed not being eligible are reported in Table 2. Full details of the search process can be seen in Fig 1.

thumbnail
Fig 1. PRISMA flow diagram for identification of included studies in informed consent for RCTs patient reported measures review.

https://doi.org/10.1371/journal.pone.0199775.g001

Descriptive characteristics: Included studies

The table in S1 Table summarises the basic characteristics of the included studies [1124]. Identified studies were published between 1996 and 2013. Eleven of the 14 included studies were set within the USA, with one further study being multi-site and set across the USA, Canada, Australia and New Zealand. The two remaining studies were conducted in the United Kingdom and Italy. The clinical trial population in which the informed consent studies were set varied and ranged across: mental health trials (e.g. depression, schizophrenia); paediatric trials, oncology trials; and others. All studies included patients as participants (additionally some studies also involved nurses and others healthy volunteers). This variability was further reflected in the testing scenario sometimes being a real trial and others being a hypothetical trial. The size of the sample included in each included study also varied and ranged from nine to 1086 participants (median = 174). As expected the demographics (e.g. age, gender, ethnicity, employment and education) of participants in the included studies varied and in some cases were not reported (see S1 Table).

Descriptive characteristics: Instruments from included studies

Information relating to characteristics of the instruments identified in the included studies is presented in Table 3. The included studies report 14 separate instruments whose aim is to measure an aspect of informed consent for RCTs. The included studies varied in their reports of what the instrument aimed to measure overall and reported concepts such as: ‘therapeutic misconception’; ‘therapeutic misunderstanding’; ‘perceived understanding’; ‘patient understanding of research’; ‘clinical trial understanding’; ‘understanding information’; ‘comprehension of informed consent information’; ‘understanding and retention of trial information’; ‘maintaining informed consent’ (operationalised through repeated measurement); ‘quality of informed consent’; ‘evaluation to consent’ (relates to evaluating capacity); ‘autonomous authorisation’; ‘assessing decisional capacity’; and ‘decision making’. Four of the included studies reported development of an instrument to assess competence, or capacity, of research subjects to consent to participation in RCTs i.e. the studies were set amongst participants who may have diminished decisional capacity e.g. early stage Alzheimer’s, schizophrenia. [11,16, 23, 24].

Of the 14 instruments, three explicitly reported a theoretical or conceptual framework underpinning their development (theories of therapeutic misunderstandings and or misconception [12, 13, 17]): a further two [22, 24] implicitly referred to the ‘conceptual dimensions of informed consent’ or ‘principles of research ethics’ as informing their development and nine reported no guiding theoretical framework. Linked to this, some instruments were explicit with regard to which constructs they were measuring while others were more vague.

The time required to complete the measure ranged from less than 5 to 20 minutes (median 8.4 mins). Five studies did not report time required to complete [13, 14, 20, 22, 23] and one reported completion time as ‘study procedures’ that included additional procedures as well as instrument completion [12]. Half of the included studies did not report the recall period assessed using the instrument with the seven remaining studies varying from point of consent to 10 weeks post consent.

The number of items per instrument varied across the 14 measures and ranged from 5 to 34 (median = 14) with a cumulative total of 179 individual items. There was some level of duplication or overlap across the 179 items. Specifically, 156 (87%) measured understanding or knowledge of domains, nine items (5%) measured decisional control (and focused on perceived voluntariness with all items identified from one tool [20]), eight items (4%) measured appreciation (of aspects such as expectations and consequences of participation) and six items (3%) measured reasoning. All of the appreciation and reasoning items are attributable to two tools that both aimed to measure patient’s competence or capacity to consent for research [11, 16]. Response options of instruments also varied with some being open-ended responses and others being Likert type questions. Mode of administration also varied with the majority being self-completed but others being administered by trained interviewers either face-to-face or over the telephone.

Finally, five of the 14 studies reported patient or public involvement during some stage in the development of the tool [12, 14, 15, 17, 20]. Two studies directly involved patients in identifying core content for inclusion in the tool [15, 20]; one study involved patients in reviewing and modifying the tool before piloting [14]; and two studies worked with patients during the piloting of the tool [12, 17].

Item domain and sub-domain classification

As mentioned above, the majority of items contained across all measures assess participants understanding in relation to specific features of the trials. Other aspects of cognition reported to be measured related to decisional control, reasoning, and appreciation. To identify which aspects of understanding were being assessed, we coded individual items into domains and sub-domains that broadly captured the underlying construct being measured (as described in the Methods section). Table 4 presents a summary of the item classification, including definitions (with example items), according to coded domains and subdomains. S1 Text provides coding of all items across the included instruments.

thumbnail
Table 4. Domains and subdomains identified across individual items of measures identified in the review.

https://doi.org/10.1371/journal.pone.0199775.t004

Our review identified five core domains across the 179 items (which spanned the core cognitive concepts of understanding, decisional control, appreciation, and reasoning). These core domains were constructed as: Autonomy; Consequences; Expectations; Purpose; and Individualisation. These domains are conceptually distinct but some are more intimately connected than others e.g. consequences and expectations. Consequences (n = 62) and purpose (n = 66) were the most commonly identified domains and individualisation (n = 8) the least. These core domains could be further categorised into discrete subdomains. Including: aim (of the trial to which they were consenting); alternatives; benefit; confidentiality; disadvantage or risk (of interventions); experience; motivations; positive beliefs; process; randomisation; satisfaction; therapeutic misconception; uncertainty; and voluntariness. The most commonly identified subdomain was ‘benefit’ (n = 35/20%) and ‘motivations’ the least (n = 1 / 0.5%). It is important to note that subdomains were not exclusively linked to one core domain. For example, ‘process’ was associated with all domains whereas ‘confidentiality’ was only linked to ‘consequences’ and ‘purpose’. Fig 2 provides an overview of the relational intersections of sub-domains across core domains identified in patient reported measures of informed consent for clinical trials.

thumbnail
Fig 2. Conceptual diagram of domains from RCT informed consent validated measures.

https://doi.org/10.1371/journal.pone.0199775.g002

Table 5 provides a summary of domain content identified in the informed consent measures included in our review. Fourteen of the included instruments could be classed as being multi-dimensional based on their coded domains. The Index of Clinical Trial Understanding (ICTU) was the only measure that could be considered unidimensional due to it exclusively including items that could be coded to one domain: purpose [19]. However, within the purpose domain, the ICTU patient reported measure did capture aspects relating to aim, process and randomisation. Across the 14 patient reported measures, only 1 included all 5 identified domains: the MacArthur Competence Assessment Tool–Clinical Research (MacCAT-CR) [11]. The MacCAT-CR was developed to assess depressed patients capacities to consent to research and covers cognitive aspects of appreciation and reasoning in addition to understanding [11].

thumbnail
Table 5. Inclusion of core domains across included measures ranked by frequency of domains.

https://doi.org/10.1371/journal.pone.0199775.t005

Discussion

This review of patient reported measures for informed consent for clinical trials is, to our knowledge, one of the first to systematically characterise the item content across these measures into individual outcome domains highlighting the heterogeneity that exists across outcome measures reporting to capture the same outcome. Importantly, this review further underlines the predominant lack of input from potential trial participants during development to aid in identification of what aspects of the informed consent process for trials matters to participants and should therefore be considered important for measurement when assessing the process–a perfect contradiction.

We identified 179 individual items across 14 instruments, the majority of which (87%) assessed understanding, and the items of which could be conceptualised into 5 core domains: Autonomy; Consequences; Expectations; Purpose; and Individualisation. A range of discrete subdomains were identified across these core domains relating to content, such as: aim; benefit; disadvantage or risk; satisfaction; therapeutic misconception. The majority of instruments were multidimensional although the coverage of domains was highly variable with most measures only addressing a subset of domains–with one measure (ICTU) being unidimensional in its content. This variability in coverage and focus of the measures make any future wish to synthesise outcome data from across these measures problematic, suggesting the need for the development of a core outcome set to inform the domains that all future studies should report. This work is now in development by the authors [25].

Our review showed that the majority of instruments lacked a theoretical framework to inform their development. This calls into question their construct validity (i.e. the extent to which the instrument tests the theory it is measuring) and raises concerns about their ability to accurately measure the underlying concept of informed consent. In other words, our review may have failed to identify domains and sub-domains of relevance for informed consent to clinical trials due to the lack of key content included in the instrument development. Measures that did report the use of theory to inform their development also varied in their conceptualisation of informed consent and as such associated domains and sub-domains relating to constructs varied. Thus providing further evidence that the over-arching concept (in this case ‘informed consent to trials’) which they aim to measure is likely not the same between measures.

Whilst all included instruments were patient–reported, only three included trial participants or patients in the development phase pre-pilot. This lack of stakeholder input also raises questions about content validity and specifically whether these measures represent items that are of importance to potential trial participants [25].

Our review further highlighted the dominant focus of measures on the “understanding” of trial specific information–this concentration on understanding has also been raised by a number of other commentators [6,7, 26]. Whilst understanding of information is an important component of clinical trials informed consent, many of the existing measures lack consideration of other aspects that might be important for the decision making process (e.g. preference construction, affective forecasting and integration of information with personal values and goals) [27, 28]. Only a few studies have measured and reported specific decision making outcomes (such as decision conflict, decision regret and deliberation) during the informed consent process [2934]. Interventions that aim to provide a more holistic approach to informed consent and go beyond solely seeking to improve understanding of trial information (by considering aspects of decision making that could also be important) are needed [28, 32, 33, 35]. As these decision-focused, and other, interventions to support the informed consent process for clinical trials become more widespread, it is likely that the instruments used to evaluate their effectiveness will also progress. Ideally, this progress should include involving potential trial participants in instrument development and evaluation.

Strengths and limitations

This study included a detailed systematic search to identify patient reported measures of informed consent to clinical trials and included rigorous methods to identify and code relevant domains across included patient reported measures. Searching was applied across a range of databases and incorporated search filters designed to ensure wide coverage and capture of relevant measurement tools. It included studies from a variety of trial contexts and geographical settings which maximises the relevance of review to different settings. It does, however, have some weaknesses. The coding of items was conducted by two authors independently with a third author checking a random sub-sample. The coding was informed by directed content analysis, which has some level of interpretation required during the analysis. Therefore, whilst a systematic and rigorous approach, like many qualitatively interpretive approaches it is subjective and it is possible that if conducted by other researchers (with different perspectives and lenses) that a different overall result may emerge. No formal assessment of inter-rater reliability was conducted, however, informal assessments of consistency did not highlight any major problems. In addition, we did not conduct any formal assessment of the methodological quality of instruments identified in included studies. Whilst this was not the aim of the study it could have provided a conclusion about which (if any) of the existing measures is the most methodologically sound.

Conclusions

This study has demonstrated the variability in the theoretical underpinning, development and domain coverage of existing patient-reported measures of informed consent for clinical trials. The dominant focus of tools to date has been limited to measuring understanding of items deemed important by researchers—the conceptualisation of informed consent could benefit from being extended to include broader considerations of decision-making. Meaningful involvement of potential trial participants during development of measures ‘critical for tool relevance’ is also lacking. The findings from this work provide evidence to support efforts to identify the key domains (of relevance to all stakeholders) which could be measured to assess the adequacy of the existing (and efforts to improve) informed consent process for clinical trials.

Supporting information

S1 Appendix. Search strategies for Medline, Embase, CINAHL Land PsychINFO.

https://doi.org/10.1371/journal.pone.0199775.s001

(PDF)

S1 Table. Characteristics of included studies.

https://doi.org/10.1371/journal.pone.0199775.s002

(PDF)

S1 Text. Coding of items across instruments.

https://doi.org/10.1371/journal.pone.0199775.s003

(XLSX)

Acknowledgments

The authors would like to acknowledge Cynthia Fraser (Senior Information Scientist) for help designing and running the search strategies.

References

  1. 1. World Medical Association (WMA): WMA Declaration of Helsinki: Ethical Principles for Medical Research Involving Human Subjects. Ferney-Voltaire: WMA; 2008. http://www.wma.net/en/30publications/10policies/b3/index.html
  2. 2. International Conference on Harmonisation (ICH): ICH Harmonised Tripartite Guideline: Guideline for Good Clinical Practice E6(R1). Geneva: ICH; 1996. [Step 4 version]
  3. 3. Beauchamp TL & Childress JF. Principles of Biomedical Ethics. 2012. Oxford: Oxford University Press, 7.
  4. 4. REGULATION (EU) No 536/2014 OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL of 16 April 2014 on clinical trials on medicinal products for human use, and repealing Directive 2001/20/EC.
  5. 5. Kinnersley P, Phillips K, Savage K, Kelly MJ, Farrell E, Morgan B, et alInterventions to promote informed consent for patients undergoing surgical and other invasive healthcare procedures. Cochrane Database Syst Rev. 2013 Jul 6;(7):CD009445. pmid:23832767
  6. 6. Synnot A, Ryan R, Prictor M, Fetherstonhaugh D, Parker B. Audio-visual presentation of information for informed consent for participation in clinical trials. Cochrane Database Syst Rev. 2014 May 9;5:CD003717. pmid:24809816
  7. 7. Sand K, Kaasa S, Havard Loge J. The Understanding of Informed Consent Information—Definitions and Measurements in Empirical Studies. AJOB Primary Research. 2010. 1, 2.
  8. 8. Terwee CB, Jansma EP, Riphagen II, de Vet HC. Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments. Qual Life Res. 2009;18(8):1115–23. pmid:19711195
  9. 9. http://tinyurl.com/COSMINProtocol
  10. 10. Potter WJ & Levine-Donnerstein D (1999). Rethinking validity and reliability in content analysis. Journal of Applied Communication Research, 27, 258–284.
  11. 11. Appelbaum PS, Grisso T, Frank E, O'Donnell S, Kupfer DJ.Competence of depressed patients for consent to research. Am J Psychiatry. 1999 Sep;156(9):1380–4. pmid:10484948
  12. 12. Appelbaum PS, Anatchkova M, Albert K, Dunn LB, Lidz CW. Therapeutic misconception in research subjects: development and validation of a measure. Clin Trials. 2012 Dec;9(6):748–61. pmid:22942217
  13. 13. Chou PH, O'Rourke N. Development and initial validation of the Therapeutic Misunderstanding Scale for use with clinical trials research participants. Aging Ment Health. 2012;16(2):145–53. pmid:21902558
  14. 14. Guarino P, Lamping DL, Elbourne D, Carpenter J, Peduzzi P. A brief measure of perceived understanding of informed consent in a clinical trial was validated. J Clin Epidemiol. 2006 Jun;59(6):608–14 pmid:16713523
  15. 15. Hutchison C, Cowan C, Paul J. Patient understanding of research: developing and testing of a new questionnaire. Eur J Cancer Care (Engl). 2007 Mar;16(2):187–95;
  16. 16. Jeste DV, Palmer BW, Appelbaum PS, Golshan S, Glorioso D, Dunn LB, et al. A new brief instrument for assessing decisional capacity for clinical research. Arch Gen Psychiatry. 2007 Aug;64(8):966–74. pmid:17679641
  17. 17. Joffe S, Cook EF, Cleary PD, Clark JW, Weeks JC. Quality of informed consent: a new measure of understanding among research subjects. J Natl Cancer Inst. 2001 Jan 17;93(2):139–47. pmid:11208884
  18. 18. Miller CK, O'Donnell DC, Searight HR, Barbarash RA. The Deaconess Informed Consent Comprehension Test: an assessment tool for clinical research subjects. Pharmacotherapy. 1996 Sep-Oct;16(5):872–8. pmid:8888082
  19. 19. Miller JD, Kotowski MR, Comis RL, Smith SW, Silk KJ, Colaizzi DD, et al. Measuring cancer clinical trial understanding. Health Commun. 2011 Jan;26(1):82–93. pmid:21218302
  20. 20. Miller VA, Ittenbach RF, Harris D, Reynolds WW, Beauchamp TL, Luce MF, et al The decision making control instrument to assess voluntary consent. Med Decis Making. 2011 Sep-Oct;31(5):730–41. pmid:21402793
  21. 21. Porteri C, Andreatta C, Anglani L, Pucci E, Frisoni GB. Understanding information on clinical trials by persons with Alzheimer's dementia. A pilot study. Aging Clin Exp Res. 2009 Apr;21(2):158–66. pmid:19448388
  22. 22. Prentice KJ, Appelbaum PS, Conley RR, Carpenter WT. Maintaining informed consent validity during lengthy research protocols. IRB. 2007 Nov-Dec;29(6):1–6. pmid:18237078
  23. 23. Resnick B, Gruber-Baldini AL, Pretzer-Aboff I, Galik E, Buie VC, Russ K, et al. Reliability and validity of the evaluation to sign consent measure. Gerontologist. 2007 Feb;47(1):69–77. pmid:17327542
  24. 24. Sugarman J, Lavori PW, Boeger M, Cain C, Edsond R, Morrison V, et al. Evaluating the quality of informed consent. Clin Trials. 2005;2(1):34–41. pmid:16279577
  25. 25. Gillies K, Entwistle V, Treweek SP, Fraser C, Williamson PR, Campbell MK. Evaluation of interventions for informed consent for randomised controlled trials (ELICIT): protocol for a systematic review of the literature and identification of a core outcome set using a Delphi survey. Trials. 2015 Oct 27;16:484. pmid:26507504
  26. 26. Nishimura A, Carey J, Erwin PJ, Tilburt JC, Murad MH, McCormick JB. Improving understanding in the research informed consent process: a systematic review of 54 interventions tested in randomized control trials. BMC Med Ethics. 2013,14:28. pmid:23879694
  27. 27. Bekker HL, Thornton J, Airey C, Connelly J, Hewison J, Robinson M, et al. Informed decision making: an annotated bibliography and systematic review. Health Technol. Assess., 3 (1999), pp. 1–159
  28. 28. Abhyankar P, Velikova G, Summers B, Bekker HL. Identifying components in consent information needed to support informed decision making about trial participation: An interview study with women managing cancer. Soc Sci Med. 2016 Jul;161:83–91. pmid:27261532
  29. 29. Abhyankar P, Bekker HL, Summers BA, Velikova G. Why values elicitation techniques enable people to make informed decisions about cancer trial participation. Health Expect. 2011 Mar;14 Suppl 1:20–32.
  30. 30. Miller SM, Hudson SV, Egleston BL, Manne S, Buzaglo JS, Devarajan K, et al. The relationships among knowledge, self-efficacy, preparedness, decisional conflict, and decisions to participate in a cancer clinical trial. Psychooncology. 2013, 22: 481–489. pmid:22331643
  31. 31. Stryker JE, Wray RJ, Emmons KM, Winer E, Demetri G. Understanding the decisions of cancer clinical trial participants to enter research studies: factors associated with informed consent, patient satisfaction, and decisional regret. Patient Educ Couns. 2006, 63: 104–109. pmid:16242898
  32. 32. Juraskova I, Butow P, Bonner C, Bell ML, Smith AB, Seccombe M, Boyle F, Reaby L, Cuzick J, Forbes JF. Improving decision making about clinical trial participation—a randomised controlled trial of a decision aid for women considering participation in the IBIS-II breast cancer prevention trial. Br J Cancer. 2014 Jul 8;111(1):1–7. pmid:24892447
  33. 33. Politi MC, Kuzemchak MD, Kaphingst KA, Perkins H, Liu J, Byrne MM. Decision Aids Can Support Cancer Clinical Trials Decisions: Results of a Randomized Trial. Oncologist. 2016 Dec;21(12):1461–1470. pmid:27511904
  34. 34. Gillies K, Elwyn G, Cook J. Making a decision about trial participation: the feasibility of measuring deliberation during the informed consent process for clinical trials. Trials. 2014 Jul 30;15:307. pmid:25073967
  35. 35. Gillies K, Skea ZC, Campbell MK. Decision aids for randomised controlled trials: a qualitative exploration of stakeholders' views. BMJ Open. 2014 Aug 19;4(8):e005734. pmid:25138811