Computer assisted self interviewing (CASI) has been used at the Melbourne Sexual Health Centre (MSHC) since 2008 for obtaining sexual history and identifying patients' risk factors for sexually transmitted infections (STIs). We aimed to evaluate the impact of CASI operating at MSHC.
The proportion of patients who decline to answer questions using CASI was determined. We then compared consultation times and STI-testing rates during comparable CASI and non-CASI operating periods. Patients and staff completed anonymous questionnaires about their experience with CASI. 14,190 patients completed CASI during the audit period. Men were more likely than women to decline questions about the number of partners they had of the opposite sex (4.4% v 3.6%, p = 0.05) and same sex (8.9% v 0%, p<0.001). One third (34%) of HIV-positive men declined the number of partners they had and 11–17% declined questions about condom use. Women were more likely than men to decline to answer questions about condom use (2.9% v 2.3%, p = 0.05). There was no difference in the mean consultation times during CASI and non-CASI operating periods (p≥0.17). Only the proportion of women tested for chlamydia differed between the CASI and non-CASI period (84% v 88% respectively, p<0.01). 267 patients completed the survey about CASI. Most (72% men and 69% women) were comfortable using the computer and reported that all their answers were accurate (76% men and 71% women). Half preferred CASI but 18% would have preferred a clinician to have asked the questions. 39 clinicians completed the staff survey. Clinicians felt that for some STI risk factors (range 11%–44%), face-to-face questioning was more accurate than CASI. Only 5% were unsatisfied with CASI.
Citation: Vodstrcil LA, Hocking JS, Cummings R, Chen MY, Bradshaw CS, Read TRH, et al. (2011) Computer Assisted Self Interviewing in a Sexual Health Clinic as Part of Routine Clinical Care; Impact on Service and Patient and Clinician Views. PLoS ONE 6(3): e18456. https://doi.org/10.1371/journal.pone.0018456
Editor: Esper Kallas, University of Sao Paulo, Brazil
Received: November 10, 2010; Accepted: March 8, 2011; Published: March 31, 2011
Copyright: © 2011 Vodstrcil et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This study was in part supported by funds from the National Health and Medical Research Council (grant number 568971) and there was no additional external funding received for this study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
The prevalence of sexually transmitted infections (STIs) is closely related to the community's access to clinical services . This was illustrated in the UK when under-funding of genitourinary medicine (GUM) clinics led to reduced access to services and increases in gonorrhea rates which subsequently stabilized and declined with improved access , . However obtaining sufficient funding for sexual health services is difficult while health care costs are rising at twice the rate of inflation . It is therefore important that sexual health services like other areas of medicine, strive to increase their clinical efficiency.
One method that has been studied in a number of small randomized clinical trials or observational studies is computer assisted self interviewing (CASI). It was our hope that CASI may lead to improved efficiency and reduced cost of our sexual health clinical service –. The five published studies on CASI in STI services have generally shown that the benefit of operating CASI is that it improves the accuracy of the clinical information –. However, only one of these studies investigated the effect of CASI on clinical outcomes and reported that CASI may have contributed to a reduction of HIV testing rates , thus demonstrating a potential weakness of its introduction.
Very few clinical STI services have CASI operating as part of routine clinical practice and no studies have been published on CASI in routine practice. The earlier studies were relatively small and therefore had limited statistical precision but also may be biased because their participants may not have been representative of an entire clinical service. The Melbourne Sexual Health Centre (MSHC) is an STI service that sees approximately 20,000 individuals a year and has had CASI operating as part of routine clinical practice since mid-2008. CASI was introduced in the clinic with the aim to collect a core sexual history from a patient before they saw a clinician, thereby resulting in increased efficiency and more thorough risk profiles being identified. CASI obtains answers to questions about a patient's gender of sexual partners, STI history, and sexual risk behavior (i.e. condom use and number of partners). The CASI questions were chosen because they were deemed to be part of the core sexual history , . When a patient completes CASI on one of the laptop computers in the clinic waiting room the data is stored on the main clinic server and a summary is printed on a sticker which is placed in the patients file. This allowed for an audit of CASI records which could be compared to data entered manually into the server when CASI was not available.
In 2010 all the laptop computers that ran CASI were stolen which resulted in its temporary discontinuation. This provided an unexpected opportunity to use this period as a control period to evaluate the effect of CASI on clinical practice. To complement this evaluation we also undertook surveys of both staff and patients to provide a complete picture of the acceptability of CASI as part of routine clinical practice.
Materials and Methods
This study involved three separate components: a retrospective audit, a survey of patients and a survey of clinicians using CASI. It was conducted at MSHC a large urban sexual health service that provides a walk-in clinic. Patients attending the centre initially see a triage nurse to determine if they need to be seen. The triage nurse then classifies them as either needing to see a doctor (complicated cases e.g. symptomatic for an STI) or they could be seen by either a doctor or nurse (uncomplicated cases e.g. asymptomatic screen). Only men who have sex with men (MSM) are able to make appointments for first visits without triage.
CASI has been available for use at MSHC since June 2008 except for a four month period in 2010 (January 26th – May 25th) following a robbery when the 10 laptop computers were stolen. At MSHC all new and returning patients attending the centre were first directed towards the 10 computer terminals in the foyer where they registered their demographic details (patient assisted registration), which was available in English, Thai, Korean and Chinese at the time of the evaluation. When this is complete the computer prompts all new individuals and those who have not been seen at MSHC for more than three months to begin their sexual history (available in English only at time of evaluation). Patients not wishing to do CASI can close the CASI screen or walk away from the computer which automatically closes after no activity for 3 minutes. CASI questions focus on five main areas; gender of sexual partners, number of sexual partners, drug use and history of both sexual health related infections and previous HIV testing.
For every CASI question, patients have the option to record ‘decline to answer’. After completing the CASI questions, patients are assessed by the triage nurse (and subsequently a clinician) using their paper medical record that includes a sticker with the summarized CASI history. This sticker includes the number of questions the patient has ‘declined to answer’.
CASI retrospective audit
Proportion of patients who declined questions.
To determine the proportion of individual patients who declined to answer specific questions we undertook a retrospective analysis of computer records of all patients undertaking CASI for the first time during the operating period (11th June 2008 – 30th June 2010, excluding the period when the computers were stolen). If patients were eligible for CASI twice between June 2008 and June 2010 only their first visit was included in the analysis. Sex workers were excluded from the analysis because they attend more often than every three months and because sex workers are not easily compared from one country to another and hence limit the generalizability of the study findings. In order to calculate the proportion that declined to answer each question on CASI, we divided the number who declined to answer each specific question into the number who were asked that question.
CASI compared with non-CASI periods
To determine if CASI influenced clinical practice we compared components of clinical practice during three specific 12-week time periods: one period when CASI was operating (1st February – 30th April 2009) and two similar time periods when CASI was not operating (1st February – 30th April 2008 before CASI was instituted and 1st February – 30th April 2010 when CASI ceased to operate). By including the same period (end of Summer to mid-Autumn) we removed seasonal variability from our analysis. For the CASI and non-CASI periods we used data from all patients who would be eligible to use CASI (new patients or those not seen for more than three months excluding sex workers) in each of the three 12-week periods. Only a patient's first visit within each specific 12-week period was included in the analysis.
Consultation duration in CASI compared with non-CASI periods.
The time taken for a consultation was recorded by the center's computer. The data analysis for the duration of consultations included only consultations of clinicians who worked in all three of the time periods. If a clinician only worked in one or two of the time periods, their data was excluded to avoid the individual characteristics of these clinicians influencing the consult duration. This analysis also excluded patients who were seen in less than 5 minutes or who took more than 90 minutes as these data are likely to be errors associated with clinicians not recording start and finish times correctly.
Uptake to STI testing in CASI compared with non-CASI periods.
To determine if CASI influenced STI testing rates we compared STI testing during the CASI and non-CASI periods. It was expected that there be no differences in the uptake to STI or HIV testing in patients who completed or did not complete CASI. We looked at chlamydia tests, HIV tests for all patients and anal swabs taken from MSM for either chlamydia and/or gonorrhea. The data analysis was restricted to patients who saw a clinician who was working during each of the three periods.
To determine the patient's views on CASI we used one page self-completed, anonymous questionnaires containing nine questions that were given out after patients were assessed by the triage nurse for a one week period (31st May – 4th June 2010). Questions included demographics such as gender, age, gender of sexual partners, and whether the patient was a new patient to the clinic or a returning patient. Patients were also asked to rate the ease of computer use, describe the accuracy of their answers and rate how comfortable they were answering the questions on a computer. A final question asked whether patients would prefer using the computer for a self-interview or being asked the questions face-to-face by the treating clinician. Patients also had an opportunity to provide an open-ended comment about the computers.
Clinician, triage nurse and administration staff questionnaires
The staff survey was conducted using an internet survey program, SurveyMonkey™ (www.surveymonkey.com). All MSHC staff members were provided with a link to the online questionnaire together with a letter explaining that their answers would remain confidential and anonymous.
Clinicians were asked whether in their view CASI or face-to-face interviewing was: better for obtaining accurate information about gender and number of sexual partners, condom use, injecting drug use, and last HIV test; if they would recommend CASI to another clinic; how useful CASI was and how it affects the building of rapport with patients; and whether or not they were satisfied with CASI operation. Triage nurses had additional questions about how CASI affects the triage process. Administration staff were asked about their opinions on how CASI affects patient flow in the clinic and how often patients ask for help. Most questions provided an opportunity to expand on answers.
Patient response rate and staff and patient questionnaires.
Chi squared analysis was used for exploring differences in patient response rate between gender and for analyzing associations between categorical variables in staff and patient questionnaires.
Consultation duration and STI testing.
Linear regression analysis was used to determine differences in consultation time between CASI and non-CASI periods, adjusting for potential intra cluster correlation among individual clinicians. Logistic regression was conducted to evaluate whether the proportion of patients who has an STI test varied between CASI and non-CASI periods adjusting for potential intra cluster correlation among individual clinicians.
Ethical approval was obtained from the Alfred Hospital Research Ethics Committee who approved written consent not being obtained to preserve the anonymous nature of the questionnaire. The ethics committee also approved no consent being obtained for the retrospective analysis of existing data because it involved no risk to confidentiality.
CASI retrospective audit
There were 20,704 individual patients who attended the centre at least once during the CASI operating period (11th June 2008 to 30th June 2010, excluding the period from 26th January 2010 to 24th May 2010 when CASI was not in operation) (Figure 1). Of these individual patients, 18,093 (12,140 men and 5,953 women) were eligible to do CASI on their first visit during this period (sex workers excluded). Of the eligible patients, 9,545 (79%) men and 4,645 (78%) women completed CASI.
Proportion of patient who declined questions.
The proportions of men and women who declined different questions in CASI ranged from 0–8.9% (Table 1). There were significant differences in the proportion of questions that were declined by men and women. Men were significantly more likely than women to decline questions about how many casual sexual partners (CSPs) of the opposite sex they had had in the last 12 months (p = 0.05), and how many CSPs of the same sex they had had in the last 12 months (p<0.001). Women were significantly more likely than men to decline to answer questions about condom use with CSPs of the opposite sex in the last 12 months (p = 0.05). There was no difference between men and women in reporting condom use with regular sexual partners of the opposite sex.
When answering questions on CASI about sexual activity, HIV-positive MSM were significantly more likely than HIV-negative MSM to decline questions about the number of CSPs, anal sex with CSPs and condom use with CSPs compared with HIV-negative men (p<0.002) (Table 2).
CASI v non-CASI periods
Consultation times with CASI compared with non-CASI periods.
The mean consultation times for the CASI and non-CASI period stratified by the type of clinician (doctors or nurses) and the type of consultation (complicated, uncomplicated or appointment) are demonstrated in Table 3. There were no significant differences in the mean consultation times between the CASI and non-CASI period (p≥0.17).
Uptake to STI testing with CASI compared with non-CASI periods.
To determine if there were any differences in STI testing rates between CASI and non-CASI periods, an analysis of the uptake to STI testing was performed (Table 4). Only the proportion of women tested for chlamydia was different in the CASI period compared with the non-CASI period (p<0.001, 84% v 88% respectively).
During the survey week, 306 patients answered CASI and of these 267 (87%) patients completed the questionnaire after being triaged. Only 266 specified their gender and were included in the analysis (Table 5). Most respondents (72% men and 69% women) were comfortable using the computer and most reported (76% men and 71% women) that their answers to all questions were accurate. Women (19%) were more likely than men (7%) to report difficulty in using the computer (p = 0.02). About half of patients preferred to use CASI but a significant minority (18%) would have preferred a clinician to have asked the questions in person.
There were 84 comments made by respondents in the free text box; 52 of the comments concerned technical difficulties mainly to do with the sensitivity of the touch screens of the computers on which CASI operates in the reception area. Twelve had positive feedback including that it was a ‘good innovative system which provides pre-consultation information’, that it was an ‘easier and faster method’ and that it was very ‘clear and quick’ to use. Four patients had general suggestions to improve clarity of questions. Fourteen of the patients who received the questionnaire reported that they found CASI either repetitive, confusing, over complicated or intrusive.
During the survey period, 19 of 22 doctors and 20 of 22 nurses who were currently employed and had worked during both CASI and non-CASI periods completed the staff survey. There was no statistical difference (p>0.14) in the responses of nurses and doctors to any questions and therefore responses were combined in Table 6. A significant minority (range 11%–44%) of clinicians felt that when identifying STI risk factors face-to-face questioning was more accurate than CASI. For example, 44% of clinicians believed face-to-face was more accurate for obtaining answers about condom use.
Clinicians overwhelmingly supported CASI with 84% of clinicians reporting they were satisfied with it and only one felt that CASI adversely affected their consultations. 63% felt it improved the quality of their consults and made consults quicker and 89% would recommend CASI being implemented at another clinic. Examples of some of the text responses provided are demonstrated in Table 7.
All (n = 16) nurses who worked in triage and responded to the online questionnaire were satisfied with CASI operating at MSHC and 88% (14) thought CASI improved the triage process.
Four of six administration staff members believed that CASI improved flow of patients through the registration process whereas the other two thought CASI made flow worse. Most administration staff said they had to help patients with the computer ‘often’ or ‘sometimes’ mainly with technical issues the patient faced.
This is the first evaluation of CASI in operation in routine practice in a sexual health. We found that patients declined to answer questions infrequently, most were comfortable and preferred using CASI, and most claimed to answer questions accurately. CASI had little influence on the duration of consultations. There is the possibility that it could have reduced chlamydia testing in women, although in this observational analysis, it is perhaps most plausible that other unmeasured differences accounted for this finding. In general, CASI was not expected to change uptake to STI testing as patients report risk behavior to both CASI and in face-to-face interviewing. Staff were satisfied with CASI but did not always think CASI was better for obtaining accurate information about sexual risk. They did think that it improved clinical care in terms of increased quality of consults and shorter consult times. These findings from a large evaluation, in addition to the smaller analytical studies generally support the introduction of CASI into clinical STI services –. The true value of CASI is most likely to be realized when it is integrated with further innovations in clinical care such as the development of express clinical services, although CASI operating alone allows for the development of a detailed behavioral surveillance system , .
Relatively few patients declined to answer questions when CASI was operating as part of routine care. The exception to this was HIV-positive men where over one third declined to answer questions about the number of recent male sexual partners. In addition, about one in 20 men and women declined to answer questions about the number of opposite sex partners. Our observation that overall few patients declined to answer the majority of questions must be tempered by the fact that about 20% of patients did not undertake CASI in our study. Unfortunately we do not have information on why patients chose not to undertake CASI but reasons may have included: the CASI terminals being occupied when the clinic was busy; there was insufficient time just before closing time; or because CASI was only available in English throughout this evaluation period.
We did not find any objective difference in consultation times during CASI and non-CASI periods despite the majority of clinicians subjectively feeling that CASI shortened their consultations. The objective analysis involved a large number of consultations, was corrected for the complexity of the patients seen and adjusted for the clinician seeing them. Our conclusion from this data is that if CASI does shorten consultations, it is not by a clinically important difference. It is possible that if time was saved using CASI it may have been used by clinicians in other parts of the consultation that could explain the 63% of clinicians who felt that the quality of the consultation was improved.
In general CASI had no effect on the use of diagnostic tests with the possible exception of reducing the number of chlamydia tests ordered for females. However, the absolute difference in chlamydia testing rates was small (84% tested during CASI periods vs. 88% for non-CASI periods) and this difference may have been due to other unmeasured factors. Given that the CASI histories generally identify a higher risk among heterosexual women, it is difficult to postulate a plausible rationale for why chlamydia testing rates would be lower in this group . In the UK, a randomized controlled trial reported lower HIV testing rates in patients who entered information in CASI compared with patients who were interviewed with the traditional pen and paper interview . We observed no significant differences in HIV testing rates in our study.
In the current study of CASI as part of routine care, a somewhat lower proportion of patients were comfortable or very comfortable using CASI (71%) than found in a randomized study at our centre (86%) . Similarly in the current study a lower proportion of patients found using CASI easy or very easy (79%) than found in the randomized study (86%) . This small but important difference may have been because in the randomized study patients were required to initially consent to participate which may have resulted in a sample that were more comfortable with using computers .
The current study highlighted the complexity of the accuracy of the answers to sensitive questions about sexual risk. In our patient survey only about 75% of patients reported that their answers to the questions were all accurate, although only 1% reported that few were accurate. It is important to note that we did not aim to compare the accuracy of answers between CASI and face-to-face interviews. We obtained opinions from clinicians and patients as to how accurate they think responses to CASI are. Therefore, the responses we received may be biased if patients report that their answers are accurate if it is socially desirable to do so and if clinicians make assumptions about the accuracy of CASI obtained information. Given that previous research has shown that CASI obtains more accurate answers to socially desirable questions than clinicians – it is likely that less than 75% of patients answer all questions accurately to clinicians. However in the current study clinicians felt that they could obtain more accurate answers than CASI. The clinician's view that they can obtain more accurate answers may in part be explained by the complexity of some questions that require detailed clarification (e.g. condom use) although this cannot explain their views in relation to simple questions about the sex of partners.
There are a number of limitations to our study. Firstly, it was an observational study that was subject to the biases associated with such studies. For example there may have been systematic differences between the three time periods that may have either resulted in significant findings that were attributed to the influence of CASI or alternatively disguised real effects of CASI. We lessened this possibility by standardizing the time of year, clinician and type of consult but other unmeasured factors cannot be excluded. We note that all real life evaluations of interventions suffer from this limitation. Secondly, a significant minority of patients during the CASI period did not undertake CASI but we would make the point that our evaluation was one of a clinic with and without CASI operating and not a comparison of patients who did and did not use CASI. Another point that requires consideration is that most patients know that their responses to CASI will eventually be read by a triage nurse or clinician. Thus their responses will not remain anonymous during their consult. This point does not explain why studies have reported that CASI obtains more accurate answers to socially undesirable questions –, but might explain why we reported no differences in uptake to STI testing, and why clinicians believe they obtain more accurate answers to some risk behavior questions.
This study had a number of important strengths. Firstly, it represented a large number of patients undergoing CASI as part of routine clinical care. Secondly, we used two control periods on either side of the CASI period to hopefully minimize other factors, such as temporal changes that may have been different between CASI and non-CASI periods. Thirdly, the periods of time we analyzed were the same each year allowing us to remove seasonal variability from our analysis.
Having established that CASI can operate successfully as part of routine clinical practice it is now important to undertake research on how CASI can be best used to develop express clinical services, that both improve the efficiency and effectiveness of clinical care with the important population health consequences of improved STI rates , . For example, while it may be safe to operate an express clinical service for low risk heterosexuals, using such a service for MSM, who are at significant risk of HIV may forego the opportunities to encourage condom use that might occur when a clinician and patient talk directly . Some of these concerns may be circumvented by further innovative developments with computer counseling but one could argue that the introduction of these developments should be carefully evaluated like all important health interventions before being introduced , .
The authors wish to acknowledge the IT assistance received from A. Afrizal. We also thank all of the participants and clinicians that took part in this evaluation.
Conceived and designed the experiments: LAV RC MYC CKF. Performed the experiments: LAV JKS CKF. Analyzed the data: LAV JSH MYC CSB TRHR CKF. Wrote the paper: LAV JSH MYC CSB TRHR JKS CKF. Designed the system used in the study: JKS.
- 1. Fairley CK, Bowden FJ, Gay NJ, Paterson BA, Garland SM, et al. (1997) Sexually transmitted diseases in disadvantaged Australian communities. Jama 278: 117–118.
- 2. House of Commons Health Committee.Sexual Health. Third Report of Session 2002–03. London: The Stationery Office Limited.
- 3. White PJ, Ward H, Cassell JA, Mercer CH, Garnett GP (2005) Vicious and virtuous circles in the dynamics of infectious disease and the provision of health care: gonorrhea in Britain as an example. J Infect Dis 192: 824–836.
- 4. Keehan S, Sisko A, Truffer C, Smith S, Cowan C, et al. (2008) Health spending projections through 2017: the baby-boom generation is coming to Medicare. Health Aff (Millwood) 27: w145–155.
- 5. Ghanem KG, Hutton HE, Zenilman JM, Zimba R, Erbelding EJ (2005) Audio computer assisted self interview and face to face interview modes in assessing response bias among STD clinic patients. Sex Transm Infect 81: 421–425.
- 6. Kissinger P, Rice J, Farley T, Trim S, Jewitt K, et al. (1999) Application of computer-assisted interviews to sexual behavior research. Am J Epidemiol 149: 950–954.
- 7. Kurth AE, Martin DP, Golden MR, Weiss NS, Heagerty PJ, et al. (2004) A comparison between audio computer-assisted self-interviews and clinician interviews for obtaining the sexual history. Sex Transm Dis 31: 719–726.
- 8. Richens J, Copas A, Sadiq ST, Kingori P, McCarthy O, et al. (2010) A randomised controlled trial of computer-assisted interviewing in sexual health clinics. Sex Transm Infect 86: 310–314.
- 9. Tideman RL, Chen MY, Pitts MK, Ginige S, Slaney M, et al. (2007) A randomised controlled trial comparing computer-assisted with face-to-face sexual history taking in a clinical setting. Sex Transm Infect 83: 52–56.
- 10. Tideman RL, Pitts MK, Fairley CK (2004) Current practice of sexual history taking by sexual health physicians in Australia and New Zealand. Sex Transm Infect 80: 389–391.
- 11. Tideman R, Pitts M, Fairley CK (2006) Use of the Delphi sorting technique to establish a core sexual history. Int J STD AIDS 17: 170–172.
- 12. Baraitser P, Collander Brown K, Gleisner Z, Pearce V, Kumar U, et al. (2011) ‘Do it yourself’ sexual health care: the user experience. Sex Health 8: 23–29.
- 13. Yeung A, Bush M, Cummings R, Bradshaw CS, Chen MY, et al. (2010) Use of computerized medical records to determine the feasibility of testing for Chlamydia without patients seeing a practitioner. Int J STD AIDS 21: 755–757.
- 14. Kurth AE (2010) Utilizing information and communication technology tools in STD clinics: has the time come to go digital? Sex Transm Dis 37: 669–671.
- 15. Fairley CK, Sze JK, Vodstrcil LA, Chen MY (2010) Computer-assisted self interviewing in sexual health clinics. Sex Transm Dis 37: 665–668.
- 16. Kamb ML, Fishbein M, Douglas JM Jr, Rhodes F, Rogers J, et al. (1998) Efficacy of risk-reduction counseling to prevent human immunodeficiency virus and sexually transmitted diseases: a randomized controlled trial. Project RESPECT Study Group. Jama 280: 1161–1167.
- 17. Weinhardt LS, Mosack KE, Swain GR (2007) Development of a computer-based risk-reduction counseling intervention: acceptability and preferences among low-income patients at an urban sexually transmitted infection clinic. AIDS Behav 11: 549–556.