Although portable instruments have been used in the assessment of sleep disturbance for patients with low back pain (LBP), the accuracy of the instruments in detecting sleep/wake episodes for this population is unknown. This study investigated the criterion validity of two portable instruments (Armband and Actiwatch) for assessing sleep disturbance in patients with LBP. 50 patients with LBP performed simultaneous overnight sleep recordings in a university sleep laboratory. All 50 participants were assessed by Polysomnography (PSG) and the Armband and a subgroup of 33 participants wore an Actiwatch. Criterion validity was determined by calculating epoch-by-epoch agreement, sensitivity, specificity and prevalence and bias- adjusted kappa (PABAK) for sleep versus wake between each instrument and PSG. The relationship between PSG and the two instruments was assessed using intraclass correlation coefficients (ICC 2, 1). The study participants showed symptoms of sub-threshold insomnia (mean ISI = 13.2, 95% CI = 6.36) and poor sleep quality (mean PSQI = 9.20, 95% CI = 4.27). Observed agreement with PSG was 85% and 88% for the Armband and Actiwatch. Sensitivity was 0.90 for both instruments and specificity was 0.54 and 0.67 and PABAK of 0.69 and 0.77 for the Armband and Actiwatch respectively. The ICC (95%CI) was 0.76 (0.61 to 0.86) and 0.80 (0.46 to 0.92) for total sleep time, 0.52 (0.29 to 0.70) and 0.55 (0.14 to 0.77) for sleep efficiency, 0.64 (0.45 to 0.78) and 0.52 (0.23 to 0.73) for wake after sleep onset and 0.13 (−0.15 to 0.39) and 0.33 (−0.05 to 0.63) for sleep onset latency, for the Armband and Actiwatch, respectively. The findings showed that both instruments have varied criterion validity across the sleep parameters from excellent validity for measures of total sleep time, good validity for measures of sleep efficiency and wake after onset to poor validity for sleep onset latency.
Citation: Alsaadi SM, McAuley JH, Hush JM, Bartlett DJ, McKeough ZM, Grunstein RR, et al. (2014) Assessing Sleep Disturbance in Low Back Pain: The Validity of Portable Instruments. PLoS ONE 9(4): e95824. https://doi.org/10.1371/journal.pone.0095824
Editor: Berthold Langguth, University of Regensburg, Germany
Received: February 20, 2013; Accepted: March 31, 2014; Published: April 24, 2014
Copyright: © 2014 Alsaadi et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This research was supported by a grant from the University of Sydney, Sydney Medical School, Sydney, Australia. Prof. Maher's fellowship is funded by the Australian Research Council. Dr. Alsaadi was supported by the University of Dammam, Kingdom of Saudi Arabia during the study. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: The authors have declared that no competing interests exist.
Low back pain (LBP) is a common health condition; it has a lifetime prevalence of 40%, and a point prevalence (at any point in time) of 20% . LBP is associated with both physical and psychological consequences, for example disability, depression and anxiety . Studies have also found that between 50–60% of patients with LBP report sleep disturbance , . A recent systematic review found that people with chronic LBP report increased duration to sleep onset, reduced total sleep time, and lower sleep efficiency .
Sleep disturbance in patients with LBP is associated with psychological distress, physical disability , fatigue and day-time sleepiness . Patients with LBP who complain of sleep disturbance have been found to experience more severe pain  and are more likely to be hospitalized for their LBP than those without sleep problems . The literature suggests that there is a bidirectional relationship between disturbed sleep and intensity of pain. (i.e. pain may lead to the reporting sleep disturbance and poor sleep may cause or exacerbate the pain) . It is plausible therefore that disturbed sleep is likely to adversely impact LBP management. Moreover, the consequences of sleep disturbance can hinder treatment effectiveness. For example, exercise therapy, used to reduce pain, improve function and enhance return to work , is a critical component of LBP management. Clinicians prescribe exercise therapy for approximately half of their patients with LBP . The effects of sleep disturbance such as fatigue are likely to hinder exercise performance and consequently lead to poorer treatment outcomes. For these reasons the assessment of sleep disturbance in patients with LBP is an important clinical and research question.
The gold standard for assessing sleep quality is Polysomnography (PSG). However, due to its complexity and expense it is infrequently used in research on sleep quality in patients with LBP. Most studies reporting on sleep quality and LBP have used data from self-report questionnaires . Self-report measures however correlate poorly with PSG and therefore estimates of sleep parameters in patients with LBP may not be accurate . Newly developed portable instruments provide a less expensive, objective alternative to PSG and are a potentially more accurate method of measuring sleep quality in a free-living environment than self-report measures . A commonly used portable method is actigraphy, in which a small device containing an accelerometer to detect limb movement is worn on the wrist or ankle. A mathematical algorithm is used to estimate sleep/wake episodes. The accuracy of actigraphy to evaluate sleep parameters has been investigated by comparison with PSG in several medical conditions and for some sleep disorders, but not for the LBP population –.
In addition to accelerometry, the BodyMedia SenseWear Armband, acquires other physiological signals including skin temperature, galvanic skin response and heat flux which are thought to be important in determining sleep/wake cycles . This instrument may therefore provide a more accurate assessment of sleep quality than actigraphy alone . Further, because the Armband is worn on the upper arm interference from fine limb movement associated with limb dominance is minimised. Despite the potential superiority of the Armband, only 4 studies have investigated its accuracy in detecting sleep/wake episodes measured by polysomnography. These studies were performed in healthy children and adolescents , healthy volunteers placed on hypnotics or placebo  and sleep apnea , . There was variability in findings across the studies with the Armand able to detect patients' sleep with more accuracy than detecting wake episodes. Only one study examined a different actigraphy device in parallel with the Armband .
Although a number of studies , – have employed actigraphy for the assessment of sleep disturbance in patients with LBP, the accuracy of the instrument for this population is uncertain. In particular, there is some evidence that patients with LBP exhibit higher body activity during sleep than those without LBP , which might adversely affect the accuracy of the actigraphy in detection of an individual's sleep/wake episodes. This casts some doubt on whether findings of previous validity studies in other conditions generalise for the LBP population. Therefore, the aim of the current study was to determine the criterion validity of the actigraph and the BodyMedia SenseWear Armband for measuring sleep parameters in a sample of patients with LBP by comparing the instruments' recordings of sleep/wake to those of the PSG. A secondary aim was to investigate whether the additional physiological measures provided by the Armband increase the accuracy of sleep parameters compared with accelerometry alone (i.e. actigraph).
Materials and Methods
This was a cross-sectional study conducted between March 2010 and June 2011. The study protocol was approved by the University of Sydney Human Research Ethics Committee, Australia (09-2009/12100). All participants signed informed consent forms before participation in the study. Participants were compensated for their time and transportation expenses.
Participants with non-specific LBP were recruited from physiotherapy clinics in the Sydney metropolitan area and from the community through advertising. The inclusion criteria were: patients aged between 18 and 79 years with a primary complaint of LBP (pain between the 12th rib and buttock crease) with or without leg pain (pain radiating to the lower limb “sciatica”) and possessing sufficient fluency in the English language to understand and respond to instructions. Exclusion criteria were: LBP caused by a serious spinal pathology, according to medical/physiotherapy evaluation or patient report; nerve root compromise (evidenced by at least two of myotomal weakness, dermatomal sensory loss, or hypo-reflexia of the lower limb reflexes); spinal surgery within the preceding 6 months; previously diagnosed with a sleep disorder for which they were receiving care; and patients receiving care for a mental health condition.
Participating physiotherapists informed patients about the study. If a patient indicated an interest in participating, the physiotherapist provided them with comprehensive information about the study procedures and then passed on their contact details to the study researcher. The researcher contacted the patient, screened the patient for eligibility, and arranged a time to meet eligible patients at the sleep laboratory. Potential participants from the community were provided with comprehensive information about the study through the post or electronic mail. Those who showed an interest in participating were then contacted and screened for inclusion by the study researcher. All who met the eligibility criteria met the study researcher at the sleep laboratory.
The sleep assessments were conducted at the sleep laboratory of the Woolcock Institute of Medical Research, the University of Sydney, Australia. The study researcher, who was a trained physiotherapist, met the participants to screen for neurological signs, obtain informed consent, collect basic demographic information (including age; gender; body mass index; nationality; level of education; whether currently seeking care) and participant's clinical condition (including pain intensity; pain duration; disability; psychological distress; fatigue –see Table S1). Although participant's clinical profiles were not included in the analysis, they were assessed to describe the study sample. At the end of the interview the researcher fitted the Armband and the Actiwatch and provided instructions on how to avoid getting the Armband and Actiwatch wet during bathing/showering. A sleep laboratory technician then carried out the overnight PSG study.
Each participant had measures of sleep parameters taken with the Armband and Actiwatch and also with PSG, which is considered the criterion measure, while sleeping overnight in the sleep laboratory. The assessed sleep parameters were: total sleep time (TST); sleep onset latency (SOL); sleep efficiency (SE) and wake after sleep onset (WASO). These parameters were calculated as below:
TST: the total number of minutes scored as sleep from lights out to lights on.
SOL: the total number of minutes scored as awake beyond lights out prior to sleep onset.
SE: the ratio of minutes spent asleep to total minutes in bed, X 100 (expressed as percentage).
WASO: the total minutes scored as wake after sleep onset before lights on.
The evaluation of these sleep parameters (TST, SOL, SE and WASO) was based on “lights off” and “lights on” time according to the PSG recording. Lights off was the time that the patient started trying to sleep (start of PSG) and lights on was the time that the patient was awakened (end of PSG), as recorded by the sleep laboratory technician.
An Armband (SenseWear-Pro3, BodyMedia Monitoring System, Pittsburgh PA, USA) was attached on the right upper arm during testing according to the manufacturer's instructions. The software (SenseWear Professional Software version 6.1) used average variations in body movements, differential and proportional changes in heat-flux and skin temperature and the galvanic skin response to score each 60 second time epoch as either sleep or awake .
Following the manufacturer's instructions the Actiwatch (Actiwatch 2; Philips Respironics, Murrysville PA, USA) was attached to the non-dominant wrist during testing. Epoch length was set at 30 secs to match the PSG setting. The data were downloaded and analysed using ActiWare (R) software version 5.52.0003 (Philips Respironics, Murrysville, PA, USA). The standard factory-default algorithm was used for sleep interval detection. The parameters were: wake threshold set as “medium” and the sleep interval detection algorithm set as “immobile minutes.” Immobile minutes for sleep onset and end of sleep were set at 10 minutes.
The software scored each epoch as either asleep or awake by evaluating the level of activity compared to the immediate prior and subsequent epochs of activity (±2 min). The threshold value was set to medium (wake threshold value = 40). The medium threshold value has been validated in a previous technical report . If the number of activity movements (count) exceeded the threshold, the epoch was scored as wake. If activity counts fell below or were equal to the threshold, the epoch was scored as sleep .
Overnight attendance in-laboratory polysomnography (PSG) was performed in a university-based research sleep laboratory. The contemporary standard technique was used for the recording and included measurements obtained from the following: electroencephalogram (EEG) central channels (C3-M2, C4-M1) and occipital channels (O1-M2, O2-M1), bilateral electrooculogram (EOG), chin electromyogram (EMG), bilateral tibialis anterior EMG, Lead II electrocardiogram (ECG), nasal air-flow (pressure derived), fingertip pulse oxygen saturation (SpO2), snoring using a PTAF lite pressure transducer sensor, and body position using a body position sensor. The PSG study was performed using the Sandman system (Tyco Healthcare, Colorado, USA). Sleep staging was scored using current American Academy of Sleep Medicine criteria AASM . Each epoch was assigned a stage of sleep or wake on the basis of the EEG, EOG and EMG channels. Respiratory events and arousals were scored according to standard AASM (alternative hypopnoea definition) and the American Sleep Disorders Association criteria ASDA , respectively. The Apnea-Hypopnea index (AHI) was calculated by dividing the total number of apneas and hypopneas by the total sleep time (hours).
As synchronisation of time is critical to accurately compare the device and PSG epochs optimal matching between the “lights off” and “lights on” time agreement was tested a number of times within a ±2 min time range. The peak agreement value was used in the final analysis .
Data Analysis and Statistical Methods
Epoch by epoch sleep/wake agreement.
We evaluated the criterion validity of the Armband and Actiwatch by comparing sleep/wake episodes reported by these devices to the sleep/wake episodes reported by PSG. For each participant we calculated epoch by epoch sleep/wake agreement using the Prevalence and Bias-Adjusted Kappa (PABAK) , sensitivity and specificity. Agreement, sensitivity and specificity calculations were based on results of 2×2 table, where PSG is considered the reference standard and the two portable sleep instruments are considered as index tests.
The PSG and the Actiwatch evaluate individual's sleep in 30 seconds intervals, whereas the Armband evaluates sleep in 60 seconds intervals, called sleep epochs. The Armband's epoch length is calibrated by the manufacturer and could not be altered. Therefore, to compare the 60-second epochs of the Armband to the 30-second epochs of the PSG each Armband's epoch score was harmonised to 60 seconds before the analysis.
Evaluation of sleep parameters.
Sleep parameters (total sleep time TST, sleep onset latency SOL, sleep efficiency SE, wake after sleep onset WASO) estimated by the Armband and Actiwatch described above, were compared to sleep parameters estimated by the PSG (the reference standard measure) in a parallel form of reliability using the intraclass correlation coefficients (ICC 2, 1) with two-way model using single measure and absolute agreement, (reported with 95% confidence intervals (CIs). In addition, scatter plots, regression analyses and Bland and Altman plots were used for comparison purposes. We chose this approach because it is generally agreed that there is no single statistical procedure that adequately covers this issue , . To describe the criterion validity of the continuous sleep parameters we compared the obtained ICC values to the benchmarks proposed by Fleiss for excellent reliability (>0.75), fair to good reliability (0.4 to 0.75) and poor reliability (<0.4) . Finally, to compare the criterion validity of the Armband to that of the Actiwatch we compared the 95% CI of the obtained statistics.
Statistical analyses were conducted using SPSS version 17 (SPSS Inc., Chicago, IL) and MedCalc for Windows, version 126.96.36.199 (MedCalc Software, Mariakerke, Belgium).
Characteristics of study participants
Fifty patients with non-specific LBP participated in the study. The sample's demographic information and clinical description are shown in Table 1. The majority (92%) of the sample had chronic LBP with a mean (SD) pain intensity of 4.12 (1.9) on a 0–10 scale. Twenty-eight participants (56%) were seeking care for their LBP. The sample's mean (SD) weight was 76.7 (20.9) kg, with a body mass index of 25.7 (5.2) kg/m2.
The psychological distress assessment, using the DASS-21, indicated that the majority of participants were within normal level of depression, anxiety and stress. Thirty two (64%) participants scored within normal levels for depression (total DAAS-21 depression subscale <9), 28 (56%) participants scored within normal levels for anxiety (total DAAS-21 anxiety subscale <7) and 27 (54%) participants scored within normal levels for stress (total DAAS-21 stress subscale <14). Likewise, the fatigue assessment showed that 27 (54%) participants had fatigue scores within the normal levels (i.e. total FSS <36). After completing the PSG testing a sleep physician diagnosed 4 (8%) participants with severe obstructive sleep apnea (OSA), 3 (6%) participants with moderate OSA, and 18 (36%) participants with mild OSA. Self-reported sleep measurement showed that 37 (74%) participants had poor sleep quality according to the Pittsburgh Sleep Quality Index PSQI (i.e. >5) , , and 32 (64%) participants had symptoms of clinical insomnia according to the Insomnia Severity Index ISI (i.e. >14), , . Similarly, 38 (76%) participants showed evidence of excessive day-time sleepiness as measured by the ESS (i.e. <10). Two patients used escitalopram, an oral drug used for treating depression and/or generalized anxiety disorder.
For the duration of the PSG recording, all 50 participants wore the Armband, while only 33 participants wore the Actiwatch, due to limited Actiwatch availability. The mean (SD) time spent in bed during the PSG recording was 7.13 (1.2) hrs, with mean (SD) total sleep time of 6.02 (1.0) hrs, mean (SD) sleep onset latency 15.19 (14.2) mins, mean (SD) wake after sleep onset of 47.30 (35.7) mins and overall sleep efficiency of 84.5%.
Epoch by epoch sleep/wake agreement
Table 2 shows the sensitivity, specificity, PABAK, and agreement (proportion and 95% CI) results derived from epoch by epoch comparison between the Armband, Actiwatch and PSG.
The Armband and Actiwatch both had sensitivity (i.e. detecting sleep) of 0.90. Specificity (i.e. detecting being awake) for the Armband and the Actiwatch was 0.54 and 0.67 respectively. Both instruments demonstrated a high level of observed agreement (i.e. detecting both sleep and being awake), 85% for the Armband and 88% for the Actiwatch. The prevalence-and bias-adjusted kappa (PABAK) measurement showed that both instruments have high level of agreement with the PSG in detection of sleep and wake, 0.69 and 0.77 for the Armband and for the Actiwatch, respectively.
Continuous measures of sleep
Descriptive statistics for the continuous measures of sleep parameters derived from the PSG, Armband and Actiwatch, and the ICC values are presented in Table 3. The criterion validity, as reflected in the ICC values, are similar for the Armband and Actiwatch but varied across the sleep parameters from excellent validity for measures of total sleep time, good validity for measures of sleep efficiency and wake after onset to poor validity for sleep onset latency. With exception of a few extreme scores, the scatter plots and regression analyses in Figure 1 are consistent with the ICC analyses; again showing that the two instruments have a similar relationship with PSG, but the strength of the relationship varied substantially across the four continuous sleep measures.
The horizontal axis represents instrument's estimation of sleep parameters: TST, total sleep time; SOL, sleep onset latency; SE, sleep efficiency and WASO, wake after sleep onset. The vertical axis represents these sleep parameters estimated by the reference standard, the PSG. Each square represents data from each participant.
Comparative performance of the two measures
There was no evidence that the Armband had greater criterion validity than the Actiwatch with the 95% CIs for the PABAK and ICC statistics overlapping.
Results from the Bland and Altman plots can be found in the supporting information section (Figure S1). These plots show the agreement between the instruments and the PSG for each sleep parameter by assessing the difference between a PSG sleep parameter and the instrument sleep parameter against the PSG sleep parameter. These plots show similar performance for the two measures.
Both the Armband and actigraph provided valid measures of total sleep time, sleep efficiency and wake after sleep onset but not sleep onset latency. As the Armband does not appear to have superior criterion validity to the actigraph we conclude that the parameters sampled by the Armband do not provide additional accuracy in identifying sleep/wake epochs in the way that they are measured by this device.
To our knowledge, this is the first study to evaluate the validity of actigraphy in detecting sleep/wake in patients with LBP. The study findings are consistent with results from recent systematic reviews that investigated the role of actigraphy in sleep/wake detection for other health conditions , . These reviews have reported that actigraphy is sensitive in detecting sleep episodes, however, wakefulness detection remains somewhat problematic. Additionally, we have confirmed that the estimation of sleep onset latency is a limitation of actigraphy. This limitation may be attributed to the nature of the accelerometry which is based on body mobility detection rather than body physiological changes, as in the case of PSG . Nevertheless, investigation of different types of sleep algorithms with different activity sensitivity may overcome these limitations. For example, a recent study found that lowering the actigraphy threshold to 5 minutes of immobility, rather than the standard 10 minutes, improved the detection of sleep onset latency .
Our study findings suggest that the Armband and the Actiwatch are useful objective tools to assess sleep parameters in patients with LBP (total sleep time, sleep efficiency, and wake after sleep onset). As these instruments are portable we conclude that they are likely to be useful for assessing sleep in a naturalistic setting. If the accurate assessment of sleep onset latency is of primary importance, researchers or clinicians could consider other devices such as the “Sleep Switch” , which has been found to be very strongly associated with sleep onset latency of PSG .
This study had several strengths. It is the first evaluation of the validity of the Armband to assess sleep parameters and the first to evaluate actigraphy in a group of patients with LBP by comparing the instruments to the widely accepted gold standard of sleep/wake detection, PSG. The study sample was recruited from both the community and primary care clinics and therefore forms a sample representative of those seeking care as well as those not currently seeking care for their LBP. Finally, we followed current recommended methods for conducting and analysing portable instruments validation against PSG , .
This study also had some limitations. First, our data were collected in a sleep laboratory setting, and therefore, may not generalize to a home environment. Further research to validate these instruments using a home portable PSG are potentially worthwhile. Second, PSG data and Actiwatch data were collected in 30-sec epochs and the Armband data were collected in 60-sec epochs. This difference may have reduced the potential for agreement for the Armband with the PSG. Third, inspection of the plots (Figure 1) identified several outliers in the data. As these cases may exert undue influence on the results, we conducted a post-hoc sensitivity analysis by removing them and re-running the statistical analyses. However, since this did not change the results, we retained these cases in the analysis. In addition, the analysis showed the 95% confidence intervals are often wide and should also be taken into consideration when interpreting the study findings. For example, the point estimate for the ICC for total sleep time by Actiwatch is 0.80, which is relatively strong (Table 3). However, the lower bound of the 95% CI is 0.46 which is only moderate and reflects some uncertainty with the results. Finally, there are a variety of sleep/wake algorithm modes with different activity sensitivities (i.e. low, medium and high). In this study we used the medium threshold setting, the commonly used threshold . However, we acknowledge that other settings might improve the accuracy of the device. Thus, future research is needed to identify the optimal threshold setting to detect sleep/wake in this group of patients. Further investigation is also needed to assess the accuracy of actigraphy in detecting change (responsiveness) in sleep quality in patients with LBP that might occur following intervention.
Bland and Altman Plots of Difference vs. PSG Score for Sleep Parameters Evaluated by Armband/Actiwatch against PSG. TST, total sleep time; SOL, sleep onset latency; SE, sleep efficiency; WASO, wake after sleep onset.
Conceived and designed the experiments: JM JH SA. Performed the experiments: SA GD RG DB JM. Analyzed the data: SA JM ZM CM GD. Contributed reagents/materials/analysis tools: SA GD JM. Wrote the paper: SA JH JM CM. Obtained funds for the study: JM. Obtained Ethics approval: SM.
- 1. Hoy DG, Bain C, Williams G, March L, Brooks P, et al. (2012) A systematic review of the global prevalence of low back pain. Arthritis Rheum 64: 2028–2037.
- 2. Manchikanti L, Singh V, Datta S, Cohen SP, Hirsch JA, et al. (2009) Comprehensive review of epidemiology, scope, and impact of spinal pain. Pain Physician 12: E35–70.
- 3. Marin R, Cyhan T, Miklos W (2006) Sleep disturbance in patients with chronic low back pain. Am J Phys Med Rehab 85: 430–435.
- 4. Alsaadi SM, McAuley JH, Hush JM, Maher CG (2012) Erratum to: Prevalence of sleep disturbance in patients with low back pain. Eur Spine J 21: 554–560.
- 5. Kelly GA, Blake C, Power CK, O'Keeffe D, Fullen BM (2011) The association between chronic low back pain and sleep: a systematic review. Clin J Pain 27: 169–181.
- 6. van de Water AT, Eadie J, Hurley DA (2011) Investigation of sleep disturbance in chronic low back pain: an age- and gender-matched case-control study over a 7-night period. Man Ther 16: 550–556.
- 7. McCracken LM, Iverson GL (2002) Disrupted sleep patterns and daily functioning in patients with chronic pain. Pain Res Manag 7: 75–79.
- 8. Kaila-Kangas L, Kivimaki M, Harma M, Riihimaki H, Luukkonen R, et al. (2006) Sleep disturbances as predictors of hospitalization for back disorders-A 28-year follow-up of industrial employees. Spine 31: 51–56.
- 9. O'Brien EM, Waxenberg LB, Atchison JW, Gremillion HA, Staud RM, et al. (2011) Intraindividual variability in daily sleep and pain ratings among chronic pain patients: bidirectional association and the role of negative mood. Clin J Pain 27: 425–433.
- 10. Hayden JA, van Tulder MW, Tomlinson G (2005) Systematic review: strategies for using exercise therapy to improve outcomes in chronic low back pain. Ann Intern Med 142: 776–785.
- 11. Freburger JK, Carey TS, Holmes GM, Wallace AS, Castel LD, et al. (2009) Exercise prescription for chronic back or neck pain: who prescribes it? who gets it? What is prescribed? Arthritis Rheum 61: 192–200.
- 12. Silva GE, Goodwin JL, Sherrill DL, Arnold JL, Bootzin RR, et al. (2007) Relationship between reported and measured sleep times: the sleep heart health study (SHHS). J Clin Sleep Med 3: 622–630.
- 13. Ancoli-Israel S, Cole R, Alessi C, Chambers M, Moorcroft W, et al. (2003) The role of actigraphy in the study of sleep and circadian rhythms. Sleep 26: 342–392.
- 14. van de Water ATM, Holmes A, Hurley DA (2011) Objective measurements of sleep for non-laboratory settings as alternatives to polysomnography–a systematic review. J Sleep Res 20: 183–200.
- 15. Sadeh A (2011) The role and validity of actigraphy in sleep medicine: an update. Sleep Med Rev 15: 259–267.
- 16. Martin J, Hakim A (2011) Wrist actigraphy. Chest 139: 1514–1527.
- 17. Germain A, Buysse D, Kupfer D (2006) Preliminary validation of a new device for studying sleep. “SLEEP 2006”-20th Anniversary Meeting of the Associated Professional Sleep Societies (AOSS). Salt Lake City, Utah USA.
- 18. Sunseri M, Liden C, Farringdon J, Pelletier R, Safier S, et al. (2009) The Sensewear Armband as a sleep detection device, BodyMedia internal white paper.
- 19. Soric M, Turkalj M, Kucic D, Marusic I, Plavec D, et al. (2013) Validation of a multi-sensor activity monitor for assessing sleep in children and adolescents. Sleep Med 14: 201–205.
- 20. Peterson B, Chiao P, Pickering E, Freeman J, Zammit G, et al. (2012) Comparison of actigraphy and polysomnography to assess effects of zolpidem in a clinical research unit. Sleep Med 13: 419–424.
- 21. Sharif MM, BaHammam AS (2013) Sleep estimation using BodyMedia's SenseWear(TM) armband in patients with obstructive sleep apnea. Ann Thorac Med 8: 53–57.
- 22. O'Driscoll D, Turton A, Copland J, Strauss B, Hamilton G (2013) Energy expenditure in obstructive sleep apnea: validation of a multiple physiological sensor for determination of sleep and wake. Sleep Breath 17: 139–146.
- 23. O'Donoghue GM, Fox N, Heneghan C, Hurley DA (2009) Objective and subjective assessment of sleep in chronic low back pain patients compared with healthy age and gender matched controls: a pilot study. BMC Musculoskelet Disord 10: 122.
- 24. Harman K, Pivik RT, D'Eon JL, Wilson KG, Swenson JR, et al. (2002) Sleep in depressed and nondepressed participants with chronic low back pain: electroencephalographic and behaviour findings. Sleep 25: 775–783.
- 25. Lavie P, Epstein R, Tzischinsky O, Gilad D, Nahir M, et al. (1992) Actigraphic measurements of sleep in rheumatoid arthritis: comparison of patients with low back pain and healthy controls. J Rheumatol 19: 362–365.
- 26. Bulthuis Y, Vollenbroek-Hutten M, Hermens H, Vendrig L, van Lummel R (2004) Psychological distress, disturbed sleep and physical activity during the night in chronic low-back pain patients. J Back Musculoskelet Rehabil 17: 69–76.
- 27. Oakley N (1997) Validation with polysomnography of the sleepwatch sleep/wake scoring algorithm used by the actiwatch activity monitoring system. Technical Report to Mini Mitter Co, Inc,.
- 28. Mini Mitter Company IAR, Inc. Company (2005) Actiware Software: Actiwatch Instruction Manual Software version 5.0 ed. Oregon, USA: Respironics,.
- 29. Iber C, Ancoli-Israel S, Chesson A, Quan S (2007) The AASM manual for the scoring of sleep and associated events: rules, terminology and technical specifications. Wenchester, IL USA: American Academy of Sleep Medicine. 59 p.
- 30. American Sleep Disorders Association (1992) EEG arousals: scoring rules and examples: a preliminary report from the Sleep Disorders Atlas Task Force of the American Sleep Disorders Association. Sleep 15: 173–184.
- 31. Wang D, Wong KK, Dungan GC 2nd, Buchanan PR, Yee BJ, et al. (2008) The validity of wrist actimetry assessment of sleep with and without sleep apnea. J Clin Sleep Med 4: 450–455.
- 32. Byrt T, Bishop J, Carlin JB (1993) Bias, prevalence and kappa. J Clin Epidemiol 46: 423–429.
- 33. Bland JM, Altman DG (1986) Statistical methods for assessing agreement between two methods of clinical measurement. Lancet 1: 307–310.
- 34. Terwee CB, Bot SDM, de Boer MR, van der Windt DAWM, Knol DL, et al. (2007) Quality criteria were proposed for measurement properties of health status questionnaires. Jo Clin Epidemiol 60: 34–42.
- 35. Fleiss J (1986) The design and analysis of clinical experiments. New York: John Wiley and Sons.
- 36. Buysse DJ, Reynolds CF 3rd, Monk TH, Berman SR, Kupfer DJ (1989) The Pittsburgh Sleep Quality Index: a new instrument for psychiatric practice and research. Psychiatry Res 28: 193–213.
- 37. Backhaus J, Junghanns K, Broocks A, Riemann D, Hohagen F (2002) Test-retest reliability and validity of the Pittsburgh Sleep Quality Index in primary insomnia. J Psychosom Res 53: 737–740.
- 38. Bastien CH, Vallières A, Morin CM (2001) Validation of the Insomnia Severity Index as an outcome measure for insomnia research. Sleep Med 2: 297–307.
- 39. Smith S, Trinder J (2001) Detecting insomnia: comparison of four self-report measures of sleep in a young adult population. J Sleep Res 10: 229–235.
- 40. Lichstein KL, Stone KC, Donaldson J, Nau SD, Soeffing JP, et al. (2006) Actigraphy validation with insomnia. Sleep 29: 232–239.
- 41. Chae KY, Kripke DF, Poceta JS, Shadan F, Jamil SM, et al. (2009) Evaluation of immobility time for sleep latency in actigraphy. Sleep Med 10: 621–625.
- 42. Tryon WW (2004) Issues of validity in actigraphic sleep assessment. Sleep 27: 158–165.
- 43. Hauri PJ (1999) Evaluation of a sleep switch device. Sleep 22: 1110–1117.
- 44. Chae KY, Kripke DF, Poceta JS, Shadan F, Jamil SM, et al. (2009) Evaluation of immobility time for sleep latency in actigraphy. Sleep Med 10: 621–625.