Accuracy of Fitbit Charge 4, Garmin Vivosmart 4, and WHOOP Versus Polysomnography: Systematic Review.

Publisher: JMIR Publications Inc Country of Publication: Canada NLM ID: 101624439 Publication Model: Electronic Cited Medium: Internet ISSN: 2291-5222 (Electronic) Linking ISSN: 22915222 NLM ISO Abbreviation: JMIR Mhealth Uhealth Subsets: MEDLINE

Original Publication: Toronto: JMIR Publications Inc., [2013]-

Sleep* ; Wearable Electronic Devices*; Child ; Humans ; Polysomnography ; Reproducibility of Results ; Fitness Trackers

Background: Despite being the gold-standard method for objectively assessing sleep, polysomnography (PSG) faces several limitations as it is expensive, time-consuming, and labor-intensive; requires various equipment and technical expertise; and is impractical for long-term or in-home use. Consumer wrist-worn wearables are able to monitor sleep parameters and thus could be used as an alternative for PSG. Consequently, wearables gained immense popularity over the past few years, but their accuracy has been a major concern.
Objective: A systematic review of the literature was conducted to appraise the performance of 3 recent-generation wearable devices (Fitbit Charge 4, Garmin Vivosmart 4, and WHOOP) in determining sleep parameters and sleep stages.
Methods: Per the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) statement, a comprehensive search was conducted using the PubMed, Web of Science, Google Scholar, Scopus, and Embase databases. Eligible publications were those that (1) involved the validity of sleep data of any marketed model of the candidate wearables and (2) used PSG or an ambulatory electroencephalogram monitor as a reference sleep monitoring device. Exclusion criteria were as follows: (1) incorporated a sleep diary or survey method as a reference, (2) review paper, (3) children as participants, and (4) duplicate publication of the same data and findings.
Results: The search yielded 504 candidate articles. After eliminating duplicates and applying the eligibility criteria, 8 articles were included. WHOOP showed the least disagreement relative to PSG and Sleep Profiler for total sleep time (-1.4 min), light sleep (-9.6 min), and deep sleep (-9.3 min) but showed the largest disagreement for rapid eye movement (REM) sleep (21.0 min). Fitbit Charge 4 and Garmin Vivosmart 4 both showed moderate accuracy in assessing sleep stages and total sleep time compared to PSG. Fitbit Charge 4 showed the least disagreement for REM sleep (4.0 min) relative to PSG. Additionally, Fitbit Charge 4 showed higher sensitivities to deep sleep (75%) and REM sleep (86.5%) compared to Garmin Vivosmart 4 and WHOOP.
Conclusions: The findings of this systematic literature review indicate that the devices with higher relative agreement and sensitivities to multistate sleep (ie, Fitbit Charge 4 and WHOOP) seem appropriate for deriving suitable estimates of sleep parameters. However, analyses regarding the multistate categorization of sleep indicate that all devices can benefit from further improvement in the assessment of specific sleep stages. Although providers are continuously developing new versions and variants of wearables, the scientific research on these wearables remains considerably limited. This scarcity in literature not only reduces our ability to draw definitive conclusions but also highlights the need for more targeted research in this domain. Additionally, future research endeavors should strive for standardized protocols including larger sample sizes to enhance the comparability and power of the results across studies.
(© An-Marie Schyvens, Nina Catharina Van Oost, Jean-Marie Aerts, Federica Masci, Brent Peters, An Neven, Hélène Dirix, Geert Wets, Veerle Ross, Johan Verbraecken. Originally published in JMIR mHealth and uHealth (https://mhealth.jmir.org).)

Biochem Med (Zagreb). 2012;22(3):276-82. (PMID: 23092060)
Brain Sci. 2022 Feb 08;12(2):. (PMID: 35203996)
Sensors (Basel). 2022 Jul 04;22(13):. (PMID: 35808535)
Psychiatr Danub. 2013 Dec;25(4):426-34. (PMID: 24247058)
J Cancer Surviv. 2021 Apr;15(2):273-280. (PMID: 32875536)
Nat Sci Sleep. 2020 Oct 27;12:821-842. (PMID: 33149712)
J Sleep Res. 2020 Dec 2;:e13246. (PMID: 33289237)
J Sleep Res. 2011 Mar;20(1 Pt 2):201-6. (PMID: 20561176)
Behav Res Methods. 2014 Dec;46(4):1032-41. (PMID: 24442593)
Sleep. 2020 Feb 13;43(2):. (PMID: 31641776)
Nat Sci Sleep. 2021 Jun 28;13:885-897. (PMID: 34234595)
Curr Psychiatry Rep. 2015 Mar;17(3):554. (PMID: 25698339)
Sleep. 2015 Sep 01;38(9):1461-8. (PMID: 26158896)
Sensors (Basel). 2016 May 23;16(5):. (PMID: 27223290)
Sleep Med. 2002 Jan;3(1):43-7. (PMID: 14592253)
PLoS One. 2020 Dec 11;15(12):e0243214. (PMID: 33306678)
J Sleep Res. 2006 Sep;15(3):309-16. (PMID: 16911033)
Sensors (Basel). 2022 Aug 22;22(16):. (PMID: 36016077)
Sleep. 2021 May 14;44(5):. (PMID: 33378539)
J Med Internet Res. 2019 Nov 28;21(11):e16273. (PMID: 31778122)
J Sci Med Sport. 2016 Oct;19(10):848-53. (PMID: 26794719)
Curr Diab Rep. 2014 Jul;14(7):507. (PMID: 24816752)
Eur J Public Health. 2023 Apr 1;33(2):242-248. (PMID: 36805658)
BMJ. 2021 Mar 29;372:n71. (PMID: 33782057)
PLoS One. 2022 Oct 18;17(10):e0275287. (PMID: 36256631)
J Sleep Res. 2020 Feb;29(1):e12926. (PMID: 31621129)
Circulation. 2016 Nov 1;134(18):e367-e386. (PMID: 27647451)
J Sleep Res. 2007 Dec;16(4):372-80. (PMID: 18036082)
Sleep Med Rev. 2019 Aug;46:151-160. (PMID: 31154154)
J Sleep Res. 2020 Feb;29(1):e12944. (PMID: 31680327)
Psychiatry Res. 2019 Apr;274:27-29. (PMID: 30776709)
Front Psychol. 2021 Mar 25;12:641451. (PMID: 33841275)
J Family Med Prim Care. 2016 Oct-Dec;5(4):780-784. (PMID: 28348990)
Biosensors (Basel). 2021 Jun 08;11(6):. (PMID: 34201016)
J Sleep Res. 2011 Mar;20(1 Pt 2):183-200. (PMID: 20374444)
Sleep. 2005 Feb;28(2):195-202. (PMID: 16171243)
J Sleep Res. 2009 Mar;18(1):74-84. (PMID: 19250176)
Sleep. 2005 Apr;28(4):499-521. (PMID: 16171294)
Int J Biosens Bioelectron. 2018;4(4):195-202. (PMID: 30906922)
Chronobiol Int. 2018 Jun;35(6):754-758. (PMID: 29750580)
Sleep. 2019 Dec 24;42(12):. (PMID: 31579900)
J Sports Sci. 2020 Nov;38(22):2631-2636. (PMID: 32713257)

Keywords: PRISMA; Preferred Reporting Items for Systematic Reviews and Meta-Analyses; assessing sleep; polysomnography; sleep; validation; wearable device

Date Created: 20240401 Date Completed: 20240403 Latest Revision: 20240412

20240412

PMC11004611

10.2196/52192

38557808