Assessing the Clinical Robustness of Digital Health Startups: Cross-sectional Observational Analysis.

Item request has been placed! ×
Item request cannot be made. ×
loading   Processing Request
Read Online Read More Add to Saved list
  • Additional Information
    • Source:
      Publisher: JMIR Publications Country of Publication: Canada NLM ID: 100959882 Publication Model: Electronic Cited Medium: Internet ISSN: 1438-8871 (Electronic) Linking ISSN: 14388871 NLM ISO Abbreviation: J Med Internet Res Subsets: MEDLINE
    • Publication Information:
      Publication: <2011- > : Toronto : JMIR Publications
      Original Publication: [Pittsburgh, PA? : s.n., 1999-
    • Subject Terms:
      Cross-Sectional Studies*; Child ; Data Collection ; Humans
    • Abstract:
      Background: The digital health sector has experienced rapid growth over the past decade. However, health care technology stakeholders lack a comprehensive understanding of clinical robustness and claims across the industry.
      Objective: This analysis aimed to examine the clinical robustness and public claims made by digital health companies.
      Methods: A cross-sectional observational analysis was conducted using company data from the Rock Health Digital Health Venture Funding Database, the US Food and Drug Administration, and the US National Library of Medicine. Companies were included if they sell products targeting the prevention, diagnosis, or treatment phases of the care continuum. Clinical robustness was defined using regulatory filings and clinical trials completed by each company. Public claims data included clinical, economic, and engagement claims regarding product outcomes made by each company on its website.
      Results: A total of 224 digital health companies with an average age of 7.7 years were included in our cohort. Average clinical robustness was 2.5 (1.8 clinical trials and 0.8 regulatory filings) with a median score of 1. Ninety-eight (44%) companies had a clinical robustness score of 0, while 45 (20%) companies had a clinical robustness score of 5 or more. The average number of public claims was 1.3 (0.5 clinical, 0.4 economic, and 0.4 engagement); the median number of claims was 1. No correlation was observed between clinical robustness and number of clinical claims (r 2 =0.02), clinical robustness and total funding (r 2 =0.08), or clinical robustness and company age (r 2 =0.18).
      Conclusions: Many digital health companies have a low level of clinical robustness and do not make many claims as measured by regulatory filings, clinical trials, and public data shared online. Companies and customers may benefit from investing in greater clinical validation efforts.
      (©Sean Day, Veeraj Shah, Sari Kaganoff, Shannon Powelson, Simon C Mathews. Originally published in the Journal of Medical Internet Research (https://www.jmir.org), 20.06.2022.)
    • Comments:
      Comment in: J Med Internet Res. 2023 Sep 21;25:e41715. (PMID: 37733417)
    • References:
      PLoS One. 2017 Mar 1;12(3):e0173160. (PMID: 28249025)
      Digit Health. 2018 May 10;4:2055207618770861. (PMID: 29942631)
      Support Care Cancer. 2020 Mar;28(3):1469-1479. (PMID: 31273501)
      NPJ Digit Med. 2019 Mar 22;2:18. (PMID: 31304366)
      Evid Based Ment Health. 2019 Feb;22(1):4-9. (PMID: 30635262)
      J Med Internet Res. 2021 Feb 8;23(2):e18773. (PMID: 33555259)
      Cyberpsychol Behav Soc Netw. 2021 Nov;24(11):697-698. (PMID: 34806914)
      Lancet. 2018 Nov 24;392(10161):2263-2264. (PMID: 30413281)
      Headache. 2020 Oct;60(9):1947-1960. (PMID: 32799346)
      Sci Transl Med. 2019 Jun 26;11(498):. (PMID: 31243153)
      Obesity (Silver Spring). 2021 Apr;29(4):654-661. (PMID: 33759385)
      NPJ Digit Med. 2020 May 12;3:68. (PMID: 32411829)
      J Diabetes Sci Technol. 2020 Jan;14(1):165-169. (PMID: 31470739)
      Telemed J E Health. 2013 Jun;19(6):444-54. (PMID: 23697504)
      J Med Internet Res. 2019 Jun 17;21(6):e13166. (PMID: 31210136)
      JAMA Intern Med. 2019 Jun 1;179(6):838-840. (PMID: 30801617)
      Arch Womens Ment Health. 2021 Dec;24(6):881-892. (PMID: 33929636)
      NPJ Digit Med. 2021 Jul 15;4(1):111. (PMID: 34267296)
      J Med Internet Res. 2020 Feb 20;22(2):e16866. (PMID: 32130134)
      Eur J Clin Invest. 2019 Apr;49(4):e13072. (PMID: 30690709)
      Health Aff (Millwood). 2020 Apr;39(4):704-714. (PMID: 32207998)
      Health Aff (Millwood). 2019 Jan;38(1):115-123. (PMID: 30615535)
      J Med Internet Res. 2020 Jun 5;22(6):e15617. (PMID: 32501277)
      NPJ Digit Med. 2019 May 13;2:38. (PMID: 31304384)
      Mayo Clin Proc. 2015 Apr;90(4):469-80. (PMID: 25841251)
    • Contributed Indexing:
      Keywords: digital health; health tech; real-world evidence; software as a medical device (SaaMD); venture capital
    • Publication Date:
      Date Created: 20220620 Date Completed: 20220622 Latest Revision: 20240110
    • Publication Date:
      20240110
    • Accession Number:
      PMC9253972
    • Accession Number:
      10.2196/37677
    • Accession Number:
      35723914