Publications and Results

Digital health technologies (DHTs) are increasingly being adopted in clinical trials, as they enable objective evaluations of health parameters in free-living environments. Although lumbar accelerometers notably provide reliable gait parameters, embedding accelerometers in chest devices, already used for vital signs monitoring, could capture a more comprehensive picture of participants’ wellbeing, while reducing the burden of multiple devices. Here we assess the validity of gait parameters measured from a chest accelerometer. Twenty healthy adults (13 females, mean ± sd age: 33.9 ± 9.1 years) instrumented with lumbar and chest accelerometers underwent in-lab and outside-lab walking tasks, while monitored with reference devices (an instrumented mat, and a 6-accelerometers set). Gait parameters were extracted from chest and lumbar accelerometers using our open-source Scikit Digital Health gait (SKDH-gait) algorithm, and compared against reference values via Bland–Altman plots, Pearson’s correlation, and intraclass correlation coefficient. Mixed effects regression models were performed to investigate the effect of device, task, and their interaction. Gait parameters derived from chest and lumbar accelerometers showed no significant difference and excellent agreement across all tasks, as well as good-to-excellent agreement and strong correlation against reference values, thus supporting the deployment of a single multimodal chest device in clinical trials, to simultaneously measure gait and vital signs.

Article Type:
Research Article
Authors:
Xuemei Cai, Mar Santamaria, Charmaine Demanuele, F. Isik Karahanoglu, Hao Zhang, Andrew Messere, Dimitrios Psaltos, Jessica Selig, Miles Welbourn, Nunzio Camerlingo, Wenyi Lin, Lukas Adamowicz
Publication Date:
17 June 2024

Digital health technologies (DHTs) can collect gait and physical activity in adults, but limited studies have validated these in children. This study compared gait and physical activity metrics collected using DHTs to those collected by reference comparators during in-clinic sessions, to collect a normative accelerometry dataset, and to evaluate participants’ comfort and their compliance in wearing the DHTs at-home.

The MAGIC (Monitoring Activity and Gait in Children) study was an analytical validation study which enrolled 40, generally healthy participants aged 3–17 years. Gait and physical activity were collected using DHTs in a clinical setting and continuously at-home.

Overall good to excellent agreement was observed between gait metrics extracted with a gait algorithm from a lumbar-worn DHT compared to ground truth reference systems. Majority of participants either “agreed” or “strongly agreed” that wrist and lumbar DHTs were comfortable to wear at home, respectively, with 86% (wrist-worn DHT) and 68% (lumbar-worn DHT) wear-time compliance. Significant differences across age groups were observed in multiple gait and activity metrics obtained at home.

Our findings suggest that gait and physical activity data can be collected from DHTs in pediatric populations with high reliability and wear compliance, in-clinic and in home environments.

Article Type:
Research Article
Authors:
Junrui Di, Pirinka Georgiev, Lukas Adamowicz, Wenyi Lin, Hao Zhang, Dimitrios Psaltos, Jessica Selig, F. Isik Karahanoglu, Charmaine Demanuele, Mar Santamaria, Xuemei Cai
Publication Date:
21 March 2024

Wearable accelerometers allow for continuous monitoring of function and behaviors in the participant’s naturalistic environment. Devices are typically worn in different body locations depending on the concept of interest and endpoint under investigation. The lumbar and wrist are commonly used locations: devices placed at the lumbar region enable the derivation of spatio-temporal characteristics of gait, while wrist-worn devices provide measurements of overall physical activity (PA). Deploying multiple devices in clinical trial settings leads to higher patient burden negatively impacting compliance and data quality and increases the operational complexity of the trial. In this work, we evaluated the joint information shared by features derived from the lumbar and wrist devices to assess whether gait characteristics can be adequately represented by PA measured with wrist-worn devices. Data collected at the Pfizer Innovation Research (PfIRe) Lab were used as a real data example, which had around 7 days of continuous at-home data from wrist- and lumbar-worn devices (GENEActiv) obtained from a group of healthy participants. The relationship between wrist- and lumbar-derived features was estimated using multiple statistical methods, including penalized regression, principal component regression, partial least square regression, and joint and individual variation explained (JIVE). By considering multilevel models, both between- and within-subject effects were taken into account. This work demonstrated that selected gait features, which are typically measured with lumbar-worn devices, can be represented by PA features measured with wrist-worn devices, which provides preliminary evidence to reduce the number of devices needed in clinical trials and to increase patients’ comfort. Moreover, the statistical methods used in this work provided an analytic framework to compare repeated measures collected from multiple data modalities.

Article Type:
Research Article
Authors:
Xuemei Cai, F. Isik Karahanoglu, Mar Santamaria, Lukas Adamowicz, Charmaine Demanuele, Dimitrios Psaltos, Junrui Di, Wenyi Lin
Publication Date:
18 October 2023

To assess nocturnal scratching as a concept of interest associated with meaningful aspects of health of patients with AD (adults and children); and to explore patient-centred considerations for novel COAs measuring nocturnal scratch using DHTs.

Article Type:
Research Article
Authors:
Carrie Northcott
Publication Date:
01 July 2023

Digital health technologies (DHTs) present unique opportunities for clinical evidence generation but pose certain challenges. These challenges stem, in part, from existing definitions of drug development tools, which were not created with DHT-derived measures in mind. DHT-derived measures can be leveraged as either clinical outcome assessments (COAs) or as biomarkers since they share properties with both categories of drug development tools. Examples from the literature indicate a variety of applications for DHT-derived data, including capturing disease physiology, symptom tracking, or response to therapies. The distinction between the categorization of DHT-derived measures as COAs or as biomarkers can be very fine, with terminology variability among regulatory authorities. This has significant implications for integration of DHT-derived measures in clinical trials, leading to confusion regarding the evidence required to support these tools' use in drug development. There is a need to amend definitions and create clear evidentiary requirements to support broad adoption of these new and innovative tools. The biopharma industry, the technology sector, consulting businesses, academic researchers, and regulators need a dialogue via multi-stakeholder collaborations to clarify questions around DHT-derived measures, to unify definitions, and to create the foundations for evidentiary package requirements, providing a path forward to predictable results.

Article Type:
Research Article
Authors:
Charmaine Demanuele
Publication Date:
29 April 2023

Traditional clinical trials require tests and procedures that are administered in centralized clinical research sites, which are beyond the standard of care that patients receive for their rare and chronic diseases. The limited number of rare disease patients scattered around the world makes it particularly challenging to recruit participants and conduct these traditional clinical trials. Participating in clinical research can be burdensome, especially for children, the elderly, physically and cognitively impaired individuals who require transportation and caregiver assistance, or patients who live in remote locations or cannot afford transportation. In recent years, there is an increasing need to consider Decentralized Clinical Trials (DCT) as a participant-centric approach that uses new technologies and innovative procedures for interaction with participants in the comfort of their home. This paper discusses the planning and conduct of DCTs, which can increase the quality of trials with a specific focus on rare diseases.

Article Type:
Research Article
Authors:
Charmaine Demanuele
Publication Date:
11 April 2023

This paper examines the use of digital endpoints (DEs) derived from digital health technologies (DHTs), focusing primarily on the specific considerations regarding the determination of meaningful change thresholds (MCT). Using DHTs in drug development is becoming more commonplace. There is general acceptance of the value of DHTs supporting patient-centric trial design, capturing data outside the traditional clinical trial setting, and generating DEs with the potential to be more sensitive to change than conventional assessments. However, the transition from exploratory endpoints to primary and secondary endpoints capable of supporting labeling claims requires these endpoints to be substantive with reproducible population-specific values. Meaningful change represents the amount of change in an endpoint measure perceived as important to patients and should be determined for each digital endpoint and given population under consideration. This paper examines existing approaches to determine meaningful change thresholds and explores examples of these methodologies and their use as part of DE development: emphasizing the importance of determining what aspects of health are important to patients and ensuring the DE captures these concepts of interest and aligns with the overarching endpoint strategy. Examples are drawn from published DE qualification documentation and responses to qualification submissions under review by the various regulatory authorities. It is the hope that these insights will inform and strengthen the development and validation of DEs as drug development tools, particularly for those new to the approaches to determine MCTs.

Article Type:
Research Article
Authors:
Charmaine Demanuele
Publication Date:
05 April 2023

To assess the reliability of wearable sensors for at-home assessment of walking and chair stand activities in people with knee osteoarthritis (OA).

Article Type:
Research Article
Authors:
Pirinka Georgiev, Charmaine Demanuele, Paul Wacnik, Lukas Adamowicz
Publication Date:
03 February 2023

This paper provides considerations for designing and deploying a BYOD model to capture data for clinical studies. These considerations address: (1) early identification and engagement with internal and external stakeholders; (2) study design including informed consent and recruitment strategies; (3) outcome, endpoint, and technology selection; (4) data management including compliance and data monitoring; and (5) statistical considerations to meet regulatory requirements.

Article Type:
Research Article
Authors:
Charmaine Demanuele, Pirinka Georgiev
Publication Date:
04 July 2022

Wearable inertial sensors are providing enhanced insight into patient mobility and health. Significant research efforts have focused on wearable algorithm design and deployment in both research and clinical settings; however, open-source, general-purpose software tools for processing various activities of daily living are relatively scarce. Furthermore, few studies include code for replication or off-the-shelf software packages. In this work, we introduce SciKit Digital Health (SKDH), a Python software package (Python Software Foundation) containing various algorithms for deriving clinical features of gait, sit to stand, physical activity, and sleep, wrapped in an easily extensible framework.

Article Type:
Research Article
Authors:
Lukas Adamowicz, Yiorgos Christakis, Matthew D. Czech, Tomasz Adamusiak
Publication Date:
21 April 2022