Approaches to generating graphical user interface indicators based on evaluations of wearable device-related activity

Abstract

A platform for dynamically generating a visual scheme of a graphical user interface to indicate compliance with study requirements is disclosed herein. The platform can receive device data corresponding to a first time period. The platform can generate a first compliance indicator associated with a first data type of the device data. The platform can generate a second compliance indicator associated with a second data type of the device data. The platform can generate a third compliance indicator associated with a third data type of the device data. The platform can generate an overall compliance indicator based on the first, second, and third compliance indicators. The platform can generate a first visual representation of the overall compliance indicator in a first color or in a second color based on the value of the overall compliance indicator.

Description

Atorney Docket No. 124824.8139.WO01APPROACHES TO GENERATING GRAPHICAL USER INTERFACE INDICATORS BASED ON EVALUATIONS OF WEARABLE DEVICE-RELATED ACTIVITYCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims priority to US Provisional Application No. 63 / 701 ,478, titled “Approaches to Generating Graphical User Interface Indicators Based on Evaluating Wearable Device-Related Activities” and filed on September 30, 2024, which is incorporated by reference herein in its entirety.TECHNICAL FIELD

[0002] Various embodiments concern computer programs and associated computer-implemented techniques for generating graphical user interface indicators associated with wearable device-related activity.BACKGROUND

[0003] Clinical studies are useful for evaluating the efficacy and safety of health treatments, such as pharmaceutical drugs, medical devices, surgical procedures, behavioral therapies, and preventative measures including vaccines. Participants of such studies can be selected based on specific inclusion and exclusion criteria to ensure that study results are applicable to a target population. For example, participants can be selected to have particular attributes, including age, gender, medical history, current health status, and / or specific biomarkers. By carefully selecting participants, researchers can control for variables that can confound the study’s results, thereby enhancing the validity and generalizability of the findings. Throughout the study, participants can be required to follow particular protocols, including medication administration requirements, regular check-ups, and / or the completion of questionnaires or studies.

[0004] The quality of a clinical study (e.g., for evaluating the efficacy of a particular health treatment) can be influenced by the compliance associated with the participants of the study. For example, an administrator (e.g., a clinical research coordinator) associated with a clinical study manually monitors compliance with user activityAtorney Docket No. 124824.8139.WO01 requirements and / or other related protocols for a particular study. For example, an administrator reads complex participant data, compares such data with the study’s compliance requirements, and determines whether a particular user is compliant with such requirements. In some cases, an administrator can follow up with clinical study participants using phone calls, emails, or text messages to encourage compliance with study requirements and / or intervene in cases of unsatisfactory compliance. To illustrate, a clinical research coordinator manually calls a participant of a study upon receiving information that the participant has not completed a required activity of the study (e.g., via an activity log provided by the user).BRIEF DESCRIPTION OF THE DRAWINGS

[0005] Figure 1 illustrates a network environment that includes a compliance evaluation platform that is executed by a computing device.

[0006] Figure 2A illustrates an example of a computing device that is able to implement a compliance evaluation platform that is designed to generate graphical indicators of compliance based on activity data associated with a computing device.

[0007] Figure 2B illustrates an example of a system architecture representing a compliance evaluation platform that is designed to generate graphical indicators of compliance based on activity data associated with a computing device.

[0008] Figure 3 depicts an example of a communication environment that includes a compliance evaluation platform that is configured to receive several types of data.

[0009] Figure 4 depicts another example of a communication environment that includes a compliance evaluation platform that is configured to receive several types of data.

[0010] Figure 5 includes a schematic diagram of an approach to generating graphical indicators of compliance based on activity data associated with a computing device.

[0011] Figure 6 includes an illustration of a graphical user interface (GUI) for graphically encoding user-specific compliance information based on activity data associated with a corresponding computing device.Atorney Docket No. 124824.8139.WO01

[0012] Figure 7 includes an illustration of a GUI for graphically encoding userspecific compliance information including indicators of compliance with particular compliance requirements associated with a corresponding computing device.

[0013] Figure 8 includes an illustration of a GUI for graphically encoding userspecific compliance information in response to user interaction with time period-specific indicators.

[0014] Figure 9 includes a schematic diagram of a flow for generating compliance indicators associated with a computing device for particular time intervals.

[0015] Figure 10 includes a schematic diagram of a flow for generating compliance indicators for particular humans based on data from a computing device.

[0016] Figure 11 includes a schematic diagram of a flow for generating visual representations of data type-specific and overall compliance indicators based on data from a computing device.

[0017] Figure 12 includes a block diagram of a processing system in which at least some operations described herein can be implemented.DETAILED DESCRIPTION

[0018] Healthcare tracking applications enable administrators of clinical studies to track health-related indicators, measures, and events over time associated with study participants. For example, healthcare tracking applications may receive information from heart rate sensors, location sensors, and health records. Health tracking applications may include applications that enable humans to record health-related activities, such as athletic events or exercises, as well as corresponding times. In some cases, health tracking applications enable users to log their weights, heights, or other biometric information. Traditionally, health tracking applications enable users to view details regarding these activities over time, as well as basic analytics regarding the nature of these activities.

[0019] For example, clinical researchers can leverage healthcare tracking applications to perform studies on the efficacy of particular healthcare treatments, such as medications, therapies, or diets. Such applications can track information provided by a human and / or associated with a corresponding user device to suggest and monitor activities performed by the human, medication administration, or other such informationAtorney Docket No. 124824.8139.WO01 associated with one or more users, which may be analyzed and used to evaluate particular therapies or data within suitable clinical trials. As such, healthcare tracking applications can improve human health by enabling clinical research into physical training, medications, dieting, or other clinically significant indicators. However, the effectiveness of using healthcare tracking applications within clinical trials depends on consistent compliance with the parameters of a given clinical study for accurate evaluation and analysis of the associated data across a variety of humans.

[0020] To illustrate, humans associated with a health tracking application can be associated with particular treatment plans associated with the requirements of a particular clinical study (e.g., as determined by a principal investigator and enforced by clinical research coordinators). For example, a human within a clinical study is assigned a set of required actions or activities to be performed at a particular frequency or at specific times. Conventional health tracking applications enable a user to input or log performed actions or activities for evaluation of compliance. However, such systems can struggle to ingest data from homogeneous sources (e.g., beyond a users’ inputs) to determine compliance with the set of required actions or activities. In other words, in conventional systems, information relating to the users’ activities may be limited to that provided by the user (e.g., via a particular platform or application programming interface). However, such platforms do not enable the efficient and seamless assimilation of complex data from a variety of sources, such as information from wearable device (e.g., smartwatches) for evaluation of compliance with the set of required actions or activities assigned to the associated user.

[0021] For example, a wearable device, such as a smartwatch, can provide information relating to a users’ daily activities and / or engagement, such as based on the number of synchronization events between the device and an associated server system during given time periods. However, data originating from the smartwatch can be complex and time-consuming to analyze and evaluate. In some cases, such data is not in a human-readable format. Furthermore, data from a given wearable device may not easily be linked to the associated participants, thereby requiring manual review and association of data from devices with identifiers of the associated participants. In studies with significant numbers of participants (e.g., hundreds, thousands, or millions), such manual review becomes intractable and time-consuming. As such, traditional compliance monitoring systems that rely on manual review of compliance data can failAtorney Docket No. 124824.8139.WO01 to intervene to encourage compliance with the study’s protocol (e.g., via phone calls or other similar notification methods) in a timely and effective manner.

[0022] Furthermore, in pre-existing compliance monitoring systems for clinical studies, information relating to compliance is not effectively portrayed to clinical research coordinators or other administrative entities. For example, while manually generated information identifying particular participants with unsatisfactory compliance can be generated, such information fails to provide effective information relating to the nature of the lack of compliance, as well as its history or extent. For example, preexisting systems do not provide temporally resolved information relating to which particular activities or tasks are deficient for given participants or users, in a scalable manner. Furthermore, any information provided does not effectively communicate temporal information relating to compliance, as compliance can differ with respect to a variety of parameters, times, and users. Furthermore, any provided information can be overly complicated (e.g., include more than two or three color schemes or parameters). As such, clinical research coordinators do not receive sufficient information, in an easy- to-digest form, to enable targeted compliance monitoring and intervention.

[0023] Dynamic study compliance rules that depend on different users (e.g., depending on the study associated with a particular user) signify that a human cannot practically, in a scalable manner, evaluate compliance of a large set of users if requirements or compliance changes over time, or if different parameters are significant for different users or studies. Integration of device data (e.g., associated with wearable devices) with user data can complicate the compliance evaluation process, as the system can struggle to handle large volumes of data in a manner that adapts to varying compliance criteria for different users and / or different studies.

[0024] The compliance evaluation platform disclosed herein enables automated and intelligent data processing (e.g., from wearable device data) and compliance assessment to ensure accurate and timely interventions for humans within clinical studies. For example, the compliance evaluation platform can receive device data associated with a first time period, where such device data includes wearing time data (e.g., data associated with times at which the wearable device is worn by a given human), synchronization data (e.g., including times at which data associated with the wearable device is synchronized with a server system enabling compliance monitoring),Atorney Docket No. 124824.8139.WO01 and survey input data (e.g., including indications of surveys completed by humans within a particular study). Based on such received data, the compliance evaluation platform can retrieve a compliance requirement associated with the human, such as a set of required activities (e.g., a frequency thereof). Based on such requirements, the compliance evaluation platform can process the device data to generate a compliance value associated with a compliance requirement, such as a frequency of device synchronization events for a particular user. The compliance evaluation platform can determine whether this compliance value is consistent with the associated compliance requirement (e.g., a frequency of synchronization events reaches a threshold for a required number of synchronization events associated with a particular clinical study).

[0025] In some implementations, the compliance evaluation system determines whether the human is in compliance with a given requirement based on a variety of data (e.g., from different sources, including one or more wearable devices and / or user devices) associated with the human. For example, the compliance evaluation system receives information from a smartwatch (e.g., watch synchronization data), a smartphone (sleep / wake data), and a computer application (e.g., user survey data) to determine an overall compliance with compliance requirements. As such, the compliance evaluation system enables assimilation of data from a variety of data sources and of differing data formats, thereby improving the resilience and scalability of compliance evaluation (e.g., to handle clinical studies necessitating technologically complex compliance requirements).

[0026] Based on such a determination, the compliance evaluation platform can determine whether the human is compliant with the compliance requirement within the associated time period and determine a color scheme with which to display a representation of whether the human satisfies the particular compliance requirement. For example, the compliance evaluation platform can generate an icon of a particular color (e.g., yellow or green) on a graphical user interface accessible to a clinical research coordinator depending on the compliance status of a particular human. The icon can be associated with a particular time period for compliance (e.g., a week or a day associated with the compliance requirement), thereby enabling a graphical, easy- to-understand representation of compliance associated with the user.Atorney Docket No. 124824.8139.WO01

[0027] For example, the compliance evaluation platform determines that a human satisfies a particular compliance requirement (e.g., associated with a device synchronization event); based on such a determination, the compliance evaluation system generates a green icon in the shape of a symbol associated with a synchronization event (e.g., the shape of a watch) within a graphical user interface accessible to a clinical research coordinator or a similar entity. The compliance evaluation system can generate the icon within a region of the GUI that is associated with a time period associated with the compliance determination (e.g, within a day or week view on a calendar). Additionally or alternatively, the compliance evaluation system determines that a human does not satisfy a particular compliance requirement (e.g., associated with the device synchronization event). Based on such a determination, the compliance evaluation system generates a yellow icon in the shape of the symbol associated with a synchronization event within a graphical user interface accessible to a clinical research coordinator or a similar entity, within the associated region of the GUI for the respective time period. The compliance evaluation system can select the color scheme from a choice of two possible schemes to ensure the simplicity and comprehensibility of generated icons or other visual cues.

[0028] Based on such information, the compliance evaluation platform enables intervention in humans associated with a clinical study (e.g., where the platform determines that the human is not compliant with the associated compliance requirements). For example, the compliance evaluation platform enables a clinical research coordinator to evaluate and / or describe any deficiencies in compliance of a particular human. For example, the compliance evaluation platform enables identification of user information associated with deficient compliance records, including names, contact information, and / or demographic information associated with the study participant. By doing so, the compliance evaluation platform enables initiation of a communication with a human determined to be non-compliantwith a study’s compliance requirements, thereby enabling prompt interventions to improve future compliance of the participant with the study and improving any results associated with the study.

[0029] Such technical features associated with the compliance evaluation platform offer several technical benefits and innovations that enhance the management and monitoring clinical studies. For example, the platform enables automated data integration of data from various sources efficiently and in a scalable manner, therebyAtorney Docket No. 124824.8139.WO01 enabling prompt interventions on a timescale at which the behavior of participants can be altered. For example, by handling large volumes of heterogeneous data, the platform is scalable to accommodate clinical studies with growing numbers of participants and / or with different compliance requirements (e.g., thereby enabling compliance monitoring based on a variety of types of device data of heterogeneous sources). Furthermore, the platform provides real-time or timely compliance assessments that enable timely interventions. For example, clinical research coordinators can quickly identify non- compliant participants and take necessary actions to ensure adherence to study protocols in a dynamic, concurrent manner (e.g., prior to the end of the study).

[0030] By providing an easy-to-understand GUI that presents temporal information associated with compliance with a pair of color schemes, the compliance evaluation platform enables effective presentation of compliance-related data in a simple manner, enabling quick and efficient compliance monitoring. Moreover, by facilitating efficient communication between clinical research coordinators and study participants by enabling the identification and linking of contact information and participant data to the participants’ associated devices, the platform provides tools for initiating timely interventions. As such, the disclosed compliance evaluation platform enables real-time compliance monitoring using a user-friendly interface that enhances the efficiency and effectiveness of clinical research-related tasks, thereby contributing to improved health outcomes.Terminology

[0031] References in the present disclosure to “an embodiment” or “some embodiments” means that the feature, function, structure, or characteristic being described is included in at least one embodiment. Occurrences of such phrases do not necessarily refer to the same embodiment, nor do they necessarily refer to alternative embodiments that are mutually exclusive of one another.

[0032] The term “based on” is to be construed in an inclusive sense rather than an exclusive sense. That is, in the sense of “including but not limited to.” Thus, the term “based on” is intended to mean “based at least in part on” unless otherwise noted.

[0033] The terms “connected,” “coupled,” and variants thereof are intended to include any connection or coupling between two or more elements, either direct orAtorney Docket No. 124824.8139.WO01 indirect. The connection or coupling can be physical, logical, or a combination thereof. For example, elements may be electrically or communicatively connected to one another despite not sharing a physical connection.

[0034] The term “module” may refer broadly to software, firmware, hardware, or combinations thereof. Modules are typically functional components that generate one or more outputs based on one or more inputs. A computer program may include or utilize one or more modules. For example, a computer program may utilize multiple modules that are responsible for completing different tasks, or a computer program may utilize a single module that is responsible for completing multiple tasks.

[0035] When used in reference to a list of items, the word “or” is intended to cover all of the following interpretations: any of the items in the list, all of the items in the list, and any combination of items in the list.Overview of the Compliance Evaluation Platform

[0036] Figure 1 illustrates a network environment 100 that includes a compliance evaluation platform 102 that is executed by a computing device 104. An individual (also referred to as a “user” or a “human”) can interact with the compliance response platform 102 via interfaces 106. For example, a patient, a study participant, and / or a clinical research coordinator can access an interface through which information regarding wearable device usage and other information related to compliance can be reviewed. As another example, a healthcare professional can access an interface through which information regarding patients, such as blood sugar levels, heart-rate information, biometric information (e.g., height and weight), or activity information (e.g., fitness or therapeutic procedures carried out by the human) can be reviewed. Additionally or alternatively, a study participant can access an interface through which information relating to the study can be input (e.g., via a portal and / or associated electronic surveys). In some implementations, the interfaces 106 enable individuals, such as clinical research coordinators, to communicate directly with participants associated with the study or healthcare professionals (e.g., through a peripheral, such as a keyboard or a mouse). Depending on the nature of the individual accessing the interfaces 106, the interfaces 106 can allow for examination of outputs produced by the compliance evaluation platform 102 and management of preferences. Some interfaces may be configured to facilitate interactions between patients, study participants, clinicalAtorney Docket No. 124824.8139.WO01 research coordinators, and healthcare professionals, while other interfaces can be configured to serve as informative and / or interactive dashboards for patients, clinical research coordinators, or healthcare professionals.

[0037] The data obtained by the compliance evaluation platform 102 can be associated with the individual accessing the interfaces 106 or some other person (e.g., users of associated wearable devices). Additionally or alternatively, the interfaces can enable an individual to view or pose questions associated with another person. In such embodiments, the individual may be a healthcare professional or a clinical research coordinator who is responsible for monitoring, managing, or treating the other person. Examples of healthcare professionals include physicians, nurses, dietitians, and the like.

[0038] As shown in Figure 1 , the compliance evaluation platform 102 can reside in a network environment 100. Thus the computing device 104 on which the compliance evaluation platform 102 resides can be connected to one or more networks 108A-B. Depending on its nature, the computing device 104 could be connected to a personal area network (PAN), local area network (LAN), wide area network (WAN), metropolitan area network (MAN), or cellular network. For example, if the computing device 104 is a computer server, then the computing device 104 can be accessible to users via respective mobile phones that are connected to the internet via LANs. The device data, compliance requirements, compliance values, and / or other information can be generated by the respective mobile phones or acquired by the respective mobile phones.

[0039] Additionally or alternatively, the computing device 104 can be connected to one or more other computing devices over a short-range wireless connectivity technology, such as Bluetooth®, Near Field Communication (NFC), Wi-Fi® Direct (also referred to as “Wi-Fi P2P”), and the like. As an example, the compliance evaluation platform 102 could be embodied as a mobile application that is executed by a mobile phone. In some embodiments, the mobile phone may be communicatively connected — via a wireless communication channel — to a source from which to acquire relevant content, healthcare information, study information, participant information, and / or compliance information. The source could be a server, and / or other devices (e.g., that can provide physiological information, such as watches, fitness trackers, or otherAtorney Docket No. 124824.8139.WO01 wearable computing devices, such as portable electronic blood sugar monitors). The content (e.g., compliance, study, or healthcare-related data) can be alternatively obtained from another computer program executing on the mobile device. Additionally or alternatively, the content can be acquired from databases and / or servers that are communicably linked to the computing device 104 (e.g., through a network). For example, the computing device 104 can communicate with databases or servers storing updated healthcare information or study requirements.

[0040] The interfaces 106 can be accessible via a web browser, desktop application, mobile application, or another form of a computer program. For example, a clinical research coordinator may be able to access interfaces (e.g., graphical user interfaces (GUIs)) through which information relating to studies’ participants, such as compliance information, participant demographic data, and / or the participant-related health measurements, is provided by a mobile application executing on a mobile device. Accordingly, the interfaces 106 generated by the compliance evaluation platform 102 may be accessible on various computing devices, including mobile phones, tablet computers, desktop computers, and the like.

[0041] Generally, the compliance evaluation platform 102 is executed — at least partially — by a cloud computing service operated by, for example, Amazon Web Services®, Google Cloud Platform™, or Microsoft Azure®. Thus, the computing device 104 may be representative of a computer server that is part of a server system 110. Often, the server system 110 is comprised of multiple computer servers. These computer servers can include different types of data (e.g., compliance data, survey results, wearable device data, participant information, and the like), algorithms for processing incoming data, and other assets. Those skilled in the art will recognize that these data could also be distributed among the server system 1 10 and one or more computing devices. As an example, data that is input by, or related to, patients may be stored on, and processed by, their own computing devices for security or privacy purposes.

[0042] Components of the compliance evaluation platform 102 can also be hosted locally. That is, the compliance evaluation platform 102 can reside on the computing device used to access one of the interfaces 106. For example, the compliance evaluation platform 102 can be embodied as a mobile application executing on a mobileAtorney Docket No. 124824.8139.WO01 phone as mentioned above. Note, however, that the mobile application may be communicatively connected to the server system 110 on which other components of the compliance evaluation platform 102 are hosted.

[0043] Figure 2A illustrates an example of a computing device 200 that is able to implement a compliance evaluation platform 212 that is designed to analyze and evaluate heterogeneous data for compliance determination, presentation, and participant interference. As shown in Figure 2A, the computing device 200 can include a processor 202, memory 204, display mechanism 206, communication module 208, and sensor suite 210. Each of these components is discussed in greater detail below. Additionally or alternatively, the generation module 214, the computation module 216, the analytics module 218, and / or the GUI module 220 are housed in one or more other devices or components associated with the computing device 200, including within peripheral and / or external memory devices or within other suitable media. In some implementations, the modules of the compliance evaluation platform 212 are each stored in a decentralized manner (e.g., across various devices).

[0044] Those skilled in the art will recognize that different combinations of these components may be present depending on the nature of the computing device 200. For example, if the computing device 200 is a computer server that is part of a server system (e.g., the server system 110 of Figure 1 ), then the computing device 200 may not include the display mechanism 206 or sensor suite 210. Conversely, if the computing device 200 is a mobile phone, then the computing device 200 can include the display mechanism 206 and sensor suite 210.

[0045] The computing device 200 on which the compliance evaluation platform 212 resides may not include sensors in some embodiments. In such embodiments, the data accessed by the compliance evaluation platform 212 could instead be generated by one or more sensors 222A-N that are external to the computing device 200. For example, the computing device 200 may be a mobile phone, and the sensors 222A-N may be included in a watch or fitness tracker that is communicatively connected to the computing device 200.

[0046] The processor 202 can have generic characteristics similar to general- purpose processors, or the processor 202 may be an application-specific integrated circuit (ASIC) that provides control functions to the computing device 200. As shown inAtorney Docket No. 124824.8139.WO01Figure 2A, the processor 202 can be coupled to all components of the computing device 200, either directly or indirectly, for communication purposes.

[0047] The display mechanism 206 can be any mechanism that is operable to visually convey information to a user. For example, the display mechanism 206 can be a panel that includes light-emitting diodes (LEDs), organic LEDs, liquid crystal elements, or electrophoretic elements. As further discussed below, outputs produced by the compliance evaluation platform 212 (e.g., through execution of its modules) can be posted to the display mechanism 206 for review by a user of the computing device 200.

[0048] The communication module 208 may be responsible for managing communications external to the computing device 200. The communication module 208 can be wireless communication circuitry that is able to establish wireless communication channels with other computing devices. Examples of wireless communication circuitry include 2.4 gigahertz (GHz) and 5 GHz chipsets compatible with Institute of Electrical and Electronics Engineers (IEEE) 802.11 - also referred to as “Wi-Fi chipsets.” Alternatively, the communication module 208 may be representative of a chipset configured for Bluetooth, NFC, and the like. Some computing devices - like mobile phones, tablet computers, and the like - are able to wirelessly communicate via separate channels, while other computing devices - like watches and fitness trackers - tend to wirelessly communicate via a single channel. Accordingly, the communication module 208 may be one of multiple communication modules implemented in the computing device 200, or the communication module 208 may be the only communication module implemented in the computing device 200.

[0049] The nature, number, and type of communication channels established by the computing device 200 - and more specifically, the communication module 208 - can depend on (i) the sources from which data is received by the compliance evaluation platform 212 and (ii) the destinations to which data is transmitted by the compliance evaluation platform 212. Assume, for example, that the compliance evaluation platform 212 resides on a mobile phone in the form of a mobile application. In such embodiments, the communication module 208 can communicate with sensors 222A-N external to the computing device 200 from which to obtain data. Moreover, the communication module 208 may communicate with a server system (e.g., server system 110 of Figure 1 ) to which analyses of the data - or the data itself - are transmitted.Atorney Docket No. 124824.8139.WO01

[0050] Often, various sensors are implemented in the computing device 200. Collectively, these sensors may be referred to as the “sensor suite” 210 of the computing device 200. For example, the computing device 200 may include a motion sensor whose output is indicative of motion of the computing device 200 as a whole. Examples of motion sensors include accelerometers and gyroscopes. In some embodiments, the motion sensor is implemented in an inertial measurement unit (IMU) that measures the force, angular rate, or orientation of the computing device 200. The IMU may accomplish this through the use of one or more accelerometers, one or more gyroscopes, one or more magnetometers, or any combination thereof. As specific examples, the IMU could be a 6-axis IMU that draws low current and therefore is suitable for “always-on” applications in battery-driven computing devices, or the IMU could be a 3-axis IMU that includes logic-level shifting circuitry that can readily interface with a microcontroller. As another example, the computing device 200 may include an ambient light sensor whose output is indicative of the amount of light in the ambient environment.

[0051] As mentioned above, data could also be acquired from sensors 222A-N that are external to the computing device 200. These sensors 222A-N could be included in another computing device, such as a watch or fitness tracker, that is directly connected to the computing device 200. Alternatively, these sensors 222A-N could be discrete sensing units that are directly or indirectly connected to the computing device 200. For example, sensor 222A may be a pulse oximeter that monitors the oxygen saturation of the user of the computing device 200 or another person, for the purpose of creating a photoplethysmogram (PPG). To monitor the oxygen saturation, sensor 222A may be placed on a thin part of a living body, usually a fingertip or earlobe, and then pass two wavelengths of light through that body part toward a photodetector. The photodetector can measure the changing absorbance at each wavelength, allowing sensor 222A to determine the absorbances due to the pulsing of arterial blood through that body part.

[0052] For convenience, the compliance evaluation platform 212 is referred to as a computer program that resides within the memory 204. However, the compliance evaluation platform 212 could be comprised of software, firmware, or hardware that is implemented in, or accessible to, the computing device 200. In accordance with embodiments described herein, the compliance evaluation platform 212 can include aAtorney Docket No. 124824.8139.WO01 data ingestion module 214, computation module 216, analytics module 218, and graphical user interface (GUI) module 220. These modules could be integral parts of the compliance evaluation platform 212, or these modules could be logically separate from the compliance evaluation platform 212 but operate “alongside” it. One or more modules associated with the compliance evaluation platform 212 can reside on one or more servers communicably linked to the computing device 200. Together, these modules enable the compliance evaluation platform 212 to dynamically evaluate realtime compliance data from heterogeneous data sources associated with participants of clinical studies to improve the efficacy of interventions in participant behavior. As mentioned above, the given individual could be the user of the computing device 200 or another person.

[0053] The data ingestion module 214 can be responsible for data retrieval (e.g., wearable device data retrieval and / or compliance data retrieval and processing), thereby facilitating the determination and visualization of compliance indicators on a GUI accessible to managers, such as clinical research coordinators. For example, the data ingestion module may retrieve activity data, synchronization events, and / or other relevant activity data from a participant’s computing device, such as a wearable device, as well as compliance requirement data (e.g., associated with the requirements of a particular study associated with the participant of the computing device). As such, the data ingestion module 214 enables the compliance evaluation platform 212 to retrieve sufficient data to evaluate the compliance of users associated with a particular study (e.g., based on data originating from associated wearable devices of the user).

[0054] The computation module 216 (e.g., also called a “computation system”) can be responsible for the analysis or computation of data associated with participants (e.g., of different studies) to evaluate compliance of the participants with any requirements associated with such studies. For example, the computation module 216 generates or calculates processed data based on information associated with the study participants, such as device usage metrics, synchronization events, or other suitable processed data. In some implementations, the computation module 216 assimilates data from a variety of sources and of a variety of formats (e.g., survey data associated with a participant via a transmission to a server associated with the study). By doing so, the computation module 216 enables analytics for data associated with study participants, therebyAtorney Docket No. 124824.8139.WO01 improving the usability and applicability of data in order to determine whether the participants of the studies are compliant with any requirements of the given studies.

[0055] The analytics module 218 can implement one or more programs in sequence. For example, the analytics module 218 can receive (e.g., via the network environment 100) As such, the analytics module 218 can determine whether the processed data (e.g., of the computation module 216) indicates that a particular participant is compliant within a particular time period with any requirements of associated studies. For example, the analytics module 218 receives preprocessed measurement values from the computation module derived from activity data collected from the participants’ computing devices. The analytics module can compare the measurement values to threshold values for each predetermined time interval and determine whether the participant’s activity data meets the compliance requirements. For each time interval, the analytics module can generate a compliance status indicator based on the results of the comparison, thereby enabling configuration of the associated graphical user interface based on a color scheme assigned to the given compliance status indicator.

[0056] The GUI module 220 can be responsible for generating interfaces (e.g., the interfaces 106 of Figure 1 ) that are viewable on the display mechanism 206 and / or displays associated with other devices communicably coupled to the computing device. Various types of information can be presented on these interfaces. For example, the GUI is responsible for the display of generated compliance data based on the results of the analytics module 218. The GUI can be configured to provide managers, such as clinical research coordinators, with information relating to the compliance of study participants. The GUI can receive compliance indicators and display configurations (e.g., color schemes) associated with the compliance indicators. Based on such configurations, the compliance evaluation platform 212 can cause display of such compliance indicators by generating associated graphical representations accessible to the manager, thereby enabling the manager to initiate communications to improve participant compliance.

[0057] Figure 2B illustrates an example of a system architecture 250 representing a compliance evaluation platform that is designed to generate graphical indicators of compliance based on activity data associated with a computing device. For example,Atorney Docket No. 124824.8139.WO01 the compliance evaluation platform disclosed herein enables users 252 to access an application (e.g., the user access application 254) to verify an authentication access token 256 and / or communicate with the users via the communication module 256. In some implementations, the user access application 254 enables user access to the GUI configuration module 260, which in turn enables access to secure data from a compliance metric database 262. Additionally or alternatively, data associated with the compliance metric database 262 can be stored within the query database 274.

[0058] In some implementations, the user access application 254 leverages a load balancer 264 to access an API gateway 266, thereby enabling access to study data 268 and / or other information associated with a study authorization server 270. For example, the study data 268 is accessible to users via the GUI configuration module 260 and / or the study authorization server 270. In some implementations, the study authorization server 270 accesses a cloud database 272, a query database 274 and / or the sensor suite 276, enabling storage of pertinent information within the data storage server 278.

[0059] As such, modules, applications, servers, and / or other suitable components of the system architecture 250 of Figure 2B can be associated with and / or reside on one or more of components associated with the computing device 200 of Figure 2A, including one or more modules of the compliance evaluation platform 212 (e.g., the generation module 214, the computation module 216, the analytics module 218, the GUI module 220, the communication module 208, and / or the sensor(s) 222A-222N). Thus, the computing device 200 of Figure 2A can include, span, use, or leverage one or more devices, servers, or other suitable components (e.g., across a distributed system, cloud system, individual devices, and / or a combination thereof).

[0060] Figure 3 depicts an example of a communication environment that includes a compliance evaluation platform 302 that is configured to receive several types of data. Here, for example, the compliance evaluation platform 302 receives compliance requirement data 304 or device data, including first sensor data 306 that is generated by a first sensor (e.g., sensor 222A of Figure 2A), and / or second sensor data 308 that is generated by a second sensor (e.g., sensor 222B of Figure 2A). Those skilled in the art will recognize that these data have been selected for the purpose of illustration. Other types of data, such as survey data (e.g., including indications of data entry events,Atorney Docket No. 124824.8139.WO01 treatment regimen compliance, etc.), could also be obtained by the compliance evaluation platform 302.

[0061] These data may be obtained from multiple sources.

[0062] Consider device data, such as the first sensor data 306 or the second sensor data 308, for example. The device could be obtained directly on the computing device on which the compliance evaluation platform 302 is executing. For example, if the compliance evaluation platform 302 is implemented on a mobile phone in the form of a mobile application, the device data may be representative of input provided by an individual through interfaces generated by the mobile application (e.g., survey results associated with related studies). Alternatively, the device could be obtained from another computing device (e.g., from a wearable device via an API or another suitable connection or interface). Referring again to the aforementioned example in which the compliance evaluation platform 302 is implemented as a mobile application executing on a mobile phone, the mobile phone could obtain the device data from a server system (e.g., server system 110 of Figure 1). In some implementations, the query data 304 may include information relating to health-related events or wearable device-related events, such as smartwatch synchronization events with an associated server, heart-rate data associated with the wearable device, messages sent by a given human, logged medications, learning contents completed, meal / exercise / mood / weight / medication information submitted by the human, clinical readings completed and sent by an associated healthcare provider, laboratory test results and / or surveys submitted by the human. The server system may manage a data store in which queries submitted by an individual are documented.

[0063] As mentioned above, sensor data could be obtained from sensors included in the computing device that is responsible for executing the compliance evaluation platform 302, or sensor data could be obtained from sensors that are external to the computing device that is responsible for executing the compliance evaluation platform 302. Thus, the first and second sensor data 306, 308 may be generated by sensors included in the computing device on which the compliance evaluation platform 302 is executing, or the first and second sensor data 306, 308 may be generated by sensors that are external to the computing device on which the compliance evaluation platform 302 is executing (e.g., a wearable device associated with the participants of a givenAtorney Docket No. 124824.8139.WO01 study). As an example, the first sensor data 306 may be generated by an IMU implemented in the computing device on which the compliance evaluation platform 302 is executing, while the second sensor data 308 may be generated by a pulse oximeter that is communicatively connected - either directly or indirectly - to the computing device on which the compliance evaluation platform 302 is executing.

[0064] Wearable devices can include sensors and generate associated sensor datasets (e.g., sets of sensor data). For example, wearable devices can include any wearable technology (e.g., technology designed to be used while worn). Wearable technology can include smartwatches, smart glasses, activity trackers (e.g., pedometers), smart rings, hearing aids, or implants (medical or otherwise). Wearable devices and associated sensors can directly or indirectly collect data associated with a user’s health, such as heart rate, calories burned, steps walked, blood pressure, release of biochemicals, time spent exercising, seizures, physical strain, body composition, and / or water levels. For example, wearable devices can utilize sensor data to determine periods of physical activity, including ambulatory periods, as well as periods of physical inactivity, including periods of sleep. As such, because wearable devices can be worn, such devices can collect data passively, enabling associated users (e.g., humans) to live freely during data collection. As such, wearable devices enable the collection and subsequent analysis of health-related data.

[0065] In some implementations, the sensors associated with the compliance evaluation platform 302 can include other devices capable of collecting data. For example, sensors 222A-222N can include sensors, such as inertial measurement units or accelerometers, associated with mobile devices, such as smartphones, tablets, or laptop computers. For example, sensors 222A-222N can be housed on a smartphone carried within a human’s pocket, thereby enabling dynamic collection of free-living data associated with the human’s movement. In some implementations, sensor data can include location-based measurements, such as global positioning system (GPS) or network-based location data (e.g., from Internet Protocol (IP) addresses or connections to associated base stations within a telecommunication network). As such, the data collected at the compliance evaluation platform 212 can include a variety of sensor measurements associated with movement or health, for example.Atorney Docket No. 124824.8139.WO01

[0066] Figure 4 depicts another example of a communication environment 400 that includes a compliance evaluation platform 402 that is configured to obtain data from one or more sources. Here, the compliance evaluation platform 402 may obtain data (e.g., queries, prompts, and / or content) from a mobile phone 404, watch 406, laptop computer 408, or server system 410 (collectively referred to as the “networked devices”). For example, the compliance evaluation platform 402 may obtain response data (e.g., query data 304 of Figure 3) from the laptop computer 408 or server system 410. As another example, the compliance evaluation platform 402 may obtain sensor data (e.g., sensor data 306, 308 of Figure 3) from the mobile phone 404 or watch 406.

[0067] The networked devices can be connected to the compliance evaluation platform 402 via one or more networks. These networks can include PANs, LANs, WANs, MANs, cellular networks, the Internet, etc. Additionally or alternatively, the networked devices may communicate with one another over a short-range wireless connectivity technology. For example, if the compliance evaluation platform 402 resides on the mobile phone 404 in the form of a mobile application, data may be obtained from the watch 406 over a Bluetooth communication channel while data may be obtained from the server system 410 over the Internet via a Wi-Fi communication channel.

[0068] Embodiments of the communication environment 400 may include a subset of the networked devices. For example, the communication environment 400 may include a compliance evaluation platform 402 that obtains, in real time, data from the mobile phone 404 and watch 406 as that data is generated over the course of a free- living scenario. Additional data could be obtained from the server system 410 on a periodic basis (e.g., daily or weekly).

[0069] From the foregoing, it will be appreciated that specific embodiments of the invention have been described herein for purposes of illustration, but that various modifications may be made without deviating from the scope of the invention. Accordingly, the invention is not limited except as by the appended claims.Atorney Docket No. 124824.8139.WO01Approaches to Processing, Evaluating, and Presenting Participant Compliance for Dynamic Behavioral Interventions

[0070] Figure 5 includes a schematic diagram of an approach to generating graphical indicators of compliance based on activity data associated with a computing device.A. Data Ingestion

[0071] As mentioned above, the compliance evaluation platform 212 can include a data retrieval component - namely, a data ingestion module (e.g., data ingestion module 214). Initially, a compliance evaluation platform (e.g., the compliance evaluation platform 212) can collect data from one or more sources. For example, at operation 501 , through the data ingestion module 214, the compliance evaluation platform can retrieve and / or collect event data from a device associated with a participant of a study. For example, the data ingestion module 214 retrieves information associated with activities performed by a user of a wearable device and / or a participant of a clinical study (e.g., device data).

[0072] As described above, a computing device can include a mobile device or another type of electronic device (e.g., a wearable device, such as a smartwatch). A computing device can be associated with a device identifier, such as a media access control (MAC) address or another unique identifier (e.g., as assigned to the device by a study administrator or manager, such as a clinical research coordinator). The computing device can be associated with a particular participant with a participant identifier. A participant identifier can include a code or string (e.g., a unique alphanumeric code) assigned to each participant within a clinical study. For example, the identifier uniquely distinguishes one participant from another and can be linked to device identifiers associated with devices specific to the particular participants.

[0073] For example, the compliance evaluation platform 212 can retrieve data associated with a device of a participant of one or more clinical studies. The device can be associated with a corresponding device identifier. The compliance evaluation platform 212, via the data ingestion module 214, can determine a participant associated with the device by identifying a participant identifier that is linked to a device identifier. For example, the data ingestion module 214 can query a participant database using theAtorney Docket No. 124824.8139.WO01 associated device identifier to identify the participant identifier. By doing so, the data ingestion module 214 enables the compliance evaluation platform 212 to evaluate the compliance of the participant associated with the device in the context of any compliance requirements specific to the study and / or user.

[0074] The participant database can include various types of information relating to each participant of studies. For example, the participant database includes participant identifiers, personal information (e.g., associated with names or contact information, and demographic details), and information relating to one or more studies associated with the participant. In some implementations, the compliance evaluation platform 212 handles information relating to participants participating in more than one study. For example, the participant database includes a list of studies (e.g., study identifiers) associated with a particular participant. The participant database can include contact information associated with participants, such as telephone numbers, email addresses, and / or other suitable contact information.

[0075] The data associated with the device (e.g., the wearable device) can include information relating to a device of the participant, such as real-time data from a smartwatch. The device data can include wearing time data, synchronization data, survey input data, and / or any additional information of any format that is relevant to a particular study or trial. In some embodiments, device data can include activity metrics (e.g., step counts, distances travelled, sleep data, etc.), or wearing time data (e.g., including device usage data, such as screen time / time for which a device is worn or used, application usage statistics, device interaction events, and / or battery level information). Wearing time data can include information relating to the duration and patterns of when or how a participant wears a device. For example, wearing time data includes a total time that a device is worn within a specified period or time interval (e.g., associated with continuous wear time without removal or cumulative wear time across removal events). The wearing time data can include data relating to the frequency of device removal (e.g., removal before bed or other similar activities) and / or can include contextual information and / or data relating to compliance with wearing protocols (e.g., whether the device is worn in the manner associated with compliance requirements for a given study).Atorney Docket No. 124824.8139.WO01

[0076] The device data can include synchronization data, including events associated with data synchronization events between a wearable device and an associated server. Such data can include information relating to the frequency of data uploads and / or connectivity status. The synchronization data can include data synchronization timestamps (e.g., a time or date at which a watch synchronized with an associated server), including a frequency of synchronization events (e.g., hourly or daily). The synchronization data can include a manner of synchronization (e.g., data relating to the type of connection used for synchronization) and / or device information (e.g., associated with the server to which the device is synchronized and / or the device identifier of the wearable device).

[0077] The device data can include survey input data can include reports of selfreported health metrics, questionnaire responses, and / or other such information as reported by a participant of a study (e.g., via the wearable device and / or another device). For example, the survey input data includes information relating to data input events, such as events or logs associated with when or what activities have been performed by the user. Additionally or alternatively, the survey input data includes information relating to whether a participant has completed a given questionnaire or response. By retrieving such data, the compliance evaluation platform 212 can evaluate compliance associated with any required surveys or questionnaires, or other required activities that are reportable directly from the participant, with respect to the requirements of an associated study.

[0078] In some implementations, device data includes other information that can be associated with evaluating participant compliance in the context of a study, such as location information (e.g., associated with GPS coordinates) or other information that can be used to evaluate compliance with the requirements of a study.

[0079] At operation 502, the compliance evaluation platform 212 (e.g. via the data ingestion module 214) can retrieve requirements associated with compliance of a participant with one or more associated studies. For example, the compliance evaluation platform 212 retrieves time interval-dependent compliance requirements for particular participants of a given study. The compliance requirements can include information relating to criteria or standards that participants are to adhere to within the study. The requirements can include the specification of a threshold value for aAtorney Docket No. 124824.8139.WO01 particular value associated with a given participant (e.g., within a time-interval). For example, compliance requirements include a minimum duration required for wearing a device (e.g., a health monitoring smartwatch) within particular time periods, such as within each week, each day, or each hour. The compliance requirements can include requirements for data synchronization, including a minimum frequency and / or number of synchronization events within a particular time interval. Compliance requirements can include a comparison operator (e.g., a specification of a “greater than,” “less than,” “greater than or equal to,” “less than or equal to,” and / or an “equal to” operator) with respect to the threshold value (e.g., as a determination method for whether or not the human is compliant with the compliance requirements). In some implementations, the compliance evaluation platform 212 dynamically monitors data associated with (e.g., synchronized with) the participant’s computing device, as well as study compliance requirements, to enable dynamic adaptations to changes in compliance requirements or participant data, thereby improving the ability of the compliance evaluation platform 212 to dynamically evaluate compliance.B. Data Computation

[0080] As mentioned above, the compliance evaluation platform 212 can include a data computation component - namely, a data computation module (e.g. , computation module 216). The compliance evaluation platform (e.g., the compliance evaluation platform 212) can compute metrics or values based on data from one or more sources (e.g., data from the data ingestion module 214). For example, the data computation module is configured to calculate compliance values or measurement values characterizing the compliance of a participant of a study with respect to any requirements. In some implementations, the computation module 216 determines particular parameters on the basis of information from a wearable device, such as a frequency of smartwatch synchronization events based on a raw communication log associated with the smartwatch.

[0081] At operation 503 of Figure 5, the compliance evaluation platform 212 (e.g., via the computation module 216) can execute value computation 503 based on retrieved data (e.g., associated with data retrieval within operation 501 ) to determine compliance values. A compliance value can include a quantitative measure for assessing the compliance of a participant (e.g., of a study) with prescribedAtorney Docket No. 124824.8139.WO01 requirements. For example, compliance values can be derived from data collected using the participant’s computing device (e.g., a wearable device, such as a smartwatch). A compliance value can include, or be based on, a measurement value that is representative of one or more raw or processed data points collected from a participant’s device. A measurement value can include heath data, including physiological data (e.g., related to weight, blood pressure, heart rate, etc.), pulse oximeter data, sleep duration data, and / or other similar metrics. For example, a measurement value includes a number of times a smartwatch has synced with an associated server within a specified time frame (e.g., within a given month, week, or day).

[0082] A measurement value can include other device data-derived information. For example, the operation 503 enables the compliance evaluation platform 212 to identify and sort heterogeneous data from various devices or sources associated with study participants and extract temporal data associated with these devices. For example, the compliance evaluation platform 212 identifies that data is associated with a wearable device and determines a number of synchronization events associated with the wearable device within a particular time period. In some implementations, the compliance evaluation platform 212 identifies that the data is associated with physiological data (e.g., associated with raw pulse oximeter data). The compliance evaluation platform 212, using the computation module 216, can process the data to determine an elapsed time of the human wearing the watch based on such data (e.g., a wearing time) within the associated time period. The compliance evaluation platform 212 can determine that the device data includes study survey data (e.g., data provided by the user via an online form or application programming interface). The compliance evaluation platform 212 can determine metrics or values associated with the survey (e.g., frequencies or occurrences of reported activities by the user, such as reported exercises or therapies) and store such values as compliance values. Measurement values can be associated with temporal data, such as time-stamps associated with events, activities, or logged events within the device data. Temporal data can include information relating to the elapsed time of such events (e.g., an elapsed time of detection that a participant is wearing a smartwatch).

[0083] In some implementations, the compliance evaluation platform 212 determines such compliance values as related to particular time intervals. For example,Atorney Docket No. 124824.8139.WO01 a time interval includes a specification of a time period (e.g., from a start time / date to an end time / date). To illustrate, the time interval can include a particular week (e.g., Monday to Sunday or Sunday to Saturday). A time interval can include a particular day (e.g., from midnight to midnight or from 9:00 am to 9:00 am). A time interval can include a particular month (e.g., from the 1stof a given month to the last day of the given month). A compliance value and corresponding compliance requirement, as described above, can pertain to or be associated with different time intervals and / or time interval lengths. For example, a compliance value includes a measurement of how many synchronization events have been detected for a particular time interval (e.g., a week in July or a particular day within the month of July). The time intervals can overlap. For example, a first time interval can be within or overlap with a second time interval.

[0084] In some implementations, the compliance requirements (e.g., as described above in relation to operation 502) can specify a requirement for a particular time period (e.g., a particular week) or time period type or lengths (e.g., for any week-long periods of time). A particular study and / or associated user can be assigned compliance requirements for particular time periods or time period types. For example, a first compliance requirement for a participant of a study can specify that the participant must be associated with a first number of synchronizations within each week of the study to be compliant. A second compliance requirement for the participant can specify that the participant must be associated with a second number of synchronizations within each day of the study to be compliant. By enabling complex time interval-dependent compliance requirements (and by evaluating the compliance of the user using associated time interval-dependent compliance values), the compliance evaluation platform 212 enables the assimilation of complex measurement data (e.g., pertaining to different time periods) in an automated, dynamic manner, while enabling complex evaluation and presentation of such information to relevant stakeholders (e.g., clinical research coordinators).C. Data Analytics

[0085] As mentioned above, the compliance evaluation platform 212 can include a data analysis component - namely, a compliance analytics module (e.g., analytics module 218). The compliance evaluation platform (e.g., the compliance evaluation platform 212) can evaluate whether one or more participants associated with theAtorney Docket No. 124824.8139.WO01 platform are compliant with associated compliance requirements based on compliance values and compliance requirements (e.g., as generated at the computation module 216). For example, the analytics module is configured to determine whether a particular participant (e.g., as identified by a participant identifier that is linked to a device of the device data) is compliant with associated compliance requirements based on the device data. To illustrate, the analytics module 218 determines whether the calculated compliance values are consistent with requirements associated with a particular study, such as whether the number of synchronization events within a particular time interval reach a threshold number specified by study requirements for the particular participant.

[0086] For example, at operation 504, the compliance evaluation platform 212 can determine whether a participant is compliant with associated compliance requirements. For example, the compliance evaluation platform 212 can extract a compliance value associated with a particular time period, such as a particular day within the length of the study. For example, the compliance evaluation platform 212 determines a particular compliance value associated with the particular time period (e.g., a week), such as a number of smartwatch synchronization events that occurred within a particular week of the study. The compliance evaluation platform 212 can determine a compliance requirement associated with the particular participant (e.g., with an identifier of the particular participant) for that particular time period. To illustrate, the compliance evaluation platform 212 determines a minimum number of synchronization events associated with the particular time period for the particular user given the requirements or standards set by the study. In some implementations, different studies (e.g., as identified by a study identifier) can be associated with different compliance requirements. Different participants within a study can be associated with different compliance requirements (e.g., for a control group, rather than a treatment group, or vice versa).

[0087] For example, the compliance evaluation platform 212 determines a comparison operator associated with a particular compliance requirement, as well as the associated threshold number for each time interval of a set of time intervals. The compliance evaluation platform 212 can determine whether the compliance value for the particular time interval is greater than, equal to, or less than the threshold value associated with the particular compliance requirement for the particular time interval.-ZJ-Atorney Docket No. 124824.8139.WO01By doing so, the compliance evaluation platform 212 can determine whether the human is compliant with the particular compliance requirement.

[0088] The compliance evaluation platform 212 can determine a compliance indicator associated a particular compliance requirement and / or an associated time interval. A compliance indicator can include a metric, signal, or flag indicating whether a participant or entity is adhering to requirements or standards associated with a particular study. For example, a compliance indicator can include a Boolean (e.g., true / false or 0 / 1 value) indicating whether the human is compliant with a particular compliance requirement. The compliance indicator can include quantitative or qualitative measures of the compliance. For example, a compliance indicator for a particular time interval can include a fraction of compliance requirements (e.g., for that particular time interval) that are satisfied by the participant based on the device data. The human can be compliant (or not compliant) with more than one compliant requirement associated with a particular time period. For example, the compliance evaluation platform 212, through the analytics module 218, determines that a participant meets the minimum number of synchronization events for a particular week of the study, but not a maximum numberof watch removal events within the particular week. In some implementations, the compliance evaluation platform 212 determines an overall compliance indicator for a particular time period. For example, the compliance evaluation platform 212 determines that the human is compliant within a particular time period when it is determined that the human has satisfied all compliance requirements for that particular time period.

[0089] Based on the compliance indicators and at operation 505, the compliance evaluation platform 212 can determine a display configuration for displaying the associated compliance indicators on a graphical user interface. For example, the compliance evaluation platform 212 can determine a color scheme associated with particular time intervals, where the color scheme characterizes a compliance indicator (e.g., an overall indicator for a time interval and / or an individual indicator for a particular compliance requirement of the time interval). The color scheme can include a text color and / or background color, as well as a symbol that represents a particular compliance requirement or time interval.Atorney Docket No. 124824.8139.WO01

[0090] In some implementations, the compliance evaluation platform 212 selects a color scheme from a pair of color schemes, where a first color scheme of the pair indicates a lack of compliance (e.g., for a particular time period) and a second color scheme of the pair indicates compliance with the requirements (i.e. , for the particular time period). For example, the first color scheme is associated with the color yellow to indicate a lack of compliance. The second color scheme can be associated with the color green to indicate compliance with the associated requirement. The compliance evaluation platform 212 can configure a graphical user interface, as described below, based on this selected color scheme.D. Graphical User Interface

[0091] As mentioned above, the compliance evaluation platform 212 can include a user interface component - namely, a GUI module (e.g., the GUI module 220). The compliance evaluation platform (e.g., the compliance evaluation platform 212) can cause display of an interface for displaying compliance information for one or more participants of a study in an effective manner that enables timely behavior interventions to improve the quality of study data. For example, at operation 506, the compliance evaluation platform displays a calendar-like view with visual representations of indicators that represent the processed, heterogeneous device data and its implications for study compliance. The calendar-like view can include graphical representations of compliance indicators that indicate whether a human is compliant for a particular day or week and / or whether a particular compliance requirement for the particular time period is satisfied.

[0092] Figure 6 includes an illustration 600 of a graphical user interface (GUI) for graphically encoding user-specific compliance information based on activity data associated with a corresponding computing device. For example, the GUI includes a representation of a time period (e.g., a calendar tile indicating a day, such as calendar tile 602). The calendar tile can include a color scheme that represents the compliance of the human for the corresponding time period. The graphical user interface can include indications of compliance requirements in temporal order (e.g., according to calendar tiles, or in any other temporal order, such as in list form) to improve the effectiveness of the presentation of temporal information associated with study compliance.Atorney Docket No. 124824.8139.WO01

[0093] The color scheme can include one or more colors indicating how particular attributes of the compliance indicator are to be represented on a graphical user interface. For example, the color scheme can specify a font, format, color, and / or background color for text or symbols associated with the compliance indicator (or the graphical representation thereof). For example, a first color scheme can specify that a background color of a calendar tile of the GUI is of a particular color (e.g., orange or yellow, as shown in Figure 8), thereby demonstrating that an overall compliance indicator associated with the particular time period shows non-compliance with one or more associated compliance requirements. In some implementations, the second color scheme specifies that a background color of the calendar tile of the GUI is green to indicate that the particular time period (e.g., the particular calendar day) shows compliance with all associated compliance requirements. In some implementations, the GUI demonstrates compliance with individual compliance requirements via the color scheme. For example, the GUI can include a symbol 604 with a color scheme that indicates that a particular compliance requirement (e.g., a requirement to wear a smartwatch a particular number of hours on the given day) is satisfied. The color scheme can include a green background and a dark green symbol color. The symbol 606 can include or exhibit a second color scheme of the pair (e.g., a yellow / dark brown color scheme), as shown in Figure 6.

[0094] In some implementations, the graphical user interface includes a summary 608 of compliance, which can provide summaries of compliance on a week-by-week, day-by-day basis (and / or on another suitable temporal basis). For example, the summary 608 includes a summary of compliance requirements for a given time period (e.g., compliance requirements 610) and a summary of associated compliance values for the same time period (e.g., compliance values 612).

[0095] Figure 7 includes an illustration of a GUI for graphically encoding userspecific compliance information including indicators of compliance with particular compliance requirements associated with a corresponding computing device. In some implementations, the graphical user interface includes a summary of compliance indicators for a particular day or time period. For example, the compliance evaluation platform 212, using the GUI module 220, generates a display that includes a visual representation of a sum of compliance requirements with which the participant has complied (e.g., visual representation 702). In some implementations, the complianceAtorney Docket No. 124824.8139.WO01 evaluation platform 212 includes a representation of a sum of compliance requirements with which the participant has not complied (e.g., for the given time period), such as visual representation 704. In some implementations, the compliance evaluation platform 212 can generate a set of visual representations of compliance indicators associated with a different time period within the same display. For example, symbol 706 includes a visual representation of a weekly compliance indicator 706 (e.g., a compliance indicator indicating whether the human has complied with a compliance requirement for the given week).

[0096] Figure 8 includes an illustration of a GUI 800 for graphically encoding userspecific compliance information in response to user interaction with time period-specific indicators. For example, the graphical user interface includes a hover-over graphical indication for a particular time period (e.g., based on a hover-over or mouse-over operation or interaction by a user, such as a clinical research coordinator). For example, the hover-over graphical indication enables a user to hover over a specific region of the GUI corresponding to a given time interval (e.g., a calendar tile corresponding to a day). The compliance evaluation platform 212 can, in response to detecting such an action, display indicators of compliance associated with the particular time interval and / or other information, such as compliance values (e.g., a representation of how long a watch has been worn, if the participant is subject to a watch wearing requirement), as shown in visual representation 802 of Figure 8.

[0097] In some implementations, the compliance evaluation platform 212 generates the visual representations of participant compliance based on an interaction (e.g., by an administrator or clinical research coordinator) with a menu specifying a particular participant identifier and / or time period (e.g., month). In some implementations, the compliance evaluation platform 212 detects one or more non- compliant participants based on the compliance indicators and generates a representation (e.g., a list) of such participants for display on a GUI associated with the clinical research coordinator, thereby enabling prompt, and timely displays of compliance information. By generating such compliance information, including using clear, simple, uncomplicated color schemes (e.g., green or yellow) in a dynamic fashion (e.g., as such information is received from associated devices), the compliance evaluation platform 212 enables clinical research coordinators to execute prompt behavior interventions to improve study compliance for problematic participants.Atorney Docket No. 124824.8139.WO01

[0098] In some implementations, the compliance evaluation platform 212 generates contact information associated with participants (e.g., with non-compliant compliance indicators within a particular / pre-determined time period) by querying the participant database, thereby enabling prompt, scalable interventions (without requiring time-intensive manual lookup). By enabling the dynamic evaluation, detection, and presentation of such data, the compliance evaluation platform 212 enables clinical research coordinators to improve real-time interventions in large clinical studies (e.g., with multiple participants) in a scalable manner.Methodologies for Dynamically Analyzing, Evaluating, and Displaying Study Participant Compliance Data

[0099] Figure 9 includes a schematic diagram of a flow 900 for generating compliance indicators associated with a computing device for particular time intervals. For example, the compliance evaluation platform 212 evaluates the compliance of participants of a study with pre-determined compliance requirements associated with the study and presents such information in a dynamic, automated manner. By doing so, the compliance evaluation platform 212 enables prompt, scalable behavioral interventions to improve study compliance and, ultimately, improve the quality of clinical trials.

[0100] At operation 901 , the compliance evaluation platform 212 can receive data relating to activities performed with a first computing device, such as a wearable device of a participant of a study. For example, the compliance evaluation platform 212 receives, from a first computing device associated with the participant, data relating to activities that are performed with, or monitored by, the first computing device. As an illustrative example, the compliance evaluation platform 212 receives pulse oximeter data associated with a wearable device, such as a smartwatch, thereby enabling the platform to determine times at which the device is worn by the participant.

[0101] At operation 902, the compliance evaluation platform 212 can determine whether the participant complies with the study’s requirement over time. For example, the compliance evaluation platform 212 can determine, based on an analysis of the data, whether the participant complies with the requirement for each time interval of a series of time intervals. As an illustrative example, the compliance evaluation platform 212 can determine whether the data from the device (e.g., the pulse oximeter data) isAtorney Docket No. 124824.8139.WO01 such that the participant has worn the device for enough time to comply with any requirements specified by the study.

[0102] In some implementations, the compliance evaluation platform 212 determines compliance indicators for a series of time intervals (e.g., in order to provide comprehensive, time-resolved compliance information for particular participants). For example, the compliance evaluation platform 212 generates, using the data relating to the activities, a measurement value for each time interval of the series of time intervals. The compliance evaluation platform 212 can determine a series of compliance indicators based on whether, for each time interval of the series of time intervals, the measurement value meets a threshold value associated with the requirement. The compliance evaluation platform 212 can determine, based on the series of compliance indicators, whether the participant complies with the requirement for each time interval of the series of time intervals. As an illustrative example, the compliance evaluation platform 212 determines whether the participant has worn the wearable smartwatch for an amount of time greater than a threshold value on each day of a given week, where the threshold value is set by the particular study or compliance requirement thereof.

[0103] In some implementations, the compliance evaluation platform 212 generates measurement values associated with the device data to generate the compliance information. For example, the compliance evaluation platform 212 determines a data type associated with the requirement, wherein the data type specifies a physiological measurement type. The compliance evaluation platform 212 can extract, from the data relating to the activities and for each time interval of the series of time intervals, temporal data associated with the data type. The compliance evaluation platform 212 can generate, using the temporal data associated with the data type, the measurement value for each time interval of the series of time intervals. As an illustrative example, the compliance evaluation platform 212 determines a time-series of data (e.g., pulse-oximeter data and / or data derived thereof, such as times at which the device is being worn by the user) for further evaluation with respect to the compliance requirements.

[0104] At operation 903, the compliance evaluation platform 212 can post a visual representation of the compliance information over time. For example, the compliance evaluation platform 212 posts, to the graphical user interface that is accessible to theAtorney Docket No. 124824.8139.WO01 manager via a second computing device, a visual representation of compliance across the series of time intervals, such that for each time interval, a corresponding indicator of compliance is either (1 ) colored a first color to indicate that the participant was compliant with the requirement during that time interval, or (2) colored a second color to indicate that the participant was not compliant with the requirement during that time interval. As an illustrative example, the compliance evaluation platform 212 can determine whether to generate an indication of the particular compliance requirement in green or in yellow, thereby providing a simple-to-understand method for evaluating a participants’ compliance with compliance requirements. The compliance evaluation platform 212 can generate such information on a temporal, graphical representation, such as a calendar-type display.

[0105] At operation 904, the compliance evaluation platform 212 can cause the display of all indicators of compliance for a given interval based on an interaction (e.g., a hover-over action) detected on the graphical user interface. For example, the compliance evaluation platform 212 can, in response to receiving input that is indicative of an interaction, by the manager via the graphical user interface, with a given time interval of the series of time intervals, automatically the display of all indicators of compliance generated for the given time interval. As an illustrative example, the compliance evaluation platform 212 can determine that a user (e.g., a clinical research coordinator) is hovering over a particular region (e.g., a particular calendar tile corresponding to a day) of the graphical user interface; based on such a determination, the compliance evaluation platform 212 can provide additional information relating to the compliance of the participant, such as compliance indicators and / or additional time- related information. By doing so, the compliance evaluation platform 212 enables a clinical research coordinator to dynamically query the platform for temporally-resolved compliance information based on detecting an associated interaction with the GUI, while avoiding overwhelming the coordinator with such information otherwise.

[0106] In some implementations, the compliance evaluation platform 212 can link a device with a particular participant of a study based on the device identifier to determine user-dependent (and / or study-dependent) compliance requirements. For example, the compliance evaluation platform 212 determines a device identifier associated with the first computing device. The compliance evaluation platform 212 can determine, using a participant database and the device identifier, an identifier for theAtorney Docket No. 124824.8139.WO01 participant. The compliance evaluation platform 212 can extract, from a participant database and using the identifier, the threshold value, wherein the threshold value is associated with the requirement and with the participant and corresponds to each time interval of the series of time intervals. As an illustrative example, the compliance evaluation platform 212 can determine that the device data originates from a device that is associated with a particular participant. Based on such a determination, the compliance evaluation platform 212 can determine compliance requirements that are particular to the given user and / or the associated study, thereby enabling scalable, yet tailored, evaluation of users’ participation in studies.

[0107] In some implementations, the compliance evaluation platform 212 generates a hover-over graphical indicator of compliance associated with a participant. For example, the compliance evaluation platform 212 determines a region, on the graphical user interface, that corresponds to the given time interval of the series of time intervals. The compliance evaluation platform 212 can detect, via the graphical user interface, that the interaction is associated with the region. The compliance evaluation platform 212 can generate a hover-over graphical indication of all indicators of compliance generated for the given time interval, wherein the hover-over graphical indication at least partially overlaps with the region that corresponds to the given time interval of the series of time intervals. As an illustrative example, the compliance evaluation platform 212 can determine that the user is interacting with a region of the calendar that is associated with a particular day (e.g., a particular calendar tile); in response to such a detection, the compliance evaluation platform 212 can determine to generate a hover-over graphical indication that provides additional information relating to the participant’s compliance for that particular day, such as particular requirements that were not satisfied or satisfied by the participant, and how. By doing so, the compliance evaluation platform 212 can provide information to the clinical research coordinator that facilitates interventions and / or inquiries with the participant, by providing additional contextual information relating to any compliance issues.

[0108] In some implementations, the compliance evaluation platform 212 generates a second visual indication of compliance for another series of time intervals (e.g., for another compliance requirement, associated with another type of device data). For example, the compliance evaluation platform 212 splits the series of time intervals into a second series of time intervals, wherein each time interval of the series of timeAtorney Docket No. 124824.8139.WO01 intervals corresponds to a first interval length, and wherein each time interval of the second series of time intervals corresponds to a second interval length that is distinct from the first interval length. The compliance evaluation platform 212 can determine a second requirement for the participant that is associated with the second series of time intervals. The compliance evaluation platform 212 can determine, based on the data relating to the activities, whether the participant complies with the second requirement for each time interval of the second series of time intervals. The compliance evaluation platform 212 can post, to the graphical user interface, a second visual representation of compliance across the second series of time intervals, wherein the second visual representation of compliance comprises indicators of whether the participant complies with the second requirement for each time interval of the second series of time intervals. As an illustrative example, the compliance evaluation platform 212 can generate similar compliance indicators for other compliance requirements of a study, such as for synchronization events or survey input data, as described above.

[0109] In some implementations, the compliance evaluation platform 212 can generate a user control that enables communication between the clinical research coordinator and the participant (e.g., if the participant is determined to be non-compliant for a particular time- interval). For example, the compliance evaluation platform 212 determines that the participant does not comply with the requirement for a first time interval of the series of time intervals. Based on determining that the participant does not comply with the requirement for a first time interval of the series of time intervals, the compliance evaluation platform 212 can extract, from a participant database, contact information associated with the participant. The compliance evaluation platform 212 can cause generation, via the graphical user interface, of a user control enabling communication with the participant using the contact information. As an illustrative example, the compliance evaluation platform 212 can generate contact information associated with the participant based on a determination that the participant has not complied with study requirements (e.g., a minimum watch synchronization frequency) for one or more time intervals. In response to such a determination, the compliance evaluation platform 212 can generate contact information for the user to enable communication between a clinical research coordinator and the participant. Such contact information can include a telephone number, an email address, a physical address, or other suitable contact information. In some implementations, theAtorney Docket No. 124824.8139.WO01 compliance evaluation platform 212 configures a video or telephone communication application to enable calls with the participant. In some implementations, the compliance evaluation platform 212 configures an email client or a similar application to generate an electronic message to send to the participant. Such communications can include information relating to the lack of compliance, such as particular types of compliance requirements that were failed and / or the associated time intervals of non- compliance.

[0110] In some implementations, the compliance evaluation platform 212 can monitor data from the participants device (e.g., via a server) and update the graphical user interface accordingly. For example, the compliance evaluation platform 212 monitors the data relating to the activities that are performed with, or monitored by, the first computing device. In response to monitoring the data, the compliance evaluation platform 212 can determine that, at a second time distinct from the first time, the data is updated. The compliance evaluation platform 212 can determine, based on the updated data, an updated series of time intervals. Based on determining that the data is updated, the compliance evaluation platform 212 can determine, based on an analysis of the updated data, whether the participant complies with the requirement for each time interval of the updated series of time intervals. The compliance evaluation platform 212 can update the visual representation of compliance based on whether the participant complies with the requirement for each time interval of the updated series of time intervals. As an illustrative example, the compliance evaluation platform 212 can update the graphical user interface based on further data from the device (e.g., further synchronization data associated with the participant’s wearable smartwatch). By doing so, the compliance evaluation platform 212 can dynamically and automatically update and detect changes in compliance, thereby enabling prompt and effective interventions in cases of worsening compliance with study requirements.

[0111] Figure 10 includes a schematic diagram of a flow 1000 for generating compliance indicators for particular humans based on data from a computing device.

[0112] At operation 1001 , the compliance evaluation platform 212 can receive device data that includes wearing time data, synchronization data, survey input data, or any suitable study-related data. For example, the compliance evaluation platform 212 receives, from a wearable device of a human, device data associated with a first timeAtorney Docket No. 124824.8139.WO01 period, wherein the device data includes at least one of (i) wearing time data including times at which the wearable device is worn by the human within the first time period, (ii) synchronization data including times at which data associated with the wearable device is synchronized with a server system within the first time period, and (iii) survey input data including indications of survey input events associated with the human within the first time period.

[0113] At operation 1002, the compliance evaluation platform 212 can retrieve a compliance requirement associated with the human and / or the associated study. For example, the compliance evaluation platform 212 retrieves at least one compliance requirement that is associated with the human.

[0114] In some implementations, the compliance evaluation platform 212 can determine a compliance requirement based on determining that the device data includes data of a first type. For example, the compliance evaluation platform 212 determines a first data type associated with the device data. The compliance evaluation platform 212 can retrieve, from a compliance database, a first compliance requirement, of the at least one compliance requirement, that corresponds to the first data type, wherein the first compliance requirement includes (1 ) a threshold value and (2) an indication of a comparison operator.

[0115] In some implementations, the compliance evaluation platform 212 can determine the compliance requirements based on identifying a participant based on a device identifier associated with the device data. For example, the compliance evaluation platform 212 determines a device identifier associated with the wearable device. The compliance evaluation platform 212 can determine, using a participant database and the device identifier, an identifier for the human. The compliance evaluation platform 212 can extract, from the participant database and using the identifier, the threshold value, wherein the threshold value is associated with the first compliance requirement and with the human.

[0116] At operation 1003, the compliance evaluation platform 212 can process the device data to generate a compliance value that enables evaluation of whether the human is compliant with the at least one compliance requirement. For example, the compliance evaluation platform 212 processes the device data to generate at least one compliance value associated with the at least one compliance requirement.Atorney Docket No. 124824.8139.WO01

[0117] At operation 1004, the compliance evaluation platform 212 can generate a compliance indicatorthat indicates whether the participant of the study is compliant with the compliance requirements. For example, the compliance evaluation platform 212 determines whether the at least one compliance value is consistent with the at least one compliance requirement. In response to a determination that the at least one compliance value is consistent with the at least one compliance requirement, the compliance evaluation platform 212 can generate at least one compliance indicator that indicates whether the human is compliant, for the first time period, with the at least one compliance requirement.

[0118] In some implementations, the compliance evaluation platform 212 can generate measurement values to be evaluated against compliance requirements to determine the participant’s compliance for a given time period. For example, the compliance evaluation platform 212 generates, using the device data, a measurement value, of the first data type, for the first time period. The compliance evaluation platform 212 can determine whether the measurement value meets the threshold value according to the indication of the comparison operator. Based on determining whether the measurement value meets the threshold value, the compliance evaluation platform 212 can determine whether the at least one compliance value is consistent with the at least one compliance requirement.

[0119] In some implementations, the compliance evaluation platform 212 can determine the measurement value by extracting data associated with a physiological measurement of the device data. For example, the compliance evaluation platform 212 may determine that the first data type specifies a physiological measurement type. The compliance evaluation platform 212 can extract, from the device data, data associated with the physiological measurement type and corresponding to the first time period. The compliance evaluation platform 212 can generate, using the data associated with the first data type, the measurement value for the first time period.

[0120] At operation 1005, the compliance evaluation platform 212 can determine that the human is not compliant for the first time period. For example, the compliance evaluation platform 212 can determine, based on the at least one compliance indicator, that the human is not compliant with the at least one compliance requirement for the first time period.Atorney Docket No. 124824.8139.WO01

[0121] At operation 1006, the compliance evaluation platform 212 can determine a first colors scheme of a pair of color schemes for the compliance indicator. For example, in response to a determination that the human is not compliant with the at least one compliance requirement for the first time period, the compliance evaluation platform 212 determines a first color scheme of a pair of color schemes.

[0122] At operation 1007, the compliance evaluation platform 212 can receive a request for data associated with non-compliant humans. For example, the compliance evaluation platform 212 receives, from an administrator device, a request for a visualization of non-compliant humans associated with the first time period.

[0123] At operation 1008, the compliance evaluation platform 212 can generate a visual representation of the compliance indicator. For example, the compliance evaluation platform 212 generates, for display on a graphical user interface that is accessible via the administrator device, a visual representation of the at least one compliance indicator that is of the first color scheme.

[0124] In some implementations, the compliance evaluation platform 212 can generate a hover-over graphical indication based on user interactions with the graphical user interface. For example, the compliance evaluation platform 212 determines a region, on the graphical user interface, that corresponds to the first time period. The compliance evaluation platform 212 can detect, via the graphical user interface, an interaction that is associated with the region. The compliance evaluation platform 212 can generate a hover-over graphical indication of the at least one compliance indicator, wherein the hover-over graphical indication at least partially overlaps with the region that corresponds to the first time period.

[0125] In some implementations, the compliance evaluation platform 212 can generate contact information associated with non-compliant participants to facilitate behavioral interventions. For example, based on determining that the human does not comply with the at least one compliance requirement for the first time period, the compliance evaluation platform 212 can extract, from a participant database, contact information associated with the human. The compliance evaluation platform 212 can cause generation, via the graphical user interface, of a user control enabling communication with the human using the contact information.Atorney Docket No. 124824.8139.WO01

[0126] In some implementations, the compliance evaluation platform 212 can detect updated data and update the graphical user interface accordingly. For example, the compliance evaluation platform 212 monitors data associated with the wearable device. In response to monitoring the data associated with the wearable device, the compliance evaluation platform 212 determines that, at a second time distinct from the first time, the device data is updated. The compliance evaluation platform 212 can determine that the updated device data includes data associated with a second time period. Based on determining that the data is updated, the compliance evaluation platform 212 can process the updated device data to generate a second compliance value associated with the at least one compliance requirement. The compliance evaluation platform 212 can determine whether the second compliance value is consistent with the at least one compliance requirement. In response to a determination that the human is not compliant with the at least one compliance requirement for the second time period, the compliance evaluation platform 212 can generate a second compliance indicator that indicates whether the human is compliant, for the second time period, with the at least one compliance requirement. The compliance evaluation platform 212 can update the visual representation of compliance based on the second compliance indicator.

[0127] Figure 11 includes a schematic diagram of a flow 1100 for generating visual representations of data type-specific and overall compliance indicators based on data from a computing device.

[0128] At operation 1101 , the compliance evaluation platform 212 can receive device data associated with a particular time period (e.g., a day, week, or month). For example, the compliance evaluation platform 212 receives, from a wearable device that is associated with a device identifier, device data that corresponds to a first time period, wherein the device data includes information relating to human activity that involves, or is trackable by, the wearable device.

[0129] At operation 1102, the compliance evaluation platform 212 can generate a first compliance indicator for a first type of device data (e.g., associated with a first compliance requirement). For example, the compliance evaluation platform 212 generates a first compliance indicator by retrieving, for a human that is associated with the device identifier, a first compliance requirement that is representative of a minimumAtorney Docket No. 124824.8139.WO01 duration of time for which the human is to wear the wearable device over the first time period, determining, based on the device data, an actual duration of time for which the human wore the wearable device over the first time period, and comparing the actual duration of time to the minimum duration of time, so as to establish the first compliance indicator.

[0130] At operation 1103, the compliance evaluation platform 212 can generate a second compliance indicator for a second type of device data (e.g., associated with a second compliance requirement). For example, the compliance evaluation platform 212 generates a second compliance indicator by retrieving, for the human that is associated with the device identifier, a second compliance requirement that is representative of a minimum number of synchronization events to be completed within the first time period, determining, based on the device data, an actual number of synchronization events completed within the first time period, and comparing the actual number of synchronization events to the minimum number of synchronization events, so as to establish the second compliance indicator.

[0131] At operation 1104, the compliance evaluation platform 212 can generate a third compliance indicator for a third type of device data (e.g., associated with a third compliance requirement). For example, the compliance evaluation platform 212 generates a third compliance indicator by retrieving, for the human associated with the device identifier, a third compliance requirement that is representative of a minimum number of data input events to be completed within the first time period, determining, based on the device data, an actual number of data input events completed within the first time period, and comparing the actual number of data input events to the minimum number of data input events, so as to establish the third compliance indicator.

[0132] At operation 1105, the compliance evaluation platform 212 can generate an overall compliance indicator based on the first, second, and third compliance indicators. For example, the compliance evaluation platform 212 generates an overall compliance indicator that indicates whether at least one of the first, second, and third compliance indicators denotes that the human is not compliant over the first time period.

[0133] At operation 1106, the compliance evaluation platform 212 can generate a visual representation of the overall compliance indicator in a first color scheme upon determining that the overall compliance indicator denotes that the human is notAtorney Docket No. 124824.8139.WO01 compliant. For example, in response to a determination that the overall compliance indicator denotes that the human is not compliant over the first time period, the compliance evaluation platform 212 can generate, for display on a graphical user interface, a first visual representation of the overall compliance indicator in a first color scheme of a pair of color schemes, wherein the first visual representation is associated with a graphical representation of the first time period.

[0134] At operation 1107, the compliance evaluation platform 212 can generate another visual representation of a compliance indicator upon determining that the overall compliance indicator denotes that the participant is compliant. For example, in response to a determination that the overall compliance indicator denotes that the human is compliant over the first time period, the compliance evaluation platform 212 generates, for display on the graphical user interface, a second visual representation of the overall compliance indicator in a second color scheme of the pair of color schemes, wherein the second color scheme different from the first color scheme, and wherein the second visual representation is associated with the graphical representation of the first time period.Processing System

[0135] Figure 12 is a block diagram illustrating an example of a processing system 1200 in which at least some operations described herein can be implemented. For example, components of the processing system 1200 may be hosted on a computing device that includes a compliance evaluation platform e.g., the compliance evaluation platform 102 of Figure 1 , compliance evaluation platform 212 of Figure 2A, compliance evaluation platform 302 of Figure 3, and / or compliance evaluation platform 402 of Figure 4).

[0136] The processing system 1200 may include a processor 1202, main memory 1206, non-volatile memory 1210, network adapter 1212, video display 1218, input / output device 1220, control device 1222 (e.g., a keyboard or pointing device), drive unit 1224 including a storage medium 1226 (e.g., a non-transitory storage medium), and signal generation device 530 that are communicatively connected to a bus 1216. The bus 1216 is illustrated as an abstraction that represents one or more physical buses or point-to-point connections that are connected by appropriate bridges, adapters, or controllers. The bus 1216, therefore, can include a system bus, aAtorney Docket No. 124824.8139.WO01Peripheral Component Interconnect (PCI) bus or PCI-Express bus, a HyperTransport or industry standard architecture (ISA) bus, a small computer system interface (SCSI) bus, a universal serial bus (USB), inter-integrated circuit (I2C) bus, or an Institute of Electrical and Electronics Engineers (IEEE) standard 1394 bus (also referred to as “Firewire”).

[0137] While the main memory 1206, non-volatile memory 1210, and storage medium 1226 are shown to be a single medium, the terms “machine-readable medium” and “storage medium” should be taken to include a single medium or multiple media (e.g., a centralized / distributed database and / or associated caches and servers) that store one or more sets of instructions 1228. The terms “machine-readable medium” and “storage medium” shall also be taken to include any medium that is capable of storing, encoding, or carrying a set of instructions for execution by the processing system 1200.

[0138] In general, the routines executed to implement the embodiments of the disclosure may be implemented as part of an operating system or a specific application, component, program, object, module, or sequence of instructions (collectively referred to as “computer programs”). The computer programs typically comprise one or more instructions (e.g. , instructions 1204, 1208, 1228) set at various times in various memory and storage devices in a computing device. When read and executed by the processors 1202, the instruction(s) cause the processing system 1200 to perform operations to execute elements involving the various aspects of the present disclosure.

[0139] Further examples of machine- and computer-readable media include recordable-type media, such as volatile memory devices and non-volatile memory devices 1210, removable disks, hard disk drives, and optical disks (e.g., Compact Disk Read-Only Memory (CD-ROMS) and Digital Versatile Disks (DVDs)), and transmissiontype media, such as digital and analog communication links.

[0140] The network adapter 1212 enables the processing system 1200 to mediate data in a network 1214 with an entity that is external to the processing system 1200 through any communication protocol supported by the processing system 1200 and the external entity. The network adapter 1212 can include a network adaptor card, a wireless network interface card, a router, an access point, a wireless router, a switch, a multilayer switch, a protocol converter, a gateway, a bridge, bridge router, a hub, a digital media receiver, a repeater, or any combination thereof.Atorney Docket No. 124824.8139.WO01Remarks

[0141] The foregoing description of various embodiments of the claimed subject matter has been provided for the purposes of illustration and description. It is not intended to be exhaustive or to limit the claimed subject matter to the precise forms disclosed. Many modifications and variations will be apparent to one skilled in the art. Embodiments were chosen and described in order to best describe the principles of the invention and its practical applications, thereby enabling those skilled in the relevant art to understand the claimed subject matter, the various embodiments, and the various modifications that are suited to the particular uses contemplated.

[0142] Although the Detailed Description describes certain embodiments and the best mode contemplated, the technology can be practiced in many ways no matter how detailed the Detailed Description appears. Embodiments may vary considerably in their implementation details, while still being encompassed by the specification. Particular terminology used when describing certain features or aspects of various embodiments should not be taken to imply that the terminology is being redefined herein to be restricted to any specific characteristics, features, or aspects of the technology with which that terminology is associated. In general, the terms used in the following claims should not be construed to limit the technology to the specific embodiments disclosed in the specification, unless those terms are explicitly defined herein. Accordingly, the actual scope of the technology encompasses not only the disclosed embodiments, but also all equivalent ways of practicing or implementing the embodiments.

[0143] The language used in the specification has been principally selected for readability and instructional purposes. It may not have been selected to delineate or circumscribe the subject matter. It is therefore intended that the scope of the technology be limited not by this Detailed Description, but rather by any claims that issue on an application based hereon. Accordingly, the disclosure of various embodiments is intended to be illustrative, but not limiting, of the scope of the technology as set forth in the following claims.

Claims

Atorney Docket No. 124824.8139.WO01CLAIMS l / We claim:1 . A method of altering a visual scheme of a graphical user interface to visually indicate compliance with a requirement by a participant in a study that is overseen by a manager, the method comprising: receiving, from a first computing device associated with the participant, data relating to activities that are performed with, or monitored by, the first computing device; determining, based on an analysis of the data, whether the participant complies with the requirement for each time interval of a series of time intervals; posting, to the graphical user interface that is accessible to the manager via a second computing device, a visual representation of compliance across the series of time intervals, such that for each time interval, a corresponding indicator of compliance is either: colored a first color to indicate that the participant was compliant with the requirement during that time interval, or colored a second color to indicate that the participant was not compliant with the requirement during that time interval; and in response to receiving input that is indicative of an interaction, by the manager via the graphical user interface, with a given time interval of the series of time intervals, automatically causing display of all indicators of compliance generated for the given time interval.

2. The method of claim 1 , wherein determining whether the participant complies with the requirement for each time interval of a series of time intervals comprises: generating, using the data relating to the activities, a measurement value for each time interval of the series of time intervals;Atorney Docket No. 124824.8139.WO01 determining a series of compliance indicators based on whether, for each time interval of the series of time intervals, the measurement value meets a threshold value associated with the requirement; and determining, based on the series of compliance indicators, whether the participant complies with the requirement for each time interval of the series of time intervals.

3. The method of claim 2, wherein generating the measurement value for each time interval of the series of time intervals comprises: determining a data type associated with the requirement, wherein the data type specifies a physiological measurement type; extracting, from the data relating to the activities and for each time interval of the series of time intervals, temporal data associated with the data type; and generating, using the temporal data associated with the data type, the measurement value for each time interval of the series of time intervals.

4. The method of claim 2, further comprising: determining a device identifier associated with the first computing device; determining, using a participant database and the device identifier, an identifier for the participant; and extracting, from a participant database and using the identifier, the threshold value, wherein the threshold value is associated with the requirement and with the participant and corresponds to each time interval of the series of time intervals.

5. The method of claim 1 , wherein causing the display of all indicators of compliance generated for the given time interval comprises: determining a region, on the graphical user interface, that corresponds to the given time interval of the series of time intervals; detecting, via the graphical user interface, that the interaction is associated with the region; and generating a hover-over graphical indication of all indicators of compliance generated for the given time interval,Atorney Docket No. 124824.8139.WO01 wherein the hover-over graphical indication at least partially overlaps with the region that corresponds to the given time interval of the series of time intervals.

6. The method of claim 1 , further comprising: splitting the series of time intervals into a second series of time intervals, wherein each time interval of the series of time intervals corresponds to a first interval length, and wherein each time interval of the second series of time intervals corresponds to a second interval length that is distinct from the first interval length; determining a second requirement for the participant that is associated with the second series of time intervals; determining, based on the data relating to the activities, whether the participant complies with the second requirement for each time interval of the second series of time intervals; and posting, to the graphical user interface, a second visual representation of compliance across the second series of time intervals, wherein the second visual representation of compliance comprises indicators of whether the participant complies with the second requirement for each time interval of the second series of time intervals.

7. The method of claim 1 , further comprising: determining that the participant does not comply with the requirement for a first time interval of the series of time intervals; based on determining that the participant does not comply with the requirement for a first time interval of the series of time intervals, extracting, from a participant database, contact information associated with the participant; and causing generation, via the graphical user interface, of a user control enabling communication with the participant using the contact information.Atorney Docket No. 124824.8139.WO018. The method of claim 1 , wherein receiving the data relating to the activities occurs at a first time, and wherein the method further comprises: monitoring the data relating to the activities that are performed with, or monitored by, the first computing device; in response to monitoring the data, determining that, at a second time distinct from the first time, the data is updated; determining, based on the updated data, an updated series of time intervals; based on determining that the data is updated, determining, based on an analysis of the updated data, whether the participant complies with the requirement for each time interval of the updated series of time intervals; and updating the visual representation of compliance based on whether the participant complies with the requirement for each time interval of the updated series of time intervals.

9. A computing device including:(i) one or more processors; and(ii) one or more non-transitory media storing instructions that, when executed by the one or more processors, cause the computing device to perform operations comprising: receiving, from a wearable device of a human, device data associated with a first time period, wherein the device data includes at least one of -(i) wearing time data including times at which the wearable device is worn by the human within the first time period,(ii) synchronization data including times at which data associated with the wearable device is synchronized with a server system within the first time period, and(iii) survey input data including indications of survey input events associated with the human within the first time period;Atorney Docket No. 124824.8139.WO01 retrieving at least one compliance requirement that is associated with the human; processing the device data to generate at least one compliance value associated with the at least one compliance requirement; determining whether the at least one compliance value is consistent with the at least one compliance requirement; in response to a determination that the at least one compliance value is consistent with the at least one compliance requirement, generating at least one compliance indicator that indicates whether the human is compliant, for the first time period, with the at least one compliance requirement; determining, based on the at least one compliance indicator, that the human is not compliant with the at least one compliance requirement for the first time period; in response to a determination that the human is not compliant with the at least one compliance requirement for the first time period, determining a first color scheme of a pair of color schemes; receiving, from an administrator device, a request for a visualization of non-compliant humans associated with the first time period; and generating, for display on a graphical user interface that is accessible via the administrator device, a visual representation of the at least one compliance indicator that is of the first color scheme.

10. The computing device of claim 9, wherein the instructions for retrieving the at least one compliance requirement that is associated with the human cause the computing device to perform operations comprising: determining a first data type associated with the device data; and retrieving, from a compliance database, a first compliance requirement, of the at least one compliance requirement, that corresponds to the first data type, wherein the first compliance requirement includes (1 ) a threshold value and (2) an indication of a comparison operator.Atorney Docket No. 124824.8139.WO0111. The computing device of claim 10, wherein the instructions for determining whether the at least one compliance value is consistent with the at least one compliance requirement cause the computing device to perform operations comprising: generating, using the device data, a measurement value, of the first data type, for the first time period; determining whether the measurement value meets the threshold value according to the indication of the comparison operator; and based on determining whether the measurement value meets the threshold value, determining whether the at least one compliance value is consistent with the at least one compliance requirement.

12. The computing device of claim 11 , wherein the instructions for generating the measurement value cause the computing device to perform operations comprising: determining that the first data type specifies a physiological measurement type; extracting, from the device data, data associated with the physiological measurement type and corresponding to the first time period; and generating, using the data associated with the first data type, the measurement value for the first time period.

13. The computing device of claim 10, wherein retrieving the first compliance requirement comprises: determining a device identifier associated with the wearable device; determining, using a participant database and the device identifier, an identifier for the human; and extracting, from the participant database and using the identifier, the threshold value, wherein the threshold value is associated with the first compliance requirement and with the human.Atorney Docket No. 124824.8139.WO0114. The computing device of claim 9, wherein the instructions for generating the visual representation of the at least one compliance indicator cause the computing device to perform operations comprising: determining a region, on the graphical user interface, that corresponds to the first time period; detecting, via the graphical user interface, an interaction that is associated with the region; and generating a hover-over graphical indication of the at least one compliance indicator, wherein the hover-over graphical indication at least partially overlaps with the region that corresponds to the first time period.

15. The computing device of claim 9, wherein the instructions cause the computing device to cause operations comprising: based on determining that the human does not comply with the at least one compliance requirement for the first time period, extracting, from a participant database, contact information associated with the human; and causing generation, via the graphical user interface, of a user control enabling communication with the human using the contact information.

16. The computing device of claim 9, wherein receiving the device data associated with the first time period occurs at a first time and wherein the instructions cause the computing device to cause operations comprising: monitoring data associated with the wearable device; in response to monitoring the data associated with the wearable device, determining that, at a second time distinct from the first time, the device data is updated; determining that the updated device data includes data associated with a second time period; based on determining that the data is updated, processing the updated device data to generate a second compliance value associated with the at least one compliance requirement;Atorney Docket No. 124824.8139.WO01 determining whether the second compliance value is consistent with the at least one compliance requirement; in response to a determination that the human is not compliant with the at least one compliance requirement for the second time period, generating a second compliance indicator that indicates whether the human is compliant, for the second time period, with the at least one compliance requirement; and updating the visual representation of compliance based on the second compliance indicator.

17. A method comprising: receiving, from a wearable device that is associated with a device identifier, device data that corresponds to a first time period, wherein the device data includes information relating to human activity that involves, or is trackable by, the wearable device; generating a first compliance indicator by: retrieving, for a human that is associated with the device identifier, a first compliance requirement that is representative of a minimum duration of time for which the human is to wear the wearable device over the first time period, determining, based on the device data, an actual duration of time for which the human wore the wearable device over the first time period, and comparing the actual duration of time to the minimum duration of time, so as to establish the first compliance indicator; generating a second compliance indicator by: retrieving, for the human that is associated with the device identifier, a second compliance requirement that is representative of a minimum number of synchronization events to be completed within the first time period, determining, based on the device data, an actual number of synchronization events completed within the first time period, andAtorney Docket No. 124824.8139.WO01 comparing the actual number of synchronization events to the minimum number of synchronization events, so as to establish the second compliance indicator; generating a third compliance indicator by: retrieving, for the human associated with the device identifier, a third compliance requirement that is representative of a minimum number of data input events to be completed within the first time period, determining, based on the device data, an actual number of data input events completed within the first time period, and comparing the actual number of data input events to the minimum number of data input events, so as to establish the third compliance indicator; generating an overall compliance indicator that indicates whether at least one of the first, second, and third compliance indicators denotes that the human is not compliant over the first time period; in response to a determination that the overall compliance indicator denotes that the human is not compliant over the first time period, generate, for display on a graphical user interface, a first visual representation of the overall compliance indicator in a first color scheme of a pair of color schemes, wherein the first visual representation is associated with a graphical representation of the first time period; and in response to a determination that the overall compliance indicator denotes that the human is compliant over the first time period, generate, for display on the graphical user interface, a second visual representation of the overall compliance indicator in a second color scheme of the pair of color schemes, wherein the second color scheme different from the first color scheme, and wherein the second visual representation is associated with the graphical representation of the first time period.Atorney Docket No. 124824.8139.WO0118. A non-transitory medium storing instructions that, when executed by one or more processors of a computing device, cause the computing device to perform operations comprising: receiving, from a set of wearable devices associated with a set of humans, a dataset that includes sets of device data, each of which is associated with a first time period and a corresponding one of the set of humans, wherein each set of device data in the dataset includes indications of at least one of:(i) times at which a corresponding one of the set of wearable devices is worn by the corresponding human within the first time period,(ii) times at which data associated with the corresponding wearable device is synchronized with a server system within the first time period, and(iii) survey input events associated with the corresponding human within the first time period; generating a set of compliance indicators for the set of humans by - retrieving a compliance requirement associated with each human in the set of humans, and determining, for each human in the set of humans, an overall compliance indicator indicating whether a degree of compliance by that human with the corresponding compliance requirement; receiving, from an administrator device, a request for visualization of non- compliant humans associated with the first time period; generating, for display on a graphical user interface that is accessible via the administrator device, graphical representations of a subset of the set of humans, wherein the humans included in the subset are associated with corresponding compliance indicators that indicate non-compliance; receiving, from the administrator device, input that is indicative of a selection, made via the graphical user interface, of a first graphical representation corresponding to a first human included in the subset; andAtorney Docket No. 124824.8139.WO01 generating, for display on the graphical user interface, a visual representation of a sequence of compliance indicators generated for the first human in temporal order, wherein the compliance indicators correspond to a sequence of time periods including the first time period.

19. The non-transitory medium of claim 18, wherein the instructions for retrieving the compliance requirement associated with each human in the set of humans cause the computing device to perform operations comprising: determining a first data type associated with the dataset; and retrieving, from a compliance database, a first compliance requirement that corresponds to the first data type, wherein the first compliance requirement includes (1 ) a threshold value and (2) an indication of a comparison operator.

20. The non-transitory medium of claim 18, wherein the instructions cause the computing device to perform operations comprising: determining a region, on the graphical user interface, that corresponds to the first time period; detecting, via the graphical user interface, an interaction that is associated with the region; and generating a hover-over graphical indication of a compliance indicator of the sequence of compliance indicators, wherein the hover-over graphical indication at least partially overlaps with the region that corresponds to the first time period.

Images