Apparatus, system and method for biomarker collection, two-way patient communication and long-term patient follow-up - Patents.com

A cloud-based platform with AI-driven biomarker analysis and communication tools provides personalized insights and recommendations, addressing the challenge of effectively utilizing patient biomarker data for improved medical treatment outcomes.

JP2024542298AInactive Publication Date: 2024-11-13COMPASS PATHFINDER LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
JP2024552099
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Priority Date
2021-11-23
Filing Date
2022-11-22
Publication Date
2024-11-13
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

Existing medical treatments face challenges in correlating patient biomarker data effectively and presenting it in a meaningful manner to facilitate user-driven improvements, as current data is often high-level and lacks actionable insights.

Method used

A cloud-based secure platform for biomarker collection and two-way patient communication, utilizing AI and machine learning to generate personalized recommendations and summaries, enabling real-time feedback and synchronization across devices.

Benefits of technology

Enables detailed patient insights and actionable recommendations, facilitating improved patient outcomes through personalized therapy adjustments and continuous monitoring.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024542298000001_ABST
    Figure 2024542298000001_ABST
Patent Text Reader

Abstract

Techniques are provided for generating a set of biomarkers and generating a summary and one or more recommendations based at least in part on the biomarkers. Sensor data associated with a user may be received. The sensor data may be analyzed to generate a set of biomarkers. One or more biomarkers of the set may be combined to generate one or more additional biomarkers. The summary and one or more recommendations may be generated based at least in part on the generated set of biomarkers and the additional biomarkers. The generated summary and one or more recommendations may be provided for display on a client device.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This PCT application claims priority to U.S. Provisional Patent Application No. 63 / 282,633, entitled “APPARATUSES, SYSTEMS, AND METHODS FOR BIOMARKER COLLECTION, BI-DIRECTIONAL PATIENT COMMUNICATION, AND LONGITUDINAL PATIENT FOLLOW-UP,” filed November 23, 2021, which is incorporated by reference in its entirety for all purposes. [Background technology]

[0002]

[0002] Today, many medical treatments and therapies are performed with the aid of personal computers and smart devices. However, there are difficulties in correlating patient biomarker data and appropriately utilizing patient biomarker data when communicating with patients. For example, biomarkers may be collected from a variety of devices, but often the data from such devices is high-level and may not provide detailed insight or recommendations to address changes from a baseline score. Furthermore, such biomarker data may not be presented in a meaningful way such that a user may be able to make changes to improve the score associated with the biomarker data. Summary of the Invention

[0003]

[0003] Various embodiments according to the present disclosure are described with reference to the drawings. [Brief description of the drawings]

[0004] [Figure 1]

[0004] FIG. 1 illustrates an example interface that may be used to implement aspects of various embodiments. [Diagram 2]

[0005] FIG. 1 illustrates another example interface that can be used to implement aspects of various embodiments. [Diagram 3]

[0006] FIG. 1 illustrates an example system that may be utilized to implement one or more aspects of various embodiments. [Figure 4]

[0007] FIG. 1 illustrates an example methodology that may be utilized to implement one or more aspects of various embodiments. [Diagram 5]

[0008] FIG. 1 illustrates an example of an environment for implementing one or more aspects of various embodiments. [Figure 6]

[0009] 1 is an exemplary block diagram of an electronic device that may be utilized to implement one or more aspects of the various embodiments. [Figure 7]

[0010] FIG. 1 illustrates components of another exemplary environment in which aspects of various embodiments may be implemented. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0005]

[0011] In the following description, various embodiments are described. For purposes of explanation, specific configurations and details are set forth in order to provide a thorough understanding of the embodiments. However, it will be apparent to those skilled in the art that the embodiments may be practiced without these specific details. Furthermore, well-known features may be omitted or simplified so as not to obscure the embodiments being described.

[0006]

[0012] Techniques are provided for generating a set of biomarkers and generating a summary and one or more recommendations based at least in part on the biomarkers. Sensor data associated with a user may be received. The sensor data may be analyzed to generate a set of biomarkers. One or more biomarkers of the set may be combined to generate one or more additional biomarkers. The summary and one or more recommendations may be generated based at least in part on the generated set of biomarkers and the additional biomarkers. The generated summary and one or more recommendations may be provided for display on a client device.

[0007]

[0013] According to an exemplary embodiment, a data-secure and anonymized cloud-based platform for biomarker collection, two-way patient communication, and longitudinal patient follow-up may be provided. A cloud-based confidential architecture for digital biomarker collection may be utilized in digital biomarker collection using smartphone sensors, wearables, and other such smart devices. Additionally, an anonymized and confidential cloud-native patient communication system may be provided, which enables delivery of patient education materials, as well as multi-party communication between patients and care teams. Additionally, content may be delivered securely and synchronously to patients and care teams.

[0008]

[0014] According to one or more embodiments, a secure artificial intelligence biomarker action and response service may be provided that is configured to provide real-time patient and therapist feedback regarding predefined triggers. As a non-limiting example, if a patient typically sleeps 8 hours during a given night following an initial dosing session of a therapy administered, and the patient receives only 5 hours of sleep per night for several months following dosing, this sleep change may be an indication of a relapse or declining health of the patient that may be flagged for the care team.

[0009]

[0015] Information may be dynamically loaded from a cloud-based environment, which allows for global synchronization of all devices with respect to content. Additionally, the system may allow the content to be customized, such as by allowing artificial intelligence, machine learning, and / or care teams to perform customization prior to displaying the content. Customized content may be managed remotely or locally. Because customization may be performed in this manner, different versions of the application may not need to be released for different studies or use cases. The application may be applicable across various studies and use cases using global synchronization. In some embodiments, at least a subset of the data and information presented to the user is stored locally but updated from a remote cloud-based backend. The application may dynamically retrieve information from the cloud-based backend, and the information may be downloaded on the fly. According to an exemplary embodiment, patients may be assigned to a particular study, and a cloud-based algorithm may perform an analysis of what information is relevant for each patient. A global list of all required information may be created, and relevant content may be provided in real time or near real time. If a connection to the cloud-based environment is not available, data from the most recent cloud pull may be shown. If there has been no recent cloud pull, default information may be shown until a connection to the Internet is available. Thus, the system may be able to provide different content to different patients, and to the same patient over time, in a single application.

[0010]

[0016] FIG. 1 illustrates an exemplary interface 100 that may be used to implement aspects of various embodiments. According to an exemplary embodiment, a client device may have an interface that may display various elements. The client device may include a smartphone, a tablet, or a personal computer such as a laptop or desktop computer, among other such devices. The interface may include elements, such as a check-in 110, that allow the user to enter or select a response that corresponds to the user's mood at that point in time. Also, the elements of the interface may include suggested action items 120 and current progress tracking 140. The suggested action items 120 may include recommended actions that the user should take. The recommended actions may be determined using machine learning or other artificial intelligence techniques and may be determined using one or more biomarkers analyzed for the user. As a non-limiting example, a biomarker associated with a user may indicate that the user may not be focused, may be anxious, or may not be getting enough sleep. For example, one or more scores associated with the user's biomarkers may fall below a determined threshold. As a result, the system may determine that the user would benefit from practicing mindfulness. The system may present recommendations for practicing mindfulness as action items for the user to take. The user may simply click, tap, or otherwise interact with the recommended action item, and a process for mindfulness may be loaded for the user to participate in.

[0011]

[0017] According to another exemplary embodiment, the user may be presented with a current progress 130 of the user's therapeutic journey. The current progress may include mandatory screenings that the user is required to complete before a given date. For example, the user may be required to complete Screens 1A-1C. As the user completes an individual item, the completed item may be presented in a manner that indicates that the item does not require further action. For example, Screen 1A (corresponding to element 140) is displayed as completed and therefore is light gray, with a blackened circle next to it. If the user taps, clicks, or otherwise interacts with an item, the user may be taken to an electronic page that provides content about the item. If the user wishes to track the user's progress to this point, the user may tap, click, or otherwise interact with an element to see a timeline, such as element 150. According to an exemplary embodiment, the timeline may display the completed action items in chronological order.

[0012]

[0018] 2 illustrates another example interface 200 that may be used to implement aspects of various embodiments. According to one example embodiment, the interface 200 may present various recommendations 210 for a user to consider. In some embodiments, the recommendations may be tailored to a particular user using artificial intelligence techniques. In other examples, the recommendations may include predefined recommendations that may be generally applicable to a set of users. In some embodiments, the recommendations may be a combination of tailored recommendations and generally applicable recommendations.

[0013]

[0019] In this exemplary embodiment, the recommendations may include breathing exercises 220, session experience information 230, and an option to schedule an appointment with a care team 240. The breathing exercises may include information about the breathing exercises along with resources for guided meditations that the user may be able to use. The session experience information may include general information related to the therapy the user is receiving. The session experience information may also include information related to the user's specific treatment experience. The user may, in some exemplary embodiments, provide feedback regarding the user's subjective experience while receiving therapy. The user may also be able to schedule an appointment with the care team using element 240, according to one exemplary embodiment. Interacting with the element may cause a virtual scheduling assistant to open, where the user may select a date and time that is convenient for the user and may specify whether the user would like a video call, a phone call, or a text chat. If there is no time slot that is convenient for the user, the user may be able to leave a video, phone, or text message for the user's care team.

[0014]

[0020] 3 illustrates an example system 300 that may be utilized to implement one or more aspects of various embodiments. The system may include a mobile or web-based application, a secure layer, a data processing layer, and / or a patient feedback layer, according to one example embodiment. The system may include a fully secure and anonymized cloud-based platform for biomarker collection, two-way patient communication, and / or long-term patient follow-up.

[0015]

[0021] The patient may grant permission for biomarker collection, including collection of sensor data. According to an exemplary embodiment, sensor data 320 may be provided to or collected by the client device 304. The sensor data may be collected at various points in time using various sensors, including but not limited to smartphone sensors, wearable device sensors, and imaging device sensors. The sensors, according to an exemplary embodiment, may include but are not limited to light sensors, global positioning system (GPS) sensors, accelerometers, gyroscopes, magnetometers, barometers, network connectivity sensors, activity status sensors, screen touch events, data from paired wearables (e.g., heart rate sensors, glucose levels, neck wearables detecting brain activity, etc.), and other such sensors and signals. According to an exemplary embodiment, personal identification information associated with the sensor data may be masked to maintain user privacy. The client device may include, but is not limited to, a smartphone, tablet, personal computing device, or wearable device, among other such devices. A user management module 308 may be utilized to authenticate one or more client devices, according to one exemplary embodiment. In some embodiments, a patient may have their own user account under a unique identifier. The user account may include a subject identifier, such as an indication of where the patient is in the patient's treatment journey. In another embodiment, the user account may include more extensive information, such as whether the patient is part of an affiliated program. The subject identifier may act as a global identifier for all communications, preparation, biomarker collection, or other interactions, uniquely identifying the user while preserving the anonymity of the actual individual. Each subject identifier may be computer-generated or assigned to an individual. In other embodiments, an administrator may assign subject identifiers to patients.

[0016]

[0022] In at least one exemplary embodiment, the system may allow access to the patient or care team via a mobile or web-based application. When a user account is created, the user may be able to log in, at which point the application will download the latest preparation materials for which the user has been authenticated. As a non-limiting example, the application may download look-ahead materials for an upcoming treatment session.

[0017]

[0023] A communication component such as the communication component 306 may be utilized to connect the client device with members of the care team. The communication component 306 may support video conferencing, teleconferencing, and text-based communication between users. If user consent allows, the patient and the care team may be able to communicate directly with each other, such as through video, text, and / or audio, both synchronously and asynchronously. For example, the patient may leave a message for the patient's care team if someone is not available to speak on demand or the patient may be able to speak with a member of the patient's care team in real time. In this manner, the patient may be able to prepare for an upcoming therapy session. Additionally, the patient may be able to follow up with the patient's care team before and / or after a therapy session as needed. The application may enable capture of patient and care team communications for later processing, according to an exemplary embodiment. For example, the communications may be processed using natural language processing and / or other artificial intelligence analysis, as appropriate and as enabled by patient consent. In an exemplary embodiment, anomaly detection may enable unsupervised machine learning algorithms to detect deviations from baseline measurements, even when only subject identifiers are available. In particular, in some exemplary embodiments, Bayesian analysis may be used to combine population level measurements with patient specific data to determine a baseline for each patient. Sustained deviations from this baseline may represent significant deviations from the patient's healthy state. For example, if the average population level amount of sleep is 8 hours per night, but the patient typically sleeps 6 hours per night, a normal range of 5.75 to 6.5 hours per night may be created for the patient. However, if the patient begins to consistently receive only 4 hours of sleep per night, this may represent a statistically and medically significant deviation from the patient's normal range.

[0018]

[0024] A content database 314 may store content to be provided for display on a client device through the cloud sync module 312. The content database may include educational content that may help assist a user through their treatment journey. While this example uses a cloud sync module, the content may be stored locally on the client device in other exemplary embodiments. The application may provide anonymized data collections, educational content, biomarker summaries, and / or suggestions generated using artificial intelligence. Sensor data may be uploaded at a secure layer via the client device 304 to an application programming interface (API) gateway 310, including secure entry to backend services and logic. Referring to the secure layer, data sent from the application to the cloud-based environment may pass through the secure layer. The secure layer may include an API gateway, according to one exemplary embodiment.

[0019]

[0025] Data may be sent from the API gateway 310 to a data processing layer, which may structure the data, provide machine learning biomarker creation, and generate suggestions or recommendations using artificial intelligence based on one or more biomarkers. The system may trigger functions such as a microservice 316 for data insertion, configured to handle database insertions. According to an exemplary embodiment, biomarker sets may be feature flagged and individual sensor and study settings are toggled based on patient preferences. Data may be dynamically injected, for example, via a serverless lambda function that may be configured to remediate missing data. However, data may be injected via any suitable means.

[0020]

[0026] In an exemplary embodiment, each request and response may be verified by an API gateway that serves as the entry point to the backend. The API gateway may ensure that requests are authenticated before sending them to backend services and databases. Additionally, de-personalized educational content may be synchronized across mobile applications.

[0021]

[0027] Referring now to the data processing layer, collected patient data may be inserted as semi-structured or unstructured data into a database (e.g., a NoSQL database), such as data store 318. Additionally, the data may be processed and inserted into a structured data warehouse, such as structured data store 320. Such processing may occur periodically or at predefined time intervals. Using biomarker analysis and generation component 322, the structured data may be analyzed and digital biomarkers may be generated for each patient. According to an exemplary embodiment, the biomarkers may be processed with artificial intelligence to identify deviations. Input from multiple sensors may be processed using machine learning or unsupervised frameworks to help analyze the data and generate one or more conclusions from the data. According to an exemplary embodiment, any number of sensors may be configured to generate novel measurements of an individual, which may require additional hardware in some cases. For example, input from a light sensor may be combined with accelerometer data to generate a measurement of patient sleep, which may then be used to understand the patient's health at that point in time. Left alone, light sensor data and accelerometer data may not be as accurate as a combination of data. The overall integration of any number of sensors into a single machine learning algorithm may enable the possibility of continuous monitoring of patient health and outcomes of interest. In an exemplary embodiment, the biomarkers may be processed in a cloud-based environment. In other exemplary embodiments, the biomarkers may be processed locally or on any suitable computing device. The processed biomarkers may be sent to an application, such as a mobile or web-based application, for review by the care team. The biomarkers may be sent at any time, such as in real-time, near real-time, or at a determined point in time. A trigger may alert the care team when a threshold is met for one or more biomarkers.For example, if a patient has a sleep range of 7-8 hours per night at a 95% confidence level, the system may alert the care team if the patient sleeps 4-5 hours per night at a 95% confidence level, as this reduction in sleep may signal a deterioration in mental health. The thresholds may be patient-specific and may be generated using a model where each patient has their own individual baseline. The baselines may be combined with an average baseline (e.g., the average baseline for a given population) to generate a relevant estimate. In an exemplary embodiment, a Bayesian model may be utilized to generate the estimate.

[0022]

[0028] The biomarkers may be stored, such as in biomarker storage 324. The biomarker data may be stored temporally, so that the data may be time-stamped. In this way, a patient's progress throughout therapy may be more easily tracked over time.

[0023]

[0029] The patient feedback layer may provide biomarker summaries, suggestions regarding content and other action items, and / or real-time patient-expert communication. Biomarker processing may help generate human-readable summaries and recommendations that may be made available for the patient in the application. The summaries and recommendations may be generated in a biomarker summary and recommendation generation component 326 in an exemplary embodiment. The summaries and recommendations may be biomarker and patient dependent, but such information may provide the patient's historical levels, deviations outside the norm (e.g., outside the patient's 95% confidence limits), and potential suggestions if patterns are determined. The summaries and / or recommendations may also provide information indicating why the summary is useful and / or reflective of patient health. As a non-limiting example, if the system determines that sleep is more useful on days when the patient has performed at least 30 minutes of walking, a suggestion may be provided to the application if the patient has not performed the patient's walking by 5 p.m. on that day. Thus, such summaries may display the patient's historical sleep over recent months, along with deviations outside the norm. In response to recommendations generated using artificial intelligence, the system may notify the patient about action items.

[0024]

[0030] Referring to the patient feedback layer, the biomarker summary may be presented to the patient along with suggested action items and recommended content. In an exemplary embodiment, a real-time video chat with an assigned therapist or other member of the care team may be scheduled in response to the suggested action items. The chat may follow any suitable schedule (e.g., twice per week) depending on the patient's progress in treatment. Surveys, such as short structured surveys, may be presented to the patient that may be used for further enrichment of the biomarkers. As a non-limiting example, the surveys may be used to directly assess patient mental health and patient status. In various embodiments, the system may recreate or provide assessments similar to common mental health assessments, such as, but not limited to, the Montgomery-Asberg Depression Rating Scale (MADRS), the Patient Health Questionnaire, or the 9-item (PHQ-9), that may be used clinically. Alternatively, the surveys may include subjective elements or reflect questions that the user feels are more suitable for measuring patient health. For example, such questions may include, "How many times over the last 7 days did the subject engage in physical activity?" According to one exemplary embodiment, the results of these surveys may be used as training labels for supervised machine learning.

[0025]

[0031] The application may be configured to recommend content to the user. For example, recommendations may be presented to the user in the application under tabs. Recommendations may be generated based on data collected from the patient, according to one exemplary embodiment. For example, if the user's collected data indicates elevated anxiety levels, the user may be recommended to watch a breathing exercises video to promote relaxation.

[0026]

[0032] Additionally, the user may be asked how they are doing and provided with options to reply based on the user's satisfaction. According to an exemplary embodiment, the reply may be stored and considered as part of the biomarker analysis. The user may also be presented with a schedule of upcoming sessions and a history of past sessions.

[0027]

[0033] In the application, the user may also be directed to a video, audio, or text chat with a member of the user's care team. The user may also be prompted to provide personal details or adjust settings. Care team members, or administrators, may be provided with access to the back end of the application.

[0028]

[0034] According to an exemplary embodiment, various means of authentication may be provided. For example, a login portal may be provided to enable anonymity for patients and care teams. Additionally, the system may include automated cross-platform digital biomarker and sensor data collection, such as across various operating systems, that may be incorporated into a single cloud-native database. Additionally, the system may include a synchronized content database that is updated remotely for new studies and patients. In at least some exemplary embodiments, users may utilize a quick response (QR) code to log into one or more features of the service environment.

[0029]

[0035] In an exemplary embodiment, the system may be a cross-platform front-end application that is consistent across all devices, allowing for easier validation of the application for regulatory purposes as one code base. Moreover, the application may enable the display of custom biomarkers to the care team and the patient. Additionally, the application may provide custom alerts in response to the data collected. The application may enable "full circle" machine learning, as the system may be configured to collect data, upload, analyze, identify triggers, and / or send information to the care team.

[0030]

[0036] The system may further be configured to allow the patient to apply for treatment, agree to a consent form, and / or download a mobile application or access a web-based application. The patient may sign into the application using a secure and encrypted login process. During the onboarding process, the patient may enable access to data collection and notifications (e.g., the patient may grant permission via the mobile device). In an exemplary embodiment, the application may collect health data, movement data, data from external wearables, and device usage data, when available. The collected data may be encrypted, anonymized, and uploaded to a cloud-based environment. The application may also suggest educational content, such as text, video, and / or audio, for the patient to browse and consume depending on the patient's progress through the treatment process.

[0031]

[0037] The application may include an administrator user interface for managing studies, treatments, and / or participants. The administrator user interface may be presented to the administrator via a mobile device or other computerized device. Such a user interface may allow the administrator to add or remove participants to one or more studies and / or locations. For example, one or more studies and / or one or more locations may populate one or more drop-down menus. Additionally, such a user interface may present the administrator with the participant's identifier and the time and date when it was created. The user interface may also present the administrator with the ability to expand the participant's identifier and view further details regarding the participant and / or study.

[0032]

[0038] The application may present the participant with a one-time login code and / or QR code to access the mobile application. For example, such a code may be presented to the participant at the beginning of treatment. In an exemplary embodiment, the administrator and / or user may have the system generate a new code. Each login code and / or QR code may be associated with a unique subject identifier.

[0033]

[0039] The application may also include one or more permissions that may be enabled or disabled according to one or more embodiments. Permissions may include, but are not limited to, active energy, electrodermal activity, flights climbed, heart rate, heart rate variability, mindful minutes, oxygen saturation, resting heart rate, sleep, stride length, walking and running distance, and walking heart rate average. A user may prevent an application from utilizing the corresponding type of data or sensor.

[0034]

[0040] FIG. 4 illustrates an exemplary method that may be utilized to implement one or more aspects of various embodiments. It should be understood that for any process herein, unless otherwise stated, there may be additional, fewer, or alternative steps performed in a similar or alternative order or in parallel within the scope of various embodiments. According to an exemplary embodiment, sensor data associated with a user may be received 410. The sensor data may be analyzed to generate a set of biomarkers 420. One or more biomarkers of the set may be combined to generate one or more additional biomarkers 430. A summary and recommendations related to the biomarkers may be generated based at least in part on the generated set of biomarkers and the additional biomarkers 440. The generated summary may be provided for display on a client device 450.

[0035]

[0041] As described, different approaches may be implemented in various environments according to the described embodiments. FIG. 5 illustrates an example of an environment 500 for implementing one or more aspects of various embodiments. As will be appreciated, although a web-based environment is used for purposes of explanation, different environments may be used to implement various embodiments, as appropriate. The system includes electronic client devices 502, 508, which may include any suitable device operable to send and receive requests, messages or information over a suitable network 504 and to communicate information to a user of the device. Examples of such client devices include personal computers, cell phones, handheld messaging devices, laptop computers, set-top boxes, personal digital assistants, e-book readers, and the like. The network may include any suitable network, including an intranet, the Internet, a cellular network, a local area network, or any other such network, or combinations thereof. The components used for such a system may depend at least in part on the type of network and / or environment selected. Protocols and components for communicating over such networks are well known and will not be described in detail herein. Communication over the network may be enabled via wired or wireless connections and combinations thereof. In this example, the network includes the Internet as the environment includes one or more servers 506 for receiving requests and serving content in response thereto, although, as will be apparent to one skilled in the art, in other networks, alternative devices serving similar purposes may be used.

[0036]

[0042] The exemplary environment includes at least one application server 510 and a data store 512. It should be understood that there may be several application servers, layers or other elements, processes or components, which may be coupled or otherwise configured, that may interact to perform a task, such as retrieving data from an appropriate data store. The term "data store" as used herein refers to any device or combination of devices capable of storing, accessing and retrieving data, which may include any combination of data servers, databases, data storage devices and data storage media, and any number of such devices, in any standard, distributed or clustered environment. The application server 510 may include any suitable hardware and software for integrating with the data store 512 as needed to execute aspects of one or more applications for client devices, and for handling much of the data access and business logic for the applications. The application server may cooperate with the data store to service access control and generate content, such as text, graphics, audio and / or video to be transferred to the user, which may be served to the user by one or more servers 506, including a web server, in this example in the form of HTML, XML or another suitable structured language. Handling of all requests and responses, as well as delivery of content between the client devices 502, 508 and the application server 510 may be handled by the web server of the server 506. It should be understood that the web server and application server are not required and are merely exemplary components, as the structured code described herein may be executed on any suitable device or host machine, as described elsewhere herein.

[0037]

[0043] The data store 512 may include a number of separate data tables, databases, or other data storage mechanisms and media for storing data related to a particular aspect. For example, the illustrated data store includes mechanisms for storing production data 514 and user information 518, which may be used to serve content for the production side. The data store is also shown to include mechanisms for storing log or application session data 516. It should be understood that there may be many other aspects that may need to be stored in the data store, such as page image information and access rights information, which may be stored in any of the mechanisms listed above or in additional mechanisms in the data store 512, as appropriate. The data store 512, through logic associated therewith, is operable to receive instructions from the application server 510 and retrieve, update, or otherwise process data in response thereto. In one example, a user may submit a request to transcribe, tag, and / or label a media file. In this case, the data store may access the user information to verify the user's identity and provide a transcript including the tags and / or labels along with an analysis associated with the media file. The information may then be returned to the user, such as in a results listing on a web page that the user can view via a browser on the user device 502, 508. Information about a particular feature of interest may be viewed in a dedicated page or window of the browser.

[0038]

[0044] Each server will typically include an operating system that provides executable program instructions for the general administration and operation of the server, and will typically include a computer-readable medium that stores instructions that, when executed by the server's processor, enable the server to perform its intended functions. Suitable implementations for server operating systems and general functions are known or commercially available, and will be readily implemented by those of skill in the art, especially in light of the disclosure herein.

[0039]

[0045] The environment in one embodiment is a distributed computing environment utilizing several computer systems and components interconnected via communication links using one or more computer networks or direct connections. However, those skilled in the art will appreciate that such a system may operate equally well in systems having fewer or a greater number of components than are shown in Figure 5. Thus, the illustration of system 500 in Figure 5 should be taken as illustrative in nature and not limiting on the scope of the present disclosure.

[0040]

[0046] 6 illustrates an example block diagram of an electronic device that may be utilized to implement one or more aspects of various embodiments. An instance of an electronic device 600 may include one or more servers and one or more client devices. In general, the electronic device may include a processor / CPU 602, a memory 604, a power supply 606, and input / output (I / O) components / devices 610 that may be operable to provide, for example, a graphical or textual user interface, such as a microphone, a speaker, a display, a touch screen, a keyboard, a mouse, a keypad, a microscope, a GPS component, a camera, a heart rate sensor, a light sensor, an accelerometer, a target biometric sensor, a neck wearable that detects brain activity, and the like.

[0041]

[0047] A user may provide input via a touchscreen of electronic device 600. The touchscreen may determine whether a user is providing input, for example, by determining whether the user is touching the touchscreen with a part of the user's body, such as the user's finger. Electronic device 600 may also include a communication bus 612 that connects to the above-mentioned elements of electronic device 600. Network interface 608 may include a receiver and transmitter (or transceiver) and one or more antennas for wireless communication.

[0042]

[0048] The processor 602 may include any type of processing device, such as one or more of a central processing unit (CPU) and a graphics processing unit (GPU). Also, for example, the processor may utilize central processing logic, or other logic, for performing one or more functions or actions or for initiating one or more functions or actions from one or more other components, and may include hardware, firmware, software, or a combination thereof. Also, based on a desired application or need, the central processing logic, or other logic may include, for example, a software-controlled microprocessor, discrete logic, such as an application specific integrated circuit (ASIC), a programmable / programmed logic device, a memory device containing instructions, or the like, or combinational logic embedded in hardware. Additionally, logic may also be fully embodied as software.

[0043]

[0049] Memory 604, which may include random access memory (RAM) 614 and read only memory (ROM) 616, may be enabled by any type of memory device, for example, one or more of a primary (directly accessible by the CPU) or secondary (indirectly accessible by the CPU) storage device (e.g., flash memory, magnetic disk, optical disk, etc.). The RAM may include an operating system 618, data storage 620, which may include one or more databases, and programs and / or applications 622, which may include, for example, software aspects of programs 624. The ROM 616 may also include a basic input / output system (BIOS) 626 of the electronic device 600.

[0044]

[0050] The software aspects of the program 622 are intended to broadly include or represent all programming, applications, algorithms, models, software, and other tools necessary to implement or facilitate the methods and systems according to embodiments of the present invention, the elements of which may reside on a single computer or be distributed among multiple computers, servers, devices, or entities.

[0045]

[0051] The power supply 606 may include one or more power components and may help facilitate the supply and management of power to the electronic device 600.

[0046]

[0052] Input / output components including input / output (I / O) interface 610 may include any interface for facilitating communication between, for example, components of electronic device 600, components of external devices, and end users. For example, such components may include a network card, which may be an integration of a receiver, a transmitter, a transceiver, and one or more input / output interfaces. A network card may facilitate wired or wireless communication, for example, with other devices of a network. In the case of wireless communication, an antenna may facilitate such communication. Also, some of the input / output interfaces 610 and the bus 612 may facilitate communication between components of electronic device 600 and, in one example, may facilitate processing performed by processor 602.

[0047]

[0053] If the electronic device 600 is a server, the server may include a computing device that may be capable of sending or receiving signals, e.g., a wired or wireless network, or may be capable of processing or storing signals, e.g., in memory, as physical memory states. The server may be an application server that includes configurations for providing one or more applications to another device over a network. The application server may also host a website that may provide, for example, a user interface for administration of the exemplary embodiment.

[0048]

[0054] FIG. 7 illustrates an example environment 700 in which aspects of various embodiments may be implemented. In this example, a user may utilize one or more client devices 702 to submit requests to a multitenant resource provider environment 706 over at least one network 704. The client devices may include any suitable electronic device operable to send and receive requests, messages, or other such information over an appropriate network and to communicate information to a user of the device. Examples of such client devices include personal computers, tablet computers, smartphones, notebook computers, and the like. The at least one network 704 may include any suitable network, including an intranet, the Internet, a cellular network, a local area network (LAN), or any other such network, or combination, and communication over the network may be enabled via wired and / or wireless connections. The resource provider environment 706 may include any suitable components for receiving requests and returning information or performing actions in response to those requests. As an example, the provider environment may include web servers and / or application servers for receiving and processing requests and then returning data, web pages, video, audio, or other such content or information in response to the request.

[0049]

[0055] In various embodiments, the provider environment may include various types of resources that may be utilized by multiple users for a variety of different purposes. As used herein, computing resources and other electronic resources utilized in a network environment may be referred to as “network resources.” These may include, for example, servers, databases, load balancers, routers, and the like that may perform tasks, such as receiving, transmitting, and / or processing data and / or executable instructions. In at least some embodiments, all or a portion of a given resource or set of resources may be allocated to a particular user or for a particular task, at least for a determined period of time. The sharing of these multi-tenant resources from the provider environment is often referred to as resource sharing, web services, or “cloud computing,” among other terms, as well as depending on the particular environment and / or implementation. In this example, the provider environment includes multiple resources 714 of one or more types. These types may include, for example, application servers operable to process instructions provided by users, or database servers operable to process data stored in one or more data stores 716 in response to user requests. As is known for such purposes, a user may also reserve at least a portion of the data storage in a given data store. Methods for enabling users to reserve various resources and resource instances are well known in the art, and thus a detailed description of the entire process, and an explanation of all possible components, will not be described in detail herein.

[0050]

[0056] In at least some embodiments, a user desiring to utilize a portion of the resource 714 can submit a received request to an interface layer 808 of the provider environment 706. The interface layer can include an application programming interface (API) or other exposed interface that allows a user to submit a request to the provider environment. The interface layer 808 in this example can also include other components, such as at least one web server, a routing component, a load balancer, etc. When a request to provision a resource is received in the interface layer 708, information about the request can be directed to a service manager 710, or other such system, service, or component, configured to manage user accounts and information, resource provisioning and usage, and other such aspects. The service manager 710 that receives the request can perform tasks such as authenticating the identity of the user submitting the request and determining whether the user has an existing account with the resource provider, if account data can be stored in at least one data store 712 in the provider environment. The user can provide any of a variety of types of credentials to the provider to authenticate the user's identity. These credentials may include, for example, a username and password pair, biometric data, a digital signature, a QR-based certificate, or other such information.

[0051]

[0057] The provider can verify this information against information stored about the user. If the user has an account with the proper permissions, status, etc., the resource manager can determine whether there are sufficient resources available to suit the user's request, and if there are sufficient resources, can provision those resources for use by the user for the amount specified by the request, or possibly grant access to a corresponding portion of those resources. This amount can include, for example, the ability to process a single request or perform a single task, a specified time period, or a cycling / renewable period, among other values. If the user does not have a valid account with the provider, or the user account does not allow access to the type of resource specified in the request, or another such reason prevents the user from gaining access to such resources, a communication can be sent to the user to enable the user to create or modify an account or change the resource specified in the request, among other options. In at least some exemplary embodiments, a user can be authenticated to access an entire fleet of services offered within the service provider environment. In other exemplary embodiments, the user's access can be limited to specific services within the service provider environment using one or more access policies tied to the user's credential(s).

[0052]

[0058] Once a user has been authenticated, an account verified, and resources allocated, the user may utilize the allocated resource(s) for a specified capacity, amount of data transfer, time period, or other such value. In at least some embodiments, the user may provide a session token or other such proof with subsequent requests to allow those requests to be processed on that user session. The user may receive a resource identifier, specific address, or other such information that may enable the client device 702 to communicate with the allocated resource without having to communicate with the service manager 710, at least until such time that a relevant aspect of the user account changes, the user is no longer granted access to the resource, or another such aspect changes.

[0053]

[0059] Also, the service manager 710 in this example (or another such system or service) can function as a virtual layer of hardware and software components that handles control functions in addition to management actions, such as may include provisioning, scaling, replication, etc. The resource manager can utilize dedicated APIs in the interface layer 808, where each API can be provided to receive a request for at least one specific action to be performed with respect to the data environment, such as provisioning, scaling, cloning, or quiescing an instance. Upon receiving a request to one of the APIs, the web services portion of the interface layer can parse or otherwise analyze the request to act on the call or determine the steps or actions required to process the call. For example, a web services call can be received that includes a request to create a data repository.

[0054]

[0060] The interface layer 708 in at least one embodiment includes a scalable set of user-facing servers that can offer various APIs and return appropriate responses based on the API specifications. The interface layer, in one embodiment, can also include at least one API services layer, consisting of stateless, replicated servers that handle external-facing user APIs. The interface layer can be responsible for web services front-end features such as authenticating users based on credentials, authorizing users, throttling user requests to the API server, validating user input, and marshalling or unmarshalling requests and responses. The API layer can also be responsible for reading and writing database configuration data to / from an administration data store in response to API calls. In many embodiments, the web services layer and / or API services layer will be the only externally visible components or the only components that are visible to and accessible by users of the control services. The servers of the web services layer are stateless and can be horizontally scaled as known in the art. The API servers, as well as the persistent data stores, may be spread across multiple data centers across a region, for example, so that they are resilient to single data center failures.

[0055]

[0061] Various embodiments may also be implemented in a wide variety of operating environments that may, in some cases, include one or more user computers or computing devices that may be used to operate any of a number of applications. User or client devices may include any of a number of general-purpose personal computers, such as desktop or laptop computers running standard operating systems, as well as any of a number of cellular, wireless and handheld devices capable of running mobile software and supporting a number of networking and messaging protocols. Such systems may also include a number of workstations running any of a variety of commercially available operating systems and other known applications for purposes such as development and database management. These devices may also include other electronic devices, such as dummy terminals, thin clients, gaming systems and other devices capable of communicating over a network.

[0056]

[0062] Most embodiments utilize at least one network, as will be familiar to those skilled in the art, for supporting communications using any of a variety of commercially available protocols, such as TCP / IP, FTP, UPnP, NFS, and CIFS. The network may be, for example, a local area network, a wide area network, a virtual private network, the Internet, an intranet, an extranet, a public switched telephone network, an infrared network, a wireless network, and any combination thereof. In embodiments utilizing a web server, the web server may run any of a variety of server or mid-tier applications, including an HTTP server, an FTP server, a CGI server, a data server, a Java server, and a business application server. The server(s) may also be capable of executing programs or scripts in response requests from user devices, such as by executing one or more web applications, which may be implemented as one or more scripts or programs written in any programming language, such as Java, C, C#, or C++, or any scripting language, such as Perl, Python, or TCL, and combinations thereof. The server(s) may also include database servers, including, but not limited to, those commercially available from Oracle®, Microsoft®, Sybase®, and IBM®.

[0057]

[0063] The environment may include various data stores and other memory and storage media, as described above. These may be present in various locations, such as across a network, on storage media local to (and / or present in) one or more of the computers, or remote from any or all of the computers. In a particular set of embodiments, information may reside in a storage area network (SAN) familiar to those skilled in the art. Similarly, files necessary to perform functions ascribed to a computer, server, or other network device may be stored locally and / or remotely, as appropriate. Where the system includes computerized devices, each such device may include hardware elements that may be electrically coupled via a bus, including, for example, at least one central processing unit (CPU), at least one input device (e.g., a mouse, keyboard, controller, touch-sensitive display element or keypad), and at least one output device (e.g., a display device, printer, or speaker). Such a system may also include one or more storage devices, such as disk drives, optical storage devices, and solid-state storage devices, such as random access memory (RAM) or read-only memory (ROM), as well as removable media devices, memory cards, flash cards, etc. Such devices may also include a computer-readable storage medium reader and a communication device (e.g., a modem, a network card (wireless or wired), an infrared communication device), and a working memory as described above. A computer-readable storage medium reader may be connected to or configured to accept computer-readable storage media representing remote, local, fixed and / or removable storage devices, as well as storage media for temporarily and / or more permanently containing, storing, transmitting and retrieving computer-readable information.

[0058]

[0064] The systems and various devices will also include several software applications, modules, services or other elements located in at least one working memory device, including an operating system and application programs such as client applications or web browsers. It should be appreciated that alternative embodiments may have numerous variations from the embodiments described above. For example, customized hardware may also be used and / or particular elements may be implemented in hardware, software (including portable software such as applets), or both. Additionally, connections to other computing devices, such as network input / output devices, may be employed. Storage media and other non-transitory computer readable media for containing code or portions of code may include any suitable media known or used in the art, such as volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data, including, but not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other media that may be used to store the desired information and that may be accessed by the system devices. Based on the disclosure and teachings provided herein, those skilled in the art will appreciate other ways and / or methods for implementing the various embodiments.

[0059]

[0065] Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense, however it will be apparent that various modifications and changes may be made thereto without departing from the broader spirit and scope of the invention as set forth in the appended claims.

Claims

1. Receiving sensor data associated with a user; analyzing the sensor data to generate a set of biomarkers; combining one or more biomarkers of the set to generate one or more additional biomarkers; generating a summary and one or more recommendations based at least in part on the generated set of biomarkers and the additional biomarkers; providing said generated summary for display on a client device; and A computer-implemented method comprising:

2. The computer-implemented method of claim 1 , wherein the sensor data is analyzed using at least one neural network.

3. The computer-implemented method of claim 1 , wherein the summary and the one or more recommendations are determined using machine learning.

4. 2. The computer-implemented method of claim 1, wherein the sensor data is collected from one or more of a light sensor, a global positioning system (GPS) sensor, an accelerometer, a gyroscope, a magnetometer, a barometer, a network connectivity sensor, an activity sensor, screen touch events, and data from a paired wearable.

5. determining a score for at least one biomarker; determining that the score is below a determined threshold; generating the one or more recommendations based at least in part on the scores; The computer-implemented method of claim 1 , further comprising:

6. Receiving first sensor data associated with a user; analyzing the first sensor data to generate a set of biomarkers; generating one or more recommendations based at least in part on the generated set of biomarkers; providing the one or more recommendations for display on a client device; and determining that the user has taken an action regarding the one or more recommendations; analyzing second sensor data associated with the user; causing an indication related to the analyzed second sensor data to be provided for display; and A computer-implemented method comprising:

7. combining a plurality of biomarkers from said set of biomarkers to generate a new biomarker; generating the one or more recommendations based at least in part on the generated set of biomarkers and the new biomarker; The computer-implemented method of claim 6 , further comprising:

8. 7. The computer-implemented method of claim 6, wherein at least one of the first sensor data and the second sensor data is analyzed using at least one neural network.

9. The computer-implemented method of claim 6 , wherein the one or more recommendations are determined using machine learning.

10. 7. The computer-implemented method of claim 6, wherein the sensor data is collected from one or more of a light sensor, a global positioning system (GPS) sensor, an accelerometer, a gyroscope, a magnetometer, a barometer, a network connectivity sensor, an activity sensor, screen touch events, and data from a paired wearable.

11. determining a score for at least one biomarker; determining that the score is below a determined threshold; generating the one or more recommendations based at least in part on the scores; The computer-implemented method of claim 6 , further comprising:

12. determining a baseline score for one or more biomarkers of said set; determining that a second score for the one or more biomarkers is below the determined baseline score; generating the one or more recommendations based at least in part on the baseline score and the second score; The computer-implemented method of claim 6 , further comprising:

13. determining a score for at least one biomarker; generating an alert if the score falls below a determined threshold; providing the alert for display on the client device; The computer-implemented method of claim 6 , further comprising:

14. At least one processor; Memory and 11. A system comprising: the memory storing one or more instructions that, when executed by the at least one processor, cause the at least one processor to: Receiving first sensor data associated with a user; analyzing the first sensor data to generate a set of biomarkers; generating one or more recommendations based at least in part on the generated set of biomarkers; providing the one or more recommendations for display on a client device; and determining that the user has taken an action regarding the one or more recommendations; analyzing second sensor data associated with the user; causing an indication related to the analyzed second sensor data to be provided for display; and A system that allows the user to:

15. The instructions, when executed by the at least one processor, cause the at least one processor to: combining a plurality of biomarkers from said set of biomarkers to generate a new biomarker; generating the one or more recommendations based at least in part on the generated set of biomarkers and the new biomarker; The system of claim 14 , further comprising:

16. The system of claim 14 , wherein at least one of the first sensor data and the second sensor data is analyzed using machine learning.

17. 15. The system of claim 14, wherein the sensor data is collected from one or more of a light sensor, a global positioning system (GPS) sensor, an accelerometer, a gyroscope, a magnetometer, a barometer, a network connectivity sensor, an activity sensor, screen touch events, and data from a paired wearable.

18. The instructions, when executed by the at least one processor, cause the at least one processor to: determining a score for at least one biomarker; determining that the score is below a determined threshold; generating the one or more recommendations based at least in part on the scores; The system of claim 14 , further comprising:

19. The instructions, when executed by the at least one processor, cause the at least one processor to: determining a baseline score for one or more biomarkers of said set; determining that a second score for the one or more biomarkers is below the determined baseline score; generating the one or more recommendations based at least in part on the baseline score and the second score; The system of claim 14 , further comprising:

20. The instructions, when executed by the at least one processor, cause the at least one processor to: determining a score for at least one biomarker; generating an alert if the score falls below a determined threshold; providing the alert for display on the client device; The system of claim 14 , further comprising:

Citation Information

Patent Citations

  • Systems and methods for creating a neural network to provide personalized recommendations using activity monitoring devices with biometric sensors

    US20170120107A1

  • Glucose management

    US20210212606A1

  • Hypoglycemic event prediction using machine learning

    US20210338116A1