System and method for monitoring a plurality of individuals in a designated area
The system addresses the challenge of monitoring multiple individuals in a common space by using contactless and wearable sensors to associate signals with digital identities, enabling accurate and continuous monitoring of vital signs and activities.
Patent Information
- Application Number
- PCT/CA2024/051138
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-09-01
- Filing Date
- 2024-08-30
- Publication Date
- 2025-03-06
AI Technical Summary
Current contactless human monitoring systems struggle to accurately monitor and differentiate multiple individuals within a common space, particularly in uncontrolled environments with a large number of subjects.
A system and method that utilize a combination of contactless sensors and wearable sensors to concurrently monitor individuals in a designated area. The system includes a digital processor that processes signals from contactless sensors and wearable sensors to automatically associate the signals with respective digital identities, based on digital synchronicity and similarity metrics.
Enables continuous, accurate monitoring of multiple individuals' vital signs and activities relative to each other within a designated space, improving situational awareness and interaction tracking, and enhancing safety and security.
Smart Images

Figure CA2024051138_06032025_PF_FP_ABST
Abstract
Description
SYSTEM AND METHOD FOR MONITORING A PLURALITY OF INDIVIDUALS IN A DESIGNATED AREAFIELD OF THE DISCLOSURE
[0001] The present disclosure relates to monitoring systems, and, in particular, to a system and method for monitoring a plurality of individuals in a designated area.BACKGROUND
[0002] The monitoring and detection of humans using contactless and wearable sensors is an active field. Work to date has focused on breath rate estimation, fall detection, congestive heart failure detection and activity classification.
[0003] Current work in the field of contactless human monitoring has been mainly limited to academic settings and the monitoring of healthy subjects. Although work has been done to advance this area of study, several challenges still exist when contactless monitoring is used to monitor humans in an uncontrolled environment with a large number of subjects.
[0004] This background information is provided to reveal information believed by the applicant to be of possible relevance. No admission is necessarily intended, nor should be construed, that any of the preceding information constitutes prior art or forms part of the general common knowledge in the relevant art.SUMMARY
[0005] The following presents a simplified summary of the general inventive concept(s) described herein to provide a basic understanding of some aspects of the disclosure. This summary is not an extensive overview of the disclosure. It is not intended to restrict key or critical elements of embodiments of the disclosure or to delineate their scope beyond that which is explicitly or implicitly described by the following description and claims.
[0006] A need exists for system and method for monitoring a plurality of individuals in a designated area that overcome some of the drawbacks of known techniques, or at least, provides a useful alternative thereto. Some aspects of this disclosure provide examples of such systems and methods. For example, some embodiments described a system and method for associating signals from a contactless sensor disposed within the designated area to concurrently monitor the plurality of individuals, and respective wearable sensors worn by respective individuals.
[0007] In accordance with one aspect, there provided a system for concurrently monitoring a plurality of registered individuals in a designated area, the system comprising: a digital processor; a contactless sensor in operative communication with said digital processor and disposed within the designated area to concurrently monitor the plurality of registered individuals and output respectively discernable contactless sensor signals digitally representative of a current individually discernable time-variable state of each of the registered individuals; a respective wearable sensor to be worn by each corresponding one of the registered individuals to wirelessly output to said digital processor: a respective digital identity associated with the corresponding one of the registered individuals, and a respective wearable sensor signal digitally representative of said current individually discernable time-variable state of the corresponding one of the registered individuals; wherein said digital processor processes said respectively discernable contactless sensor signals and each said respective wearable sensor signal to automatically associate, given at least a digital synchronicity of each said current individually discernable time-variable state, a given discernable contactless sensor signal with a corresponding said respective wearable sensor signal and said respective digital identity associated therewith, thereby associating said respective digital identity with a corresponding one of said respectively discernable contactless sensor signals.
[0008] In one embodiment, the contactless sensor comprises a radar sensor.
[0009] In one embodiment, the contactless sensor comprises at least one of a radar sensor, a Wi-Fi based system for contactless monitoring, a thermal camera, a depth camera or an RGB camera.
[0010] In one embodiment, each said wearable sensor comprises a smart watch or a smart patch.
[0011] In one embodiment, the current individually discernable time-variable state comprises a vital sign pattern.
[0012] In one embodiment, the vital sign pattern comprises at least one of a breathing activity pattern or a breathing rate.
[0013] In one embodiment, the vital sign pattern comprises at least one of a cardiac activity pattern or a heart rate.
[0014] In one embodiment, the current individually discernable time-variable state comprises a discernable anatomical motion.
[0015] In one embodiment, the discernable anatomical motion comprises at least one of a discernable activity or a motion pattern.
[0016] In one embodiment, the system further comprises a digital storage device operatively coupled to said digital processor and operable to digitally store, against each said respective digital identity, digital information automatically extracted from said respectively discernable contactless sensor signals and associated with each said respective digital identify by said digital processor given at least said digital synchronicity.
[0017] In one embodiment, the digital storage device stores against at least some said respective digital identity, at least one of a breathing rate, a breathing pattern, a hear rate, a user activity, a user interaction, or a sleeping pattern.
[0018] In one embodiment, the system further comprises a digital output operatively coupled to said digital processor, wherein said digital processor is operable to output an alert in respect of a given digital identity based on digital information automatically extracted from said respectively discernable contactless sensor signals and associated with said given digital identify by said digital processor given said digital synchronicity.
[0019] In one embodiment, the digital processor automatically evaluates a digital similarity of a digitally synchronized current individually discernable time-variable state to confirm association of said respective digital identity with said corresponding one of said respectively discernable contactless sensor signals.
[0020] In one embodiment, the digital similarity is automatically evaluated as a function of at least one of a Pearson correlation coefficient, a Concordance correlation coefficient or matched filtering.
[0021] In one embodiment, the processor extracts health-related or behavioural information from said corresponding one of said respectively discernable contactless sensor signals and automatically associates said health-related or behavioural information with said respective digital identity.
[0022] In accordance with another aspect, there is provided a method for concurrently monitoring a plurality of registered individuals in a designated area, the method comprising: acquiring, via a contactless sensor disposed within the designated area to concurrently monitor the plurality of registered individuals, respectively discernable contactless sensor signals digitally representative of a current individually discernable time-variable state of each of the registered individuals; concurrently acquiring, via a respective wearable sensor to be worn by each corresponding one of the registered individuals: a respective digital identity associated with the corresponding one of the registered individuals, and a respective wearable sensor signal digitally representative of said current individually discernable time-variable state of the corresponding one of the registered individuals; synchronously processing said respectively discernable contactless sensor signals and each said respective wearable sensor signal to automatically associate, given at least a digital synchronicity of each said current individually discernable timevariable state, a given discernable contactless sensor signal with a corresponding said respective wearable sensor signal and said respective digital identity associated therewith, thereby associating said respective digital identity with a corresponding one of said respectively discernable contactless sensor signals.
[0023] In one embodiment, the current individually discernable time-variable state comprises a vital sign pattern.
[0024] In one embodiment, the vital sign pattern comprises at least one of a breathing activity pattern or a breathing rate.
[0025] In one embodiment, the vital sign pattern comprises at least one of a cardiac activity pattern or a heart rate.
[0026] In one embodiment, the current individually discernable time-variable state comprises a discernable anatomical motion.
[0027] In one embodiment, the discernable anatomical motion comprises at least one of a discernable activity or a motion pattern.
[0028] In one embodiment, the method further comprises digitally storing, against each said respective digital identity, digital information automatically extracted from said respectively discernable contactless sensor signals and associated with each said respective digital identify by said digital processor given at least said digital synchronicity.
[0029] In one embodiment, the storing comprises storing against at least some said respective digital identity, at least one of a breathing rate, a breathing pattern, a hear rate, a user activity, a user interaction, or a sleeping pattern.
[0030] In one embodiment, the method further comprises outputting an alert in respect of a given digital identity based on digital information automatically extracted from said respectively discernable contactless sensor signals and associated with said given digital identify by said digital processor given said digital synchronicity.
[0031] In one embodiment, the method further comprises automatically evaluating a digital similarity of a digitally synchronized current individually discernable time-variable state to confirm association of said respective digital identity with said corresponding one of said respectively discernable contactless sensor signals.
[0032] In one embodiment, the digital similarity is automatically evaluated as a function of at least one of a Pearson correlation coefficient, a Concordance correlation coefficient or matched filtering.
[0033] In one embodiment, the method further comprises automatically extracting health-related or behavioural information from said corresponding one of said respectively discernable contactless sensor signals and automatically associating said health-related or behavioural information with said respective digital identity.
[0034] In accordance with another aspect, there is provided a non-transitory computer- readable medium comprising digital instructions stored therein to concurrently monitor a plurality of registered individuals in a designated area by: acquiring, via a contactless sensor disposed within the designated area to concurrently monitor the plurality of registered individuals, respectively discernable contactless sensor signals digitally representative of a current individually discernable time-variable state of each of the registered individuals; concurrently acquiring, via a respective wearable sensor to be worn by each corresponding one of the registered individuals: a respective digital identity associated with the corresponding one of the registered individuals, and a respective wearable sensor signal digitally representative of said current individually discernable time-variable state of the corresponding one of the registered individuals; and synchronously processing said respectively discernable contactless sensor signals and each said respective wearable sensor signal to automatically associate, given at least a digital synchronicity of each said current individually discernable time-variable state, a given discernable contactless sensor signal with a corresponding said respective wearable sensor signal and said respective digital identity associated therewith, thereby associating said respective digital identity with a corresponding one of said respectively discernable contactless sensor signals.
[0035] Other aspects, features and / or advantages will become more apparent upon reading of the following non-restrictive description of specific embodiments thereof, given by way of example only with reference to the accompanying drawings.BRIEF DESCRIPTION OF THE FIGURES
[0036] Several embodiments of the present disclosure will be provided, by way of examples only, with reference to the appended drawings, wherein:
[0037] Figure 1 is a high-level diagram of a system for monitoring a plurality of individuals in a designated area using a contactless sensor and respective wearable sensors, in accordance with one embodiment;
[0038] Figure 2 is a diagram of an exemplary system for monitoring a plurality of individuals in a designated area using a contactless radar sensor and respective smartwatch wearable sensors, in accordance with one embodiment;
[0039] Figure 3 is a high-level diagram of an illustrative data processing flow for acquiring and associating contactless and wearable sensor signals based on synchronization of a current individually discernable time-variable state, in accordance with one embodiment;
[0040] Figure 4 is a more detailed flow diagram of illustrative processing steps for associating contactless and wearable sensor signals acquired using the system of Figure 2, in which the system relies on a breathing-related state to associate signals and user identity, in accordance with one embodiment; and
[0041] Figure 5 is a more detailed flow diagram of illustrative processing steps for associating contactless and wearable sensor signals acquired using the system of Figure 2, in which the system relies on an anatomical motion-related state to associate signals and user identity, in accordance with one embodiment.
[0042] Elements in the several figures are illustrated for simplicity and clarity and have not necessarily been drawn to scale. For example, the dimensions of some of the elements in the figures may be emphasized relative to other elements for facilitating understanding of the various presently disclosed embodiments. Also, common, but well -understood elements that are useful or necessary in commercially feasible embodiments are often notdepicted in order to facilitate a less obstructed view of these various embodiments of the present disclosure.DETAILED DESCRIPTION
[0043] Various implementations and aspects of the specification will be described with reference to details discussed below. The following description and drawings are illustrative of the specification and are not to be construed as limiting the specification. Numerous specific details are described to provide a thorough understanding of various implementations of the present specification. However, in certain instances, well-known or conventional details are not described in order to provide a concise discussion of implementations of the present specification.
[0044] Various apparatuses and processes will be described below to provide examples of implementations of the system disclosed herein. No implementation described below limits any claimed implementation and any claimed implementations may cover processes or apparatuses that differ from those described below. The claimed implementations are not limited to apparatuses or processes having all of the features of any one apparatus or process described below or to features common to multiple or all of the apparatuses or processes described below. It is possible that an apparatus or process described below is not an implementation of any claimed subject matter.
[0045] Furthermore, numerous specific details are set forth in order to provide a thorough understanding of the implementations described herein. However, it will be understood by those skilled in the relevant arts that the implementations described herein may be practiced without these specific details. In other instances, well-known methods, procedures and components have not been described in detail so as not to obscure the implementations described herein.
[0046] In this specification, elements may be described as “configured to” perform one or more functions or “configured for” such functions. In general, an element that is configured to perform or configured for performing a function is enabled to perform thefunction, or is suitable for performing the function, or is adapted to perform the function, or is operable to perform the function, or is otherwise capable of performing the function.
[0047] It is understood that for the purpose of this specification, language of “at least one of X, Y, and Z” and “one or more of X, Y and Z” may be construed as X only, Y only, Z only, or any combination of two or more items X, Y, and Z (e.g., XYZ, XY, YZ, ZZ, and the like). Similar logic may be applied for two or more items in any occurrence of “at least one ...” and “one or more...” language.
[0048] Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs.
[0049] Throughout the specification and claims, the following terms take the meanings explicitly associated herein, unless the context clearly dictates otherwise. The phrase “in one of the embodiments” or “in at least one of the various embodiments” as used herein does not necessarily refer to the same embodiment, though it may. Furthermore, the phrase “in another embodiment” or “in some embodiments” as used herein does not necessarily refer to a different embodiment, although it may. Thus, as described below, various embodiments may be readily combined, without departing from the scope or spirit of the innovations disclosed herein.
[0050] In addition, as used herein, the term “or” is an inclusive “or” operator, and is equivalent to the term “and / or,” unless the context clearly dictates otherwise. The term “based on” is not exclusive and allows for being based on additional factors not described, unless the context clearly dictates otherwise. In addition, throughout the specification, the meaning of "a," "an," and "the" include plural references. The meaning of "in" includes "in" and "on."
[0051] As used in the specification and claims, the singular forms “a”, “an” and “the” include plural references unless the context clearly dictates otherwise.
[0052] The term “comprising” as used herein will be understood to mean that the list following is non-exhaustive and may or may not include any other additional suitableitems, for example one or more further feature(s), component(s) and / or element(s) as appropriate.
[0053] Monitoring humans and human activity is a large and continuously evolving field. Modern monitoring techniques leverage the latest technologies to gather data on humans during various daily activities. These techniques can serve personal use for individuals or be employed commercially by businesses, as well as publicly by governments and organizations. Tracking people’s locations, activities, interactions, and movements has many applications and is becoming increasingly prevalent in everyday life.
[0054] While monitoring and detecting humans and human activity using sensors is an active field, technology allowing the monitoring and identification of multiple humans simultaneously in the same space is still relatively underdeveloped. Existing sensor technology lacks sufficient monitoring accuracy needed to differentiate and identify multiple individuals within a common space.
[0055] One common form of sensor is the body-worn sensor. These sensors can be found in the form of a wearable device, such as a smartwatch, or body-mounted devices such as a smart patch. Body-worn sensors can be effective at monitoring, recording, and outputting data reflective of the wearer's heart rate, heart rate variability, sleeping patterns, exercise levels, and movements, for example. They can be used to track an individual’s motions, vital signs, and locations, providing valuable health, activity and motion insights. These body-worn sensors provide personalized feedback and health parameters to the wearer based on the sensed vital signs, motions and activity levels, making them a useful tool for personal health monitoring and management.
[0056] However, despite their effectiveness in monitoring the wearer's data, body -worn sensors lack the capability to accurately place an individual within a space or monitor their activities relative to other individuals. This limitation is significant when understanding the interaction between multiple people is required, such as in crowded workplaces, public events, or assisted living facilities. Without the ability to monitor an individual's position and actions relative to others, body-worn sensors fall short in applications that require situational awareness and interaction tracking.
[0057] Another common form of sensor for monitoring human activities is the contactless infrastructure sensors. These sensors can be effective at monitoring individuals and their activities without the need for physical contact or interaction. These sensors, which may include, but are not limited to, radar, WiFi detection, RGB cameras, depth cameras, and thermal cameras, can be used across various sectors, including private, commercial, and government domains. To date, advances in this technology have focused on breath rate estimation, fall detection, congestive heart failure detection based on breathing patterns and activity classification. Algorithms exist to classify posture, activity, and estimate breathing rate and heart rate in very specific orientations or fixed ranges from the radar. Examples of industries that utilize these forms of contactless sensors include healthcare, assisted living facilities, workplace safety, public safety, correctional facilities, and child and infant monitoring. By capturing and analyzing data without physical contact, these sensors provide a non-invasive means of tracking individuals, ensuring safety, and enhancing security. Their ability to continuously monitor and transmit real-time sensor data makes them effective in situations where ongoing individual tracking is important.
[0058] However, despite their effectiveness in monitoring single individuals, contactless sensors struggle to simultaneously track multiple individuals in a common space. This limitation becomes particularly evident in environments that require monitoring individuals relative to each other in a designated area. Additionally, contactless sensors lack robustness in signal association techniques required for recording the vital signs for multiple subjects. Current technologies struggle to differentiate and accurately monitor several people at once, leading to potentially incorrect sensor data, and gaps in safety and security. Enhancing these systems to support multi-individual tracking would significantly improve their utility, allowing for better management of group dynamics, individual health tracking, and more efficient emergency responses in scenarios involving multiple individuals.
[0059] A need therefore exists for a monitoring system capable of continuously monitoring multiple individuals in a designated area. For example, a system that can concurrently monitor the activities, vital signs, and / or health parameters of multiple individuals, relative to each other, within the same space, but be particularly useful.Accordingly, the systems and methods described herein provide, in accordance with different embodiments, provide different examples of a monitoring system for monitoring a plurality of individuals within a designated space.
[0060] With reference to Figure 1, and in accordance with one embodiment, such a system, generally referred using the numeral 20, will now be described at a high level. In the illustrated embodiment, the system 20 is generally operated to concurrently monitor a plurality of registered individuals in a designated area, denoted here as area 10. The system 20 generally comprises a digital processor 15, and a contactless sensor 14 in operative communication therewith and disposed within the designated area 10 to concurrently monitor the plurality of registered individuals. In general, the contactless sensor, such as a radar, Wi-Fi, RGB, depth camera, thermal camera or like sensor, is operable to concurrently monitor the individuals within the area 10, and output respectively discernable contactless sensor signals digitally representative of a current individually discernable time-variable state of each of the registered individuals. For example, while each individual is not uniquely identifiable from the contactless sensor data, a respective time-variable attribute may be extracted and monitored in respect of each individual in the sensor’s sensing radius or field of view. Examples of time-variable states may include, but are not limited to, physiological states such as those related to an individual’s vital sign(s) (respiration rate, heart rate, etc.), and / or anatomical motion statues such as body motions, gestures and / or movements.
[0061] The system further comprises a respective wearable sensor 11 to be worn by each corresponding one of the registered individuals to wirelessly output to the digital processor 15: a respective digital identity associated with the corresponding one of the registered individuals, and a respective wearable sensor signal digitally representative of the current individually discernable time-variable state of the corresponding one of the registered individuals.
[0062] The processor 15, synchronously acquiring both the contactless sensor signals and wearable sensor signals, can process them to automatically associate, given at least a digital synchronicity of each individually discernable time-variable state, a givendiscernable contactless sensor signal with a corresponding wearable sensor signal. Accordingly, a respective digital identity associated with a given wearable sensor signal can be digitally associated with its corresponding contactless sensor signal and related attributes.
[0063] For example, in accordance with certain embodiments, the monitoring system may evaluate the vital sign signals of monitored individuals to identify and differentiate them. Various embodiments may alternatively or additionally assess the motions and activities of the monitored individuals to achieve identification and differentiation. In accordance with various embodiments, such a monitoring system may further process the vital sign and motion signals to associate health parameters with the monitored individuals, further identifying and differentiating the individuals being monitored.
[0064] In accordance with various embodiments, a monitoring system designed to observe the activities and vital signs of a plurality of individuals enables continuous monitoring within a designated space using multiple sensors. For example, in one embodiment, signals from a contactless sensor are transmitted to a digital processor. Simultaneously, respective body -worn sensors worn by the monitored individuals transmit signals to the same digital processor. In one example, which will be described in greater detail below, the digital processor can be operated to remove clutter and identify vital signs and / or motions recorded from the monitored individuals. Furthermore, the digital processor can then analyze the signals to identify correlations between the sensor data, for example, corresponding to a respective temporally synchronized and digitally distinguishable timevariable state each monitored individual. In some examples, this correlation can be measured based on a similarity metric, e.g. establishing a correlation threshold. When this threshold is exceeded, a correlation between the contactless sensor data and body-worn sensor data is established, and the correlating data can be assigned to the corresponding monitored individual, enabling the monitoring system to identify the individual based on their sensor signals and differentiate them from the plurality of individuals.
[0065] In accordance with various embodiments, the contactless sensor, which may be in the form of a radar, WIFI monitoring, thermal camera, depth camera, or a Red GreenBlue (RGB) camera, is used to monitors a plurality of individuals within a designated area. The sensor signals are transmitted back to the digital processor where they are processed to identify the vital signs, e.g. representative of breathing, and motions of the individuals being monitored, for example.
[0066] Similarly, in accordance with various embodiments, the body-worn sensor, which may be in the form of a smartwatch or smart patch, is worn by the same individuals being monitored by the contactless sensor. Through the use of various body-worn sensor signals, which may include, but are not limited to photopl ethy smogram (PPG) signals, the body worn sensor can monitor one or more of the wearer’s heart rate, heart rate variability, breathing and / or motions. These signals are transmitted back to the digital processor where they are further processed and compared against the contactless sensor signals for correlations in vital signs and / or motions.
[0067] In accordance with various embodiments, the digital processor further processes the sensor signals to associate the monitored vital signs and motions with corresponding health parameters related to those characteristics. Utilizing a similarity metric and correlation threshold as previously described, for example, the digital processor identifies correlations between the monitored vital signs and motion characteristics, and the health parameter characteristics. If a correlation is detected, the health parameters are associated with the corresponding individual. The ongoing monitoring of these health parameters, and the collection of the associated data, can be used for medical purposes, for example, or other scenarios as will be appreciated by the skilled artisan.
[0068] As described, the monitoring system, in some embodiments, employs a similarity metric and correlation threshold to link temporally synchronized signals and health parameters with the corresponding individuals being monitored. In certain embodiments, the similarity metric utilizes either the Pearson Correlation Coefficient, a Concordance Correlation Coefficient or Matched Filtering to identify correlations among the processed sensor signals and health parameter data. Both correlation coefficients assess the degree of association between two variables. Specifically, these coefficients evaluatethe relationship between the sensed vital signs, motion, and / or health parameters in relation to the sensed vital signs or motion.
[0069] With reference now to Figure 2, and in accordance with a more detailed embodiment, the process of monitoring multiple individual’s activity and health effects using a contactless sensor 104, and body -worn sensors on individuals 101 and 102, within a room 100, is depicted. It will be appreciated that the process illustrated is a simplified process, and that each step of the process may be broken down into more detailed, or alternate, computer-executable processes.
[0070] In the example, of Figure 2, the process for monitoring various individuals within a common space, referred to as room 100, utilizes a contactless sensor in the form of radar 104 and body -worn sensors in the form of smartwatches worn by individuals 101 and 102. The radar 104 monitors the individuals and transmits sensor data to a central digital processor 105, which has multiple processing blocks, and where the sensor readings are processed 107 to identify breathing characteristics and / or motions of the monitored individuals. Simultaneously, the body -worn sensors on individuals 101 and 102 record and wirelessly transmit sensor signals related to each individual's vital signs and / or activities via Bluetooth™ 106, or the like, to the digital processor 105 through an antenna 112. The digital processor processes the sensor signals from both the radar 104 and the smartwatch sensors to isolate and identify signals representative of the individuals' breathing and / or motions. Using the described correlation coefficient, in one example, the digital processor identifies correlations between the breathing and / or motion signals from the radar and the smartwatches. When a correlation is detected between the body-worn sensor and the contactless sensor, the digital processor 105 associates the sensed data with the respective individuals in the space 100. The digital processor 105 can further process the sensor signals to identify correlations between the sensed characteristics and health parameters corresponding to these characteristics 110, for example. The monitored characteristics and health parameters can then be stored in a database 111, or again used to output an alert in respect of a particular individual, as appropriate.
[0071] Figure 3, in accordance with various embodiments, further describes the procedure for associating sensor data with a person’s identification and their health parameters. In stage 1 (206), a contactless sensor concurrently collects data from the individuals being monitored 200, while a body-worn sensor, in one example, uses photoplethysmography (PPG) and accelerometer signals to simultaneously collect data from the same monitored individuals 201. In stage 2 (207), the raw data from the contactless sensor 200 is processed to estimate each individual’s breathing rate and detect activities 202. PPG and accelerometer signals 201 from the wearable device are also processed to synchronously estimate the individual’s breathing rate estimation and detect activity 203. In stage 3 (208), the synchronized breathing rate estimations and activity information from 202 and 203 are compared using a correlation coefficient 204 to identify the monitored individual based on their monitored data.
[0072] Furthermore, the contactless sensor’s data 200, body -worn devices’ data 201, and correlation data 204 can be used to identify health parameters and vital signs corresponding to the monitored individuals. The digital processor further processes the sensor signals to identify and output health parameters and vital signs corresponding to the breathing rate and activities detected from the monitored individuals 205.
[0073] In accordance with various embodiments, Figure 4 schematically illustrates a procedure for collecting, processing, and correlating the signals associated with, in this example, a stationary subject 301, using a body -worn sensor, in the form of a smartwatch, and a contactless sensor, in the form of a radar 303. A digital processor 304, receives and processes the data in three stages of processing. These stages include processing the contactless sensor data to extract breathing signal estimation 305, processing the body- worn sensor data to extract breathing signal estimation 306, and using a correlation coefficient to associate the extracted breathing signal estimations from both sensors to identify the monitored individual within a group of individuals 307.
[0074] In the contactless sensor data processing step 305, a contactless sensor in the form of a radar 303 collects signals reflected from the stationary subject 301. The signals are processed using the digital processor 304 to remove any clutter or unwanted data 308,used to identify the number of individuals and their locations within a space 309, classify the activities of each of the individuals 310, and finally, if the individuals are stationary, extract estimated breathing signals from each of the individuals 311.
[0075] In the body -worn data processing step 306, a body -worn sensor in the form of a smartwatch, carried on the individual 301, wirelessly transmits PPG signals 302 to the digital processor 304. The digital processor extracts and processes the PPG signal 312, classifies the wearer’s activities 313, and, extracts the estimated breathing signals from the individual 314.
[0076] The breathing signals generated by the contactless sensor 315 and the body- worn sensor 316 are then processed to identify correlations between the data 307. Here, they are compared using a correlation coefficient 317, which identifies similarities between each of the breathing signals. If this process identifies a similarity above a given threshold, the signals are considered to be from the same individual. The signals are then associated to the corresponding individual.
[0077] In accordance with another embodiment, Figure 5 schematically illustrates an exemplary procedure 418 for collecting, processing, and correlating signals associated with the movement of subject 401 using a body -worn sensor, specifically a smartwatch, and a contactless sensor, specifically radar 403. This example and procedure adhere to the same steps described in Figure 4. However, instead of extracting breathing signals, the individual's motion signals are extracted and used to find correlations between sensors to identify the individual.
[0078] Figure 5 schematically illustrates an exemplary procedure for collecting, processing, and correlating the signals associated with the moving subject 401 using a body-worn sensor, in the form of a smartwatch, and a contactless sensor, in the form of a radar 403. A computational unit 404 receives and processes the data in three illustrative stages of processing. These stages include processing the contactless sensor data 405 to extract motion signals, processing the body-worn sensor data 406 to extract activity signal estimation of mobile individuals, and, using a correlation technique, associating theextracted motion and activity signals from both sensors 407 to identify the monitored individual within a group of individuals.
[0079] In the contactless sensor data processing step 405, a contactless sensor in the form of a radar 403 collects signals reflected from the moving subject 401. The signals are processed using the digital processor 404 to remove any clutter or unwanted data 408, and then used to identify the number of individuals and their locations within a space 409, classify the activities of each of the individual’s 410, and finally, extract motion signals from each of the individuals 411.
[0080] In the body-worn data processing step 406, a body-worn sensor in the form of a smartwatch, carried on the individual 401, wirelessly transmits accelerometer signals 402 to the digital processor 404. The digital processor implements processing steps, including extracting and filtering the accelerometer signals 412, classifying the wearer’s activities 413, and, extracting estimated activity signals from the mobile individual 414.
[0081] The motion signals generated by the contactless sensor 415 and the activity signals generated by the body -worn sensor 416 are then processed to identify correlations between the data 407. Here, they are compared using a correlation coefficient 417, which identifies similarities between each of the activity signals. If this process identifies a similarity above a given threshold, the signals are associated to the corresponding individual.
[0082] While the above examples distinguish processes for monitoring and associating data based on discernable time-variable states associated with vital sign(s) or anatomical motion patterns, respectively, it will be appreciated that a given system may be operable to monitor for, and associate data based on both vital sign(s) and motion data, as available, so to increase the number of conditions in which the data can be effectively associated, and / or to increase an accuracy and reliability of the associated data. Naturally, other synchronously detected signal patterns concurrently acquired and processed from wearable and contactless sensors may also, or alternatively, be considered to provide a similar solution.
[0083] While the present disclosure describes various embodiments for illustrative purposes, such description is not intended to be limited to such embodiments. On the contrary, the applicant's teachings described and illustrated herein encompass various alternatives, modifications, and equivalents, without departing from the embodiments, the general scope of which is defined in the appended claims. Except to the extent necessary or inherent in the processes themselves, no particular order to steps or stages of methods or processes described in this disclosure is intended or implied. In many cases the order of process steps may be varied without changing the purpose, effect, or import of the methods described.
[0084] Information as herein shown and described in detail is fully capable of attaining the above-described object of the present disclosure, the presently preferred embodiment of the present disclosure, and is, thus, representative of the subject matter which is broadly contemplated by the present disclosure. The scope of the present disclosure fully encompasses other embodiments which may become apparent to those skilled in the art, and is to be limited, accordingly, by nothing other than the appended claims, wherein any reference to an element being made in the singular is not intended to mean "one and only one" unless explicitly so stated, but rather "one or more." All structural and functional equivalents to the elements of the above-described preferred embodiment and additional embodiments as regarded by those of ordinary skill in the art are intended to be encompassed by the present claims. Moreover, no requirement exists for a system or method to address each and every problem sought to be resolved by the present disclosure, for such to be encompassed by the present claims. Furthermore, no element, component, or method step in the present disclosure is intended to be dedicated to the public regardless of whether the element, component, or method step is explicitly recited in the claims. However, that various changes and modifications in form, material, work-piece, and fabrication material detail may be made, without departing from the spirit and scope of the present disclosure, as set forth in the appended claims, as may be apparent to those of ordinary skill in the art, are also encompassed by the disclosure.
Claims
CLAIMSWhat is claimed is:
1. A system for concurrently monitoring a plurality of registered individuals in a designated area, the system comprising: a digital processor; a contactless sensor in operative communication with said digital processor and disposed within the designated area to concurrently monitor the plurality of registered individuals and output respectively discernable contactless sensor signals digitally representative of a current individually discernable time-variable state of each of the registered individuals; a respective wearable sensor to be worn by each corresponding one of the registered individuals to wirelessly output to said digital processor: a respective digital identity associated with the corresponding one of the registered individuals, and a respective wearable sensor signal digitally representative of said current individually discernable time-variable state of the corresponding one of the registered individuals; wherein said digital processor processes said respectively discernable contactless sensor signals and each said respective wearable sensor signal to automatically associate, given at least a digital synchronicity of each said current individually discernable timevariable state, a given discernable contactless sensor signal with a corresponding said respective wearable sensor signal and said respective digital identity associated therewith, thereby associating said respective digital identity with a corresponding one of said respectively discernable contactless sensor signals.
2. The system of claim 1, wherein said contactless sensor comprises a radar sensor3. The system of claim 1, wherein said contactless sensor comprises at least one of a radar sensor, a Wi-Fi based system for contactless monitoring, a thermal camera, a depth camera or an RGB camera.
4. The system of any one of claims 1 to 3, wherein each said wearable sensor comprises a smart watch or a smart patch.
5. The system of any one of claims 1 to 4, wherein said current individually discernable time-variable state comprises a vital sign pattern.
6. The system of claim 5, wherein said vital sign pattern comprises at least one of a breathing activity pattern or a breathing rate.
7. The system of claim 5, wherein said vital sign pattern comprises at least one of a cardiac activity pattern or a heart rate.
8. The system of any one of claims 1 to 7, wherein said current individually discernable time-variable state comprises a discernable anatomical motion.
9. The system of claim 8, wherein said discernable anatomical motion comprises at least one of a discernable activity or a motion pattern.
10. The system of any one of claims 1 to 9, wherein the system further comprises a digital storage device operatively coupled to said digital processor and operable to digitally store, against each said respective digital identity, digital information automatically extracted from said respectively discernable contactless sensor signals and associated with each said respective digital identify by said digital processor given at least said digital synchronicity.
11. The system of claim 10, wherein said digital storage device stores against at least some said respective digital identity, at least one of a breathing rate, a breathing pattern, a hear rate, a user activity, a user interaction, or a sleeping pattern.
12. The system of any one of claims 1 to 11, wherein the system further comprises a digital output operatively coupled to said digital processor, wherein said digital processor is operable to output an alert in respect of a given digital identity based on digital information automatically extracted from said respectively discernable contactless sensor signals and associated with said given digital identify by said digital processor given said digital synchronicity.
13. The system of any one of claims 1 to 12, wherein said digital processor automatically evaluates a digital similarity of a digitally synchronized current individuallydiscernable time-variable state to confirm association of said respective digital identity with said corresponding one of said respectively discernable contactless sensor signals.
14. The system of claim 13, wherein said digital similarity is automatically evaluated as a function of at least one of a Pearson correlation coefficient, a Concordance correlation coefficient or matched filtering.
15. The system of any one of claims 1 to 14, wherein said processor extracts health- related or behavioural information from said corresponding one of said respectively discernable contactless sensor signals and automatically associates said health-related or behavioural information with said respective digital identity.
16. A method for concurrently monitoring a plurality of registered individuals in a designated area, the method comprising: acquiring, via a contactless sensor disposed within the designated area to concurrently monitor the plurality of registered individuals, respectively discernable contactless sensor signals digitally representative of a current individually discernable time-variable state of each of the registered individuals; concurrently acquiring, via a respective wearable sensor to be worn by each corresponding one of the registered individuals: a respective digital identity associated with the corresponding one of the registered individuals, and a respective wearable sensor signal digitally representative of said current individually discernable time-variable state of the corresponding one of the registered individuals; synchronously processing said respectively discernable contactless sensor signals and each said respective wearable sensor signal to automatically associate, given at least a digital synchronicity of each said current individually discernable time-variable state, a given discernable contactless sensor signal with a corresponding said respective wearable sensor signal and said respective digital identity associated therewith, thereby associating said respective digital identity with a corresponding one of said respectively discernable contactless sensor signals.
17. The method of claim 1, wherein said current individually discernable time-variable state comprises a vital sign pattern.
18. The method of claim 17, wherein said vital sign pattern comprises at least one of a breathing activity pattern or a breathing rate.
19. The method of claim 17, wherein said vital sign pattern comprises at least one of a cardiac activity pattern or a heart rate.
20. The method of any one of claims 16 to 19, wherein said current individually discernable time-variable state comprises a discernable anatomical motion.
21. The method of claim 20, wherein said discernable anatomical motion comprises at least one of a discernable activity or a motion pattern.
22. The method of any one of claims 16 to 21, wherein the method further comprises digitally storing, against each said respective digital identity, digital information automatically extracted from said respectively discernable contactless sensor signals and associated with each said respective digital identify by said digital processor given at least said digital synchronicity.
23. The method of claim 22, wherein said storing comprises storing against at least some said respective digital identity, at least one of a breathing rate, a breathing pattern, a hear rate, a user activity, a user interaction, or a sleeping pattern.
24. The method of any one of claims 16 to 23, wherein the method further comprises outputting an alert in respect of a given digital identity based on digital information automatically extracted from said respectively discernable contactless sensor signals and associated with said given digital identify by said digital processor given said digital synchronicity.
25. The method of any one of claims 16 to 24, wherein the method further comprises automatically evaluating a digital similarity of a digitally synchronized current individually discernable time-variable state to confirm association of said respective digital identity with said corresponding one of said respectively discernable contactless sensor signals.
26. The method of claim 25, wherein said digital similarity is automatically evaluated as a function of at least one of a Pearson correlation coefficient, a Concordance correlation coefficient or matched filtering.
27. The method of any one of claims 16 to 26, wherein the method further comprises automatically extracting health-related or behavioural information from said corresponding one of said respectively discernable contactless sensor signals and automatically associating said health-related or behavioural information with said respective digital identity.
28. A non-transitory computer-readable medium comprising digital instructions stored therein to concurrently monitor a plurality of registered individuals in a designated area by: acquiring, via a contactless sensor disposed within the designated area to concurrently monitor the plurality of registered individuals, respectively discernable contactless sensor signals digitally representative of a current individually discernable time-variable state of each of the registered individuals; concurrently acquiring, via a respective wearable sensor to be worn by each corresponding one of the registered individuals: a respective digital identity associated with the corresponding one of the registered individuals, and a respective wearable sensor signal digitally representative of said current individually discernable time-variable state of the corresponding one of the registered individuals; and synchronously processing said respectively discernable contactless sensor signals and each said respective wearable sensor signal to automatically associate, given at least a digital synchronicity of each said current individually discernable time-variable state, a given discernable contactless sensor signal with a corresponding said respective wearable sensor signal and said respective digital identity associated therewith, thereby associating said respective digital identity with a corresponding one of said respectively discernable contactless sensor signals.
29. The non-transitory computer-readable medium of claim 28, wherein said current individually discernable time-variable state comprises a vital sign pattern.
30. The non-transitory computer-readable medium of claim 29, wherein said vital sign pattern comprises at least one of a breathing activity pattern or a breathing rate.
31. The non-transitory computer-readable medium of claim 29, wherein said vital sign pattern comprises at least one of a cardiac activity pattern or a heart rate.
32. The non-transitory computer-readable medium of any one of claims 28 to 31, wherein said current individually discernable time-variable state comprises a discernable anatomical motion.
33. The non-transitory computer-readable medium of claim 32, wherein said discernable anatomical motion comprises at least one of a discernable activity or a motion pattern.
34. The non-transitory computer-readable medium of any one of claims 28 to 33, wherein the instructions further comprise instructions for digitally storing, against each said respective digital identity, digital information automatically extracted from said respectively discernable contactless sensor signals and associated with each said respective digital identify by said digital processor given at least said digital synchronicity.
35. The non-transitory computer-readable medium of claim 34, wherein said storing comprises storing against at least some said respective digital identity, at least one of a breathing rate, a breathing pattern, a hear rate, a user activity, a user interaction, or a sleeping pattern.
36. The non-transitory computer-readable medium of any one of claims 28 to 35, wherein the method further comprises outputting an alert in respect of a given digital identity based on digital information automatically extracted from said respectively discernable contactless sensor signals and associated with said given digital identify by said digital processor given said digital synchronicity.
37. The non-transitory computer-readable medium of any one of claims 28 to 36, wherein the instructions further comprise instructions for automatically evaluating a digital similarity of a digitally synchronized current individually discernable time-variable stateto confirm association of said respective digital identity with said corresponding one of said respectively discernable contactless sensor signals.
38. The non-transitory computer-readable medium of claim 37, wherein said digital similarity is automatically evaluated as a function of at least one of a Pearson correlation coefficient, a Concordance correlation coefficient or matched filtering.
39. The non-transitory computer-readable medium of any one of claims 28 to 38, wherein the instructions further comprise instructions for automatically extracting health- related or behavioural information from said corresponding one of said respectively discernable contactless sensor signals and automatically associating said health-related or behavioural information with said respective digital identity.
Citation Information
Patent Citations
Remote monitoring system of human activity
US20180292523A1
Sensor fusion for monitoring an object-of-interest in a region
US20190332901A1
Mood-based risk assessment of individuals of a crowd in a public space
US20210158056A1
Contactless vital sign monitoring of multiple subjects in real-time
US20230157550A1