Sensor device and system for monitoring people

Abstract

A system and sensor device for observing the presence, position, movement, and / or posture of a person within a monitoring area. The sensor device (100, 200, 210, 220, 230, 240, 300, 401) includes at least one means for processing sensor measurement signals, e.g., measurement electronics, and at least one means for transmitting measurement results and / or data related to the measurement results for further processing. The sensor device (100, 200, 210, 220, 230, 240, 300, 401) includes at least two sensors configured to measure in different directions. The at least two sensors are radar-based sensors, such as frequency-modulated continuous wave MIMO radar-based sensors, configured to detect a person within the monitoring area (400) and measure and detect the movement, position, speed, path, and / or shape of the monitored person.

Description

[Technical Field]

[0001] The present invention relates to a sensor device and system for monitoring people. [Background technology]

[0002] Monitoring people is useful in many situations. For example, it is important to monitor the condition of elderly people in their home environment if it is desired to improve their chances of coping in that environment. Safety bracelet systems are currently widely used for such purposes. Their weaknesses are that the user must wear the bracelet continuously and must be able to press an alarm button in case of an emergency. There are also bracelets that check the user's health status, but they suffer from the same problems as mentioned above, plus the problem of false alarms.

[0003] Solutions have also been presented in which a film of piezoelectric material is placed on the floor, which registers the pressure changes caused by movements on the floor surface. Also known in the prior art is the use of sensors placed on or under the floor that detect the presence and movement of people without the need for pressure changes, but which work by means of capacitive sensors.

[0004] The prior art also offers the possibility of using video cameras, motion detectors, for example based on infrared detection, or ultrasonic sensors, for example, to monitor the situation and condition of elderly people. For example, document WO 2012 / 164169 discloses a method and system based on ultrasonic technology for tracking objects.

[0005] Monitoring can also be important in retail environments, for example to understand how customers behave in a retail store and what products they purchase. And while the prior art presents several systems that can be used to monitor people in a retail environment, these individual prior art solutions are difficult to install and integrate with other systems and fail to provide reliable information about customer behavior.

[0006] Several prior art solutions are known that use millimeter wave (MMW) radar to track people.

[0007] A drawback of the observation and monitoring systems known in the prior art is that they are unable to provide reliable measurements in a wide variety of situations. Prior art systems are also difficult to install and maintain. Summary of the Invention

[0008] The aim of the solution according to the invention is to eliminate the problems of the prior art. The system according to the invention is characterized in what is stated in the characterizing part of claim 1. The system according to the invention is characterized in what is stated in the characterizing part of claims 2 to 14 relating to the system. The system according to the invention is also characterized in what is stated in the characterizing part of claim 15 relating to the system.

[0009] According to a first aspect, the present invention relates to a sensor device for observing the presence, position, movement, and / or posture of a person within a monitored area. The sensor device includes at least one means for processing sensor measurement signals, e.g., measurement electronics, and means for transmitting measurement results and / or data related to the measurement results for further processing. The sensor device includes at least two sensors configured to measure in different directions from each other, the at least two sensors being radar-based sensors, such as frequency-modulated continuous wave MIMO radar-based sensors, configured to detect a person within the monitored area and to measure and detect the movement, position, speed, path, and / or shape of the monitored person.

[0010] In one embodiment of the present invention, at least two radar-based sensors are disposed in connection with the structure and / or body of the sensor device.

[0011] In one embodiment of the present invention, the device includes three radar-type sensors arranged such that the centerline of the measurement zone of each sensor is at substantially 120 degrees to the centerline of the next sensor.

[0012] In one embodiment of the present invention, the device includes four radar-type sensors arranged such that the centerline of the measurement zone of each sensor is at substantially 90 degrees to the centerline of the next adjacent sensor.

[0013] In one embodiment of the invention, one means for processing the measurement signals of the sensors is arranged for each sensor of the at least two sensors.

[0014] In one embodiment of the invention, one means for processing the measurement signals of the sensors is arranged and connected to all sensors of the sensor arrangement.

[0015] In one embodiment of the present invention, the sensor device includes at least one speaker.

[0016] In one embodiment of the present invention, the sensor device includes at least one light source for providing emergency lighting.

[0017] In one embodiment of the invention, the sensor device comprises attachment means by which the sensor device can be attached to the opening.

[0018] In one embodiment of the present invention, the sensor device and / or each sensor is configured to monitor health-related functions of a person, such as breathing frequency and heart rate.

[0019] In one embodiment of the present invention, the sensor device and / or each sensor comprises a first mode of operation and a second mode of operation, wherein in the first mode of operation the sensor is configured to track the movements of the person being monitored, and in the second mode of operation the sensor is configured to measure and / or further analyze measurements relating to a portion of the monitoring area in which the movements of the person were observed in the first mode of operation in order to observe health-related functions of the person.

[0020] In one embodiment of the present invention, the or each sensor is configured to analyze the measurement signal such that the phase of the measurement signal is determined, e.g. in a second operating mode, to observe the person's movements, e.g. the person's heartbeat and / or breathing.

[0021] In one embodiment of the present invention, at least two of the sensors are radar sensors configured to observe the elevation, azimuth, movement, and / or distance of objects using continuous wave radar technology, such as frequency modulated continuous wave (FMCW), and / or the system or sensor device is configured to create point cloud data from information received from the radar sensors about the monitored area by combining information from multiple sensors.

[0022] In one embodiment of the present invention, the sensor device comprises means for detecting the orientation of the sensor device, e.g., an acceleration sensor, and the sensor device is configured to take the detected orientation of the sensor device into account when determining the measurement result of the monitored person, e.g., by correcting the measurement result based on the detected orientation.

[0023] According to a second aspect, the present invention relates to a system for observing the presence, position, movement and / or attitude of one or more objects in a monitored area, the system comprising at least one sensor device according to any embodiment of the present invention, the sensor device or devices being mounted in the monitored area, for example on a ceiling, a wall and / or a stand.

[0024] The solution of the present invention makes it possible to obtain valuable information about people in a monitored area. The sensor device of the present invention allows for greater spacing between installed sensors, since each sensor device includes multiple sensors. This has the advantage that the system is easier to install, wire, and maintain compared to individual sensors, since not as many individual sensors are needed to achieve good coverage. Since the sensors of the sensor device are radar-based sensors, people monitoring can be performed in a more unobtrusive way compared to, for example, cameras.

[0025] Various other advantages will become apparent to those skilled in the art based on the following detailed description.

[0026] The term "plurality," as used herein, refers to any positive integer starting from 2, e.g., 2, 3, or 4. The terms "first," "second," and "third" do not denote any order, quantity, or importance, but rather are used to distinguish one element from another.

[0027] The exemplary embodiments of the invention presented herein should not be construed as imposing limitations on the applicability of the appended claims. The verb "to comprise" is used herein as an open limitation that does not exclude the presence of unrecited features. Features recited in dependent claims may be freely combined with each other unless expressly stated otherwise.

[0028] The novel features which are believed to be characteristic of the invention are set forth with particularity in the appended claims. The invention itself, however, both as to its structure and method of operation, together with additional objects and advantages thereof, will best be understood from the following description of specific embodiments read in connection with the accompanying drawings.

[0029] The present invention will be described in more detail below using several embodiments with reference to FIGS. [Brief explanation of the drawings]

[0030] [Figure 1A] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 1B] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 1C] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 1D] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 1E] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 1F] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 2A] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 2B] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 2C] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 2D] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 2E] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 3A] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 3B] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 3C] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 3D] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 3E] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 3F] 1 shows a schematic and simplified sensor arrangement according to an embodiment of the present invention; [Figure 4] 1 shows a simplified representation of one exemplary embodiment relating to the placement of at least part of the inventive solution in a monitored area. DETAILED DESCRIPTION OF THE INVENTION

[0031] In the solution of the present invention, data from people moving within a monitored area is collected by radar-based sensors. The monitored area can be, for example, a store, a cruise ship, a hotel, a shopping mall, an office or other public place, or a residential building. The sensor device includes at least one means for processing the sensor's measurement signal, such as measurement electronics, and means for transmitting measurement results and / or data related to the measurement results for further processing. The sensor device includes at least two radar-based sensors configured to measure in different directions from each other.

[0032] The sensor device can be used to monitor the number of people in a measurement area, where people move, where people are stationary, and / or how long people remain stationary in a particular location. For example, it can determine how long a person remains motionless in a chair, bed, or floor in a home environment. For example, in a retail environment, it can determine how long a customer examines a product before making a purchase decision, such as how long a customer remains stationary near a particular product that is determined to be purchased.

[0033] In one embodiment of the present invention, multiple radar-based sensors, e.g., four, are interconnected and positioned within a single enclosure, such that each sensor measures a different direction. In one embodiment, the sensor device is configured to measure 360 ​​degrees. In the example of four radar sensors, each sensor measures a 90-degree area. In the example of three radar sensors, each sensor measures a 120-degree area. The sensor devices can be installed, for example, on the ceiling of the monitored area.

[0034] The sensor device and / or system may be configured to receive measurement information from all sensors and create point cloud data of the monitored area by combining measurement data from all radar-type sensors.

[0035] 1A-1F illustrate a schematic and simplified representation of a sensor device 100 according to one embodiment of the present invention. In this embodiment, the sensor device includes four radar sensors. The sensor device includes a base portion 101 within which at least some of the components of the sensor device are disposed. FIG. 1A illustrates the sensor device from a side view when the sensor device is installed in an opening in a ceiling structure, FIG. 1B illustrates the sensor device from below, and FIG. 1C illustrates the sensor device from above. The base portion of the sensor device may include a locking means 106 that allows the sensor device to be attached to a structure such as an opening in a ceiling 105. In one embodiment of the present invention, the locking means may be rotated from a locked position to a side of the base portion, allowing the sensor device to be pushed through, for example, an opening in a ceiling. The base portion may include an attachment point 108 for the locking means, to which the locking means may be rotated and attached, for example, during transportation and storage. The device may include a spring 107 that holds the locking means open and in an in-use position, i.e., a position that keeps the device secured to the ceiling structure. The sensor device may also include an edge portion 102 configured to be wider than the top of the base portion, such that the edge portion prevents the sensor device from passing through an opening in, for example, a ceiling. The sensor antenna 112 or antenna array may be covered by a cover portion 103. The top of the sensor device may include an opening for a connector 109, or cable, to electrically and / or communicatively connect the sensor device to an electrical and / or communication network.

[0036] FIGS. 1D, 1E, and 1F show the sensor device in cross-section, with FIG. 1E showing a cross-section along line AA in FIG. 1D and FIG. 1F showing a cross-section along line BB in FIG. 1D. The control circuit board 110 of each sensor is disposed within the base. Means for processing the sensor's measurement signals, e.g., at least part of the measurement electronics, and / or at least one means for transmitting measurement results and / or data related to the measurement results for further processing, can be implemented by the control circuit board. Each control circuit board 110 is connected to a radar circuit board 111 on which at least one radar antenna 112 or antenna array is disposed. The control circuit board 110 is disposed at a 90-degree angle relative to the next control circuit board, as shown. The radar circuit board 111 and antenna 112 or antenna array are also disposed at a 90-degree angle relative to the next radar circuit board and antenna or antenna array. To ensure an optimal measurement area 113 and monitoring distance of the sensor array, the radar circuit board and antenna or antenna array can be tilted downward.

[0037] 2A-2E illustrate various sensor device configurations. In some embodiments of the present invention, the number and arrangement of sensors installed in a sensor device can be selected. In FIG. 2A, one sensor 201 is installed in sensor device 200. This type of sensor device can be used, for example, in a corner of a space when a large measurement area 202 is not required. FIG. 2B illustrates sensor device 210 with two sensors 211 and 212. In this embodiment, sensors 211 and 212 are arranged to measure in opposite directions. This embodiment can be used, for example, in a hallway. FIG. 2C illustrates sensor device 220 with two sensors 221 and 222. In this embodiment, the sensors are arranged to measure adjacent measurement areas 223 and 224 with a 90-degree angle between the sensors. This embodiment can be used, for example, in a corner and / or hallway. FIG. 2D illustrates sensor device 230 with three sensors 231, 232, and 233. In this embodiment, the sensors are positioned to measure three different directions and measurement areas 234, 235, and 236. This embodiment can be used, for example, near the edges of a measurement area, such as a wall. Figure 2E shows a sensor device 240 in which four sensors 241, 242, 243, and 244 are installed. In this embodiment, the sensors are positioned to measure different directions and measurement areas 245, 246, 247, and 248 (at 90-degree angles to each other). In this way, the sensors can monitor a 360-degree area around the sensor.

[0038] 3A-3F illustrate a sensor device similar to that of FIGS. 1A-1F in other respects, but instead of four sensors, this embodiment includes three sensors. Sensor device 300 includes a base portion 301 within which at least some of the components of the sensor device are disposed. FIG. 3A illustrates the sensor device from a side view when the sensor device is installed in an opening in a ceiling structure, FIG. 3B illustrates the sensor device from below, and FIG. 3C illustrates the sensor device from above. The base portion of the sensor device can include a locking means 306 that allows the sensor device to be attached to a structure such as an opening in a ceiling 305. In one embodiment of the present invention, the locking means 306 can be rotated from a locked position to the side of the base portion, thereby allowing the sensor device to be pushed through, for example, an opening in a ceiling. The base portion can include an attachment point 308 for the locking means, to which the locking means can be rotated and attached, for example, during transportation and storage. The device can include a spring 307 that holds the locking means open and in an in-use position, i.e., a position that keeps the device secured to the ceiling structure. The sensor device may also include an edge portion 302 configured to be wider than the top of the base portion, such that the edge portion prevents the sensor device from passing through an opening in, for example, a ceiling. The sensor antenna or antenna array may be covered by a cover portion 303. The top of the sensor device may include an opening for a connector 309, or cable, to electrically and / or communicatively connect the sensor device to an electrical and / or communication network.

[0039] 3D, 3E, and 3F show the sensor device in cross-section, with FIG. 3E showing a cross-section along line AA in FIG. 3D and FIG. 3F showing a cross-section along line BB in FIG. 3D. A control circuit board 310 for each sensor is disposed within the base. Means for processing the sensor's measurement signals, e.g., at least part of the measurement electronics, and / or at least one means for transmitting measurement results and / or data related to the measurement results for further processing, can be implemented by the control circuit board. Each control circuit board 310 is connected to a radar circuit board 311 on which at least one radar antenna or antenna array is disposed. As shown, the control circuit board 310 is disposed at a 120-degree angle relative to the next control circuit board. The radar circuit board 311 and antenna 312 or antenna array are also disposed at a 120-degree angle relative to the next radar circuit board 311 and antenna 312 or antenna array. The radar circuit board and antenna or antenna array can be tilted downward to ensure an optimal measurement area 313 monitoring distance of the sensor array.

[0040] In one embodiment of the present invention, a single radar sensor can cover an area of, for example, 10 m in diameter when installed in a corner, or 5 to 7 m when installed facing downward from the ceiling, depending on the height. With the sensor device of the present invention, there are multiple sensors measuring in different directions, so the measurement area can cover, for example, 20 m.

[0041] In one embodiment of the present invention, the sensor device includes at least one speaker.

[0042] In one embodiment of the present invention, the sensor device includes at least one light source for providing emergency lighting.

[0043] In one embodiment of the invention, the sensor device comprises attachment means by which the sensor device can be attached to the opening.

[0044] In one embodiment of the present invention, one means for processing the measurement signals of the sensors, for example a control circuit board, is arranged for each sensor of the at least two sensors. In this case, the means for processing the measurement signals of the sensors can collect or receive data from only one sensor of the sensor arrangement and transmit it to an analysis and / or further unit. In this way, the sensors of the sensor arrangement can operate independently of each other.

[0045] In one embodiment of the present invention, one means for processing the sensor measurement signals, e.g., a control circuit board, is arranged and connected to all sensors of the sensor device. In this case, the one means for processing the sensor measurement signals can collect or receive data from all sensors of the sensor device and analyze and / or transmit it to further units. In one embodiment of the present invention, the means for processing the sensor measurement signals can cycle through the controlled sensors, for example, by switching the controlled sensors every second. In this case, if the sensor device has three or four sensors, information about the movement is obtained every three or four seconds.

[0046] In one embodiment of the invention, the sensor device and / or each sensor is configured to monitor health-related functions of a person, such as breathing frequency and heart rate. In one embodiment of the invention, the sensor device and / or each sensor comprises a first mode of operation and a second mode of operation, wherein in the first mode of operation the sensor is configured to track movements of the monitored person, and in the second mode of operation the sensor is configured to measure and / or further analyze measurements relating to a portion of the monitoring area in which the movements of the person were observed in the first mode of operation, in order to observe the health-related functions of the person.

[0047] In one embodiment of the present invention, different sensors of a sensor device can be in different operational states. This allows, for example, some sensors to be used in a first operational mode and some sensors to be used in a second operational mode. The sensors can change operational modes based on the needs of the system.

[0048] In one embodiment of the present invention, the or each sensor is configured to analyze the measurement signal such that the phase of the measurement signal is determined, e.g. in a second operating mode, to observe the person's movements, e.g. the person's heartbeat and / or breathing.

[0049] In one embodiment of the present invention, at least two of the sensors are radar sensors configured to observe the elevation, azimuth, movement, and / or distance of objects using continuous wave radar technology, such as frequency modulated continuous wave (FMCW), and / or the system or sensor device is configured to create point cloud data from information received from the radar sensors about the monitored area by combining information from multiple sensors.

[0050] In one embodiment of the present invention, the sensor device comprises means for detecting the orientation of the sensor device, e.g., an acceleration sensor, and the sensor device is configured to take the detected orientation of the sensor device into account when determining the measurement result of the monitored person, e.g., by correcting the measurement result based on the detected orientation.

[0051] FIG. 4 shows a simplified example embodiment relating to the placement of sensor devices in a space to be monitored. In this example embodiment, the sensor devices are placed in a store, and FIG. 4 shows the store as viewed from above. Sensor devices 401 are placed above aisles between shelves 410 in the store, so that the sensor devices can measure the area where people move between the shelves. In this example, the measurement areas of all sensor devices 401 placed in the store essentially cover all areas 400 where people may move. The sensors can be placed so that they face directly downward or at a slight angle.

[0052] In one embodiment of the present invention, the sensor device may be used to detect and / or signal whether sprinklers have been activated within the monitored space.

[0053] In one embodiment of the present invention, in a retail environment, the system may include or be connected to an electronic price label system. The electronic price label base station may be configured to determine the location of the electronic price label by measuring the electronic price label with different base stations from different directions. The system may have a direction of arrival detection mode, in which the system can determine the location of the electronic price label by combining information on the measured label direction from different base stations, e.g., triangulation. This solution allows the system to gather the location and / or path of the electronic price label. In the direction of arrival detection mode, the base station may send a command to the electronic price label to transmit a signal, e.g., a Constant Tone Extension (CTE) signal, to the base station. The base station may include an antenna array, and the direction of arrival of the signal from the electronic price label may be determined from the base station's antenna array. For example, with three base stations, the label may be located.

[0054] In one embodiment, the base station of the electronic price label system can be located in the same location and / or in the same structure as the radar-based sensor(s). In this way, installation in a store environment is easier, as the means for detecting movement and the base station only need to be wired and installed in one place. This solution allows the system to collect the location and / or path of people in the store, as well as the location and / or path of electronic price labels. The device can be installed, for example, on the ceiling of the monitored area.

[0055] The sensors used in the solution of the present invention can be used to provide a "heat map" type image at various times, from which it can be seen how often or how many people move in a particular area at a particular time. This information can be used, for example, for targeted marketing and pricing. In one embodiment of the present invention, the means for detecting people's movement, presence, and / or location can be used to determine when a particular product has been removed from a shelf and / or returned to the shelf, and / or in this way determine and / or provide heat mapping data for a particular shelf.

[0056] In one embodiment of the invention, the means for detecting the movement, presence and / or position of a person may determine the fill rate of at least one shelf or part of a shelf, in another embodiment the fill rate may be determined using additional sensors, for example a planar sensor arranged on the shelf or a sensor such as a camera or distance measuring sensor arranged on the opposite side of the aisle.

[0057] In the solution of the present invention, the POS system can provide information about which products were purchased at what time from an electronic price label system or a shelf map of where each product is located in the store. Combining this information and using time constraints (delay between removing a product from the shelf and checking out at the register) allows for the formation of inferences about purchase information related to specific products.

[0058] In one embodiment of the present invention, a method includes, based on determining the presence of a person at a particular location, sending a message to a mobile device of a person at the location.

[0059] In one embodiment of the present invention, the system, e.g., an electronic price label system, can include a routing program based on a shopping list and a store map. The determined route based on the means for detecting the movement, presence, and / or location of the person can be used to compare which products cause the customer to deviate from the planned route and planned products on the shopping list. This information can be used, for example, for targeted marketing and pricing in the store. In one embodiment of the present invention, monitoring the movement of the person includes determining the route the person uses within the store using the means for detecting the movement, presence, and / or location of the person.

[0060] If a store is equipped with a sensor network containing multiple sensors, customer movements can be monitored from one sensor to another and / or the paths traveled by individual customers can be stored and compared. Motion observations generated by certain types of sensors, for example radar-based sensors, can be supplemented with other motion tracking systems such as cameras, PIR sensors, etc.

[0061] The processor, central unit and / or measurement electronics used in the solution of the present invention may be integrated into the sensor or may be located separately or in a separate unit. In one embodiment of the present invention, by means of software executed by the processor, the sensor or system is able to interpret the movements observed by at least one sensor and to issue an alarm if a program-defined alarm condition is met.

[0062] In one embodiment of the present invention, only a portion of the sensors in a monitored area have the functionality to enable the generation of an alarm signal as described above. For example, only sensors in some rooms, such as a living room, may be provided with this functionality, while sensors in other rooms immediately send notifications after a fall is detected and / or if the subject's measurement results are not within an acceptable and / or predefined range. In one embodiment of the present invention, only a portion of the sensors in one space, such as a room, include the functionality to enable the generation of an alarm signal as described above.

[0063] The system may also include a control center, and predetermined information regarding the presence, position, movement, and / or attitude of the object may be transmitted to the control center. Alarm conditions used in the system may be changed based on the presence information, which may be received, for example, from an RFID reader. Notifications may be sent or alarms may be raised, for example, wirelessly to an external alarm system or to a central server of the system, from which the alarm is forwarded.

[0064] The system may also have memory means in which it is adapted to record the measurement signals or information derived therefrom in order to observe the time-dependent behavior of objects in the monitored area. This allows the system to issue an alarm, for example, if the monitored person has not left bed or visited the kitchen for a certain period of time, or if the person goes to the toilet too frequently, or if the monitored person's vital functions, such as breathing or heart rate, change over time. The memory means also make it possible to learn more general circadian rhythms and detect abnormalities occurring therein.

[0065] In the following, one exemplary embodiment is described. In this exemplary embodiment, the first operation mode of the sensor is used to track the presence and movement of people, for example, in a single room. In this embodiment, tracking is performed using measured point cloud data. The required Doppler range is determined by:

number

[0066] In one example, if a person is moving at a speed of 1 m / s, the required Doppler range is ±40 Hz and the maximum measurement interval is 25 ms at a frequency of 60 GHz. Inhalation lasts approximately 2 seconds. If the corresponding movement is 5 cm, the required Doppler range is ±1 Hz and the sweep time is 1 second.

[0067] When the system observes that the person has stopped, it may activate a second mode of operation in which the system may track the person's vital functions, such as heart rate and / or breathing (such as breathing pauses and / or breathing frequency).

[0068] After the biological function of the object has been determined, the system can deactivate the second operating mode. In one exemplary embodiment, the system can periodically determine the biological function of the same person, for example, as long as the person is stationary. When the system observes stationary objects, the system begins to determine the biological function of these objects using the second operating mode.

[0069] In one exemplary embodiment of the present invention, operation in the second operating mode can be implemented such that, for example, when a stationary object is detected, point cloud data around the area of ​​the detected object is saved and analyzed. The saved package can be generated periodically, for example, every 600 ms. In one embodiment of the present invention, the data can be transferred to a central control unit for analysis. Analysis of the signal, i.e., the point cloud data, can provide information about small movements of the object, and thus the system can determine, for example, a person's breathing activity and / or heart rate.

[0070] In one embodiment of the present invention, the sensor sweep time is longer in the second operating mode, which allows a better signal-to-noise ratio to be achieved. Also, since more time is available for measurements, more TX antennas can be utilized. In this way, the angular resolution can be improved. The frequency sweep range can be increased to improve the distance resolution.

[0071] The Doppler frequency can be determined, for example, using a fast Fourier transform (FFT). Based on the determined Doppler frequency, biological function activity, such as heart rate and respiratory activity, can be determined. In one embodiment of the present invention, in the second operation mode, more TX antennas are used to increase spatial resolution. Since the measurement subject is not moving, signal processing can be performed on a smaller area.

[0072] In one embodiment of the present invention, the sensor may include a radio-based identification means for identifying a person. The radio-based identification means may be, for example, a Bluetooth®, Bluetooth® low energy (BLE), or Zigbee®-based means. In this embodiment, the system may recognize the object and the radio-based device carried by the object, such as a bracelet, watch, mobile device, tag, etc., and measurements may be linked to a specific recognized person. In this way, the system may know who is present within the measurement area and to whom the measurements relate.

[0073] In one embodiment of the present invention, the radio-based identification means may include an antenna array that allows for more accurate association of identification devices with their carriers when multiple people and devices are present.

[0074] In one embodiment of the present invention, the alarm may be automatically disabled when the identification means detects a particular person, such as a nurse, within the monitored area.

[0075] In one embodiment of the present invention, the alarm conditions of the system may include the identity of a person, for example, an alarm may be triggered when an unauthorized person enters a particular location.

[0076] In one embodiment of the present invention, a radio-based identification means, such as a Bluetooth®, Bluetooth® low energy (BLE), or Zigbee®-based means, can be used or can assist in locating a person. The sensor can include multiple antennas for the radio-based identification means, such as Bluetooth®, BLE, or Zigbee® antennas, to enable direction-finding technology, such as Zigbee®, Bluetooth®, or Bluetooth® low energy (BLE) direction-finding technology according to the Bluetooth® 5.1 specification. In one embodiment of the present invention, if the sensor's radar detects motion but the radio-based identification means does not detect a remotely readable tag or device (such as a Bluetooth®, BLE, or Zigbee® tag or device), the person detected by the radar can be considered a visitor. On the other hand, if the radar detects a remotely readable tag or device (such as a Bluetooth®, BLE, or Zigbee® tag or device), the detected person can be identified and an action can be performed based on the identified person. In one exemplary embodiment, if a resident is in a room and a caregiver is also present, the system can set the status of that person or room to "caregiver present." Similarly, if the system recognizes that a person who is not a resident of the room has entered the room, it can also acknowledge an alarm issued by the resident. In this case, the alarm can be automatically acknowledged. In one embodiment, the alarm is not automatically acknowledged but requires an active and identifiable event, for example, from the user device.

[0077] In one embodiment of the present invention, the identification of detected people can be performed using other means, such as a surveillance camera located in a hallway. In this case, a radar-based sensor detects that someone has entered a room, and the system can check information from the surveillance camera, such as a surveillance recording from a specific point in time where the person can be seen entering the room. In one embodiment, this recording can be linked to the room as an entry event, and if desired, the entrant can be identified by viewing the recording later. In this case, the identification can be performed automatically, but need not be implemented if automatic identification is not desired. When automatic identification from video is used, it can be implemented, for example, based on facial recognition technology. In one embodiment, facial or video-based recognition is not used if the user can be identified in other ways. In one embodiment, video-based identification is only used if the person cannot be identified in any other way.

[0078] In one embodiment of the present invention, measurements and observations collected by the sensor device of the present invention can be used for crowd control management, where people in a monitored area can be directed to the best available route, elevator, etc., based on, for example, the number of people in the area. This type of solution can be used, for example, in hotels, stores, shopping malls, offices, and cruise ships. Guidance can be implemented, for example, using light strips and / or guidance displays that can dynamically guide people.

[0079] In one embodiment of the present invention, the sensor device or information provided by the sensor device can be used to control elevators in an elevator system. In this case, the sensor means can be located, for example, in the waiting area of ​​the elevator at each floor and / or in the elevator car. The sensor device can be used to provide information about the presence and number of passengers waiting in at least the waiting area and / or the elevator car. The movement of the elevator car in the elevator system can be controlled based on information received from the sensor device or multiple sensor devices. In this embodiment, a sensor device including one to four sensors can be used, for example, based on the size of the monitoring area. For example, in one exemplary embodiment, a sensor device with one sensor can be used in the elevator car. In one embodiment of the present invention, based on the above-mentioned guidance means, people can be guided to available elevators, for example, by light strips and / or guidance displays that can dynamically guide people.

[0080] The embodiments of the invention described herein above in connection with the presented figures and summary of the invention can be used in any combination with each other, and at least two of the embodiments can be combined to form further embodiments of the invention.

[0081] The specific examples provided in the above description should not be construed as limiting the applicability and / or interpretation of the appended claims. The lists and groupings of examples provided in the above description are not exhaustive unless expressly stated otherwise.

Claims

1. 1. A sensor device for observing the presence, position, movement, and / or posture of a person within a surveillance area, comprising: the sensor device (100, 200, 210, 220, 230, 240, 300, 401) comprises at least one means for processing the measurement signals of the sensor, e.g. measurement electronics, and at least one means for transmitting measurement results and / or data related to the measurement results for further processing, the sensor device (100, 200, 210, 220, 230, 240, 300, 401) includes at least two sensors configured to measure in different directions; 1. A sensor device, characterized in that the at least two sensors are radar-based sensors, such as frequency-modulated continuous wave MIMO radar-based sensors, configured to detect people within the monitoring area (400) and measure and detect the movement, location, speed, path, and / or shape of the monitored people.

2. The sensor device according to claim 1 , characterized in that the at least two radar-based sensors are arranged in connection with a structure and / or body of the sensor device (100, 200, 210, 220, 230, 240, 300, 401).

3. 3. The sensor device of claim 1 or 2, characterized in that the device (230, 300) comprises three radar-type sensors arranged such that the centerline of the measurement zone of each sensor is at substantially 120 degrees to the centerline of the next sensor.

4. 10. A sensor arrangement according to any one of the preceding claims, characterized in that the arrangement (100, 240) comprises four radar-type sensors arranged such that the centre line of the measurement zone of each sensor is at substantially 90 degrees to the centre line of the next adjacent sensor.

5. 10. Sensor arrangement according to any one of the preceding claims, characterized in that one means for processing the measurement signals of said sensors is arranged for each sensor of said at least two sensors.

6. 10. Sensor arrangement according to any one of the preceding claims, characterized in that one means for processing the measurement signals of the sensors is arranged and connected to all sensors of the sensor arrangement.

7. 10. The sensor device according to any one of the preceding claims, characterized in that the sensor device (100, 200, 210, 220, 230, 240, 300, 401) comprises at least one speaker.

8. 10. The sensor device (100, 200, 210, 220, 230, 240, 300, 401) according to any one of the preceding claims, characterized in that the sensor device (100, 200, 210, 220, 230, 240, 300, 401) comprises at least one light source for providing emergency lighting.

9. 10. The sensor device according to any one of the preceding claims, characterized in that the sensor device (100, 200, 210, 220, 230, 240, 300, 401) comprises attachment means (106, 306) by means of which the sensor device can be attached to an opening.

10. 10. The sensor device (100, 200, 210, 220, 230, 240, 300, 401) according to any one of the preceding claims, characterized in that the sensor device (100, 200, 210, 220, 230, 240, 300, 401) and / or each sensor is configured to monitor health-related functions of the person, such as breathing frequency and heart rate.

11. the sensor device (100, 200, 210, 220, 230, 240, 300, 401) and / or each sensor includes a first mode of operation and a second mode of operation; 10. The sensor device according to any one of the preceding claims, characterized in that in the first mode of operation the sensor is configured to track the movements of the monitored person, and in the second mode of operation the sensor is configured to measure and / or further analyse measurements relating to a part of the monitoring area in which the movements of the person were observed in the first mode of operation in order to observe health-related functions of the person.

12. 10. A sensor device according to any one of the preceding claims, characterized in that the or each sensor device (100, 200, 210, 220, 230, 240, 300, 401) is configured to analyze the measurement signals so that a phase of the measurement signals is determined, e.g. in the second operation mode, in order to observe movements of the person, e.g. the heartbeat and / or breathing of the person.

13. 10. The sensor arrangement of any one of the preceding claims, wherein the at least two sensors are radar sensors configured to observe elevation, azimuth, movement and / or distance of objects using continuous wave radar technology, such as Frequency Modulated Continuous Wave (FMCW), and / or the system or sensor arrangement is configured to create point cloud data from information received from radar sensors about the monitored area by combining information from multiple sensors.

14. 10. The sensor device (100, 200, 210, 220, 230, 240, 300, 401) according to any one of the preceding claims, characterized in that the sensor device (100, 200, 210, 220, 230, 240, 300, 401) comprises means for detecting an orientation of the sensor device, e.g. an acceleration sensor, and the sensor device is configured to take the detected orientation of the sensor device into account when determining a measurement result of the monitored person, e.g. by correcting the measurement result based on the detected orientation.

15. 1. A system for observing the presence, position, movement, and / or orientation of one or more objects within a surveillance area, comprising: the system comprising at least one sensor device (100, 200, 210, 220, 230, 240, 300, 401) according to claims 1 to 14, A system, characterized in that the sensor device or multiple sensor devices (100, 200, 210, 220, 230, 240, 300, 401) are mounted in the monitored area, for example on a ceiling, a wall and / or a stand.

Images