Sensor arrangement and system for monitoring person

Abstract

The present invention relates to a system and a sensor arrangement for observing the presence, position, movement and / or posture of a person in a monitored area. The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) comprises at least one means for processing a measurement signal of a sensor, such as measurement electronics; and at least one device for transmitting the measurement results and / or data related to the measurement results for further processing. The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) comprises at least two sensors, the at least two sensors being configured to make measurements in different directions from each other. The at least two sensors are radar-based sensors, such as frequency modulated continuous wave (MIMO) radar-based sensors, configured to detect a person in the monitored area (400), and to measure and detect a movement, position, speed, route, and / or shape of the monitored person.

Description

Technical Field

[0001] The present invention relates to a sensor arrangement and a system for monitoring a person. Background Art

[0002] Monitoring people is useful in many situations. For example, monitoring the condition of elderly people in their home environment is important if one wishes to prolong the likelihood that an aging population will be well managed in their home environment. Safety bracelet systems are widely used today for these types of applications. Their disadvantage is that the user must wear the bracelet continuously and must be able to press the alarm button in an emergency. There are also bracelets that check the user's health status, but they have the same problems as described above, and in addition, there is the further problem of false alarms.

[0003] Solutions have also been proposed to install a membrane made of piezoelectric material on the floor, wherein the membrane registers the pressure changes caused by movements on the surface of the floor. It is also known in the prior art to use sensors to be installed on or under the floor, which detect the presence and movement of people without requiring changes in pressure, but function with the help of capacitive sensors.

[0004] The prior art also proposes the possibility of using cameras, motion detectors based on, for example, infrared detection, or ultrasonic sensors to monitor the condition and status of the elderly. For example, WO2012164169 discloses a method and system for tracking an object based on ultrasonic technology.

[0005] Monitoring is also important in a retail environment to understand the behavior of customers (e.g., in a retail store) and the products they are purchasing. There are also some systems in the prior art that can be used to monitor people in a retail store environment, but these individual prior art solutions are difficult to install and integrate into other systems, and they also fail to provide reliable information about customer behavior.

[0006] Some prior art solutions using millimeter wave (MMW) radar to track people are known.

[0007] A disadvantage of observation and monitoring systems known in the art is that they are unable to provide reliable measurements in different types of environments. Prior art systems are also difficult to install and maintain. Summary of the invention

[0008] The solution according to the invention aims to eliminate the problems of the prior art. The system according to the invention is characterized by what is stated in the characterizing part of claim 1. The system according to the invention is characterized by what is stated in the characterizing parts of claims 2 to 14 related to the system. The system according to the invention is also characterized by what is stated in the characterizing part of claim 15 related to the system.

[0009] According to a first aspect, the invention relates to a sensor arrangement for observing the presence, position, movement and / or posture of people in a monitored area. The sensor arrangement comprises at least one device for processing measurement signals of the sensor, such as measurement electronics; and a device for transmitting the measurement results and / or data related to the measurement results for further processing. The sensor arrangement comprises at least two sensors configured to measure in different directions from each other, wherein the at least two sensors are radar-based sensors, such as frequency modulated continuous wave MIMO radar-based sensors, which are configured to detect people in the monitored area and to measure and detect the movement, position, speed, route and / or shape of the monitored people.

[0010] In one embodiment of the invention, the at least two radar based sensors are arranged in connection with a structure and / or a body of the sensor arrangement.

[0011] In one embodiment of the invention, the arrangement comprises three radar type sensors arranged such that the centre line of the measurement area of ​​each sensor is arranged substantially 120 degrees to the centre line of the next sensor.

[0012] In one embodiment of the invention, the arrangement comprises four radar type sensors arranged such that the centre line of the measurement area of ​​each sensor is arranged at substantially 90 degrees to the centre line of the next nearby sensor.

[0013] In one embodiment of the invention, a device for processing a measurement signal of the sensor is arranged for each of the at least two sensors.

[0014] In one embodiment of the invention, one device for processing the measurement signals of the sensors is arranged and connected to all sensors of the sensor arrangement.

[0015] In one embodiment of the invention, the sensor arrangement comprises at least one loudspeaker.

[0016] In one embodiment of the invention, the sensor arrangement comprises at least one light source for providing emergency lighting.

[0017] In one embodiment of the invention, the sensor arrangement comprises attachment means, by means of which the sensor arrangement can be attached to the opening.

[0018] In one embodiment of the invention, the sensor arrangement and / or each sensor is configured to monitor health-related functions of a person, such as breathing rate and heart rate.

[0019] In one embodiment of the present invention, the sensor arrangement and / or each sensor comprises a first operating mode and a second operating mode, wherein in the first operating mode the sensor is configured to track the movements of a monitored person and in the second operating mode the sensor is configured to measure and / or further analyze measurements relating to a portion of the monitored area, wherein in the first operating mode the movements of the person are observed in order to observe the health-related functions of the person.

[0020] In one embodiment of the invention, the sensor arrangement or each sensor is configured to analyse the measurement signal in such a way as to determine its phase, eg in the second operating mode, in order to observe movements of the person, such as the person's heartbeat and / or breathing.

[0021] In one embodiment of the present invention, the at least two sensors are radar sensors configured to observe the elevation, azimuth, movement and / or distance of objects using continuous wave radar technology such as frequency modulated continuous wave (FMCW), and / or wherein the system or sensor arrangement is configured to create point cloud data for the monitored area based on information received from the radar sensors by combining information from multiple sensors.

[0022] In one embodiment of the invention, the sensor arrangement comprises means for detecting an orientation of the sensor arrangement, such as an accelerometer, and the sensor arrangement is configured to take the detected orientation into account when determining the measurement result for the monitored person, for example by compensating the measurement result based on the detected orientation of the sensor arrangement.

[0023] According to a second aspect, the present invention relates to a system for observing the presence, position, movement and / or posture of one or more objects in a monitored area. The system comprises at least one sensor arrangement according to any embodiment of the present invention, wherein the one or more sensor arrangements are mounted in the monitored area, for example on a ceiling, a wall and / or a bracket.

[0024] By means of the solution of the invention, valuable information about persons in the monitored area can be obtained. With the sensor arrangement of the invention, a greater spacing of the installed sensors can be achieved, since each sensor arrangement comprises a plurality of sensors. This has the advantage of easier installation, wiring and maintenance of the system when compared to individual sensors, since not so many individual sensors are required to achieve good coverage. Since the sensors of the sensor arrangement are radar-based sensors, monitoring of persons can be accomplished in an unobtrusive manner, for example when compared to cameras.

[0025] Various other advantages will become apparent to the skilled person based on the following detailed description.

[0026] The expression "plurality" herein refers to any positive integer starting from two, for example, two, three or four. The terms "first", "second" and "third" do not denote any order, quantity or importance, but are used to distinguish one element from another.

[0027] The exemplary embodiments of the present invention presented herein should not be interpreted as limiting the applicability of the appended claims. The verb "comprise" is used herein as an open-ended limitation, which does not exclude the presence of unlisted features. Unless explicitly stated otherwise, the features described in the dependent claims can be freely combined with each other.

[0028] The novel features which are believed to be characteristic of the invention are particularly set forth in the appended claims. The invention itself, however, both as to its construction and its method of operation, together with further objects and advantages thereof, will be best understood from the following description of specific embodiments when read in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] In the following, the present invention will be described in more detail by means of some auxiliary embodiments with reference to Figures 1 to 4, in which

[0030] Figures 1A to 1F A schematic and simplified sensor arrangement according to one embodiment of the invention is presented.

[0031] Figures 2A to 2E A schematic and simplified sensor arrangement according to one embodiment of the invention is presented.

[0032] Figures 3A to 3F A schematic and simplified sensor arrangement according to one embodiment of the invention is presented, and

[0033] Figure 4 An example embodiment relating to deploying at least a part of the solution of the invention to a monitored area is presented in a simplified manner. DETAILED DESCRIPTION

[0034] In the solution of the invention, radar-based sensors are utilized to collect data from people moving in a monitored area. The monitored area may be, for example, a store, a cruise ship, a hotel, a shopping center, an office or an apartment, a residence. The sensor arrangement comprises at least one device for processing the measurement signal of the sensor, such as measurement electronics; and a device for transmitting the measurement result and / or data related to the measurement result for further processing. The sensor arrangement comprises at least two radar-based sensors, which are configured to measure in different directions from each other.

[0035] The sensor arrangement may be used to monitor the number of people in the measurement area, where people move, where they are stationary and / or how long a person is stationary at a certain location. It may be determined how long a person is stationary in their home environment, e.g. in a chair, bed or on the floor. For example, in a retail environment it may be determined how long a customer is inspecting a product before making a purchase decision, e.g. how long they spend stationary next to a certain product that has been determined to have been purchased.

[0036] In one embodiment of the invention, a plurality of (e.g., four) radar-based sensors are arranged in connection with each other, such as in a housing, and such that each of the sensors measures a different direction from each other. In one embodiment, the sensor arrangement is configured to measure 360 ​​degrees. In the example of four radar sensors, each sensor measures a 90 degree area. In the example of three radar sensors, each sensor measures a 120 degree area. The sensor arrangement can be mounted, for example, on the ceiling of the monitored area.

[0037] The sensor arrangement and / or system may be configured to receive measurement information from each sensor and to create point cloud data of the monitored area by combining the measurement data from all radar-type sensors.

[0038] Figures 1A to 1F A sensor arrangement 100 is presented in a schematic and simplified manner, which presents a schematic and simplified sensor arrangement according to one embodiment of the present invention. In this embodiment, the sensor arrangement comprises four radar sensors. The sensor arrangement comprises a base part 101, inside which at least some of the components of the sensor arrangement are arranged. Figure 1A presents a side view of the sensor arrangement when the sensor arrangement is mounted to an opening in a ceiling structure, Figure 1B presents the sensor arrangement as viewed from below, and Figure 1CA sensor arrangement viewed from above is presented. The base portion of the sensor arrangement may include a locking device 106, with which the sensor arrangement can be attached to a structure, such as an opening in a ceiling 105. In one embodiment of the invention, the locking device can be turned from a locked position to the side of the base portion, so that the sensor arrangement can be pushed through an opening in, for example, a ceiling. The base portion may include an attachment point 108 for the locking device, to which the locking device can be turned and attached, for example during transportation and storage. The arrangement may include a spring 107, which opens the locking device and holds it in a use position, i.e., a position in which the arrangement is fastened to the ceiling structure. The sensor arrangement may also include an edge portion 102, which is arranged to be wider than an upper portion of the base portion, so that the edge portion will prevent the sensor arrangement from passing through an opening in, for example, a ceiling. The sensor antenna 112 or antenna array may be covered with a cover portion 103. At the top of the sensor arrangement there may be a connector 109 or an opening for a cable, with which the sensor arrangement can be electrically and / or communicatively connected to a power network and / or a communication network.

[0039] Figure 1D , 1E and 1F present the sensor arrangement in a cross-sectional view. Figure 1E Presented Figure 1D A cross-sectional view of the line AA of FIG. Figure 1F Presented Figure 1D A cross-sectional view at line BB of FIG. A control circuit board 110 for each sensor is arranged inside the base portion. At least a portion of the device for processing the measurement signal of the sensor (such as measurement electronics) and / or at least one device for transmitting the measurement result and / or data related to the measurement result for further processing can be performed by the control circuit board. Each control circuit board 110 is connected to a radar circuit board 111, and at least one radar antenna 112 or antenna array is arranged to the radar circuit board. As shown in the figure, the control circuit board 110 is arranged at a 90-degree angle to the next control circuit board. The radar circuit board 111 and the antenna 112 or antenna array are also arranged at a 90-degree angle to the next radar circuit board and antenna or antenna array. The radar circuit board and the antenna or antenna array can also be tilted downward to allow for an optimal measurement area 113 and monitoring distance for the sensor array.

[0040] exist Figures 2A to 2E Different sensor arrangement configurations are presented in . In some embodiments of the present invention, it is possible to select how many sensors are installed and arranged in the sensor arrangement. Figure 2A In FIG. 2 , one sensor 201 is arranged to the sensor arrangement 200. Such a sensor arrangement can be used, for example, in a corner of a room when a wide measuring area 202 is not required. Figure 2BA sensor arrangement 210 is presented with two mounted sensors 211, 212. In this embodiment, the sensors 211, 212 are arranged to measure in opposite directions. This embodiment may be used, for example, in corridors. Figure 2C A sensor arrangement 220 is presented with two mounted sensors 221, 222. In this embodiment, the sensors are arranged to measure measurement areas 223, 224 adjacent to each other with a 90 degree angle between the sensors. This embodiment may be used, for example, in corners and / or corridors. Figure 2D A sensor arrangement 230 is presented with three mounted sensors 231, 232, 233. In this embodiment, the sensors are arranged to measure into three different directions and measurement areas 234, 235, 236. This embodiment may be used, for example, at the edge of the measurement area, for example close to a wall. Figure 2E A sensor arrangement 240 is presented with four mounted sensors 241, 242, 243, 244. In this embodiment, the sensors are arranged to measure in different directions and measurement areas 245, 246, 247, 248 from each other (and at 90 degrees to each other). In this way, the sensors are able to monitor a 360 degree area around the sensor.

[0041] Figures 3A to 3F A sensor arrangement is presented which is otherwise related to Figures 1A to 1F The sensor arrangement of is similar to that of , but this embodiment comprises three sensors instead of four sensors. The sensor arrangement 300 comprises a base portion 301 inside which at least some of the components of the sensor arrangement are arranged. Figure 3A presents a side view of the sensor arrangement when the sensor arrangement is mounted to an opening in a ceiling structure, Figure 3B presents the sensor arrangement as viewed from below, and Figure 3CA sensor arrangement viewed from above is presented. The base portion of the sensor arrangement may include a locking device 306, with which the sensor arrangement can be attached to a structure, such as an opening in a ceiling 305. In one embodiment of the invention, the locking device 306 can be turned from a locked position to the side of the base portion, so that the sensor arrangement can be pushed through an opening in, for example, a ceiling. The base portion may include an attachment point 308 for the locking device, to which the locking device can be turned and attached, for example during transportation and storage. The arrangement may include a spring 307, which opens the locking device and holds it in a use position, i.e., a position in which the arrangement is fastened to the ceiling structure. The sensor arrangement may also include an edge portion 302, which is arranged to be wider than an upper portion of the base portion, so that the edge portion will prevent the sensor arrangement from passing through an opening in, for example, a ceiling. The sensor antenna or antenna array may be covered with a cover portion 303. At the top of the sensor arrangement there may be a connector 309 or an opening for a cable, with which the sensor arrangement can be electrically and / or communicatively connected to a power network and / or a communication network.

[0042] Figure 3D , 3E and 3F present the sensor arrangement in a cross-sectional view. Figure 3E Presented Figure 3D A cross-sectional view of the line AA of FIG. Figure 3F Presented Figure 3D A cross-sectional view at line BB of FIG. A control circuit board 310 for each sensor is arranged inside the base portion. At least a portion of the device for processing the measurement signal of the sensor (such as measurement electronics) and / or at least one device for transmitting the measurement result and / or data related to the measurement result for further processing can be performed by the control circuit board. Each control circuit board 310 is connected to a radar circuit board 311, and at least one radar antenna or antenna array is arranged to the radar circuit board. As shown in the figure, the control circuit board 310 is arranged at a 120-degree angle to the next control circuit board. The radar circuit board 311 and the antenna 312 or antenna array are also arranged at a 120-degree angle to the next radar circuit board 311 and the antenna 312 or antenna array. The radar circuit board and the antenna or antenna array can also be tilted downward to allow the optimal measurement area 313 of the sensor array to monitor the distance.

[0043] In one embodiment of the invention, one radar type sensor can cover a diameter of e.g. 10m when mounted in a corner and e.g. 5m to 7m when mounted from the ceiling down, depending on the height. With the sensor arrangement of the invention, the measurement area can cover e.g. 20m, since there are multiple sensors measuring in different directions.

[0044] In one embodiment of the invention, the sensor arrangement comprises at least one loudspeaker.

[0045] In one embodiment of the invention, the sensor arrangement comprises at least one light source for providing emergency lighting.

[0046] In one embodiment of the invention, the sensor arrangement comprises attachment means, by means of which the sensor arrangement can be attached to the opening.

[0047] In one embodiment of the invention, a device for processing the measurement signals of the sensor, such as a control circuit board, is arranged for each of the at least two sensors. In this case, the device for processing the measurement signals of the sensor collects or receives data only from one sensor of the sensor arrangement and can analyze the data and / or send the data to another unit. In this way, the sensors of the sensor arrangement can be operated independently of each other.

[0048] In one embodiment of the invention, a device for processing the measurement signals of the sensors (such as a control circuit board) is arranged and connected to all sensors of the sensor arrangement. In this case, a device for processing the measurement signals of the sensors collects or receives data from all sensors of the sensor arrangement and can analyze the data and / or send the data to another unit. In one embodiment of the invention, the device for processing the measurement signals of the sensors can change the controlled sensors in sequence, for example, by switching the controlled sensors every 1 second. In this case, if there are 3 to 4 sensors in the sensor arrangement, information about the movement is obtained every 3 to 4 seconds.

[0049] In one embodiment of the invention, the sensor arrangement and / or each sensor is configured to monitor health-related functions of a person, such as breathing rate and heart rate. In one embodiment of the invention, the sensor arrangement and / or each sensor comprises a first operating mode and a second operating mode, wherein in the first operating mode the sensor is configured to track the movement of the monitored person, and in the second operating mode the sensor is configured to measure and / or further analyze measurements related to a portion of the monitored area, wherein in the first operating mode the movement of the person is observed in order to observe the health-related functions of the person.

[0050] In one embodiment of the invention, different sensors of the sensor arrangement can be in different operating states. This makes it possible, for example, to use some of the sensors in a first operating mode and some in a second operating mode. The sensors can change operating modes based on the needs of the system.

[0051] In one embodiment of the invention, the sensor arrangement or each sensor is configured to analyse the measurement signal in such a way as to determine its phase, eg in the second operating mode, in order to observe movements of the person, such as the person's heartbeat and / or breathing.

[0052] In one embodiment of the present invention, the at least two sensors are radar sensors configured to observe the elevation, azimuth, movement and / or distance of objects using continuous wave radar technology such as frequency modulated continuous wave (FMCW), and / or wherein the system or sensor arrangement is configured to create point cloud data for the monitored area based on information received from the radar sensors by combining information from multiple sensors.

[0053] In one embodiment of the invention, the sensor arrangement comprises means for detecting an orientation of the sensor arrangement, such as an accelerometer, and the sensor arrangement is configured to take the detected orientation into account when determining the measurement result for the monitored person, for example by compensating the measurement result based on the detected orientation of the sensor arrangement.

[0054] Figure 4 An example embodiment relating to placing a sensor arrangement in a space to be monitored is presented in a simplified manner. In this example embodiment, the sensor arrangement is placed in a store and in Figure 4 The store is viewed from above in FIG. The sensor arrangements 401 are arranged above the aisles between the shelves 410 of the store so that the sensor arrangements can measure the areas where people move between the shelves. In this example, the measurement areas of all sensor arrangements 401 arranged in the store substantially cover all areas 400 where people may be moving. The sensors can be arranged so that they point directly downward or slightly tilted.

[0055] In one embodiment of the present invention, a sensor arrangement may be used to detect and / or signal whether a sprinkler has been triggered in a monitored space.

[0056] In one embodiment of the present invention, in a retail environment, the system may include or be connected to an electronic price tag system. The electronic price tag base station may be configured to locate the position of the electronic price tag by measuring the electronic price tag from different directions using different base stations. The system may have an arrival direction detection mode, in which the position of the electronic price tag may be determined by combining the information of the measured direction of the tag from different base stations (e.g., by triangulation). With this solution, the system is able to collect the position and / or route of the electronic price tag. In the arrival direction detection mode, the base station may send a command to the electronic price tag to send a signal (e.g., a constant tone extension (CTE) signal) to the base station. The base station may include an antenna array, and the arrival direction of the signal from the electronic price tag may be determined based on the antenna array of the base station. Using, for example, three base stations, the position of the tag may be determined.

[0057] In one embodiment, the base station of the electronic price tag system can be arranged in the same location and / or in the same structure as one or more radar-based sensors. This way, installation in a store environment is easy, since wiring and installation have to be done in one place for both the means for detecting movement and the base station. With this solution, the system is able to collect the location and / or route of people in the store as well as the location and / or route of the electronic price tags. This arrangement can be installed, for example, on the ceiling of the monitored area.

[0058] With the sensors used in the solution of the invention, it is possible to provide a "heat map" type image at different times, from which it can be seen how often people move in certain areas at a certain time or how many people move in certain areas at a certain time. This information can be used, for example, for targeted marketing and pricing. In one embodiment of the invention, the device for detecting the movement, presence and / or position of people is used to determine that a certain product is taken out of a shelf and / or put back on a shelf, and / or in this way, heat map data for a certain shelf can be confirmed and / or provided.

[0059] In one embodiment of the invention, the device for detecting the movement, presence and / or position of a person can determine the filling rate of at least one shelf or a part of a shelf, and in another embodiment, the filling rate can be determined using additional sensors, such as planar sensors arranged to the shelf or sensors arranged to, for example, the opposite side of an aisle, such as cameras or distance measuring sensors.

[0060] In the solution of the present invention, the POS system can provide information about which products have been purchased, when they were purchased, and from the electronic price tag system or the shelf map where each product is placed in the store. Combining this information and using time constraints (delay in taking the product off the shelf until checkout) will make it possible to form an estimate of the purchase information related to certain products.

[0061] In one embodiment of the invention, the method includes sending a message to a mobile device of a person at a location based on a determination of the person's presence at the location.

[0062] In one embodiment of the invention, the system (e.g., an electronic price tag system) may include a route selection program based on a shopping list and a store map. The route determined based on a device for detecting the movement, presence, and / or location of a person can be used to compare which products cause a customer to deviate from the planned route and the planned products on the shopping list. This information can be used for targeted marketing and pricing, such as at a store. In one embodiment of the invention, monitoring the movement of a person includes determining the route used by a person in a store using a device for detecting the movement, presence, and / or location of a person.

[0063] Where a store includes a sensor network comprising a plurality of sensors, customer movement may be monitored from sensor to sensor, and / or routes traveled by individual customers may be stored and compared. Motion observations generated by a certain type of sensor (e.g., radar-based sensors) may be supplemented with other motion tracking systems, such as cameras, PIR sensors, etc.

[0064] The processor, central unit and / or measuring electronics used in the solution of the invention may be integrated into the sensor, or they may be arranged separately or in a separate unit. In an embodiment of the invention, using software executed by a processor, the sensor or system may interpret the movement observed with at least one sensor and may issue an alarm if the alarm conditions defined for the program are met.

[0065] In one embodiment of the invention, only some of the sensors in the area to be monitored have a function that enables the issuance of an alarm signal as described above. For example, only the sensors in some rooms (such as in a living room) may be provided with this function, and the sensors in other rooms send a notification forward immediately after detecting a fall and / or the measurement result of the measured person is not within an acceptable and / or predefined range. In one embodiment of the invention, only some of the sensors in a space (such as in a room) include a function that enables the issuance of an alarm signal as described above.

[0066] The system may also include a control center, and predetermined information about the presence, location, movement and / or posture of the object may be sent to the control center. The alarm terminology used by the system may be changed, for example, based on the presence information (which may be received, for example, from an RFID reader). A notification may be sent or an alarm may be sounded, for example to an external alarm system or wirelessly to a central server of the system, from which the alarm is directed onwards.

[0067] The system may also have a memory device, wherein the system is adapted to record the measurement signals or information derived from the measurement signals for observing the time dependency of the area being monitored and the behavior of the subject. By means of this, the system can issue an alarm, for example, if the person being monitored does not get up or go to the kitchen within a certain time, or if the person goes to the toilet too often, or if the vital functions of the observed person, such as breathing or heartbeat, have changed during this time. The memory device also makes it possible to learn more common daily rhythms and detect anomalies occurring therein.

[0068] In the following, an example embodiment is described. In this example embodiment, the first operating mode of the sensor is used to track the presence and movement of people, for example in a single room. In this embodiment, the tracking is performed using measured point cloud data. The required Doppler range is given by

[0069]

[0070] In one example, if a person is moving at 1 m / s, the required Doppler range is +-40 Hz, and the maximum measurement interval at 60 GHz is 25 ms. Inhalation lasts about 2 seconds. If the corresponding movement is 5 cm, the required Doppler range is +-1 Hz, and the scan time is one second.

[0071] When the system observes that the person has stopped, the system may enable a second operating mode in which the system is able to track the person's vital functions, such as heartbeat and / or breathing, such as breathing interruptions and / or frequency.

[0072] After determining the vital functions of the subject, the system may deactivate the second mode of operation. In an example embodiment, the system may periodically determine the vital functions of the same person, for example, as long as the person remains stationary. If the system observes stationary subjects, the system begins to determine the vital functions of these subjects by using the second mode of operation.

[0073] In an example embodiment of the invention, operation in the second mode of operation may be implemented, for example such that when a stationary object has been detected, point cloud data around the area of ​​the detected object is saved and analyzed. The saved packets may be generated periodically (e.g. every 600ms). In an embodiment of the invention, the data may be transferred to a central control unit for analysis. Using the analysis of the signal (i.e. the point cloud data), information about smaller movements of the object may be observed, and thus the system is able to determine, for example, the breathing activity and / or the heartbeat of a person.

[0074] In one embodiment of the invention, the scanning time of the sensor is longer in the second operating mode, and due to this, a better signal-to-noise ratio can be achieved. In addition, more TX antennas can be utilized because more time is available for measurement. In this way, the angular resolution can be improved. To improve the range resolution, the frequency scanning range can be increased.

[0075] The Doppler frequency can be determined, for example, using a Fast Fourier Transform (FFT). Vital function activities (e.g., heartbeat and breathing activities) can be determined based on the determined Doppler frequency. In one embodiment of the present invention, more TX antennas are used in the second operating mode to increase the spatial resolution. Therefore, the person being measured does not move, so signal processing can be performed on a smaller area.

[0076] In one embodiment of the invention, the sensor may include a radio-based identification device for identifying a person. The radio-based identification device may be, for example, a device based on Bluetooth, Bluetooth Low Energy (BLE), or Zigbee. In this embodiment, the system may identify objects and radio-based devices carried by the objects, such as bracelets, watches, mobile devices, tags, and the measurement results may be linked to a specific identified person. In this way, the system is able to know who is present in the measured area and to whom the measurement results relate.

[0077] In one embodiment of the invention, the radio-based identification means may include an antenna array that enables more accurate association of an identification device with its carrier when more than one person and device are present.

[0078] In one embodiment of the invention, if the identification device detects a person (such as a nurse) in the monitored area, the alarm may be automatically disabled.

[0079] In one embodiment of the present invention, the alarm condition of the system may include the identity of a person. For example, an alarm may be triggered when an unauthorized person enters a certain location.

[0080] In one embodiment of the present invention, a radio-based identification device (e.g., a Bluetooth, Bluetooth Low Energy (BLE) or Zigbee-based device) may be used to locate a person or assist in locating a person. The sensor may include several antennas for the radio-based identification device, such as Bluetooth, BLE or Zigbee antennas for implementing direction finding technology (e.g., Zigbee, Bluetooth or Bluetooth Low Energy (BLE) direction finding technology) according to the Bluetooth 5.1 specification, for example. In one embodiment of the present invention, if the radar of the sensor detects movement, but the radio-based identification device does not detect a remotely readable tag or device (such as a Bluetooth, BLE or Zigbee tag or device), the person detected by the radar may be considered a visitor. On the other hand, if the radar detects a remotely readable tag or device (such as a Bluetooth, BLE or Zigbee tag or device), the detected person may be identified and actions may be taken based on the identified person. In an example embodiment, when a resident is in a room and there is also an assisting person, the status of the person or room may be set in the system to "there is an assisting person in the room". In the same manner, an alarm made by a resident may also be acknowledged when the system recognizes that a person belonging to a non-resident of the room has entered the room. In this case, the alarm may be acknowledged automatically. In one embodiment, the alarm is not acknowledged automatically, but requires an active, identifiable event (e.g., from a user device).

[0081] In one embodiment of the invention, the identification of the detected person can be done with other devices, such as surveillance cameras, which are arranged, for example, to the corridor. In this case, a radar-based sensor detects that someone is entering the room, and the system can check information from the surveillance camera (for example, from a surveillance record from a certain point in time), where it can be seen that someone has entered the room. In one embodiment, this record can be linked to the room as an entry event, and if necessary, the entrant can be identified later by viewing the record. In this case, the identification can be automatic, but if it is not preferred, it is not necessary to implement automatic identification. If automatic identification from video is used, it can be implemented, for example, based on facial recognition technology. In one embodiment, facial recognition or video-based identification is not used if the user can be identified by other means. In one embodiment, video-based identification is only used if the person cannot be identified in any other way.

[0082] In one embodiment of the invention, the measurements and observations collected by the sensor arrangement of the invention can be used for crowd control management. In this case, people in the monitored area can be guided to the best available routes, elevators, etc. based on the number of people in the area. Such a solution can be used, for example, in hotels, shops, shopping centers, offices, and cruise ships. Guidance can be achieved, for example, using light strips and / or guidance displays that can dynamically guide people.

[0083] In one embodiment of the invention, a sensor arrangement or information provided by the sensor arrangement can be used to control the elevators of an elevator system. In this case, the sensor device can be arranged, for example, to the waiting area (e.g., each floor) of the elevator and / or the elevator car. The sensor arrangement can be used to give information about the presence and number of passengers waiting for the elevator car at least in the waiting area and / or the elevator car. The movement of the elevator car of the elevator system can be controlled based on the information received from one or more sensor arrangements. In this embodiment, a sensor arrangement including 1 to 4 sensors can be used, for example based on the size of the monitored area. For example, in an exemplary embodiment, a sensor arrangement with one sensor can be used in the elevator car. In one embodiment of the invention, people can be guided to available elevators based on the above-mentioned guidance device, for example by light strips and / or guidance displays that can dynamically guide people.

[0084] The embodiments of the invention described herein before in conjunction with the figures and the summary of the invention presented can be used in any combination with each other. At least two embodiments can be combined together to form further embodiments of the invention.

[0085] The specific examples provided in the description given above should not be construed as limiting the applicability and / or interpretation of the appended claims.The lists and groups of examples provided in the description given above are not exhaustive unless expressly stated otherwise.

Claims

1. A sensor arrangement for observing the presence, position, movement and / or posture of people in a monitored area, characterized in that The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) comprises at least one device for processing a measurement signal of a sensor, such as measurement electronics, and at least one device for transmitting a measurement result and / or data related to the measurement result for further processing, wherein the sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) comprises at least two sensors, the at least two sensors being configured to measure in different directions from each other, and Wherein at least two of the sensors are radar-based sensors, such as frequency modulated continuous wave MIMO radar-based sensors, and the radar-based sensors are configured to detect people in the monitored area (400) and measure and detect the movement, position, speed, route and / or shape of the monitored people.

2. The sensor arrangement according to claim 1, characterized in that The at least two radar-based sensors are arranged in connection with the structure and / or body of the sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401).

3. A sensor arrangement according to claim 1 or claim 2, characterized in that The arrangement (230, 300) comprises three radar type sensors arranged such that the centre line of the measurement area of ​​each sensor is arranged substantially 120 degrees to the centre line of the next sensor.

4. A sensor arrangement according to any preceding claim, characterised in that The arrangement (100, 240) comprises four radar type sensors arranged such that the centre line of the measurement area of ​​each sensor is arranged at substantially 90 degrees to the centre line of the next nearby sensor.

5. A sensor arrangement according to any preceding claim, characterised in that Arranged for each of the at least two sensors is a device for processing the measurement signal of the sensor.

6. A sensor arrangement according to any preceding claim, characterised in that A device for processing the measurement signals of the sensors is arranged and connected to all sensors of the sensor arrangement.

7. A sensor arrangement according to any preceding claim, characterised in that The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) comprises at least one loudspeaker.

8. A sensor arrangement according to any preceding claim, characterised in that The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) comprises at least one light source for providing emergency lighting.

9. A sensor arrangement according to any preceding claim, characterised in that The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) comprises an attachment device (106, 306) by means of which the sensor arrangement can be attached to an opening.

10. A sensor arrangement according to any preceding claim, characterised in that The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) and / or each sensor is configured to monitor health-related functions of the person, such as breathing rate and heart rate.

11. A sensor arrangement according to any preceding claim, characterised in that The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) and / or each sensor comprises a first operating mode and a second operating mode, Wherein in the first operating mode, the sensor is configured to track the movement of the monitored person, and in the second operating mode, the sensor is configured to measure and / or further analyze measurements related to a portion of the monitored area, wherein in the first operating mode the movement of the person is observed in order to observe the health-related functions of the person.

12. A sensor arrangement according to any preceding claim, characterised in that The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) or each sensor is configured to analyze the measurement signal in such a way as to determine a phase of the measurement signal, for example in the second operating mode, in order to observe movements of the person, such as the person's heartbeat and / or breathing.

13. A sensor arrangement according to any preceding claim, characterised in that The at least two sensors are radar sensors configured to observe the elevation, azimuth, movement and / or distance of objects using continuous wave radar technology such as frequency modulated continuous wave (FMCW), and / or wherein the system or sensor arrangement is configured to create point cloud data for the monitored area based on information received from the radar sensors by combining information from multiple sensors.

14. A sensor arrangement according to any preceding claim, characterised in that The sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) comprises means for detecting an orientation of the sensor arrangement, such as an acceleration sensor, and the sensor arrangement is configured to take the detected orientation into account when determining the measurement results, for example by compensating the measurement results for the monitored person based on the detected orientation of the sensor arrangement.

15. A system for observing the presence, location, movement and / or posture of one or more objects in a monitored area, It is characterized in that The system comprises at least one sensor arrangement (100, 200, 210, 220, 230, 240, 300, 401) according to claims 1 to 14, The one or more sensor arrangements (100, 200, 210, 220, 230, 240, 300, 401) are mounted in the monitored area, for example on a ceiling, a wall and / or a bracket.

Images