Sensor device with infrared array sensor

Abstract

The invention relates to a sensor device (10) for thermally monitoring a room of a building (1000), comprising a sensor housing (100) which can be mounted on a ceiling or wall of a room; an infrared array sensor (200) which is attached to the side of the sensor housing facing the room and has an IR pixel array and a corresponding IR optical unit for a spatially resolved recording of thermal image pixel data; an image processing unit (300) for processing and analyzing the thermal image pixel data of the infrared array sensor (200); and a central processing unit (400) for detecting objects (40) on the image pixel plane of the thermal image pixel data processed by the image processing unit (300). The central processing unit (400) is adapted so as to track and classify detected objects (40) in order to assign associated data vectors with determined object parameters to the detected objects (40).

Description

[0001] Sensor device with infrared array sensor

[0002] The invention relates to a sensor device, in particular a sensor device with an infrared array sensor.

[0003] In building automation and modern building management, sensor devices, especially those that can detect not only the movement of people in a room but also their mere presence without movement, are becoming increasingly important. These so-called occupancy sensors or presence detectors can be used in buildings, for example, to switch on lights in rooms, ensuring that the lights do not go out even if movement is not constantly detected. This type of sensor technology can also be used to control air conditioning systems, adjusting the room temperature according to the presence of people in the room.

[0004] Like RF motion detectors, well-known RF presence detectors operate on the Doppler principle, detecting not only macro-movements but also micro-movements, for example, to detect the presence of a breathing person in a room who is not moving based on lung micro-movements. These RF presence detectors can only detect the presence of living beings in the room, but not the number of living beings in the room. Camera systems with appropriate image processing are used for this purpose. Since the camera systems operate in the optical range and usually at high resolution, raw image data is initially generated, which essentially allows people to be identified. Therefore, with these room camera systems, image analysis takes place directly in the sensor, so that only processed position and movement data, which cannot identify the people in the room, for example in a company conference room, leaves the sensor.

[0005] These so-called "Human Presence Detection" (HPD) sensors can not only detect but also count the people present in a room, regardless of whether they are moving or not, without raising any data protection concerns. In addition, such an HPD sensor features integrated temperature and humidity sensors, thus opening up entirely new possibilities for building automation. Not only can lighting, heating, and air conditioning be controlled as needed based on the number of people present in a room. Thanks to the detection of actual room usage, the HPD sensor can also be used for meeting room management or to identify available office workstations in flex-desk management.

[0006] Despite the unique technical performance of these HPD sensors, there are reservations about these camera systems, albeit technically unfounded, because the presence of a camera makes people in the room feel like they are being watched. Furthermore, the manufacturing costs for such systems are far higher than for simple presence detector systems.

[0007] The present invention is based on the object of creating a sensor device and in particular a sensor device with an infrared array sensor, which provides sensor data for building automation functions in a cost-effective and reliable manner.

[0008] This object is achieved by the sensor device according to the invention according to the independent claims. Advantageous embodiments and further developments of the invention are set forth in the subclaims.

[0009] According to the invention, a sensor device for thermally monitoring a room in a building is provided, comprising a sensor housing mountable on a ceiling or wall of the room; an infrared array sensor mounted on the side of the sensor housing facing the room, comprising an IR pixel array and associated IR optics for spatially resolved recording of thermal image pixel data; an image processing unit for image processing and image analysis of the thermal image pixel data of the infrared array sensor; and a central processing unit for object detection of objects in the image pixel plane of the thermal image pixel data processed by the image processing unit. The central processing unit is adapted to track and classify detected objects in order to assign data vectors with determined object parameters to the detected objects.It is useful if an assigned data vector of an object contains an object type as an object parameter, where the object type is a person, an object, a spatial area, a room, a building area, or a building.

[0010] It is advantageous if an assigned data vector of an object in case of object type equal to "person" contains at least one of the object parameters such as an ID, a size, a position, a speed vector, a (V=0) timer, a temperature, a room entry location, a room entry time, a room exit location, or a room exit time.

[0011] It is advantageous if an assigned data vector of an object, in the case of object type equal to “object”, contains at least one of the object parameters such as an ID, an object type, a size, a position, a speed vector, a temperature, a T-anomaly flag, a T-anomaly time, or a T-anomaly location.

[0012] It is advantageous if an assigned data vector of an object in case of object type equal to "room" contains at least one of the object parameters such as a number of people, an IR room temperature, a room T anomaly flag, or a temporal IR room temperature gradient.

[0013] The sensor device according to the invention may further comprise a multi-sensor unit adapted to detect a room parameter such as brightness, room temperature, humidity, air quality, volatile organic compounds (VOC) and CO2 concentration or smoke particles.

[0014] It is useful if an assigned data vector of an object, in case of object type equal to “room”, contains at least one of the object parameters such as a room humidity, a room air quality, a room concentration of volatile organic compounds (VOC), a room CO2 concentration or a room smoke particle flag.

[0015] The sensor device according to the invention can further comprise a communication unit adapted to receive further global data such as local weather data, building outside temperature, calendar data, and building-relevant event data and to transmit them as object parameters to the central processing unit (400). It is advantageous if an assigned data vector of an object, in the case of an object type equal to "building," contains at least one of the object parameters such as local weather data, building outside temperature, calendar data, or building-relevant event data.

[0016] It is advantageous if the central processing unit is adapted to switch on an associated (V=0) timer when a person is not moving in order to assign a "since when not moving" time period and a "since when not moving" time point to the object (35) as object parameters.

[0017] It is advantageous if the central processing unit is adapted to determine the room air temperature in the environment of the object on the basis of the processed thermal image pixel data by detecting objects that are in thermal equilibrium with the room air and to assign IR room temperature to the data vector as the object parameter.

[0018] It is useful if the communication unit is adapted to alert an external building management system via wireless or wired communication when an object indicates a temperature anomaly.

[0019] It is advantageous if the central processing unit is adapted to classify the objects into different object types based on their temperature profile, their temperature profile window, their temporal temperature profile gradient, their temporal position data, their size, or their movement pattern in space.

[0020] It is advantageous if the central processing unit is adapted to perform a correlation analysis between temperature sensor data of the multi-sensor unit and the object data determined from the image pixel data in order to detect objects that are in thermal equilibrium with the room air.

[0021] According to the invention, a system for building analysis and building management is further provided, comprising at least one sensor device according to the invention, a cloud server for receiving the object parameters from the at least one sensor device, which is adapted to carry out a building analysis or a building management on the basis of the object parameters received from the at least one sensor device.

[0022] Furthermore, according to the invention, a building complex is provided, comprising at least one building with at least one room in each case, and at least one sensor device according to the invention, which is installed in at least one room of the at least one building.

[0023] Further advantages, features, and details of the invention will become apparent from the following description of preferred embodiments and from the drawings. These show:

[0024] Fig. 1A, 1B, 1C: a schematic perspective view, a top view and a side view of a sensor device with an infrared array sensor according to an embodiment of the invention,

[0025] Fig. 2: a schematic block view of a sensor device with an infrared

[0026] Array sensor according to an embodiment of the invention,

[0027] Fig. 3A, 3B: a schematic cross-sectional view and a plan view of a conference room with a ceiling-mounted sensor device according to an embodiment of the invention,

[0028] Fig. 4A, 4B: a user interface on a computer screen displaying thermal pixel raw data and processed people counting data, as well as an illustration of people counting data from a single infrared array sensor,

[0029] Fig. 5: a schematic cross-sectional view of a building with at least one

[0030] Building automation function and sensor devices mounted in the rooms according to an embodiment of the invention, Fig. 6A, 6B: schematic perspective views of a room of a building monitored by the sensor device with infrared array sensor and an IR interior image of the infrared array sensor with detected objects according to an embodiment of the invention,

[0031] In the figures, identical components and components with the same function are marked with the same reference numerals.

[0032] Figures 1A to 1C show a schematic perspective view, a top view, and a side view of a sensor device 10 according to an embodiment of the invention. The sensor device 10 has an infrared array sensor 200, which enables, for example, the counting of people in a room. The sensor device 10 can optionally be configured as a multi-sensor device, whereby, in addition to determining the presence of humans or animals and their number in the room, brightness, room temperature, humidity, air quality, volatile organic compounds (VOCs), and CO2 can also be determined and evaluated.

[0033] Figure 2 shows a schematic block diagram of a sensor device 10 with an infrared array sensor 200 according to an embodiment of the invention. The sensor device 10 has a sensor housing 100 mountable on a ceiling 21 or wall 22 of a room 20 (Fig. 3A). Various sensor technologies can be used in the infrared array sensor 200 according to the invention. For example, an IR pixel array 210 can have a thermopile matrix based on a stack of thermoelectric elements that generate a current proportional to thermal radiation. However, it is also possible for the IR pixel array 210 to comprise a plurality of microbolometers that measure a change in the electrical resistance between two electrodes due to thermal radiation.

[0034] Another infrared array sensor 200 operates with a micro-optical mechanical system (MOMs). This means that the IR pixel array 210 of the infrared array sensor 200 has a micromechanical infrared matrix arrangement as pixels 215, which measures a mirror deflection of the respective micromechanical pixel elements due to incident infrared radiation. Such an arrangement has a significantly lower signal-to-noise ratio than conventional infrared sensors, which leads to greater accuracy and stability. With a resolution of 28 x 15 pixels 215 of the IR pixel array 210, the infrared array sensor 200 generates a thermal image that complies with data protection regulations; therefore, personal data is never recorded, not even as raw pixel data.In addition to the IR pixel array 210, the infrared array sensor 200 also has further peripheral components 220, which enable, for example, preprocessing of the pixel data of the pixels 215, controlling the IR pixel array 210, or reading and transmitting the pixel data of the pixels 215.

[0035] Furthermore, the sensor device 10 has an IR optics 240 associated with the IR pixel array 210 for spatially resolved recording of thermal image pixel data. The IR pixel array 210 is connected via a data bus 230 to an image processing unit 300 for image processing and image analysis of the thermal image pixel data of the infrared array sensor 200. The sensor device 10 further comprises a central processing unit 400 for object detection of objects in the image pixel plane of the thermal image pixel data processed by the image processing unit. The central processing unit 400 can also be connected via a data bus system 610 to a multi-sensor unit 600, which sends additional sensor data such as brightness, room temperature, humidity, air quality, volatile organic compounds (VOCs), and CO2 content to the central processing unit 400 for further processing.Using this multisensory approach, which not only determines room parameters from the thermal image pixel data, but also incorporates sensor data from the multisensor unit 600 into the determination of object parameters or into the more precise specification of the already obtained object parameters, corresponding object parameters or properties can be assigned to these objects or persons as a data vector after corresponding object or person detection, which are then incorporated into the building automation or building analysis of a building 1000 (as shown in Figure 5) or building complex. The data or property data of the objects 35 (building 1000, room 20, person 30, object 40) determined by the central processing unit 400 can then be sent to a building automation control center (not shown) via a communication unit 500.

[0036] Figures 3A and 3B show a schematic cross-sectional view and a plan view of a room 20 of a building 1000, in particular a conference room 20, with a sensor device 10 mounted on the ceiling 21 according to an embodiment of the invention. The conference room 20 has various objects 40 such as a table, chairs, a cupboard, or a display device. People 30 are present in the room 20, who can be detected and counted by the sensor device 10, as described below. Figure 4B shows a plan view of the conference room 20, wherein, for illustration purposes, the depicted pixels 215 of the IR pixel array 210 of the infrared array sensor 200 of the sensor devices 10 are schematically superimposed over the objects 40 and people 30 present in this room 20.

[0037] Figures 4A and 4B show a user interface 50 on a computer screen displaying raw thermal pixel data from pixels 215 and processed people counting data, as well as an illustration of people counting data from people 30 from a single infrared array sensor 200. Figure 4A shows, on the lower left side, a so-called "heat map" generated from the raw pixel data of the thermal image from IR pixel array 210. This raw pixel data from pixels 215 is transmitted via data bus 230 to image processing unit 300 for image processing and image analysis of the thermal image pixel data from infrared array sensor 200. Using artificial intelligence (KI), the raw pixel data from pixels 215 is analyzed and segmented to identify objects 35, such as items 40 or people 30, in room 20.

[0038] As shown in the user interface 50 in Figure 4A, based on the evaluation of the raw pixel data of the pixels 215 by means of blob analysis by the image processing unit 300 or the central processing unit 400, individual people 30 can be distinguished, tracked, and counted based on the body temperature of 37° (or a temperature window of 37° plus / minus 1° or 2°) corresponding to pixel regions of the pixels 215. Blob analysis is one of the basic image processing functions and is based on extracting features from connected pixels 215 that share the same logical state (blobs) to ensure easy segmentation and analysis of many different object properties of the segmented objects 35, such as items 40 or people 30.

[0039] Furthermore, not only can the number of people 30 be determined at a specific time using blob analysis, as shown in the user interface 50 at the bottom right, but a time history of the number of people 30 in the room 20 can also be determined, as shown in the top center of the user interface 50. Thus, the sensor device 10, as shown in Figure 4B, is capable of counting people 30 in a room 20. In the case shown in Figure 4B, two people are outside the room 20, so that three people 30 are determined by the central processing unit 400 to be in the room. The data processing of the image processing unit 300, based on edge AI platforms or edge processing, enables precise analysis in real time. Thanks to ceiling mounting on the ceiling 21, the sensor device 10 can monitor a floor area of ​​the room 20 of at least 7 m x 4 m at a standard ceiling height.The sensor device 10 ensures precise detection of the presence of persons 30 in each room 20, even if the persons 30 are not moving.

[0040] The sensor device 10 with infrared array sensor 200, as described above, opens up a wide range of applications in building automation, building data acquisition, and building analytics. It finds application in various areas such as lighting control, dynamic HVAC control, access warnings—for example, a cleaning staff member can be warned not to enter the bathroom if it is occupied—and the detection of people, animals, and objects. Furthermore, the sensor device 10 offers unprecedented data analysis of human activity. This includes counting people, monitoring various zones and doors, and motion tracking. The sensor device 10 can also be used to detect unauthorized persons attempting to approach an authorized person and enter a secured building.Examples of applications include intruder detection, preventive maintenance, traffic flow optimization, and space utilization and optimization.

[0041] Additionally, the sensor device 10 monitors thermal behavior, detects trends, and evaluates the local temperature in real time with radiometric accuracy. This technology can create dynamic heat maps of an area associated with human activity to establish a correlation between movement and thermal comfort. This is used, for example, in dynamic HVAC control, ensuring tenant thermal comfort, automated control of blinds based on sunlight, and room design based on thermal comfort.

[0042] Finally, the sensor device 10 allows the setting of custom temperature alerts to trigger warnings or initiate specific actions, such as sending an alert in the event of a potential fire hazard or optimizing and automating HVAC systems. The sensor device 10 can identify cold areas (e.g., caused by water leaks or open doors / windows) or hot areas (e.g., caused by irons or toasters) and react accordingly. Other applications include the detection of fire and hazardous situations, water leaks, and open windows or air leaks.

[0043] In addition to the multitude of applications mentioned above, the sensor device 10 according to the invention can determine further object parameters or object properties due to the further processing of the raw pixel data of the pixels 215 by the central processing unit 400 and optionally by including further sensor data from the multi-sensor unit 600, which will be described below with reference to Figures 5 to 6B.

[0044] Figure 5 shows a schematic cross-sectional view of a building 1000 with a plurality of rooms 20 with at least one building automation function and sensor devices 10 mounted in the rooms 20 according to an embodiment of the invention. As can be seen from Figure 6, a plurality of different objects 40 and persons 30 can be present as objects 35 in the corresponding rooms 20, which are initially separated or differentiated by the sensor device 10 according to the invention by means of segmentation, then classified if necessary, and finally tracked or monitored in order to enable a plurality of building automation functions or a global building analysis.

[0045] Thus, in the building 1000, in room 20 at the top left, there is a sleeping area with a bed as object 40 and a person 30, who are monitored by the sensor devices 10. This sleeping area (object type: room area) can be a bedroom in a private home in assisted living, in a hospital, or in a nursing home.The objects 35 can represent a variety of items 40, for example, an object 40 can be a bed, a cupboard, a chest of drawers, a table, a chair, a shelf in a warehouse, a transport vehicle, a forklift, a floor of the room 20, a wall 22 of the room 20, a ceiling 21 of the room 20, a metal panel, a conference room table, a window area, a door area, a door, a glass window, a glass partition, a computer, a server cabinet, a freezer in a supermarket, a checkout area in front of a supermarket checkout, a vehicle in an underground parking area, an access barrier in an underground parking area, lighting devices such as lamps or spotlights.

[0046] Figures 6A and 6B show a schematic perspective view of a room 20 of a building 1000 monitored by the sensor device 10 with infrared array sensor 200, as well as an illustration of object detection data of the infrared array sensor 200 within the room 20 according to an embodiment of the invention. The room 20 can be a building interior, for example an office interior, a conference room, or a living space, and can include, as objects 35, several objects 40, such as pieces of furniture. The interior 20 can further include, as objects 35, at least one wall 22 with a wall zone and a floor zone, and at least one window F with a window zone, wherein daylight with an infrared component enters the interior through the window F. The interior 20 further includes the sensor device 10 according to the invention, which is mounted on the ceiling 21.The sensor device 10 is configured to image at least a portion of the interior 20 onto an IR interior image 25 through an IR optics 240 in a spatially resolved manner, but with a lower resolution than a camera image, so that the IR interior image 25 is recorded.

[0047] Figure 6B shows the IR interior image 25 created by the sensor device 10 at the image pixel level. As can be seen from Figure 6B, the IR interior image 25 comprises several IR interior image regions with similar or identical IR emission brightness. Due to the operation of the sensor device 10 according to the invention, which uses a pixel array 210 operating with a micro-optical mechanical system (MOMs) to capture the IR interior image 25, an IR interior image 25 with a temperature resolution in the tenths of a degree range can be created. Using the blob analysis described above, the image processing unit 300 and / or the central processing unit 500 then segments the IR interior image 25 and identifies the objects 35 as persons 30. According to the invention, the raw pixel data is further segmented by the image processing unit 300 in order to identify or classify objects 40 in addition to persons 30.The classification of objects 35 into persons 30 and objects 40 can be performed automatically by K1, for example, using shape recognition, size, temperature, or temporal temperature profile analysis. However, the object classification of objects 35 into persons 30 and objects 40 can also be performed by a user using a look-up table and made available to the central processing unit 400. It is advantageous if the central processing unit 400 is adapted to classify the objects 35 into different object types, "person," "object," or "object type," based on their temperature profile, their temperature profile window, their temporal temperature profile gradient, their temporal position data, their size, or their movement pattern in space.

[0048] In the example shown in Figures 6A and 6B, three objects 40 with associated surfaces 40a, 40b, and 40c are detected by the sensor device 10. Furthermore, in the embodiment shown in Figure 6A, two people 30 are detected in the room 20. The classification of the people 30 is performed by artificial intelligence (K1), which makes it possible to recognize people and assign them an ID. This ID combines the location of the person 30 with tracking data. After image processing by the image processing unit 300 and further processing by the central processing unit 400, the sensor device 10 can assign an associated data vector to the objects 35 (objects 40 or people 30) detected by the image processing unit 300. This data vector optionally includes further sensor data from the multi-sensor unit 600 in addition to the data obtained by the pixel array 210.

[0049] According to the invention, a sensor device 10 is provided for thermally monitoring a room 20 of a building 1000. This sensor device has a sensor housing 100 that can be mounted on a ceiling or wall of the room 20. Furthermore, the sensor device 10 comprises an infrared array sensor 200, attached to the side of the sensor housing 100 facing the room 20, with an IR pixel array 210 and associated IR optics 240 for spatially resolved recording of thermal image pixel data. An image processing unit 300 is provided for image processing and image analysis of the thermal image pixel data of the infrared array sensor 200. A central processing unit 400 is provided for object detection of objects 35 in the image pixel plane of the thermal image pixel data processed by the image processing unit 300.

[0050] According to the invention, the central processing unit 400 is adapted to track and classify recognized objects 35 in order to assign associated data vectors with determined object parameters to the recognized objects 35.This data vector can, for example, contain the object type, an object identification number or object ID, an object size, an object position in the room or building, an object number in the room or building, an object type number in the room, an object speed vector, a (V=0) timer, a sensor flag, an object temperature, an object brightness, a temporal object temperature gradient, an object room entry location, an object room entry time, an object room exit location, an object room exit time, a sensor handover time, a sensor handover location, an object temperature anomaly flag, an object T anomaly time, an object T anomaly location, an object humidity, an object air quality, an object concentration of volatile organic compounds (VOCs), or an object CO2 concentration.

[0051] The object type of object 35 can be a person 30, an object 40, a spatial area of ​​a room 20, an entire room 20, a building area of ​​a building 1000, or an entire building 1000. An assigned data vector of an object 35 can therefore contain an object type as an object parameter, where the object type is a person 30, an object 40, a spatial area, a room 20, a building area, or a building 1000.

[0052] If the object type is "person," an assigned data vector of an object 35 can contain at least one of the object parameters, such as an ID, a size, a position, a speed vector, a (V=0) timer, a temperature, a room entry location, a room entry time, a room exit location, or a room exit time. The ID is a unique identification number that is assigned to a detected object 35, for example, to enable tracking of the object 35 during movement in the room. In addition to the ID, a size (area size in the image pixel plane), a position (area center of gravity of the object 35), a speed vector (current x / yV vector in the image pixel plane), a temperature (averaged or maximum IR pixel temperature over the area of ​​the object), as well as location and time data about the entry / exit of a person 30 of the room 20 can be recorded and assigned to the data vector as object parameters.

[0053] The central processing unit (400) can be adapted to activate an associated (V=0) timer when a person 30 is not moving, in order to assign a "no movement since" period and a "no movement since" time to the object 35 as object parameters. For this purpose, a timer is integrated that runs to record how long someone stays in a specific area, for example, in front of a bed. When the movement vector or speed vector of a person 30 drops to zero, i.e., no more movement is detected, the timer is activated. This provides important "no movement since" information, which can be relevant, for example, in nursing facilities. For example, time thresholds can be defined, exceeding which triggers an alarm. This can also be linked to the location of the person 30 in the room.For example, it's normal for a person 30 to remain motionless for hours in the bed area, but this is not normal in a bathroom area. For example, the time threshold of the (V=0) timer associated with object 35 can be set to a time period in the range of 5 to 10 hours for the bed area, but in the range of 30 minutes to 2 hours for the bathroom area.

[0054] If the object type is "object," an assigned data vector of an object 35 can contain at least one of the object parameters such as an ID, an object type, a size, a position, a speed vector, a temperature, a T-anomaly flag, a T-anomaly time, or a T-anomaly location. The parameters size, position, speed vector, and temperature can be determined like the parameters of the same name above for the object type "person." The parameters T-anomaly flag, T-anomaly time, or T-anomaly location relate to the occurrence of a temperature anomaly, i.e., the exceeding or falling below of a specified temperature threshold, as will be described in more detail below. The T-anomaly flag is to be understood as a 1-bit information item (flag) commonly used in computer science.

[0055] If the object type is "room," an assigned data vector of an object 35 can contain at least one of the object parameters, such as a person count, an IR room temperature, a room T anomaly flag, or a temporal IR room temperature gradient. Furthermore, the central processing unit 400 can communicate with other sensor devices 10 via a decentralized radio network, such as Bluetooth mesh, in order to, for example, compare person counting data with other sensor devices 10 located in the room 20. The goal of the invention is the precise detection of the so-called IR room temperature. This temperature is not a temperature measured by a conventional thermometer such as a PT100 element, but is determined from the thermal image of the raw pixel data of the IR pixel array 210 of the infrared array sensor 200.Particular attention must be paid to excluding hotspots and providing information about hotspots or other undesirable temperature deviations. A striking difference from conventional measurement methods using thermometers is that the measurements are not taken at typical locations such as the light switch, under the ceiling, or at a thermostat. Instead, the measurements are directed from the ceiling to various locations in room 20, where the temperature is actually of interest. The use of intelligent logic can further improve the measurement results.

[0056] For the IR room temperature measurement in Room 20, a "heat map" of the IR image pixel data is used. Using the "heat map," the temperature of all people, assumed to be an average of 37 degrees Celsius, can be calculated to improve the accuracy of the room temperature analysis. It is also important to exclude active zones, such as those around heaters, computers, coffee machines, or refrigerators, as these distort the measurement results. At the same time, specific zones that require special attention—such as the sofa, desired areas, or the bed area in a hospital—can be highlighted.

[0057] The applications for the sensor device 10 according to the invention are diverse and range from room temperature measurements to the monitoring of control cabinets in a server room. According to the invention, a method for thermal room monitoring is provided, which begins with the installation of the system, which remotely records a rectangular matrix of many temperature measurement points on the surfaces of objects 40 and people 30. Even at this point, an average value of the temperatures is obtained, which serves as the preliminary IR room temperature of the room 20. The user then has the option of selecting a subset of these measurement points, which again results in an average value for the IR room temperature. Next, the system can automatically mask people and calculate an even more precise average value for the IR room temperature.

[0058] From the remaining set of measuring points, anomalies such as hotspots (hot coffee cups, computers, sunlight, etc.) can then be automatically masked out. Depending on the application, such anomalous measuring points can also be used specifically for notifications and warnings, for example in the case of impending fires or undesirable heating such as fire or hot stovetops. Likewise, undesirably cold spots, such as an open refrigerator, can trigger warnings. It is advantageous if the communication unit 500 is adapted to alert an external building management system via wireless or wired communication when an object 35 indicates a temperature anomaly or T anomaly. The sensor device 10 according to the invention can also be used in supermarkets, such as unmanned checkouts, the monitoring of open freezers, and the detection of persons in front of the checkout.

[0059] These technologies measure the heat radiated from a surface of an object 35. It is known that the temperature of the room air corresponds to the temperature of some surfaces, for example, surface 40c of the "metal plate" 40 in room 20 (see Fig. 6A), but not all. Therefore, it is useful to select surfaces 40a, 40b, 40c for the measurement that are in a thermally steady state (for example, a metal object such as the metal plate 40 with the metal surface 40c) and ideally heat up or cool down at the same rate as the room air in room 20.

[0060] The idea is to calculate the room air temperature from the average of surface temperatures that do not change or change only very slowly, as these influence the air temperature. Areas with a constant temperature are averaged and given a higher weighting than areas that deviate significantly from this average or change rapidly. Therefore, the primary areas measured are those that are not directly responsible for heating the room but rather represent the result of the room temperature, in contrast to areas that are directly influenced by heating or cooling, such as floors or radiators, which are not measured.

[0061] The invention therefore provides that the central processing unit (400) can be adapted to determine the room air temperature in the vicinity of the object 35 or the object 40 based on the processed thermal image pixel data by detecting objects 35 or objects 40 that are in thermal equilibrium with the room air, and to determine the "IR room temperature" of a room 20 as an object parameter and assign it to the data vector. Metal objects 35 are particularly suitable here. It should be emphasized that simply averaging all IR radiation data does not accurately determine the true room air temperature in room 20. For example, a standing reception with many people 30 in room 20 can lead to an average IR room temperature of almost 30 degrees, since the radiation from the people 30 with a body temperature of 37 degrees falsifies the result.It is advantageous if the central processing unit 400 is adapted to carry out a correlation analysis between temperature sensor data of the multi-sensor unit 600 and the object data determined from the image pixel data in order to detect objects 35 that are in thermal equilibrium with the room air.

[0062] The sensor device 10 according to the invention can further comprise a multi-sensor unit 600 adapted to detect a room parameter such as brightness, room temperature, air humidity, air quality, volatile organic compounds (VOCs), and CO2 concentration or smoke particles. In this case, an assigned data vector of an object 35, if the object type is "room," can contain at least one of the object parameters such as room humidity, room air quality, a room concentration of volatile organic compounds (VOCs), a room CO2 concentration, or a room smoke particle flag. For example, the object parameter "air humidity" can be used to detect a mold hazard in room 20.

[0063] The sensor device according to the invention can further comprise a communication unit 500 adapted to receive further global data such as local weather data, building exterior temperature, calendar data, and building-relevant event data and to transmit them as object parameters to the central processing unit 400. In this case, an assigned data vector of an object 35, in the case of an object type equal to "building," can contain at least one of the object parameters such as local weather data, building exterior temperature, calendar data, or building-relevant event data.

[0064] The invention further provides a system for building analysis and building management, comprising at least one sensor device 10 according to the invention, a cloud server for receiving the object parameters from the at least one sensor device 10, and a cloud server adapted to perform a building analysis or building management based on the object parameters received from the at least one sensor device 10. The system transforms the sensor data and IR image pixel data from the sensor devices 10 into personal data, room data, building data, or room parameters. This data provides information about human activities, temperatures, and changes in behavior. This information is particularly important for operators of commercial properties who aim to optimize the space and energy utilization of their facilities.Construction companies now treat buildings as products, with the goal of measuring their use and performance. Because only what is measurable can be optimized. Furthermore, a building complex is provided, comprising at least one building 1000, each with at least one room 20, and at least one sensor device 10 according to the invention, which is installed in at least one room 20 of the at least one building 1000.

Claims

Patent claims 1. A sensor device (10) for thermally monitoring a room (20) of a building (1000), comprising a sensor housing (100) mountable on a ceiling (21) or wall (22) of the room (20); an infrared array sensor (200) mounted on the side of the sensor housing (100) facing the room (20), having an IR pixel array (210) and associated IR optics (240) for spatially resolved recording of thermal image pixel data; an image processing unit (300) for image processing and image analysis of the thermal image pixel data of the infrared array sensor (200);and a central processing unit (400) for object recognition of objects (35) in the image pixel plane of the thermal image pixel data processed by the image processing unit (300), characterized in that the central processing unit (400) is adapted to track and classify recognized objects (35) in order to assign associated data vectors with determined object parameters to the recognized objects (35); 2. Sensor device (10) according to claim 1, characterized in that an assigned data vector of an object (35) contains an object type as an object parameter, wherein the object type is a person (30), an object (40), a spatial area, a room (20), a building area, or a building (1000).

3. Sensor device (10) according to claim 2, characterized in that an assigned data vector of an object (35) in the case of object type equal to "person" contains at least one of the object parameters such as an ID, a size, a position, a speed vector, a (V=0) timer, a temperature, a room entry location, a room entry time, a room exit location, or a room exit time.

4. Sensor device (10) according to claim 2, characterized in that an assigned data vector of an object (35) in the case of object type equal to “object” contains at least one of the object parameters such as an ID, an object type, a size, a position, a velocity vector, a temperature, a T-anomaly flag, a T-anomaly time, or a T-anomaly location.

5. Sensor device (10) according to claim 2, characterized in that an assigned data vector of an object (35) in the case of object type equal to "room" contains at least one of the object parameters such as a number of people, an IR room temperature, a room T anomaly flag, or a temporal IR room temperature gradient.

6. Sensor device (10) according to one of the preceding claims, further comprising a multi-sensor unit (600) adapted to detect a room parameter such as brightness, room temperature, humidity, air quality, volatile organic compounds (VOC) and CO2 concentration or smoke particles.

7. Sensor device (10) according to claim 6, characterized in that an assigned data vector of an object (35) in the case of object type equal to "room" contains at least one of the object parameters such as a room humidity, a room air quality, a room concentration of volatile organic compounds (VOC), a room CO2 concentration or a room smoke particle flag.

8. Sensor device (10) according to one of the preceding claims, further comprising a communication unit (500) adapted to receive further global data such as local weather data, building outside temperature, calendar data, building-relevant event data and to send them as object parameters to the central processing unit (400).

9. Sensor device (10) according to claim 8, characterized in that an assigned data vector of an object (35) in the case of object type equal to "building" contains at least one of the object parameters such as local weather data, building outside temperature, calendar data, or building-relevant event data.

10. Sensor device (10) according to one of the preceding claims, characterized in that the central processing unit (400) is adapted to switch on an associated (V=0) timer when a person (30) is not moving in order to Object parameters to assign a “Since when not moved” duration and a “Since when not moved” time to the object (35).

11. Sensor device (10) according to one of the preceding claims, characterized in that the central processing unit (400) is adapted to determine the room air temperature in the environment of the object (40) on the basis of the processed thermal image pixel data by detecting objects (40) that are in thermal equilibrium with the room air and to assign IR room temperature to the data vector as object parameter.

12. Sensor device (10) according to one of the preceding claims, characterized in that the communication unit (500) is adapted to alert an external building management system by means of wireless or wired communication when an object (40) indicates a temperature anomaly.

13. Sensor device (10) according to one of the preceding claims, characterized in that the central processing unit (400) is adapted to classify the objects (35) into different object types based on their temperature profile, their temperature profile window, their temporal temperature profile gradient, their temporal position data, their size, or their movement pattern in space.

14. Sensor device (10) according to one of the preceding claims, characterized in that the central processing unit (400) is adapted to carry out a correlation analysis between temperature sensor data of the multi-sensor unit (600) with the object data determined from the image pixel data in order to detect objects (35) that are in thermal equilibrium with the room air.

15. System for building analysis and building management, with at least one sensor device (10) according to one of the preceding claims, a cloud server for receiving the object parameters from the at least one sensor device (10), which is adapted to carry out a building analysis or a building management on the basis of the received object parameters from the at least one sensor device (10).

16. Building complex, with at least one building (1000) each having at least one room (20), at least one sensor device (10) according to one of the preceding claims, which is installed in at least one room (20) of the at least one building (1000).

Images