Method for delimiting a region of interest in a thermal image
Patent Information
- Application Number
- EP2023790362
- Authority / Receiving Office
- EP · EP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-10-21
- Filing Date
- 2023-10-20
- Publication Date
- 2025-08-27
AI Technical Summary
Current space management systems using visible domain imagers and human recognition devices are expensive, energy-consuming, and intrusive, and struggle to accurately detect human presence, especially in large open spaces, leading to inefficiencies in energy consumption and user comfort optimization.
A method for configuring an area of interest using a thermal imager, where a user can define zones by capturing and analyzing thermal images, allowing for the detection or exclusion of human presence without transmitting video, using a thermal imager as a presence detector with demarcation zones, and simplifying the configuration process through a user-friendly interface.
This approach enables non-intrusive, energy-efficient space management by accurately detecting human presence in specific zones, optimizing energy consumption, and enhancing user comfort without the confidentiality risks associated with traditional systems.
Smart Images

Figure 1.1
Abstract
Description
DESCRIPTION TITLE: Method for delimiting an area of interest in a thermal image TECHNICAL FIELD OF THE INVENTION
[0001] The technical field of the invention is that of space management using a thermal imager, particularly in the field of tertiary buildings. Space management consists of controlling home automation electrical devices, for example lighting fixtures, independently depending on the presence of occupants, the aim being to optimize energy consumption without penalizing user comfort.
[0002] The present invention relates to a method for delimiting an area of interest from a thermal imager of a space management device from a user device, as well as a space management device configured to configure a delimitation of an area of interest according to this method. TECHNOLOGICAL BACKGROUND OF THE INVENTION
[0003] Space management devices are known that allow different home automation electrical devices to be controlled, for example, shutters, a heating and / or air conditioning device, electric door locks or suction cups, light fixtures or light sources, electrical outlets, in particular autonomously and independently depending on the user's needs in a space. These management devices allow in particular to save electricity by only controlling the electrical devices depending on the presence of a person, for example by controlling light fixtures illuminating only the areas where lighting is needed where a user is located. Indeed, in large spaces such as open-plan offices, there is a need to control one or more home automation electrical devices controlled according to the presence of a person in a delimited area according to a setpoint, which may be a temperature, a brightness, etc.For example, light sources are positioned to illuminate the entire open-plan office, but if only one person is located in the large space, the user may need to have only one or two or three luminaires illuminating the area where the person is located. The same is true with heating devices, for example electric radiators or. Connected radiator valves are positioned to heat the entire open-plan office, but if only one person is located in the large space, the user's need may be to have only one or two radiators heating the area where the person is located. However, such a management system requires detecting the person in delimited areas and therefore configuring the delimitation of these areas.
[0004] The most well-known type of space management device uses an imager in the visible domain (CMOS, a video camera) with a human recognition device (computer unit and software) to detect the human when he is in the field of vision of the camera. However, this type of camera with this human recognition device is expensive, energy-intensive and is generally intrusive, especially when it can transmit the videos to a remote device. One of the solutions to reduce consumption is that the space management device further includes a motion sensor to turn on the imager when it detects movement and the imager detects the immobile presence in order to reduce power consumption while detecting a immobile person.However, such a device is very expensive due to the two sensors and is intrusive and energy-consuming when the imager and the digital processing device operate to detect a stationary presence. In addition, such imaging sensors are intrusive, especially if the human recognition device is remote from the CMOS imager, and may even be illegal in the case of an image transmitted to a remote device or may cause cybersecurity, confidentiality and integrity problems, especially in places of defense or industrial secrecy.
[0005] Furthermore, the problem with management systems comprising an imager in the visible range (a video camera) with a human recognition device (computer unit and software) is that if an individual passes behind a window or is reflected on a window or a mirror, or in the case of a hologram, the human recognition device (computer unit and software) can detect a presence in an area even though it is not located in this area.
[0006] Management systems are known that include a motion detector with a visible imager, of the CMOS type. The detector Motion detection turns on the imager when motion is detected by the motion detector and the CMOS imager identifies if the person is in a useful area.
[0007] The problem with pyroelectric type detectors is that the detector is activated when the infrared to which a pyroelectric module is subjected in the pyroelectric type detectors varies. If the individual is perfectly still (even if he emits infrared waves) in front of the detector, he will not be detected. The same is true with ultrasonic or microwave motion detectors, in fact it only detects in the event of movement. In other words, the problem with ultrasonic or microwave motion detectors is that it does not detect a presence when the person is still, and the space management device no longer detecting the person can order, after a time delay, to turn off while a person is still in the detection zone.
[0008] Methods for delimiting areas of interest from an imager are known, particularly in the CMOS visible range, in which the space management device transmits the live video to a user device displaying the video and the user can configure areas of interest directly on the image in the visible range.
[0009] space management devices without a video image in the visible range but comprising several motion detectors without delimitation of the area of interest, that is to say that it turns on or off the lamps associated with the motion detector having detected a movement. However, these devices are difficult to set up due to the number of motion sensor installations to be installed.
[0010] In certain situations, there may therefore be a need to have a space management device without a video image in the visible domain while having a delimitation of the area of interest to avoid the installation of a plurality of motion detectors.
[0011] One solution is to propose to identify areas of interest blindly by proposing a grid in which the user can define the areas of interest. This solution is tedious for the user who requires him to check if the defined areas in the grid correspond to those he wants in the sensor's detection space.
[0012] Furthermore, there is a need for a space management device that has the ability to delimit exclusion zones, which may be located between two areas of interest, to avoid detecting a person in an area not desired by the user. For example, if a person is detected passing in a corridor located between two areas of interest, the management device will not control a device.
[0013] There is therefore a need to facilitate the configuration of delimitation of the area of interest in a field of vision of a presence detection sensor without being intrusive, by controlling home automation electrical devices independently according to the areas of stationary or mobile human presence. SUMMARY OF THE INVENTION
[0014] The invention provides a solution to the problems mentioned above, by making it possible to configure a delimitation of an area in a thermal image of a thermal imager of a space management device by identifying in a thermal image, a target and to display the target in a map representing the field of vision of the thermal imager.
[0015] One aspect of the invention relates to a method for delimiting an area in a thermal image of an imager of a space management device, comprising the steps of: requesting configuration of a delimitation of the type of interest of areas comprising displaying on a screen of a user device a form for inputting configuration of a delimitation of at least one type of interest of areas, and acquiring input by the user in the form, resulting in the configuration of a delimitation of a type of area to be delimited in a thermal image of the imager, capturing by the imager thermal images regularly, coordinating a map with the thermal image comprising displaying on the screen, a map comprising at least one coordinate layer, transmitting from the space management device to the user device information of a target or thermal images comprising a target, the target having a thermal value in a predetermined temperature range, displaying each information of a target or the thermal image in the displayed map, the information of the target having coordinates, recording coordinates of the points of a form delimiting the delimited area to be configured comprising displaying on the screen a form for entering a validation of coordinates and acquiring input by the user in the form of coordinates of points of a delimitation of the area to be delimited corresponding to the different positions of the identified target displayed on the map during the acquisition, resulting in the recording of the coordinates of the points, acquiring an end of delimitation,resulting in the production and display of a shape on the map from the various coordinates recorded in the chronological order of recording, delimitation of the area in the thermal image comprising a sub-step of displaying on the screen an input form for validation of the shape as the type of configured area, a sub-step of acquiring the input validated by the user resulting in and a sub-step of recording the shape of the delimited area of the thermal image according to the coordinates of the recorded points.,
[0016] The method makes it possible to configure the delimitation of zones in which it is necessary to detect or not to detect a presence in an image of a field of vision of a thermal imager. Thus, the space management device can use a thermal imager as a presence detector with delimitation zones. The map and / or the field of vision of the thermal imager each comprises at least one layer of coordinates (abscissa and ordinate) corresponding to each other, and the location of the target is based on this layer of coordinates. The method also makes it possible to simplify the configuration of the delimitation of the zones. Indeed, the fact of using a target displayed in a grid of a map allows the user to configure the delimitation by locating and moving the target in the environment. The detected target can be the user moving in the environment of the field of vision of the thermal imager or an object having a temperature different from other temperatures in the environment, the object can either be an automobile that can be autonomous or moved by the user. Thus, the user can see on the screen target information, which can be an image representing a target or a human or other, moving (by moving or moving the object) in the grid. Thus, the user can easily configure a delimitation by validating either coordinates of points forming the corners of a shape or the coordinates of points forming a path of the target, for example by recording and moving in the environment to form the shape of the area to be delimited. The recorded coordinates of each point therefore make it possible to form the outline of the shape corresponding to the delimitation of the type of area.The type of zone can be an area in which the user wants human presence detection to control home automation electrical devices, called an area of interest in the following, or an exclusion zone in which the user does not want to have any detection search in the image or not to control in case of presence detection in this area, called an exclusion zone in the following.
[0017] Thanks to the invention, it is therefore possible to use a thermal imager as a presence detector in a space management device allowing it to be non-intrusive, without confidentiality problems, while having zone demarcations.
[0018] In addition to the characteristics which have just been mentioned previously, the method for delimiting an area in a thermal image of a thermal imager of a space management device according to one aspect of the invention may have one or more additional characteristics among those described in the following paragraphs, considered individually or according to all technically possible combinations:
[0019] According to one embodiment, the step of recording coordinates of the points of a shape delimiting the delimited area to be configured, comprising the display on the screen of a form for entering a validation of coordinates and acquisition of input by the user in the form of coordinates of points of a delimitation of the area to be delimited corresponding to the different positions of the identified target displayed on the map during the acquisition, resulting in the recording of the coordinates of the points, is carried out by: the display on the screen of an input form for validating the coordinates of an Nth point, at least one Nth acquisition of input by the user in the displayed form resulting in: the recording of an Nth coordinate point corresponding to the position of the target, the display on the screen of an input form for validating the coordinates of an N+1th point for the production of the form with the Nth point.
[0020] This embodiment allows the user to form the desired shape quickly by only validating the replacement of the target to make its shape.
[0021] According to an example of this embodiment, the number of N is greater than 4, in particular 5. This makes it possible to make complex shapes quickly when different areas should not be in the area. In this example, a shape having N points can therefore have N vertices and N edges to form a delimited area.
[0022] According to an example, the screen further comprises a form for entering a validation of coordinates of an N point, a form for the connecting shape between the two points, for example a straight line, or a curve. In the case of a curve, the user can modify the radius of the curve between the step of delimiting the shape and the validation step, by deforming the proposed radius of curvature.
[0023] According to one embodiment, the step of acquiring an end of delimitation is carried out when the target displayed on the map is again at the first recorded position or by displaying on the screen of an input form a validation of end of delimitation, acquisition of the validated input, and causing the formation of the outline of the shape by connecting the recorded points in chronological order and connecting the last recorded point with the first recorded point.
[0024] According to one embodiment, the imager is a thermal imager, the method further comprising the steps of: transmitting the thermal image to the user device, selecting a target in the thermal image comprising displaying on the screen a form for entering a validation of coordinates of a target and acquisition of user input in the form of point coordinates and recording the position of the thermally identified target as well as thermal values corresponding to a thermal fingerprint of the selected target. This allows the operator to use it to determine the thermally identified target. Thus, the process of delineating an area in a thermal image of an imager of a space management device can be carried out while different people are present in the field of view of the imager. The operator can recognize the moving target (which can be itself or another person or a heat-emitting device) in the thermal image for the configuration of the area delineation and select it to configure the area delineation.
[0025] According to another embodiment the imager is a thermal imager, the method further comprising the steps of: analyzing thermal images for the identification of a target in each analyzed image, having the thermal value in the predetermined temperature range, and extracting a position of the thermally identified target in each thermal image, the coordinates of the extraction of the position of the extracted target being the information of the target displayed in the form of coordinates of points of a delimitation of the area to be delimited.This allows the selection of a target to be automated, the operator can thus enter, for example by clicking for a start of zone delimitation corresponding to the position of the target on the screen forming a vertex of the shape to be entered, then to section again when the operator considers that the target is at a vertex of the shape to be delimited until entering an end of delimitation leading to the production of the shape from the different positions entered.
[0026] According to a first example of this embodiment, the space management device performs the steps of thermal image analysis and extraction and in that the target information transmitted in the transmission step from the space management device to the user device are the coordinates of the position of the target thermally identified and extracted. This allows for a space management device that can never send an image from the imager to another device (so there is less risk of intrusion).
[0027] In this first example, the thermal image analysis step may comprise the sub-steps: of identifying a target in a plurality of images captured in a predetermined time, by the thermal imager, of extracting the coordinates of each position of the target identified in the different images,
[0028] and the step of displaying information of a target in the displayed map (E3), may comprise the sub-steps of reception by the user device and display of the extracted coordinates of the target on the screen map.
[0029] In particular, in this first example, the space management device can carry out the step of transmitting the coordinates of the target at regular intervals. This makes it possible to send only the position of the extracted target and thus reduce the throughput (therefore the bandwidth) of the means of communication used between the space management device and the user device. Thus, the means of communication can be a less expensive and less energy-consuming communication technology, for example by using a home automation wireless communication standard (Zigbee, etc.) with very low consumption compared to a means of communication where the space management device transmits a succession of images to the user device.
[0030] According to a second example of this embodiment, the space management device transmits to the user device each thermal image upon request from the user on the user device or regularly and in that the user device performs the steps of thermal image analysis and extraction. This makes it possible to use the power of the user device for the recognition of the target and its extraction which may have greater computing power than the space management device. Thus, the target recognition time may be faster when configuring the area delimitation.
[0031] According to one embodiment, the method comprises, prior to the step of transmitting information from the space management device to the user device of a target: an initialization step carried out by the user device: displaying on the screen a form for entering a request for coordinates, acquiring input from the user in the request form, and transmitting to the space management device a request for identifying a target and these coordinates, and in which the step of the space management device to the user device of information of a target comprises transmitting the coordinates of the target upon receipt of the identification request by the space management device.
[0032] In this example, the operator can thus enter confirmation of the start of the desired acquisition of display of a target on the screen in order to avoid transmitting data when the operator is not ready (for example he knows that no target is in the field of vision of the imager).
[0033] According to one embodiment, the step of requesting configuration of a delimitation of the type of zones to be delimited comprises the display of different input forms on the screen forming a list of types of zones, in particular zone of interest and exclusion zone and in that the acquisition comprises a selection of the type of zone to be delimited. This makes it possible to choose the type of zones to be defined by the operator.
[0034] According to one embodiment, the step of coordinating a map with the thermal image further comprises a sub-step of displaying on the screen a form for entering information on the installation height of the thermal imager and a sub-step of acquiring user entries of the information on the installation height of the thermal imager resulting in the calculation of a map size to be displayed as a function of the chosen height.
[0035] According to one embodiment, the step of coordinating a map with the thermal image further comprises a sub-step of modifying a circular image of the thermal imager according to the characteristics of the lens to improve the thermal image displayed on the screen of the user's device. In fact, as the lens distorts the reality captured by the imager, the thermal image contains distortions compared to reality. This step corrects these distortions.
[0036] According to one embodiment, the step of coordinating a map with the thermal image further comprises a sub-step of displaying on the screen a form for entering information on the grid size of the map, a sub-step of acquiring user input of the grid size and resulting in the step of displaying the map, a grid according to the chosen size. This allows the operator to configure the precision of the delimitation of the area to be delimited.
[0037] According to one embodiment, the method comprises a pairing step between the management device and the user device.
[0038] According to one embodiment, each data packet exchanged between the space management device and the user device has a size smaller than a data packet encoding the thermal image having the smallest resolution in the space management device. This makes it possible to use a non-energy-consuming, low-power communication means and, furthermore, this can improve confidentiality and avoid being intrusive (even in the event of hacking of the management device). Indeed, the management device may be physically unable to transmit a data packet encoding the thermal image or may have software blocking the sending in the event of data packets larger than the data packet encoding the thermal image having the smallest resolution of the imager.
[0039] According to one embodiment, the step of recording coordinates of the points of a shape delimiting the delimited area to be configured comprises the validation of coordinates of different points each corresponding to the coordinates of the moving target information displayed on the map and in that the shape is a polygon of which each coordinate of a point forms a corner of the polygon. This allows the operator to validate at each point forming a vertex of the shape of the area to be delimited. Indeed, another solution less easy for the operator, is that the shape of the area to be delimited is formed by following the selected target.
[0040] According to one embodiment, the method of delimiting an area in a thermal image of an imager of a space management device is carried out during an operating mode of the space management device, to modify the perimeter of a delimited area or add a delimited area to other delimited areas.
[0041] According to a variation of this embodiment, the target is a target of a thermal device having a predetermined temperature outside a range comprising a value of a human temperature and a value of an environmental temperature.
[0042] According to one embodiment, the step of acquiring an end of delimitation is carried out when the target displayed on the map is again at the first recorded position.
[0043] According to one embodiment, the step of acquiring an end of delimitation is carried out by displaying on the screen of an input form a validation of the end of delimitation, acquisition of the validated input, and causing the formation of the outline of the shape by connecting the recorded points in chronological order and connecting the last recorded point with the first recorded point.
[0044] According to one embodiment, the method comprises configuring the delimitation of several zones according to the steps of the method.
[0045] For example, the method comprises configuring a first and second area of interest in which the detection of a human target is to be monitored and in that the method further comprises the steps of: displaying on the screen input forms of a control logic, acquiring inputs by the user in the input forms of a control logic, resulting in a command to control a home automation electrical appliance based on the identification of a presence in the first area, and a control logic comprising a command to control the power supply of at least one other electrical appliance based on the identification of a presence in the second area.
[0046] According to one embodiment, the space management device is electrically connected to a power supply of the building comprising a converter (AC / DC or / and DC / DC or / and AC / AC) to power the elements of the space management device.
[0047] According to a variant of this embodiment, the space management device comprises a battery and a converter (AC / DC or / and DC / DC or / and AC / AC) connected to the battery to power the elements of the space management device.
[0048] Another aspect of the invention relates to a space management device comprising: a thermal imager comprising a sensor in the non-visible or near infrared range used to capture thermal images of a scene, a control unit comprising an output for controlling home automation electrical appliances and an input connected to the thermal imager to detect the thermal presence of people in pre-defined areas of the imager's detection field, and a memory storing user parameters and calibration data, a configuration unit configured to store the pre-defined areas by carrying out the following steps of a method for delimiting an area from a thermal imager: capturing thermal images regularly by the thermal imager, analyzing thermal images, transmitting coordinates of the detected target to the user device by the communication means,reception by the data communication means comprising the recorded coordinates and / or the delimitation shape of an area to be delimited, recording the coordinates of the shape as the delimited area of the thermal image. a communication means connected to the configuration unit and the control unit for communicating with the user device and home automation electrical devices respectively.,
[0049] According to one embodiment: the thermal imager further comprises a sensor in the visible range and a processing unit, the space management device comprises: a visible image analysis and processing unit configured to receive the image from the sensor in the visible range and identify a target such as a human presence, different and independent of the configuration unit, in which the configuration unit is configured to transmit to the visible image analysis and processing unit area delimitation coordinates, in which the visible image analysis and processing unit and the configuration unit are each configured to transmit presence data or number of presences per delimited area to the control unit, the device being configured so that the communication means transmits and receives data only by the configuration unit and the control unit.
[0050] The invention and its various applications will be better understood by reading the following description and examining the accompanying figures. BRIEF DESCRIPTION OF THE FIGURES
[0051] The figures are presented for information purposes only and in no way limit the invention.
[0052] [Fig. 1] shows a schematic representation of a space management device in an environment with a user using a user device paired with the space management device.
[0053] [Fig. 2] shows a schematic representation of several displays on a screen of the user device representing different steps of the method of delimiting an area from a thermal imager of the space management device of FIG. 1, according to a first embodiment of the invention.
[0054] [Fig. 3] shows a schematic representation of several displays on a screen of the user device representing different steps of the method of delimiting an area from a thermal imager of the space management device of FIG. 1, according to a second embodiment of the invention.
[0055] [Fig. 4] shows a schematic representation of several displays on a screen of the user device representing different steps of the method of delimiting an area from a thermal imager of the space management device of FIG. 1, according to a third embodiment of the invention. DETAILED DESCRIPTION
[0056] The figures are presented for information purposes only and in no way limit the invention.
[0057] [Fig. 1] schematically represents a user comprising a user device 1 paired with a space management device 2 comprising a thermal imager 21.
[0058] The thermal imager 21 captures thermal images in its field of vision C1. Preferably, the space management device 2 comprises only one or more thermal imagers 21 as a presence sensor which are not in the visible range.
[0059] The user device 1 is a computer, for example a handheld computer such as a smartphone (smart mobile phone), a tablet, a smart watch or may be a laptop or desktop computer or any other electronic device. In this example, the user device 1 is a smartphone represented by an enlargement according to a block diagram.
[0060] The user device 1 comprises a communication means 10 for communicating with a communication means 20 of the space management device 2. The communication can be wireless, for example using the “Wifi” or “Bluetooth” standard. The user device 1 comprises a screen 11, a human-machine interface, in this case the screen 11 is a touch screen providing the human-machine interface. The user device 1 comprises a control unit 12 comprising at least one microcontroller or processor or microprocessor and a memory making it possible to produce a configuration program for the space management device 2.
[0061] All communications, transmission and reception of data, carried out between the space management device 2 and the user device 1 (and vice versa) are carried out by these communication means 20 In the first, second, and third embodiments explained below, each data packet exchanged between the space management device 2 and the user device 1 has a size smaller than the data packet of the thermal image having the smallest resolution in the space management device 2.
[0062] The space management device 2 also comprises a control unit 22 comprising at least one microcontroller or processor or microprocessor and a memory making it possible to analyze captured thermal images to thermally identify a human presence in the thermal image and to control according to a control law home automation electrical devices, for example light sources and / or heating and / or air conditioning, and / or openings such as shutters or doors or even door locks etc., in particular according to the identification of a human presence. The management device may comprise other types of sensors, for example a brightness sensor to detect the brightness of the environment.
[0063] The user wishes to delimit an area, which could be an area of interest or exclusion.
[0064] The area of interest allows the space management device to control home automation electrical devices according to a control law based on thermal identification in this area of interest of the thermal image of a human presence.
[0065] The exclusion zone allows the space management device to control home automation electrical devices according to a control law based on a thermal identification in the thermal image of a human presence without those identified in the exclusion zone or without seeking to identify a presence in the exclusion zone.
[0066] [Fig. 2] shows a schematic representation of several displays on the screen 11 of the user device 1 according to different steps of a method of delimiting an area from a thermal imager 21 of the space management device 2, according to a first embodiment of the invention. Y1
[0067] In this embodiment, the method may configure multiple zone type boundaries.
[0068] The method therefore comprises a first step, not shown, of pairing (pairing or twinning) between the space management device 2 and the user device 1.
[0069] The method may further comprise, during this pairing, a transmission of characteristics of the imager of the space management device to the user device, such as its field of vision size as a function of height, etc., and other characteristics, for example the presence of a sensor, etc., this makes it possible to adapt the application of the user device to different types of space management device. Of course, these characteristics may be, according to another example, in an external database or stored in the user device, and the space management device transmits identification information allowing the user device to obtain these characteristics in the database.
[0070] The method comprises a step of requesting configuration of a delimitation of the type of interest of zones E1, then called step E1, comprising the display on the screen 11 of an input form E1. Step E1 further comprises the acquisition of an input in the form made by the user, resulting in a configuration of a delimitation of the type of interest of zones.
[0071] For example, in this validation mode, the screen displays two input forms to select the type of area to be delimited, either an exclusion zone mentioned on the "exclusion" screen, or an area of interest mentioned on the "NORMAL AREA" screen. The user can thus validate the configuration he wishes to carry out by selecting either "exclusion" or "NORMAL AREA".
[0072] In this example, the user selects the boundary of an area of interest.
[0073] In the application, "input form" means a selection or input or request by the user in a form containing an input control. The input control may be of any type among at least: button, check box, drop-down list, text input area, ... the list is not exhaustive.
[0074] Of course, the process may only offer one type of zone to configure, for example, only an exclusion zone or only an area of interest. In this case, the display only offers an input form to validate the configuration intention.
[0075] The method for delimiting an area further comprises a step of coordinating a map with the thermal image called coordination step E2. This coordination step E2 comprises the display on the screen 11 of a map comprising at least one layer of coordinates (abscissa and ordinate). In this example the map displayed is a grid, in this case 8X8.
[0076] In this embodiment, this coordination step E2 further comprises a sub-step of displaying on the screen 11 a form for entering information on the installation height of the thermal imager H and acquiring an entry by the user of the information on the installation height of the thermal imager, resulting either in the calculation of a map size by the application of the user device 1 having received information on the size of the fields of vision (for example during pairing as explained above), or in the transmission to the space management device 2 of the height and the calculation of a map size by the latter and the transmission to the user device 1 of this map size. The map size is here in this instance a grid comprising more or less boxes (abscissa and ordinate) to be displayed depending on the height chosen. In this example, the entry form is an “H” button.The map displayed will then remain an 8X8 grid, but could very well be 10X10. If the user does not choose a height, the map size to be displayed is predetermined, for example, the 8X8 grid.
[0077] This step may include a sub-step of modifying a circular image of the thermal imager according to the characteristics of the lens to improve the thermal image displayed on the screen of the user's equipment. Indeed, as the lens distorts the reality captured by the imager, the thermal image includes distortions compared to reality. Thus, when configuring the boundaries of the zones, the space management device 2 (by the control unit for example) or the equipment 1 can modify the circular image according to the characteristics of the lens to improve the thermal image displayed on the screen of the user's equipment.
[0078] The method may further comprise a step of displaying on the screen a form for entering information on the grid size of the map, acquiring the user's input of the grid size and resulting in the step of displaying the map, a grid according to the chosen size.
[0079] The method comprises, in this example, a step of transmitting the size of the card from the user device 1 to the space management device 2.
[0080] The method comprises a step of capturing thermal images regularly by the thermal imager 21. This step can be carried out before or after the coordination step E2.
[0081] The method comprises, in this example, for each captured thermal image, a thermal image analysis step consisting of a search for identification of a target in the captured images. The method can, according to another example, depending on the computing power, once the identification has been carried out on an image, analyze the last captured image even if other images have been captured in the meantime.
[0082] The analysis of the identification is carried out in this example by the control unit 22 of the space management device 2 by searching for a thermal value in the image which is in a predetermined temperature range. The method comprises extracting a position of the thermally identified target in each analyzed thermal image. Thus the analysis comprises adding a layer of coordinates (abscissa and ordinate) to the analyzed image. The layer of coordinates corresponds to that of the displayed map.
[0083] The method further comprises a step of transmission by the space management device 2 of the coordinates of the target and of reception of the coordinates of the target by the user device 1. For example, the space management device 2 carries out the step of transmission of the coordinates of the target at regular intervals.
[0084] The method further comprises a step of displaying information of a target in the displayed map E3, comprising the information of the target having the coordinates corresponding to the position extracted from at least one of the last captured images.
[0085] As soon as the step of displaying information of a target in the displayed map E3 is completed, the method moves on to a step of recording coordinates of the points of a shape delimiting the delimited area to be configured E4, called recording step E4, comprising the display on the screen 1 1 of a form for entering a validation of coordinates 40.
[0086] In this embodiment, the target is the user. The user thus sees on the screen 11 his position relative to the map and therefore relative to the image captured in the field of vision of the thermal imager 21. Of course, in the case of an environment which cannot be empty, for example a station hall, or an airport, the target can be a thermal device (whose heating or cooling can be carried out electrically or chemically) having a predetermined temperature outside the range between a human temperature and a temperature of the environment so as to locate it well in the environment.
[0087] When the user considers that he is in a corner, or on the outline of the area that he wishes to delimit, here in this example the outline of an area of interest, he enters (here he presses the button) the form for entering a coordinate validation 40. The user will do this several times, in this example at each corner of the area to be delimited.
[0088] The method therefore comprises a sub-step of acquiring several entries (at least three) in the recording step E4 by the user, in the form of coordinates of points of a delimitation of the area to be delimited corresponding to the different positions of the identified target displayed on the map during the acquisition, resulting in the recording of the coordinates of the points.
[0089] In this example, to improve ergonomics and user visuals, each recorded point remains displayed on screen 1 1 .
[0090] The method further comprises a step of acquiring an end of delimitation E5, resulting in production and display of a shape on the map from the different coordinates recorded in the chronological order of recording.
[0091] In this example, the end of the boundary is achieved when the target displayed on the map is again at the first recorded position.
[0092] In this example, the shape includes the recorded points but these recorded points can also be found in another example not shown.
[0093] In this embodiment, the recording of the coordinates of each point is carried out in the memory of the control unit 12 of the user device 1 and the shape of the delimited area is carried out by the control unit 12 of the user device 1 (configured to carry out this step). The control unit 22 of the space management device 2 can also be configured to carry out the shape of the delimited area which would require the user device 1 to transmit each point coordinate entered by the user (by pressing the button 30 in this example).
[0094] The method further comprises a step of delimiting the area in the thermal image E6, hereinafter called delimiting step E6.
[0095] This delimitation step E6 comprises a sub-step of displaying on the screen 11 an input form for validating the shape 60 as the type of configured zone, a sub-step of acquiring the input validated by the user resulting in the recording of the delimited zone of the thermal image according to the coordinates of the points of the shape.
[0096] The delimitation step E6 further comprises, in this embodiment, a sub-step of transmission of the shape by the user device 1 to the space management device 2 between the sub-step of acquisition of the validated input and the recording of the shape of the delimited area of the thermal image in the memory of the control unit 22 of the space management device 2.
[0097] Here, in this embodiment, the shape is a polygon, in this case in the displayed example, the shape is a rectangle of which each angle is a circle corresponding to the coordinates of points of a recorded boundary. The angles can be, according to another example, displayed in a salient manner.
[0098] Thus, the control unit 22 of the management device 2 can, during the analysis, thermally identify in the thermal image a human presence only in the delimited area of the thermal image corresponding to the shape on the displayed map, since the image and the map each comprise at least one layer of abscissa and ordinate coordinates corresponding to each other.
[0099] The control unit 22 of the management device 2 can thus be configured to control home automation electrical devices according to a control law, based on the identification of a human presence in this area of interest.
[0100] [Fig. 3] shows a schematic representation of several displays on the screen 11 of the user device 1 representing different steps of the method of delimiting an area from the thermal imager 21 of the space management device 2 of FIG. 1, according to a second embodiment of the invention.
[0101] The delimitation method is identical to the first embodiment except that the step of coordinating a map with the thermal image, referenced P1, is carried out before the step of requesting configuration of a delimitation of the type of interest of zones P2, called in the following step of configuring type of interest P2.
[0102] In addition, the P2 interest type configuration step here includes the display of several icons, each representing a configuration input form for a delimitation of either the interest type or the exclusion type. In this example, the areas of interest are of different categories, namely offices, a telephone booth, a meeting room, a meeting room with a video projector. This allows, in the case of using several space management devices, to be able to gather the same control laws according to the category of an area of interest, to simplify the operator's configuration. In addition, this can allow presence information on different categories of areas of interest to be transmitted to a server, to allow a user to obtain the availability of an area of interest.
[0103] In this example, the exclusion zones are either a corridor or a terrace. In one example, the space management device is configured to only count the number of individuals leaving or entering the zone, which may also be based on the location of the entrance and / or exit, i.e., the location of the perimeter forming the exclusion zone.
[0104] Furthermore, in this example, the user selects a second limitation zone. The method therefore comprises a second step of recording coordinates of the points of a shape delimiting the delimited zone to be configured, hereinafter called second recording step E4' and a second step of acquiring an end of delimitation E5'.
[0105] Furthermore in this embodiment, the method comprises in the registration step E4 and the second registration step E4', furthermore, after the entry of the form for entering a coordinate validation 40, the form for entering a validation end 50. In this embodiment, the step and the second step of acquiring a delimitation end E5, E5' which can be carried out before the user returns to his initial position, comprises the user entering a validation end 50 resulting in the formation of the outline of the shape by connecting the recorded points in chronological order and connecting the last recorded point with the first recorded point.
[0106] Furthermore, in this embodiment, the recording step E4 and the second recording step E4' comprise the transmission by the user apparatus to the space management device of the coordinates of each point entered by the user in the form and the recording of the coordinates of each point is carried out in the memory of the control unit 22 of the space management device 2.
[0107] The shape of the delimited area is created by the control unit 22 of the space management device 2 (configured to carry out this step) which transmits to the user device 1 the coordinates of the shape to display it on the map. The shape can also be created by the user device 1 independently (in parallel) but requires recording as in the first embodiment.
[0108] [Fig. 4] shows a schematic representation of several displays on the screen 11 of the user device 1 representing different steps of the method of delimiting an area from the thermal imager 21 of the space management device 2 of FIG. 1, according to a third embodiment of the invention.
[0109] The delimitation method is identical to the first embodiment except that the recording step E4 comprises, after acquiring an entry from the form for entering a validation of coordinates 40 (here a button), the recording of all the coordinates of the target, the coordinates of each position of the target forming the outline of the shape. Thus, in this example, as soon as the target, here the user, has validated the button of the form 40, the user moves in the field of vision 1 by making the route of his movement appear on the map; during the movement, all the points are recorded. The recording step 4 can, either, as in this example, comprise the display of a form for entering a validation of the shape 50 to move on to the step of acquiring an end of delimitation E5 when it is entered, or end as in the first embodiment by repositioning the target to the position comprising the first recorded coordinates. As soon as the user has entered the validation of the shape 50, the shape is displayed (step of acquiring an end of delimitation E5) and the method moves on to the step of delimitation of the area in the thermal image E6.
[0110] So in this third embodiment, the shape can be more precise because it is not a polygon (visually) since the operator can move in a circular or curved way and thus avoid areas more precisely.
[0111] According to another embodiment, the space management device 2 comprises a step of transmitting the thermal image to the user device. This embodiment is less interesting than the first, second and third previously explained since it requires communication means and sufficient bandwidth to transmit the thermal image.
[0112] According to a first example of this embodiment, the application of the user device 1 makes it possible to carry out the steps of analyzing thermal images for the identification of a target in each analyzed image, having the thermal value in the predetermined temperature range, and of extracting a position of the thermally identified target in each thermal image. Thus, in the following, either the space management device continues to transmit the thermal images (with a target at different locations on the image) and the user device 1 makes it possible to validate by input by the user on the map or by a displayed input form, or the space management device only transmits in the following the information of the position of the target.
[0113] According to a second example of this embodiment, the user device comprises an input form on the map of a coordinate validation allowing the user to select and validate the location of the coordinates of each point entered by the user to create the shape.
[0114] Unless otherwise specified, the same element appearing in different figures has a single reference.
Claims
CLAIMS
1. A method of delimiting an area in a thermal image of a thermal imager (21) of a space management device (2), comprising the steps: - requesting configuration of a delimitation of the type of interest of zones (E1, P2) comprising the display on a screen (11) of a user device (1) of a configuration input form of a delimitation of at least one type of interest of zones, and acquisition of an input by the user in the form, resulting in the configuration of a delimitation of a type of zone to be delimited in a thermal image of the imager, - capture by the thermal imager (21) of thermal images regularly, - coordination of a map with the thermal image (E2, P1) comprising the display on the screen of a map comprising at least one layer of coordinates, - transmitting from the space management device (2) to the user device information of a target or thermal images comprising a target, the target having a thermal value in a predetermined temperature range, - displaying each information of a target or thermal image in the displayed map (E3), the target information having coordinates, - recording coordinates of the points of a shape delimiting the delimited area to be configured (E4), comprising the display on the screen (11) of a form for entering a validation of coordinates (40) and acquisition of entry by the user in the form of coordinates of points of a delimitation of the area to be delimited corresponding to the different positions of the identified target displayed on the map during the acquisition, resulting in the recording of the coordinates of the points, - acquisition of an end of delimitation (E5), resulting in the production and display of a shape on the map from the various coordinates recorded in the chronological order of recording, the step of acquiring an end of delimitation being carried out when the target displayed on the map is again at the first recorded position or by displaying on the screen of an input form a validation of the end of delimitation, acquisition of the validated input, and resulting in the formation of the outline of the shape by connecting the points recorded in the chronological order and by connecting the last recorded point with the first recorded point, - delimitation of the area in the thermal image (E6) comprising a sub-step of displaying on the screen (11) an input form for validating the shape (60) as the type of configured area, a sub-step of acquiring the input validated by the user, and a sub-step of recording the shape of the delimited area of the thermal image as a function of the coordinates of the recorded points.
2. A method of delimiting an area from an imager (21) of a space management device (2), according to claim 1, further comprising the steps: - transmission of the thermal image to the user device, - selecting a target in the thermal image comprising displaying on the screen (11) a form for entering a validation of coordinates (40) of a target and acquiring input by the user in the form of coordinates of points and recording the position of the thermally identified target as well as thermal values corresponding to a thermal imprint of the selected target.
3. A method of delimiting an area from a thermal imager (21) of a space management device (2), according to claim 1, wherein the imager is a thermal imager, the method further comprising the steps: - thermal image analysis for identifying a target in each analyzed image, having the thermal value in the predetermined temperature range, and - extraction of a position of the thermally identified target in each thermal image, the coordinates of the extraction of the position of the extracted target being the information of the target displayed in the form of coordinates of points of a delimitation of the area to be delimited.
4. Method for delimiting an area from an imager (21) of a space management device (2), according to the preceding claim, in which the space management device (2) carries out the steps of analyzing thermal images and extracting them and in that the target information transmitted in the step of transmitting from the space management device to the user device are the coordinates of the position of the thermally identified and extracted target.
5. Method for delimiting an area from an imager (21) of a space management device (2), according to claim 3, in which the space management device (2) transmits to the user device each thermal image at the request of the user on the user device or regularly and in that the user device carries out the steps of analyzing thermal images and extracting them.
6. Method for delimiting an area from an imager (21) of a space management device (2), according to claim 4 in which: - the thermal image analysis step comprises the sub-steps: o of identification of a target in a plurality of images captured in a predetermined time, by the thermal imager (21), o of extraction of the coordinates of each position of the target identified in the different images, the step of displaying information of a target in the displayed map (E3), comprises the sub-steps of reception by the user device (1) and displaying the extracted coordinates of the target on the screen map (11).
7. Method for delimiting an area from an imager (21) of a space management device (2) according to the preceding claim, in which the space management device (2) carries out the step of transmitting the coordinates of the target at regular intervals.
8. Method for delimiting an area from an imager (21) of a space management device (2) according to one of the preceding claims, comprising prior to the step of transmitting from the space management device to the user device information of a target: - an initialization step carried out by the user device: o display on the screen (11) of a form for entering a request for coordinates (40), o acquisition of input by the user in the request form, and o transmission to the space management device (2) of a request for identification of a target and these coordinates, - and wherein the step of the space management device to the user device of information of a target comprises the transmission of the coordinates of the target upon receipt of identification requests made by the space management device (2).
9. Method for delimiting an area from an imager (21) of a space management device (2), according to any one of the preceding claims, in which the step of requesting configuration of a delimitation of the type of areas to be delimited (E1, P2) comprises the display of different input forms on the screen (11) forming a list of types of areas, in particular area of interest and exclusion area and in that the acquisition comprises a selection of the type of area to be delimited.
10. A method of delimiting an area from a thermal imager (21) of a space management device (2), according to any one of the preceding claims, in which the step of coordinating a map with the thermal image (E2, P1) further comprises a sub-step of displaying on the screen (11) a form for entering information on the height (H) of installation of the thermal imager and a sub-step of acquiring user entries of the information on the height of installation of the thermal imager (21) resulting in the calculation of a map size to be displayed according to the chosen height.
11. Method for delimiting an area from a thermal imager (21) of a space management device (2), according to any one of the preceding claims, in which the step of coordinating a map with the thermal image (E2, P1) further comprises a sub-step of displaying on the screen (11) a form for entering information on the grid size of the map, a sub-step of acquiring an entry by the user of the grid size and resulting in the step of displaying the map, a grid according to the chosen size.
12. A method of delimiting an area from a thermal imager (21) of a space management device (2) according to any one of claims 3 to 11, wherein each data packet exchanged between the space management device (2) and the user apparatus (1) has a size smaller than a data packet encoding the thermal image having the smallest resolution in the space management device (2).
13. Method for delimiting an area from a thermal imager (21) of a space management device (2), according to any one of the preceding claims, in which the step of recording coordinates of the points of a shape delimiting the delimited area to be configured (E4) comprises the validation of coordinates of different points each corresponding to the coordinates of the moving target information displayed on the map and in that the shape is a polygon of which each coordinate of a point forms a corner of the polygon.
14. Space management device (2) comprising: a thermal imager (21) comprising a sensor in the non-visible or near infrared range used to capture thermal images of a scene, - a control unit (22) comprising an output for controlling home automation electrical devices and an input connected to the thermal imager for detecting the thermal presence of people in pre-defined areas of the imager's detection field, and a memory storing user parameters and calibration data, - a configuration unit configured to store the pre-delimited areas by performing the following steps of a method for delimiting an area from a thermal imager (21): o the capture by the thermal imager (21) of thermal images regularly, o the analysis of thermal images, o the transmission of coordinates of the detected target to the user device (1) by the communication means (20), o a reception by the communication means (20) of data comprising the recorded coordinates and / or the delimitation shape of an area to be delimited, o the recording of the coordinates of the shape as a delimited area of the thermal image. - a communication means (20) connected to the configuration unit and the control unit to communicate with the user device (1) and home automation electrical devices respectively.
15. Space management device according to the preceding claim, wherein: - the thermal imager further comprises a sensor in the visible range and a processing unit - the space management device (2) comprises: o a visible image analysis and processing unit configured to receive the image from the sensor in the visible range and identify a target such as a human presence, different and independent from the configuration unit, o in which the configuration unit is configured to transmit to the visible image analysis and processing unit area delimitation coordinates, o in which the visible image analysis and processing unit and the configuration unit are each configured to transmit presence data or number of presences per delimited area to the control unit, - the device being configured so that the communication means transmits and receives data only by the configuration unit and the control unit.