Method for delimiting an area of interest in a thermal image
The method for delimiting areas of interest using a thermal imager in space management systems addresses the inefficiencies of existing technologies by enabling precise, non-intrusive control of home automation devices based on thermal image analysis, improving energy efficiency and accuracy.
Patent Information
- Application Number
- FR2022010936
- Authority / Receiving Office
- FR · FR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2022-10-21
- Publication Date
- 2025-10-24
- Estimated Expiration
- 2042-10-21
AI Technical Summary
Existing space management systems using visible range imagers and human recognition devices are expensive, energy-intensive, intrusive, and prone to errors, while motion detectors fail to detect stationary individuals, leading to inefficient control of home automation devices in large spaces.
A method for delimiting areas of interest using a thermal imager, allowing users to configure zones by identifying targets in thermal images and displaying them on a map, enabling precise control of home automation devices based on human or object presence without transmitting live images.
This approach simplifies the configuration of zones, reduces energy consumption, minimizes intrusion risks, and ensures accurate detection of stationary individuals, optimizing energy use in large spaces.
Smart Images

Figure 00000026_0000 
Figure 00000026_0001 
Figure 00000027_0000
Abstract
Description
Title of the invention: Method for delimiting an area of interest in a thermal image TECHNICAL FIELD OF THE INVENTION
[0001] The technical field of the invention is that of space management using a thermal imager, in particular in the field of tertiary buildings. Space management consists of controlling home automation electrical devices, for example light fixtures, independently depending on the presence of occupants, the aim being to optimize energy consumption without penalizing the comfort of users.
[0002] The present invention relates to a method for delimiting an area of interest from a thermal imager of a space management device from a user device, as well as a space management device configured to configure a delimitation of an area of interest according to this method. TECHNOLOGICAL BACKGROUND OF THE INVENTION
[0003] Space management devices are known for controlling various home automation electrical devices, for example, shutters, a heating and / or air conditioning device, electric door locks or suction cups, light fixtures or light sources, electrical outlets, in particular autonomously and independently depending on the user's needs in a space. These management devices make it possible in particular to save electricity by controlling only the electrical devices depending on the presence of a person, for example by controlling light fixtures illuminating only the areas where lighting is needed where a user is located.Indeed, in large spaces such as open-plan offices, there is a need to control one or more home automation electrical devices controlled according to the presence of a person in a delimited area according to a setpoint, which may be a temperature, brightness, etc. For example, light sources are positioned to illuminate the entire open-space, but if only one person is located in the large space, the user's need may be to have only one or two or three luminaires illuminating the area where the person is located. The same is true with heating devices, for example, electric radiators or connected radiator valves are positioned to heat the entire open-space, but if only one person is located in the large space, the user's need may be to have only one or two radiators heating the area where the person is located.However, such a management system requires detecting the person in delimited areas and therefore configuring the delimitation of these areas.
[0004] The most well-known type of space management device uses an imager in the visible range (CMOS, a video camera) with a human recognition device (computer unit and software) to enable the detection of the human when he is in the field of vision of the camera. However, this type of camera with this human recognition device is expensive, energy-intensive and is generally intrusive, especially when it can transmit the videos to a remote device. One of the solutions to reduce consumption is that the space management device further comprises a motion sensor to turn on the imager when it detects movement and the imager detects the immobile presence in order to reduce the electrical consumption while detecting a immobile person.However, such a device is very expensive due to the two sensors and is intrusive and energy-consuming when the imager and the digital processing device operate to detect a stationary presence. In addition, such imaging sensors are intrusive, especially if the human recognition device is remote from the CMOS imager, and may even be illegal in the case of an image transmitted to a remote device or may cause cybersecurity, confidentiality and integrity problems, especially in places of defense secret or industrial secrecy.
[0005] Furthermore, the problem with management systems comprising an imager in the visible range (a video camera) with a human recognition device (computer unit and software), is that in the event of an individual passing behind a window or a reflection on a window or a mirror or even in the event of a hologram, the human recognition device (computer unit and software) can detect a presence in an area even though it is not located in this area.
[0006] Management systems are known comprising a motion detector with an imager in the visible range, of the CMOS type. The motion detector makes it possible to turn on the imager when movement is detected by the motion detector and the CMOS type imager identifies whether the person is in a useful area.
[0007] The problem with pyroelectric type detectors is that the detector is activated when the infrared to which a pyroelectric module in the pyroelectric type detector is subjected varies. If the individual is perfectly still (even if he emits infrared waves) in front of the detector, he will not be detected. The same is true with ultrasonic or microwave motion wave motion detectors, in fact it only detects in the event of movement. In other words, the problem with ultrasonic or microwave motion wave motion detectors is that it does not detect a presence when the person is still, and the space management device no longer detecting the person can order, after a time delay, to turn off while a person is still in the detection zone.
[0008] Methods for delimiting areas of interest from an imager are known, particularly in the CMOS visible range, in which the space management device transmits the video live to a user device displaying the video and the user can configure areas of interest directly on the image in the visible range.
[0009] space management devices without video image in the visible domain but comprising several motion detectors without delimitation of the area of interest, that is to say that it turns on or off the lamps associated with the motion detector having detected a movement. However, these devices are difficult to set up due to the number of motion sensor installations to be installed.
[0010] In certain situations, there may therefore be a need to have a space management device devoid of video image in the visible domain while having a delimitation of the area of interest to avoid the installation of a plurality of motion detectors.
[0011] One solution is to propose identifying the areas of interest blindly by proposing a grid in which the user can define the areas of interest. This solution is tedious for the user, who requires him to check whether the areas defined in the grid correspond to those he wants in the sensor's detection space.
[0012] Furthermore, there is a need for a space management device having the ability to delimit exclusion zones, which may be located between two areas of interest, to avoid detecting a person in an area not desired by the user. For example, in the event of detection of a person passing in a corridor located between two areas of interest, the management device will not control a device.
[0013] There is therefore a need to facilitate the configuration of delimitation of the area of interest in a field of vision of a presence detection sensor without being intrusive, by controlling home automation electrical devices independently according to the areas of stationary or mobile human presence. Summary of the invention
[0014] The invention provides a solution to the problems mentioned above, by making it possible to configure a delimitation of an area in a thermal image of a thermal imager of a space management device by identifying a target in a thermal image and displaying the target in a map representing the field of vision of the thermal imager.
[0015] One aspect of the invention relates to a method for delimiting an area in a thermal image of an imager of a space management device, comprising the steps: • requesting configuration of a delimitation of the type of interest of zones comprising the display on a screen of a user device of a configuration input form of a delimitation of at least one type of interest of zones, and acquisition of an input by the user in the form, resulting in the configuration of a delimitation of a type of zone to be delimited in a thermal image of the imager, • capture of thermal images by the imager regularly, • coordination of a map with the thermal image including the display on the screen of a map including at least one layer of coordinates, • transmitting from the space management device to the user device information of a target or thermal images comprising a target, the target having a thermal value in a predetermined temperature range, • displaying each information of a target or thermal image in the displayed map, the target information having coordinates, • recording of coordinates of the points of a shape delimiting the delimited area to be configured including the display on the screen of an entry form for validation of coordinates and acquisition of entry by the user in the form of coordinates of points of a delimitation of the area to be delimited corresponding to the different positions of the identified target displayed on the map during the acquisition, resulting in the recording of the coordinates of the points, • acquisition of an end of delimitation, resulting in the production and display of a shape on the map from the different coordinates recorded in the chronological order of recording, • delimitation of the area in the thermal image comprising a sub-step of displaying on the screen an input form for validation of the shape as the type of configured area, a sub-step of acquiring the input validated by the user, and a sub-step of recording the shape of the delimited area of the thermal image according to the coordinates of the recorded points.
[0016] The method makes it possible to configure the delimitation of zones in which it is necessary to detect or not to detect a presence in an image of a field of vision of a thermal imager. Thus the space management device will be able to use a thermal imager as a presence detector with delimitation zones. The map and / or the field of vision of the thermal imager each comprises at least one layer of coordinates (abscissa and ordinate) corresponding to each other, and the location of the target is based on this layer of coordinates. The method makes it possible in addition to simplifying the configuration of the delimitation of the zones. Indeed, the fact of using a target displayed in a grid of a map allows the user to configure the delimitation by locating and moving the target in the environment. The detected target can be the user who moves in the environment of the field of vision of the thermal imager or an object having a temperature different from the other temperatures of the environment, the object can either be an automobile which can be autonomous or moved by the user. Thus, the user can see on the screen target information, which can be an image representing a target or a human or other, moving (by moving or by moving the object) in the grid.Thus, the user can easily configure a delimitation by validating either coordinates of points forming the corners of a shape or the coordinates of points forming a path of the target, for example by recording and moving in the environment to form the shape of the area to be delimited. The recorded coordinates of each point therefore make it possible to form the outline of the shape corresponding to the delimitation of the type of area. The type of area can be an area in which the user wants human presence detection to control home automation electrical devices, called an area of interest in the following, or an exclusion area in which the user wishes not to have a detection search in the image or not to control in the event of presence detected in this area, called an exclusion area in the following.
[0017] Thanks to the invention, it is therefore possible to use a thermal imager as a presence detector in a space management device allowing it to be non-intrusive, without confidentiality problems, while having zone demarcations.
[0018] In addition to the characteristics which have just been mentioned previously, the method for delimiting a zone in a thermal image of a thermal imager of a space management device according to one aspect of the invention may have one or more complementary characteristics among those described in the following paragraphs, considered individually or according to all technically possible combinations:
[0019] According to one embodiment, the imager is a thermal imager, the method further comprising the steps of: • transmission of the thermal image to the user device, • selecting a target in the thermal image including display on the screen of a form for entering a target coordinate validation and acquisition of input by the user in the form of coordinates of points and recording of the position of the thermally identified target as well as the thermal values corresponding to a thermal fingerprint of the selected target. This allows the operator to determine the thermally identified target. Thus, the method of delineating an area in a thermal image of an imager of a space management device can be carried out while different people are present in the field of view of the imager. The operator can recognize the moving target (which can be itself or another person or a heat-emitting device) in the thermal image for the configuration of the area delineation and select it to configure the area delineation.
[0020] According to another embodiment, the imager is a thermal imager, the method further comprising the steps: • thermal image analysis for identifying a target in each analyzed image, having the thermal value in the predetermined temperature range, and • extraction of a position of the thermally identified target in each thermal image, the coordinates of the extraction of the position of the extracted target being the information of the target displayed in the form of coordinates of points of a delimitation of the area to be delimited. This makes it possible to automate the selection of a target, the operator can thus enter, for example by a click for a start of delimitation of the area corresponding to the position of the target on the screen forming a vertex of the shape to be entered, then to section again when the operator considers that the target is at a vertex of the shape to be delimited until entering an end of delimitation leading to the production of the shape from the different positions entered.
[0021] According to a first example of this embodiment, the space management device performs the thermal image analysis and extraction steps and in that the target information transmitted in the transmission step from the space management device to the user device are the coordinates of the position of the thermally identified and extracted target. This makes it possible to have a space management device that may never send an image from the imager to another device (thus there is less risk of intrusion).
[0022] In this first example, the thermal image analysis step can comprise the sub-steps: • identification of a target in a plurality of images captured in a predetermined time, by the thermal imager, • extraction of the coordinates of each position of the target identified in the different images,
[0023] and the step of displaying information of a target in the displayed map (E3), may comprise the sub-steps of reception by the user device and display of the extracted coordinates of the target on the screen map.
[0024] In particular in this first example, the space management device can carry out the step of transmitting the coordinates of the target at regular intervals. This makes it possible to send only the position of the extracted target and thus reduce the throughput (therefore the bandwidth) of the means of communication used between the space management device and the user device. Thus, the means of communication can be a less expensive and less energy-consuming communication technology, for example by using a home automation wireless communication standard (zigbee etc.) with very low consumption compared to a means of communication where the space management device transmits a succession of images to the user device.
[0025] According to a second example of this embodiment, the space management device transmits to the user device each thermal image upon request from the user on the user device or regularly and in that the user device performs the steps of thermal image analysis and extraction. This makes it possible to use the power of the user device for the recognition of the target and its extraction which may have greater computing power than the space management device. Thus, the target recognition time may be faster when configuring the area delimitation.
[0026] According to one embodiment, the method comprises, prior to the step of transmitting information from the space management device to the user device of a target: • an initialization step carried out by the user device: • display on the screen of a form for entering a request for contact details, • acquisition of user input in the application form, and • transmission to the space management device of a request to identify a target and its coordinates, • and wherein the step of the space management device to the user device of information of a target comprises the transmission of the coordinates of the target upon receipt of an identification request by the space management device.
[0027] In this example, the operator can thus enter confirmation of the start of the desire to acquire the display of a target on the screen in order to avoid transmitting data when the operator is not ready (for example, he knows that no target is in the field of vision of the imager).
[0028] According to one embodiment, the step of requesting configuration of a delimitation of the type of zones to be delimited comprises the display of different input forms on the screen forming a list of types of zones, in particular zone of interest and exclusion zone and in that the acquisition comprises a selection of the type of zone to be delimited. This makes it possible to choose the type of zones to be defined by the operator.
[0029] According to one embodiment, the step of coordinating a map with the thermal image further comprises a sub-step of displaying on the screen a form for entering information on the installation height of the thermal imager and a sub-step of acquiring user entries of the information on the installation height of the thermal imager resulting in the calculation of a map size to be displayed as a function of the chosen height.
[0030] According to one embodiment, the step of coordinating a map with the thermal image further comprises a sub-step of modifying a circular image of the thermal imager according to the characteristics of the lens to improve the thermal image displayed on the screen of the user's device. Indeed, as the lens distorts the reality captured by the imager, the thermal image includes distortions compared to reality. This step makes it possible to correct these distortions.
[0031] According to one embodiment, the step of coordinating a map with the thermal image further comprises a sub-step of displaying on the screen a form for entering information on the grid size of the map, a sub-step of acquiring an entry by the user of the grid size and resulting in the step of displaying the map, a grid according to the chosen size. This allows the operator to configure the precision of the delimitation of the area to be delimited.
[0032] According to one embodiment, the method comprises a pairing step between the management device and the user device.
[0033] According to one embodiment, each data packet exchanged between the space management device and the user device has a size smaller than a data packet encoding the thermal image having the smallest resolution in the space management device. This makes it possible to use a non-energy-consuming, low-power communication means and, furthermore, this can improve confidentiality and avoid being intrusive (even in the event of hacking of the management device). Indeed, the management device may be physically unable to transmit a data packet encoding the thermal image or may have software blocking the sending in the event of data packets larger than the data packet encoding the thermal image having the smallest resolution of the imager.
[0034] According to one embodiment, the step of recording coordinates of the points of a shape delimiting the delimited zone to be configured comprises the validation of coordinates of different points each corresponding to the coordinates of the moving target information displayed on the map and in that the shape is a polygon where each coordinate of a point forms a corner of the polygon. This allows the operator to validate at each point forming a vertex of the shape of the area to be delimited. Indeed, another less easy solution for the operator is that the shape of the area to be delimited is formed by following the selected target.
[0035] According to one embodiment, the method of delimiting an area in a thermal image of an imager of a space management device is carried out during an operating mode of the space management device, to modify the perimeter of a delimited area or add a delimited area to the other delimited areas.
[0036] According to a variant of this embodiment, the target is a target of a thermal device having a predetermined temperature outside a range comprising a value of a human temperature and a value of a temperature of the environment.
[0037] According to one embodiment, the step of acquiring an end of delimitation is carried out when the target displayed on the map is again at the first recorded position.
[0038] According to one embodiment, the step of acquiring an end of delimitation is carried out by displaying on the screen of an input form a validation of the end of delimitation, acquisition of the validated input, and causing the formation of the outline of the shape by connecting the recorded points in chronological order and by connecting the last recorded point with the first recorded point.
[0039] According to one embodiment, the method comprises the configuration of delimitation of several zones according to the steps of the method.
[0040] For example, the method comprises configuring a first and second area of interest in which the detection of a human target is to be monitored and in that the method further comprises the steps: • displaying on the screen input forms of a control logic, acquiring inputs by the user in the input forms of a control logic, resulting in a control order for a home automation electrical device based on the identification of a presence in the first zone, and a control logic comprising a power supply control order for at least one other electrical device based on the identification of a presence in the second zone.
[0041] According to one embodiment, the space management device is electrically connected to a power supply of the building comprising a converter (AC / DC or / and DC / DC or / and AC / AC) to power the elements of the space management device.
[0042] According to a variant of this embodiment, the space management device comprises a battery and a converter (AC / DC or / and DC / DC or / and AC / AC) connected to the battery to power the elements of the space management device.
[0043] Another aspect of the invention relates to a space management device comprising: • a thermal imager comprising a sensor in the non-visible or near infrared range used to capture thermal images of a scene, • a control unit comprising an output for controlling home automation electrical devices and an input connected to the thermal imager to detect the thermal presence of people in pre-defined areas of the imager's detection field, and a memory storing user parameters and calibration data, • a configuration unit configured to memorize the pre-defined zones by carrying out the following steps of a method of delimiting a zone from a thermal imager: • the capture by the thermal imager of thermal images regularly, • thermal image analysis, • transmission of coordinates of the detected target to the user device by the communication means, • reception by means of data communication including the recorded coordinates and / or the form of delimitation of an area to be delimited, • recording the shape coordinates as a delimited area of the thermal image. • a means of communication connected to the configuration unit and the control unit to communicate with the user device and home automation electrical devices respectively.
[0044] According to one embodiment: • the thermal imager further comprises a sensor in the visible range and a processing unit, • the space management system includes: • a visible image analysis and processing unit configured to receive the image from the sensor in the visible range and identify a target such as a human presence, different and independent from the configuration unit, • in which the configuration unit is configured to transmit to the visible image analysis and processing unit area boundary coordinates, • in which the visible image analysis and processing unit and the configuration unit are each configured to transmit presence or presence number data per delimited zone to the control unit, • the device being configured so that the communication means transmits and receives data only through the configuration unit and the control unit.
[0045] The invention and its various applications will be better understood upon reading the following description and examining the accompanying figures. BRIEF DESCRIPTION OF THE FIGURES
[0046] The figures are presented for information purposes only and in no way limit the invention.
[0047] [Fig.l] shows a schematic representation of a space management device in an environment with a user using a user device paired with the space management device.
[0048] [Fig.2] shows a schematic representation of several displays on a screen of the user device representing different steps of the method of delimiting an area from a thermal imager of the space management device of [Fig.l], according to a first embodiment of the invention.
[0049] [Fig.3] shows a schematic representation of several displays on a screen of the user device representing different steps of the method of delimiting an area from a thermal imager of the space management device of [Fig.l], according to a second embodiment of the invention.
[0050] [Fig.4] shows a schematic representation of several displays on a screen of the user device representing different steps of the method of delimiting an area from a thermal imager of the space management device of [Fig.l], according to a third embodiment of the invention. DETAILED DESCRIPTION
[0051] The figures are presented for information purposes only and in no way limit the invention.
[0052] [Fig.l] schematically represents a user comprising a user device 1 paired with a space management device 2 comprising a thermal imager 21.
[0053] The thermal imager 21 captures thermal images in its field of vision CL. Preferably, the space management device 2 comprises only one or more thermal imagers 21 as presence sensors which are not in the visible range.
[0054] The user device 1 is a computer, for example a handheld computer such as a smartphone (smart mobile phone), a tablet, a smart watch or may be a laptop or desktop computer or any other electronic device. In this example, the user device 1 is a smartphone represented by an enlargement according to a block diagram.
[0055] The user device 1 comprises a communication means 10 for communicating with a communication means 20 of the space management device 2. The communication can be wireless, for example using the “Wifi” or “Bluetooth” standard. The user device 1 comprises a screen 11, a human-machine interface, in this case the screen 11 is a touch screen providing the human-machine interface. The user device 1 comprises a control unit 12 comprising at least one microcontroller or processor or microprocessor and a memory making it possible to produce a configuration program for the space management device 2.
[0056] All communications, transmission and reception of data, carried out between the space management device 2 and the user device 1 (and vice versa) are carried out by these communication means 20. In the first, second, and third embodiments explained below, each data packet exchanged between the space management device 2 and the user device 1 has a size smaller than the data packet of the thermal image having the smallest resolution in the space management device 2.
[0057] The space management device 2 also comprises a control unit 22 comprising at least one microcontroller or processor or microprocessor and a memory making it possible to analyze captured thermal images to thermally identify a human presence in the thermal image and to control according to a control law home automation electrical devices, for example light sources and / or heating and / or air conditioning, and / or openings such as shutters or doors or even door locks etc., in particular as a function of the identification of a human presence. The management device may comprise other types of sensors, for example a brightness sensor to detect the brightness of the environment.
[0058] The user wishes to delimit an area, which may be an area of interest or exclusion.
[0059] The area of interest allows the space management device to control home automation electrical devices according to a control law based on a thermal identification in this area of interest of the thermal image of a human presence.
[0060] The exclusion zone allows the space management device to control home automation electrical devices according to a control law based on an identification thermal in the thermal image of a human presence without those identified in the exclusion zone or without seeking to identify a presence in the exclusion zone.
[0061] [Fig.2] shows a schematic representation of several displays on the screen 11 of the user device 1 according to different steps of a method of delimiting an area from a thermal imager 21 of the space management device 2, according to a first embodiment of the invention.
[0062] In this embodiment, the method may configure multiple zone type boundaries.
[0063] The method therefore comprises a first step, not shown, of pairing (pairing or twinning) between the space management device 2 and the user device 1.
[0064] The method may further comprise, during this pairing, a transmission of characteristics of the imager of the space management device to the user device, such as its field of vision size as a function of height, etc., and other characteristics, for example the presence of a sensor, etc., this makes it possible to adapt the application of the user device to different types of space management device. Of course, these characteristics may be, according to another example, in an external database or stored in the user device, and the space management device transmits identification information allowing the user device to obtain these characteristics in the database.
[0065] The method comprises a step of requesting configuration of a delimitation of the type of interest of zones El, then called step El, comprising the display on the screen 11 of an input form EL. Step El further comprises the acquisition of an input in the form made by the user, resulting in a configuration of a delimitation of the type of interest of zones.
[0066] For example, in this validation mode, the screen displays two input forms to select the type of area to be delimited, either an exclusion area mentioned on the “exclusion” screen, or an area of interest mentioned on the “NORMAL AREA” screen. The user can thus validate the configuration that he wishes to carry out by selecting either “exclusion” or “NORMAL AREA”.
[0067] In this example, the user selects the delimitation of an area of interest.
[0068] In the application, the term "input form" means a selection or input or request by the user in a form comprising an input control. The input control may be of any type among at least: button, check box, drop-down list, text input area, etc., the list not being exhaustive.
[0069] Of course, the method may only propose a single type of zone to be configured, for example only an exclusion zone or only a zone of interest. In In this case, the display only offers an input form to validate the configuration intention.
[0070] The method for delimiting an area further comprises a step of coordinating a map with the thermal image called coordination step E2. This coordination step E2 comprises the display on the screen 11 of a map comprising at least one layer of coordinates (abscissa and ordinate). In this example the map displayed is a grid, in this case 8X8.
[0071] In this embodiment, this coordination step E2 further comprises a sub-step of displaying on the screen 11 a form for entering information on the installation height of the thermal imager H and acquiring an entry by the user of the information on the installation height of the thermal imager, resulting either in the calculation of a map size by the application of the user device 1 having received information on the size of the fields of vision (for example during pairing as explained above), or in the transmission to the space management device 2 of the height and the calculation of a map size by the latter and the transmission to the user device 1 of this map size. The map size is here in this instance a grid comprising more or less boxes (abscissa and ordinate) to be displayed depending on the chosen height. In this example, the entry form is an “H” button.The map displayed afterwards will remain an 8X8 grid, but could very well be 10X10. If the user does not choose a height, the map size to be displayed is predetermined, for example, the 8X8 grid.
[0072] This step may include a sub-step of modifying a circular image of the thermal imager according to the characteristics of the lens to improve the thermal image displayed on the screen of the user's equipment. Indeed, as the lens distorts the reality captured by the imager, the thermal image includes distortions compared to reality. Thus, when configuring the boundaries of the zones, the space management device 2 (by the control unit for example) or the equipment 1 can modify the circular image according to the characteristics of the lens to improve the thermal image displayed on the screen of the user's equipment.
[0073] The method may further comprise a step of displaying on the screen a form for entering information on the grid size of the map, acquiring the user's entry of the grid size and resulting in the step of displaying the map, a grid according to the chosen size.
[0074] The method comprises, in this example, a step of transmitting the size of the card from the user device 1 to the space management device 2.
[0075] The method comprises a step of capturing thermal images regularly by the thermal imager 21. This step can be carried out before or after the coordination step E2.
[0076] The method comprises, in this example, for each captured thermal image, a thermal image analysis step consisting of a search for identification of a target in the captured images. The method can, according to another example, depending on the computing power, once the identification has been carried out on an image, analyze the last captured image even if other images have been captured in the meantime.
[0077] The analysis of the identification is carried out in this example by the control unit 22 of the space management device 2 by searching for a thermal value in the image which is in a predetermined temperature range. The method comprises the extraction of a position of the thermally identified target in each analyzed thermal image. Thus the analysis comprises the addition of a layer of coordinates (abscissa and ordinate) to the analyzed image. The layer of coordinates corresponds to that of the displayed map.
[0078] The method further comprises a step of transmission by the space management device 2 of the coordinates of the target and of reception of the coordinates of the target by the user device 1. For example, the space management device 2 carries out the step of transmission of the coordinates of the target at regular intervals.
[0079] The method further comprises a step of displaying information of a target in the displayed map E3, comprising the information of the target having the coordinates corresponding to the position extracted from at least one of the last captured images.
[0080] As soon as the step of displaying information of a target in the displayed map E3 is finished, the method moves on to a step of recording coordinates of the points of a shape delimiting the delimited zone to be configured E4, called recording step E4, comprising the display on the screen 11 of a form for entering a validation of coordinates 40.
[0081] In this embodiment, the target is the user. The user thus sees on the screen 11 his position relative to the map and therefore relative to the image captured in the field of vision of the thermal imager 21. Of course, in the case of an environment which cannot be empty, for example a station hall, or an airport, the target can be a thermal device (whose heating or cooling can be carried out electrically or chemically) having a predetermined temperature outside the range between a human temperature and a temperature of the environment so as to locate it well in the environment.
[0082] When the user considers that he is in a corner, or on the outline of the area that he wishes to delimit, here in this example the outline of an area of interest, he carries out the entry (here he presses the button) of the entry form of a validation of coordinates 40. The user will do this several times, in this example at each corner of the area to be delimited.
[0083] The method therefore comprises a sub-step of acquiring several entries (at least three) in the recording step E4 by the user, in the form of coordinates of points of a delimitation of the area to be delimited corresponding to the different positions of the identified target displayed on the map during the acquisition, resulting in the recording of the coordinates of the points.
[0084] In this example, to improve the ergonomics and visual appearance of the user, each recorded point remains displayed on the screen 11.
[0085] The method further comprises a step of acquiring an end of delimitation E5, resulting in production and display of a shape on the map from the different coordinates recorded in the chronological order of recording.
[0086] In this example, the end of delimitation is achieved when the target displayed on the map is again at the first recorded position.
[0087] In this example, the shape includes the recorded points but these recorded points can also according to another example not shown.
[0088] In this embodiment, the recording of the coordinates of each point is carried out in the memory of the control unit 12 of the user device 1 and the shape of the delimited area is carried out by the control unit 12 of the user device 1 (configured to carry out this step). The control unit 22 of the space management device 2 can also be configured to carry out the shape of the delimited area which would require the user device 1 to transmit each point coordinate entered by the user (by pressing the button 30 in this example).
[0089] The method further comprises a step of delimiting the area in the thermal image E6, hereinafter called delimitation step E6.
[0090] This delimitation step E6 comprises a sub-step of displaying on the screen 11 an input form for validating the shape 60 as the type of configured zone, a sub-step of acquiring the input validated by the user resulting in the recording of the delimited zone of the thermal image as a function of the coordinates of the points of the shape.
[0091] The delimitation step E6 further comprises, in this embodiment, a sub-step of transmission of the shape by the user device 1 to the space management device 2 between the sub-step of acquisition of the validated input and the recording of the shape of the delimited area of the thermal image in the memory of the control unit 22 of the space management device 2.
[0092] Here, in this embodiment, the shape is a polygon, in this case in the example displayed, the shape is a rectangle of which each angle is a circle corresponding to the coordinates of recorded points of a boundary. The angles can be displayed prominently, for example.
[0093] Thus, the control unit 22 of the management device 2 can, during the analysis, thermally identify in the thermal image a human presence only in the delimited area of the thermal image corresponding to the shape on the displayed map, since the image and the map each comprise at least one layer of abscissa and ordinate coordinates corresponding to each other.
[0094] The control unit 22 of the management device 2 can thus be configured to control home automation electrical devices according to a control law, depending on the identification of a human presence in this area of interest.
[0095] [Fig.3] shows a schematic representation of several displays on the screen 11 of the user device 1 representing different steps of the method of delimiting an area from the thermal imager 21 of the space management device 2 of [Fig.l], according to a second embodiment of the invention.
[0096] The delimitation method is identical to the first embodiment except that the step of coordinating a map with the thermal image, referenced PI, is carried out before the step of requesting configuration of a delimitation of the type of interest of zones P2, called in the following step of configuring type of interest P2.
[0097] Furthermore, the interest type configuration step P2 here comprises the display of several icons, each representing a configuration input form for a delimitation of either the interest type or the exclusion type. In this example, the areas of interest are of different categories, namely offices, a telephone booth, a meeting room, a meeting room with video projector. This makes it possible, in the case of using several space management devices, to be able to bring together the same control laws according to the category of an area of interest, to simplify the operator's configuration. Furthermore, this can make it possible to transmit to a server, presence information on different categories of areas of interest, to allow a user to obtain the availability of an area of interest.
[0098] In this example, the exclusion zones are either a corridor or a terrace. According to one example, the space management device is configured to only count the number of individuals leaving or / entering the zone which may also be based on the location of the entrance and / or exit, i.e. the location of the perimeter forming the exclusion zone.
[0099] Furthermore, in this example, the user selects a second limitation zone. The method therefore comprises a second step of recording coordinates of the points of a shape delimiting the delimited zone to be configured, called hereinafter second recording step E4' and a second step of acquiring an end of delimitation E5'.
[0100] Furthermore in this embodiment, the method comprises in the recording step E4 and the second recording step E4', furthermore, after the input of the form for inputting a coordinate validation 40, the form for inputting an end of validation 50. In this embodiment, the step and the second step for acquiring an end of delimitation E5, E5' which can be carried out before the user returns to his initial position, comprises the input by the user of an end of validation 50 resulting in the formation of the outline of the shape by connecting the recorded points in chronological order and by connecting the last recorded point with the first recorded point.
[0101] Furthermore, in this embodiment, the recording step E4 and the second recording step E4' comprise the transmission by the user apparatus to the space management device of the coordinates of each point entered by the user in the form and the recording of the coordinates of each point is carried out in the memory of the control unit 22 of the space management device 2.
[0102] The shape of the delimited area is produced by the control unit 22 of the space management device 2 (configured to carry out this step) which transmits to the user device 1 the coordinates of the shape to display it on the map. The shape can also be produced by the user device 1 independently (in parallel) but requires recording as in the first embodiment.
[0103] [Fig.4] shows a schematic representation of several displays on the screen 11 of the user device 1 representing different steps of the method of delimiting an area from the thermal imager 21 of the space management device 2 of [Fig.l], according to a third embodiment of the invention.
[0104] The delimitation method is identical to the first embodiment except that, the recording step E4 comprises after the acquisition of an entry from the entry form of a validation of coordinates 40 (here a button), the recording of all the coordinates of the target, the coordinates of each position of the target forming the outline of the form. Thus, in this example, as soon as the target, here the user, has validated the button of the form 40, the user moves in the field of vision 1 by making the route of his movement appear on the map, during the movement, all the points are recorded.The recording step 4 can either, as in this example, comprise the display of a form for entering a validation of the shape 50 to move on to the step of acquiring an end of delimitation E5 when it is entered, or end as in the first embodiment by repositioning the target at the position comprising the first recorded coordinates. As soon as the user has entered the validation of the shape 50, the shape is displayed (step of acquiring an end of delimitation E5) and the method moves on to the step of delimitation of the area in the thermal image E6.
[0105] Thus in this third embodiment, the shape can be more precise because it is not a polygon (visually) since the operator can move in a circular or curved way and thus avoid areas more precisely.
[0106] According to another embodiment, the space management device 2 comprises a step of transmitting the thermal image to the user device. This embodiment is less interesting than the first, second and third previously explained since it requires communication means and sufficient bandwidth to transmit the thermal image.
[0107] According to a first example of this embodiment, the application of the user device 1 makes it possible to carry out the steps of analyzing thermal images for the identification of a target in each analyzed image, having the thermal value in the predetermined temperature range, and of extracting a position of the thermally identified target in each thermal image. Thus, in the following, either the space management device continues to transmit the thermal images (with a target at different locations on the image) and the user device 1 makes it possible to validate by input by the user on the map or by a displayed input form, or the space management device only transmits in the following the information of the position of the target.
[0108] According to a second example of this embodiment, the user device comprises an input form on the map for validating coordinates allowing the user to select and validate the location of the coordinates of each point entered by the user to create the shape.
[0109] Unless otherwise specified, the same element appearing in different figures has a single reference.
Claims
1. Claims Method for delimiting an area in a thermal image of a thermal imager (21) of a space management device (2), comprising the steps: - requesting configuration of a delimitation of the type of interest of zones (El, P2) comprising the display on a screen (11) of a user device (1) of a form for entering configuration of a delimitation of at least one type of interest of zones, and acquiring an entry by the user in the form, resulting in the configuration of a delimitation of a type of zone to be delimited in a thermal image of the imager, - capture by the imager (21) of thermal images regularly, - coordination of a map with the thermal image (E2, PI) including the display on the screen of a map comprising at least one layer of coordinates, - transmitting from the space management device (2) to the user device information of a target or thermal images comprising a target, the target having a thermal value in a predetermined temperature range, - displaying each information of a target or thermal image in the displayed map (E3), the target information having coordinates, - recording coordinates of the points of a shape delimiting the delimited area to be configured (E4), comprising the display on the screen (11) of a form for entering a validation of coordinates (40) and acquisition of entry by the user in the form of coordinates of points of a delimitation of the area to be delimited corresponding to the different positions of the identified target displayed on the map during the acquisition, resulting in the recording of the coordinates of the points, - acquisition of an end of delimitation (E5), resulting in the production and display of a shape on the map from the different coordinates recorded in order chronological recording, the step of acquiring an end of delimitation being carried out when the target displayed on the map is again at the first recorded position or by displaying on the screen of an input form a validation of end of delimitation, acquisition of the validated input, and causing the formation of the outline of the shape by connecting the recorded points in chronological order and connecting the last recorded point with the first recorded point, - delimitation of the area in the thermal image (E6) comprising a sub-step of displaying on the screen (11) an input form for validating the shape (60) as the type of configured area, a sub-step of acquiring the input validated by the user, and a sub-step of recording the shape of the delimited area of the thermal image as a function of the coordinates of the recorded points.
2. A method of delimiting an area from a thermal imager (21) of a space management device (2), according to claim 1, the method further comprising the steps: - transmission of the thermal image to the user device, - selecting a target in the thermal image comprising displaying on the screen (11) a form for entering a validation of coordinates (40) of a target and acquiring input by the user in the form of coordinates of points and recording the position of the thermally identified target as well as thermal values corresponding to a thermal fingerprint of the selected target.
3. A method of delimiting an area from a thermal imager (21) of a space management device (2), according to claim 1, the method further comprising the steps: - thermal image analysis for identifying a target in each analyzed image, having the thermal value in the predetermined temperature range, and - extraction of a position of the thermally identified target in each thermal image, the coordinates of the extraction of the position of the extracted target being the information of the target displayed in the form of coordinates of points of a delimitation of the area to be delimited.
4. Method for delimiting an area from a thermal imager (21) of a space management device (2), according to the preceding claim, in which the space management device (2) carries out the steps of analyzing thermal images and extracting and in that the information of the target transmitted in the step of transmitting from the space management device to the user device are the coordinates of the position of the thermally identified and extracted target.
5. Method for delimiting an area from a thermal imager (21) of a space management device (2), according to claim 3, in which the space management device (2) transmits to the user device each thermal image at the request of the user on the user device or regularly and in that the user device carries out the steps of analyzing thermal images and extracting them.
6. Method for delimiting an area from a thermal imager (21) of a space management device (2), according to claim 4 wherein: - the thermal image analysis step comprises the sub-steps: • of identifying a target in a plurality of images captured in a predetermined time, by the thermal imager (21), • of extracting the coordinates of each position of the target identified in the different images, - the step of displaying information of a target in the displayed map (E3), comprises the sub-steps of reception by the user device (1) and display of the extracted coordinates of the target on the map of the screen (11).
7. Method for delimiting an area from a thermal imager (21) of a space management device (2) according to claim previous, in which the space management device (2) carries out the step of transmitting the coordinates of the target at regular intervals.
8. Method for delimiting an area from a thermal imager (21) of a space management device (2) according to one of the preceding claims, comprising prior to the step of transmitting information of a target from the space management device to the user device: - an initialization step carried out by the user device: • displaying on the screen (11) a form for entering a request for coordinates (40), • acquiring input by the user in the request form, and • transmitting to the space management device (2) a request for identifying a target and these coordinates, - and in which the step of transmitting information of a target from the space management device to the user device comprises transmitting the coordinates of the target upon receipt of identification requests carried out by the space management device (2).
9. Method for delimiting an area from a thermal imager (21) of a space management device (2), according to any one of the preceding claims, in which the step of requesting configuration of a delimitation of the type of areas to be delimited (El, P2) comprises the display of different input forms on the screen (11) forming a list of types of areas, in particular area of interest and exclusion zone and in that the acquisition comprises a selection of the type of area to be delimited.
10. Method for delimiting an area from a thermal imager (21) of a space management device (2), according to any one of the preceding claims, in which the step of coordinating a map with the thermal image (E2, PI) further comprises a sub-step of displaying on the screen (11) a form for entering information on the height (H) of installation of the thermal imager and a sub-step of acquiring user entries of the information on the height of installation of the thermal imager (21) resulting in the calculation of a map size to be displayed based on the chosen height.
11. Method for delimiting an area from a thermal imager (21) of a space management device (2), according to any one of the preceding claims, in which the step of coordinating a map with the thermal image (E2, PI) further comprises a sub-step of displaying on the screen (11) a form for entering information on the grid size of the map, a sub-step of acquiring an entry by the user of the grid size and resulting in the step of displaying the map, a grid according to the chosen size.
12. A method of delimiting an area from a thermal imager (21) of a space management device (2) according to any one of claims 3 to 11, wherein each data packet exchanged between the space management device (2) and the user apparatus (1) has a size smaller than a data packet encoding the thermal image having the smallest resolution in the space management device (2).
13. Method for delimiting an area from a thermal imager (21) of a space management device (2), according to any one of the preceding claims, in which the step of recording coordinates of the points of a shape delimiting the delimited area to be configured (E4) comprises the validation of coordinates of different points each corresponding to the coordinates of the moving target information displayed on the map and in that the shape is a polygon of which each coordinate of a point forms a corner of the polygon.
14. Space management device (2) comprising: - a thermal imager (21) comprising a sensor in the non-visible or near infrared range used to capture thermal images of a scene, - a control unit (22) comprising an output for controlling home automation electrical appliances and an input connected to the thermal imager to detect the thermal presence of people in pre-defined areas of the imager's detection field, and a
15. memory storing user parameters and calibration data, - a configuration unit configured to memorize the pre-delimited zones by carrying out the steps of the method of delimiting a zone from a thermal imager (21) according to any one of the preceding claims, - a communication means (20) connected to the configuration unit and the control unit to communicate with the user device (1) and home automation electrical devices respectively. Space management device according to the preceding claim, in which: - the thermal imager further comprises a sensor in the visible domain and a processing unit - the space management device (2) comprises: • a visible image analysis and processing unit configured to receive the image from the sensor in the visible range and identify a target such as a human presence, different and independent from the configuration unit, • in which the configuration unit is configured to transmit to the visible image analysis and processing unit area boundary coordinates, • in which the visible image analysis and processing unit and the configuration unit are each configured to transmit presence or presence number data per delimited zone to the control unit, - the device being configured so that the communication means transmits and receives data only through the configuration unit and the control unit.