Method and device for identifying human body position, household appliance, and readable storage medium
By monitoring the temperature data of the preset area, the method of identifying the human body's position solves the problem of infringing on user privacy in the prior art, realizing the identification of human body position without taking pictures, and reducing the hardware resource requirements and costs.
Patent Information
- Application Number
- CN202110873383.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-07-30
- Publication Date
- 2025-04-18
- Estimated Expiration
- 2041-07-30
AI Technical Summary
The method of identifying the position of the human body in the prior art mainly relies on cameras for image recognition, resulting in the need to take pictures of the user during the recognition process, infringing on user privacy, and not suitable for application on home appliances.
By monitoring the preset area, a temperature data matrix set is obtained, a frame of temperature data matrix is selected from the temperature data matrix set and determined as the temperature data matrix to be identified, the human body heat source in the temperature data matrix to be identified, the foot heat source in the human body heat source is obtained, the projection center point of the foot heat source on the ground, and the human body position is identified according to the projection center point.
It realizes the identification of human positions without taking photos of users, avoids infringement of user privacy, and reduces hardware resource requirements and costs, and is suitable for home appliances.
Smart Images

Figure CN113485145B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of smart home technology, for example, to a method and device for identifying a human body position, a household appliance, and a readable storage medium. Background Art
[0002] The method of identifying the position of the human body in the prior art is mainly achieved through image recognition by cameras. Although image recognition by cameras can realize human body position recognition, it is necessary to take a photo of the user to obtain the user's image during the recognition process, which may infringe on the user's privacy and is therefore not suitable for application in home appliances. Summary of the invention
[0003] In order to provide a basic understanding of some aspects of the disclosed embodiments, a brief summary is given below. The summary is not an extensive review, nor is it intended to identify key / critical components or delineate the scope of protection of these embodiments, but rather serves as a prelude to the detailed description that follows.
[0004] The embodiments of the present disclosure provide a method and apparatus, a household appliance, and a readable storage medium for identifying a human body position, so as to enable human body position identification without taking a photo of the user.
[0005] In some embodiments, the method for identifying the position of a human body includes: monitoring a preset area to obtain a temperature data matrix set; the temperature data matrix set includes multiple frames of temperature data matrices; selecting a frame of temperature data matrix in the temperature data matrix set and determining it as the temperature data matrix to be identified; determining the human body heat source in the temperature data matrix to be identified; obtaining the foot heat source in the human body heat source; obtaining the projection center point of the foot heat source on the ground; and identifying the position of the human body based on the projection center point.
[0006] In some embodiments, the device for identifying the position of a human body includes: a first acquisition module, configured to monitor a preset area and obtain a temperature data matrix set; the temperature data matrix set includes multiple frames of temperature data matrices; a first determination module, configured to select a frame of temperature data matrix in the temperature data matrix set and determine it as the temperature data matrix to be identified; a second determination matrix, configured to determine the human body heat source in the temperature data matrix to be identified; a second acquisition module, configured to obtain the foot heat source in the human body heat source; a third acquisition module, configured to obtain the projection center point of the foot heat source on the ground; and an identification module, configured to identify the position of the human body based on the projection center point.
[0007] In some embodiments, the apparatus for identifying the position of a human body includes: a processor and a memory storing program instructions, and the processor is configured to execute the method for identifying the position of a human body as described above when running the program instructions.
[0008] In some embodiments, the household appliance includes the above-mentioned device for identifying the position of a human body.
[0009] In some embodiments, the readable storage medium stores program instructions, and when the program instructions are run, the method for identifying the position of a human body as described above is executed.
[0010] The method and device, household appliance, and readable storage medium for identifying the position of a human body provided by the embodiments of the present disclosure can achieve the following technical effects: by monitoring a preset area, a temperature data matrix set is obtained, a frame of temperature data matrix is selected from the temperature data matrix set and determined as the temperature data matrix to be identified, the human body heat source in the temperature data matrix to be identified is determined, the foot heat source in the human body heat source is obtained, the projection center point of the foot heat source on the ground is obtained, and the human body position is identified according to the projection center point. The human body heat source is obtained according to the temperature data matrix, and the human body position is identified according to the human body heat source. This method does not require obtaining the user's image, and can thus perform human body position identification without taking a photo of the user, without infringing the user's privacy.
[0011] The above general description and the following description are exemplary and explanatory only and are not intended to limit the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0012] One or more embodiments are exemplarily described by corresponding drawings, which do not limit the embodiments. Elements with the same reference numerals in the drawings are shown as similar elements, and the drawings do not constitute a scale limitation, and wherein:
[0013] Figure 1 is a schematic diagram of a method for identifying a human body position provided by an embodiment of the present disclosure;
[0014] Figure 2 is a schematic diagram of a device for identifying a human body position provided by an embodiment of the present disclosure;
[0015] Figure 3 It is a schematic diagram of another device for identifying the position of a human body provided by an embodiment of the present disclosure. DETAILED DESCRIPTION
[0016] In order to be able to understand the features and technical contents of the embodiments of the present disclosure in more detail, the implementation of the embodiments of the present disclosure is described in detail below in conjunction with the accompanying drawings. The attached drawings are for reference only and are not used to limit the embodiments of the present disclosure. In the following technical description, for the convenience of explanation, a full understanding of the disclosed embodiments is provided through multiple details. However, one or more embodiments can still be implemented without these details. In other cases, to simplify the drawings, well-known structures and devices can be simplified for display.
[0017] The terms "first", "second", etc. in the specification and claims of the embodiments of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged where appropriate, so that the embodiments of the embodiments of the present disclosure described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions.
[0018] Unless otherwise stated, the term "plurality" means two or more.
[0019] In the embodiment of the present disclosure, the character " / " indicates that the preceding and following objects are in an "or" relationship. For example, A / B indicates: A or B.
[0020] The term "and / or" is a description of the association relationship between objects, indicating that three relationships can exist. For example, A and / or B means: A or B, or, A and B.
[0021] In the embodiments of the present disclosure, household appliances refer to smart household appliances that are formed by introducing microprocessors, sensor technology, and network communication technology into household appliances. They have the characteristics of smart control, smart perception, and smart application. The operation of household appliances often relies on the application and processing of modern technologies such as the Internet of Things, the Internet, and electronic chips. For example, household appliances can be connected to electronic devices to enable users to remotely control and manage the household appliances.
[0022] Combination Figure 1 As shown, the embodiment of the present disclosure provides a method for identifying a human body position, comprising:
[0023] Step S101, monitor a preset area to obtain a temperature data matrix set; the temperature data matrix set includes multiple frames of temperature data matrices.
[0024] Step S102: Select a frame of temperature data matrix from the temperature data matrix set and determine it as the temperature data matrix to be identified.
[0025] Step S103, determining the human body heat source in the temperature data matrix to be identified.
[0026] Step S104, obtaining the foot heat source in the human body heat source.
[0027] Step S105, obtaining the projection center point of the foot heat source on the ground.
[0028] Step S106, identifying the position of the human body according to the projection center point.
[0029] The method for identifying the position of a human body provided by the embodiment of the present disclosure is adopted, by monitoring a preset area, obtaining a temperature data matrix set, selecting a frame of temperature data matrix from the temperature data matrix set and determining it as the temperature data matrix to be identified, determining the human body heat source in the temperature data matrix to be identified, obtaining the foot heat source in the human body heat source, obtaining the projection center point of the foot heat source on the ground, and identifying the human body position according to the projection center point. The human body heat source is obtained according to the temperature data matrix, and the human body position is identified according to the human body heat source. This method does not require obtaining the user's image, and can thus perform human body position identification without taking a photo of the user, without infringing the user's privacy.
[0030] Optionally, a preset area is monitored by a matrix thermopile sensor. Within a preset period, the matrix thermopile sensor continuously collects temperature values corresponding to multiple frames of matrix points, and after temperature correction of each temperature value, a multi-frame temperature data matrix is obtained, that is, a temperature data matrix set is obtained. The number of matrix points of each frame collected by the matrix thermopile sensor is between 520 and 12,800.
[0031] Optionally, a frame of temperature data matrix is randomly selected from the temperature data matrix set and determined as the temperature data matrix to be identified.
[0032] Optionally, determining the human body heat source in the temperature data matrix to be identified includes: determining other temperature data matrices in the temperature data matrix set except the temperature data matrix to be identified as reference temperature data matrices; determining the human body heat source to be identified in the temperature data matrix to be identified; respectively determining the reference human body heat sources in each reference temperature data matrix; determining the first boundary of the human body heat source to be identified; respectively determining the second boundary of each reference human body heat source; determining whether there is a second boundary different from the first boundary, and if there is a second boundary different from the first boundary, determining the human body heat source to be identified as the human body heat source in the temperature data matrix to be identified.
[0033] Optionally, each matrix point of each temperature data matrix corresponds to a temperature value, and determining the human body heat source to be identified in the temperature data matrix to be identified includes: obtaining the highest temperature value and the lowest temperature value of each matrix point in the temperature data matrix to be identified in the temperature data matrix set; determining the temperature fluctuation value of each matrix point in the temperature data matrix to be identified according to the highest temperature value and the lowest temperature value of each matrix point in the temperature data matrix to be identified; adding a first mark to the matrix point corresponding to the temperature fluctuation value greater than the first threshold value in the temperature data matrix to be identified; adding a second mark to the matrix point with the first mark in the temperature data matrix to be identified and the temperature value is within the first preset temperature range; the first mark is used to characterize the alternative human body temperature matrix point, and the second mark is used to characterize the human body temperature matrix point; determining the matrix point with the second mark as the human body heat source to be identified in the temperature data matrix to be identified.
[0034] Since human body temperature and ambient temperature have different properties, by determining the temperature fluctuation value of each matrix point in the temperature data matrix to be identified, the matrix points representing the alternative human body temperature are screened out, and the matrix points representing the ambient temperature are excluded, thereby narrowing the range of determining the human body heat source to be identified, and marking the matrix points corresponding to the temperature fluctuation value greater than the first threshold and the matrix points whose temperature values are within the first preset temperature range, so that the determined human body heat source to be identified is more consistent with the temperature characteristics of the human body.
[0035] Optionally, the first preset temperature range of the temperature value is 25°C<temperature value<42°C.
[0036] Optionally, the temperature fluctuation value of each matrix point in the temperature data matrix to be identified is determined according to the highest temperature value and the lowest temperature value of each matrix point in the temperature data matrix to be identified, including: respectively obtaining the first difference between the temperature value of each matrix point in the temperature data matrix to be identified and the corresponding highest temperature value, and determining the absolute value of each first difference as the temperature fluctuation value of each matrix point in the temperature data matrix to be identified; or, respectively obtaining the second difference between the temperature value of each matrix point in the temperature data matrix to be identified and the corresponding lowest temperature value, and determining the absolute value of each second difference as the temperature fluctuation value of each matrix point in the temperature data matrix to be identified; or, respectively obtaining the first difference between the temperature value of each matrix point in the temperature data matrix to be identified and the corresponding highest temperature value, and respectively obtaining the second difference between the temperature value of each matrix point in the temperature data matrix to be identified and the corresponding lowest temperature value; determining the absolute value of each first difference as the temperature fluctuation value of each matrix point in the temperature data matrix to be identified, and determining the absolute value of each second difference as the temperature fluctuation value of each matrix point in the temperature data matrix to be identified. That is, the temperature fluctuation value of each matrix point includes the absolute value of the first difference and the absolute value of the second difference.
[0037] Optionally, the reference human body heat source in each reference temperature data matrix is determined separately, including: obtaining the highest temperature value and the lowest temperature value of each matrix point in each reference temperature data matrix in the temperature data matrix set; determining the temperature fluctuation value of each matrix point in each reference temperature data matrix according to the highest temperature value and the lowest temperature value of each matrix point in each reference temperature data matrix; adding a third mark to the matrix points corresponding to the temperature fluctuation values greater than the sixth threshold value in each reference temperature data matrix; adding a fourth mark to the matrix points with the third mark in each reference temperature data matrix and the temperature value is within the second preset temperature range; the third mark is used to characterize the reference alternative human body temperature matrix point, and the fourth mark is used to characterize the reference human body temperature matrix point; and determining the matrix point with the fourth mark as the reference human body heat source of each reference temperature data matrix.
[0038] Optionally, determining the temperature fluctuation value of each matrix point in each reference temperature data matrix according to the highest temperature value and the lowest temperature value of each matrix point in each reference temperature data matrix includes: respectively obtaining the third difference between the temperature value of each matrix point in each reference temperature data matrix and the corresponding highest temperature value, and determining the absolute value of each third difference as the temperature fluctuation value of each matrix point in each reference temperature data matrix; or respectively obtaining the fourth difference between the temperature value of each matrix point in each reference temperature data matrix and the corresponding lowest temperature value, and determining the absolute value of each fourth difference as the temperature fluctuation value of each matrix point in each reference temperature data matrix; or respectively obtaining the third difference between the temperature value of each matrix point in each reference temperature data matrix and the corresponding highest temperature value, and respectively obtaining the fourth difference between the temperature value of each matrix point in each reference temperature data matrix and the corresponding lowest temperature value; determining the absolute value of each third difference as the temperature fluctuation value of each matrix point in each reference temperature data matrix, and determining the absolute value of each fourth difference as the temperature fluctuation value of each matrix point in each reference temperature data matrix. That is, the temperature fluctuation value of each matrix point includes the absolute value of the third difference and the absolute value of the fourth difference.
[0039] Optionally, determining the first boundary of the human body heat source to be identified includes: selecting a heat source boundary matrix point in the human body heat source to be identified, wherein there is a matrix point without a second mark in an adjacent position of the heat source boundary matrix point; and determining the heat source boundary matrix point as the first boundary of the human body heat source to be identified.
[0040] Optionally, the second boundary of each reference human body heat source is determined respectively, including: selecting corresponding reference heat source boundary matrix points in each reference human body heat source, wherein there are matrix points without the fourth mark in adjacent positions of each reference heat source boundary matrix point; and determining each reference heat source boundary matrix point as the second boundary of each corresponding reference human body heat source.
[0041] In some embodiments, due to the difference between human body temperature and ambient temperature, by determining the temperature fluctuation value of each matrix point in the temperature data matrix to be identified, the matrix points representing the candidate human body are screened out, and the matrix points representing the ambient temperature are excluded, thereby narrowing the range of determining the heat source of the human body to be identified. Since the human body has the property of constant temperature, by adding a second mark to the matrix points with a first mark and a temperature value in the first preset temperature range, the matrix points corresponding to the temperature values not in the human body temperature range are excluded, thereby determining the heat source of the human body to be identified. Since the human body has the property of activity, the first boundary of the heat source of the human body to be identified is determined by the presence of a matrix point without a second mark in the adjacent position of the heat source boundary matrix point, and the heat source of the human body to be identified is determined as the human body heat source in the temperature data matrix to be identified by the presence of a second boundary different from the first boundary, thereby excluding other matrix points of heat sources in the human body temperature range that are mistaken for the human body. By determining the human body heat source to be identified in the temperature data matrix to be identified, and determining the first boundary of the human body heat source to be identified, when there is a second boundary different from the first boundary, the human body heat source to be identified is determined as the human body heat source in the temperature data matrix to be identified. In this way, the human body heat source is determined without the need for visual algorithm processing, and the matrix thermopile sensor will not be rotated to collect the temperature data matrix, thereby improving efficiency. At the same time, since it does not need to be processed by a visual algorithm and does not require a large number of visual computing processes, the amount of computing and computing space requirements are greatly reduced, and a single-chip microcomputer with ordinary computing power can complete the algorithm recognition process. Compared with the existing method of determining the human body heat source, which requires a single-chip microcomputer to perform a large number of precise calculations, the algorithm recognition cycle is shortened, the algorithm's dependence on the single-chip microcomputer RAM (Random Access Memory) space is reduced, the requirements for the single-chip microcomputer are reduced, it is easier to implement, and the cost is reduced.
[0042] Optionally, obtaining a foot heat source in a human body heat source includes: determining a matrix point corresponding to a temperature value in a human body heat source that is greater than a second threshold and less than a third threshold as an alternative foot heat source; determining a minimum rectangle containing all matrix points of the alternative foot heat source as a first rectangle; determining a center point of the first rectangle as the center point of the alternative foot heat source; the center point of the first rectangle is the intersection point of two diagonals of the first rectangle; determining a matrix point corresponding to a temperature value in a human body heat source that is greater than a fourth threshold as a head heat source; determining a minimum rectangle containing all matrix points of the head heat source as a second rectangle; determining a center point of the second rectangle as the center point of the head heat source; the center point of the second rectangle is the intersection point of two diagonals of the second rectangle; obtaining the distance between the center point of the alternative foot heat source and the center point of the head heat source; and determining the alternative foot heat source corresponding to a distance greater than the fifth threshold as the foot heat source.
[0043] Optionally, the first threshold, the second threshold, the third threshold, the fourth threshold, the fifth threshold and the sixth threshold are all preset.
[0044] Optionally, obtaining the projection center point of the foot heat source on the ground includes: determining the center matrix point of the temperature data matrix to be identified as the reference matrix point; obtaining the offset between the reference matrix point and the center matrix point of the foot heat source; and obtaining the position of the projection center point of the foot heat source on the ground according to the offset.
[0045] Optionally, the temperature data matrix includes M*N matrix points, M is the number of rows of the temperature data matrix, and N is the number of columns of the temperature data matrix. The matrix point in the Pth row and Qth column is the central matrix point of the temperature data matrix, that is, the coordinates are (P, Q), that is, the reference matrix point coordinates are (P, Q), and when M and N are both even numbers, the horizontal coordinate P of the reference matrix point is obtained by calculating P=M / 2, and the vertical coordinate Q of the reference matrix point is obtained by calculating Q=N / 2; when N is an odd number, the vertical coordinate Q of the reference matrix point is obtained by calculating Q=(N+1) / 2; when M is an odd number, the horizontal coordinate P of the reference matrix point is obtained by calculating P=(M+1) / 2; wherein, M>P>0, N>Q>0, and M, N, P and Q are all integers.
[0046] Optionally, obtaining the central matrix point of the foot heat source includes: obtaining the maximum horizontal coordinate X1, the minimum horizontal coordinate X2, the maximum vertical coordinate Y1 and the minimum vertical coordinate Y2 in all matrix points of the foot heat source; when X1 is an odd number or X2 is an odd number, the horizontal coordinate X3 of the central matrix point of the foot heat source is obtained by calculating X3=(X1+X2+1) / 2; when X1 and X2 are both odd numbers or X1 and X2 are both even numbers, the horizontal coordinate X3 of the central matrix point of the foot heat source is obtained by calculating X3=(X1+X2) / 2; when Y1 is an odd number or Y2 is an odd number, the horizontal coordinate X3 of the central matrix point of the foot heat source is obtained by calculating X3=(X1+X2) / 2; when Y1 is an odd number or Y2 is an odd number When X1 is an odd number, the vertical coordinate Y3 of the center matrix point of the foot heat source is obtained by calculating Y3=(Y1+Y2+1) / 2; when Y1 and Y2 are both odd numbers or Y1 and Y2 are both even numbers, the vertical coordinate Y3 of the center matrix point of the foot heat source is obtained by calculating Y3=(Y1+Y2) / 2, wherein X1>X3>X2>0, Y1>Y3>Y2>0, X1, X3, X2, Y1, Y3 and Y2 are all integers, X3 is the horizontal coordinate of the center matrix point of the foot heat source, and Y3 is the vertical coordinate of the center matrix point of the foot heat source. That is, the center matrix point of the foot heat source is located in the X3th row and the Y3th column in the temperature data matrix to be identified.
[0047] Optionally, the matrix thermopile sensor is mounted on a reference wall. Optionally, the reference wall is a vertical wall.
[0048] Optionally, the central matrix point in the temperature data matrix to be identified is determined as the reference matrix point, the projection of the reference matrix point on the ground is determined as the reference projection point, and the acute angle between the connecting line between the reference projection point and the reference point and the reference wall is determined as the angle C between the matrix thermopile sensor and the reference wall. The reference point is used to characterize the installation position of the matrix thermopile sensor.
[0049] Optionally, the reference projection point is vertically connected to the reference wall, and a rectangular coordinate system is established with the intersection of the vertical line between the reference projection point and the reference wall as the coordinate origin o, the vertical line between the reference projection point and the reference wall as the y-axis, and the intersection line between the ground and the reference wall as the x-axis.
[0050] Optionally, when the reference projection point coincides with the center point of the projection of the foot heat source on the ground, the offset between the reference matrix point and the center matrix point of the foot heat source whose projection coincides with it is 0; that is, the coordinates of the center point of the projection of the foot heat source on the ground are (0, y1). Optionally, the ordinate of the reference projection point is obtained by calculating y1=H*tan(C+A / (2*N)), where y1 is the ordinate of the reference projection point, H is the distance between the reference point and the ground, C is the angle between the matrix thermopile sensor and the reference wall, N is the number of columns of the temperature data matrix to be identified, and A is the FOV (Field of View) of the matrix thermopile sensor in the vertical direction.
[0051] Optionally, when the reference projection point does not coincide with the center point of the projection of the foot heat source on the ground, the offset between the reference matrix point and the center matrix point of the foot heat source whose projection coincides with it is not 0. Optionally, the horizontal coordinate of the center point of the projection of the foot heat source on the ground is obtained by calculating x2=H*cos(C+((A*DeltN) / (2*N)))*tan((B*DeltM) / M), where x2 is the horizontal coordinate of the center point of the projection of the foot heat source on the ground, H is the distance between the reference point and the ground, C is the angle between the matrix thermopile sensor and the reference wall, N is the number of columns of the temperature data matrix to be identified, M is the number of rows of the temperature data matrix to be identified, A is the FOV of the matrix thermopile sensor in the vertical direction, and B is the FOV of the matrix thermopile sensor in the horizontal direction.
[0052] Optionally, the ordinate of the projection center point of the foot heat source on the ground is obtained by calculating y2=H*tan(C+ABS((A*DeltN) / (2*N))), where y2 is the ordinate of the projection center point of the foot heat source on the ground, and ABS is the absolute value function.
[0053] Optionally, the offset between the reference matrix point and the central matrix point of the foot heat source in the horizontal coordinate direction is obtained by calculating DeltM=|P-X3|, where DeltM is the offset between the reference matrix point and the central matrix point of the foot heat source in the horizontal coordinate direction, and X3 is the horizontal coordinate of the central matrix point of the foot heat source, wherein DeltM≥1. Optionally, the offset between the reference matrix point and the central matrix point of the foot heat source in the vertical coordinate direction is obtained by calculating DeltN=Y3-Q, where DeltN is the offset between the reference matrix point and the central matrix point of the foot heat source in the vertical coordinate direction, and Y3 is the vertical coordinate of the central matrix point of the foot heat source.
[0054] Optionally, identifying the position of the human body according to the projection center point of the foot heat source on the ground includes: determining the position of the projection center point of the foot heat source on the ground as the position of the human body.
[0055] In some embodiments, the air conditioner is provided with a matrix thermopile sensor, and the air conditioner monitors a preset area through the matrix thermopile sensor, and the preset area is the field of view angle range of the matrix thermopile sensor. The temperature data matrix set is obtained through the matrix thermopile sensor, a frame of the temperature data matrix is selected from the temperature data matrix set and determined as the temperature data matrix to be identified, the human body heat source in the temperature data matrix to be identified is determined, the foot heat source in the human body heat source is obtained, the projection center point of the foot heat source on the ground is determined, and the human body position is identified according to the projection center point. The human body position is identified through the air conditioner, and the algorithm complexity and hardware computing power chip requirements for human body position identification through image recognition by a camera in the prior art are higher, and the hardware resources required for the operation of identifying the human body position through the matrix thermopile sensor are less, and ordinary single-chip microcomputer chips are applicable, resulting in low cost for identifying the human body position. At the same time, it is not necessary to obtain the user's image, and the human body position can be identified without taking a photo of the user, without infringing the user's privacy.
[0056] Combination Figure 2As shown, the embodiment of the present disclosure provides a device for identifying the position of a human body, including a first acquisition module 201, a first determination module 202, a second determination module 203, a second acquisition module 204, a third acquisition module 205 and an identification module 206. The first acquisition module 201 is configured to monitor a preset area and obtain a temperature data matrix set; the temperature data matrix set includes multiple frames of temperature data matrices; the first determination module 202 is configured to select a frame of temperature data matrix from the temperature data matrix set and determine it as a temperature data matrix to be identified; the second determination module 203 is configured to determine a human body heat source in the temperature data matrix to be identified; the second acquisition module 204 is configured to obtain a foot heat source in the human body heat source; the third acquisition module 205 is configured to obtain a projection center point of the foot heat source on the ground; and the identification module 206 is configured to identify the position of the human body according to the projection center point.
[0057] The device for identifying the position of a human body provided by the embodiment of the present disclosure is used to monitor a preset area to obtain a temperature data matrix set, select a frame of temperature data matrix from the temperature data matrix set and determine it as the temperature data matrix to be identified, determine the human body heat source in the temperature data matrix to be identified, obtain the foot heat source in the human body heat source, obtain the projection center point of the foot heat source on the ground, and identify the human body position according to the projection center point. The human body heat source is obtained according to the temperature data matrix, and the human body position is identified according to the human body heat source. This method does not require obtaining the user's image, and can thus perform human body position identification without taking a photo of the user, without infringing the user's privacy.
[0058] Optionally, the second determination module determines the human body heat source in the temperature data matrix to be identified in the following manner, including: determining other temperature data matrices in the temperature data matrix set except the temperature data matrix to be identified as reference temperature data matrices; determining the human body heat source to be identified in the temperature data matrix to be identified; respectively determining the reference human body heat sources in each reference temperature data matrix; determining the first boundary of the human body heat source to be identified; respectively determining the second boundary of each reference human body heat source; determining whether there is a second boundary different from the first boundary, and if there is a second boundary different from the first boundary, determining the human body heat source to be identified as the human body heat source in the temperature data matrix to be identified.
[0059] Optionally, each matrix point of each temperature data matrix corresponds to a temperature value, and the second determination module determines the human heat source to be identified in the temperature data matrix to be identified in the following manner, including: obtaining the highest temperature value and the lowest temperature value of each matrix point in the temperature data matrix to be identified in the temperature data matrix set; determining the temperature fluctuation value of each matrix point in the temperature data matrix to be identified according to the highest temperature value and the lowest temperature value of each matrix point in the temperature data matrix to be identified; adding a first mark to the matrix point corresponding to the temperature fluctuation value greater than the first threshold in the temperature data matrix to be identified; adding a second mark to the matrix point with the first mark in the temperature data matrix to be identified and the temperature value is within the first preset temperature range; the first mark is used to characterize the alternative human body temperature matrix point, and the second mark is used to characterize the human body temperature matrix point; and determining the matrix point with the second mark as the human body heat source to be identified in the temperature data matrix to be identified.
[0060] Optionally, the second determination module determines the temperature fluctuation value of each matrix point in the temperature data matrix to be identified according to the highest temperature value and the lowest temperature value of each matrix point in the temperature data matrix to be identified in the following manner, including: respectively obtaining the first difference between the temperature value of each matrix point in the temperature data matrix to be identified and the corresponding highest temperature value, and determining the absolute value of each first difference as the temperature fluctuation value of each matrix point in the temperature data matrix to be identified; or, respectively obtaining the second difference between the temperature value of each matrix point in the temperature data matrix to be identified and the corresponding lowest temperature value, and determining the absolute value of each second difference as the temperature fluctuation value of each matrix point in the temperature data matrix to be identified; or, respectively obtaining the first difference between the temperature value of each matrix point in the temperature data matrix to be identified and the corresponding highest temperature value, and respectively obtaining the second difference between the temperature value of each matrix point in the temperature data matrix to be identified and the corresponding lowest temperature value; determining the absolute value of each first difference as the temperature fluctuation value of each matrix point in the temperature data matrix to be identified, and determining the absolute value of each second difference as the temperature fluctuation value of each matrix point in the temperature data matrix to be identified. That is, the temperature fluctuation value of each matrix point includes the absolute value of the first difference and the absolute value of the second difference.
[0061] Optionally, the second determination module determines the reference human body heat source in each reference temperature data matrix respectively in the following manner, including: obtaining the highest temperature value and the lowest temperature value of each matrix point in each reference temperature data matrix in the temperature data matrix set; determining the temperature fluctuation value of each matrix point in each reference temperature data matrix according to the highest temperature value and the lowest temperature value of each matrix point in each reference temperature data matrix; adding a third mark to the matrix points corresponding to the temperature fluctuation values greater than the sixth threshold value in each reference temperature data matrix; adding a fourth mark to the matrix points in each reference temperature data matrix with the third mark and the temperature value within the second preset temperature range; the third mark is used to characterize the reference alternative human body temperature matrix point, and the fourth mark is used to characterize the reference human body temperature matrix point; and determining the matrix point with the fourth mark as the reference human body heat source of each reference temperature data matrix.
[0062] Optionally, the second determination module determines the temperature fluctuation value of each matrix point in each reference temperature data matrix according to the highest temperature value and the lowest temperature value of each matrix point in each reference temperature data matrix in the following manner, including: respectively obtaining the third difference between the temperature value of each matrix point in each reference temperature data matrix and the corresponding highest temperature value, and determining the absolute value of each third difference as the temperature fluctuation value of each matrix point in each reference temperature data matrix; or, respectively obtaining the fourth difference between the temperature value of each matrix point in each reference temperature data matrix and the corresponding lowest temperature value, and determining the absolute value of each fourth difference as the temperature fluctuation value of each matrix point in each reference temperature data matrix; or, respectively obtaining the third difference between the temperature value of each matrix point in each reference temperature data matrix and the corresponding highest temperature value, and respectively obtaining the fourth difference between the temperature value of each matrix point in each reference temperature data matrix and the corresponding lowest temperature value; determining the absolute value of each third difference as the temperature fluctuation value of each matrix point in each reference temperature data matrix, and determining the absolute value of each fourth difference as the temperature fluctuation value of each matrix point in each reference temperature data matrix. That is, the temperature fluctuation value of each matrix point includes the absolute value of the third difference and the absolute value of the fourth difference.
[0063] Optionally, the second determination module determines the first boundary of the human body heat source to be identified in the following manner, including: selecting a heat source boundary matrix point in the human body heat source to be identified, where there are matrix points without a second mark in adjacent positions of the heat source boundary matrix points; and determining the heat source boundary matrix point as the first boundary of the human body heat source to be identified.
[0064] Optionally, the second determination module determines the second boundary of each reference human body heat source respectively in the following manner, including: selecting a corresponding reference heat source boundary matrix point in each reference human body heat source, wherein there is a matrix point without a fourth mark in an adjacent position of each reference heat source boundary matrix point; and determining each reference heat source boundary matrix point as the second boundary of each corresponding reference human body heat source.
[0065] Optionally, the second acquisition module acquires the foot heat source in the human body heat source in the following manner, including: determining the matrix points corresponding to the temperature values in the human body heat source greater than the second threshold and less than the third threshold as the alternative foot heat sources; determining the minimum rectangle containing all the matrix points of the alternative foot heat sources as the first rectangle; determining the center point of the first rectangle as the center point of the alternative foot heat source; the center point of the first rectangle is the intersection point of the two diagonals of the first rectangle; determining the matrix points corresponding to the temperature values in the human body heat source greater than the fourth threshold as the head heat source; determining the minimum rectangle containing all the matrix points of the head heat source as the second rectangle; determining the center point of the second rectangle as the center point of the head heat source; the center point of the second rectangle is the intersection point of the two diagonals of the second rectangle; acquiring the distance between the center point of the alternative foot heat source and the center point of the head heat source; and determining the alternative foot heat source corresponding to the distance greater than the fifth threshold as the foot heat source.
[0066] Optionally, the third acquisition module obtains the projection center point of the foot heat source on the ground by: determining the center matrix point of the temperature data matrix to be identified as the reference matrix point; obtaining the offset between the reference matrix point and the center matrix point of the foot heat source; and obtaining the position of the projection center point of the foot heat source on the ground according to the offset.
[0067] Optionally, the recognition module recognizes the position of the human body according to the projection center point in the following manner, including: determining the position of the projection center point of the foot heat source on the ground as the position of the human body.
[0068] Combination Figure 3 As shown, an embodiment of the present disclosure provides a device for identifying a human body position, including a processor 300 and a memory 301. Optionally, the device may also include a communication interface 302 and a bus 303. The processor 300, the communication interface 302, and the memory 301 may communicate with each other through the bus 303. The communication interface 302 may be used for information transmission. The processor 300 may call the logic instructions in the memory 301 to execute the method for identifying a human body position of the above embodiment.
[0069] In addition, the logic instructions in the memory 301 described above can be implemented in the form of software functional units and can be stored in a computer-readable storage medium when sold or used as an independent product.
[0070] The memory 301 is a computer-readable storage medium that can be used to store software programs and computer executable programs, such as program instructions / modules corresponding to the method in the embodiment of the present disclosure. The processor 300 executes the function application and data processing by running the program instructions / modules stored in the memory 301, that is, the method for identifying the position of a human body in the above embodiment is implemented.
[0071] The memory 301 may include a program storage area and a data storage area, wherein the program storage area may store an operating system and an application required for at least one function; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 301 may include a high-speed random access memory and may also include a non-volatile memory.
[0072] The device for identifying the position of a human body provided by the embodiment of the present disclosure is used to monitor a preset area to obtain a temperature data matrix set, select a frame of temperature data matrix from the temperature data matrix set and determine it as the temperature data matrix to be identified, determine the human body heat source in the temperature data matrix to be identified, obtain the foot heat source in the human body heat source, obtain the projection center point of the foot heat source on the ground, and identify the human body position according to the projection center point. The human body heat source is obtained according to the temperature data matrix, and the human body position is identified according to the human body heat source. This method does not require obtaining the user's image, and can thus perform human body position identification without taking a photo of the user, without infringing the user's privacy.
[0073] An embodiment of the present disclosure provides a household appliance, comprising the above-mentioned device for identifying the position of a human body.
[0074] The household appliance monitors a preset area to obtain a temperature data matrix set, selects a frame of temperature data matrix from the temperature data matrix set and determines it as a temperature data matrix to be identified, determines the human body heat source in the temperature data matrix to be identified, obtains the foot heat source in the human body heat source, obtains the projection center point of the foot heat source on the ground, and identifies the human body position according to the projection center point. The human body heat source is obtained according to the temperature data matrix, and the human body position is identified according to the human body heat source. This method does not require obtaining the user's image, and can identify the human body position without taking a photo of the user, without infringing the user's privacy.
[0075] Optionally, the household appliance is an air conditioner. Optionally, the air conditioner is provided with a matrix thermopile sensor, the air conditioner is an on-hook unit, and the on-hook unit is installed on a reference wall. Optionally, the reference wall is a vertical wall.
[0076] An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, wherein the computer-executable instructions are configured to execute the above-mentioned method for identifying a human body position.
[0077] An embodiment of the present disclosure provides a computer program product, which includes a computer program stored on a computer-readable storage medium. The computer program includes program instructions. When the program instructions are executed by a computer, the computer executes the above-mentioned method for identifying the position of a human body.
[0078] The computer-readable storage medium mentioned above may be a transient computer-readable storage medium or a non-transitory computer-readable storage medium.
[0079] The technical solution of the embodiment of the present disclosure can be embodied in the form of a software product, which is stored in a storage medium and includes one or more instructions for enabling a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiment of the present disclosure. The aforementioned storage medium may be a non-transient storage medium, including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes, or a transient storage medium.
[0080] The above description and the accompanying drawings fully illustrate the embodiments of the present disclosure so that those skilled in the art can practice them. Other embodiments may include structural, logical, electrical, process and other changes. The embodiments represent only possible changes. Unless explicitly required, separate components and functions are optional, and the order of operation may vary. The parts and features of some embodiments may be included in or replace the parts and features of other embodiments. Moreover, the words used in this application are only used to describe the embodiments and are not used to limit the claims. As used in the description of the embodiments and the claims, unless the context clearly indicates, the singular forms of "a", "an" and "the" are intended to include plural forms as well. Similarly, the term "and / or" as used in this application refers to any and all possible combinations of listings containing one or more associated ones. In addition, when used in the present application, the term "comprise" and its variants "comprises" and / or comprising refer to the presence of stated features, wholes, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components and / or groups thereof. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the presence of other identical elements in the process, method or device comprising the elements. In this article, each embodiment may focus on the differences from other embodiments, and the same and similar parts between the various embodiments may refer to each other. For the methods, products, etc. disclosed in the embodiments, if they correspond to the method part disclosed in the embodiments, then the relevant parts can refer to the description of the method part.
[0081] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software may depend on the specific application and design constraints of the technical solution. The technicians may use different methods for each specific application to implement the described functions, but such implementations should not be considered to exceed the scope of the embodiments of the present disclosure. The technicians may clearly understand that, for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above may refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here.
[0082] In the embodiments disclosed herein, the disclosed methods and products (including but not limited to devices, equipment, etc.) can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units can be only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between each other shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms. The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to implement this embodiment. In addition, each functional unit in the embodiment of the present disclosure may be integrated in a processing unit, or each unit may exist physically alone, or two or more units may be integrated in one unit.
[0083] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.
Claims
1. A method for identifying a human body position, characterized in that: include: Monitoring a preset area to obtain a temperature data matrix set; the temperature data matrix set includes multiple frames of temperature data matrices; Selecting a frame of temperature data matrix from the temperature data matrix set and determining it as the temperature data matrix to be identified; Determining a human body heat source in the temperature data matrix to be identified; Acquiring a foot heat source from the human body heat source; Obtaining the projection center point of the foot heat source on the ground; Identify the position of the human body according to the projection center point; Determining the human body heat source in the temperature data matrix to be identified, comprising: determining other temperature data matrices in the temperature data matrix set except the temperature data matrix to be identified as reference temperature data matrices; determining the human body heat source to be identified in the temperature data matrix to be identified; respectively determining the reference human body heat sources in each of the reference temperature data matrices; determining the first boundary of the human body heat source to be identified; respectively determining the second boundary of each of the reference human body heat sources; determining whether there is a second boundary different from the first boundary, and in the case that there is a second boundary different from the first boundary, determining the human body heat source to be identified as the human body heat source in the temperature data matrix to be identified; Each matrix point of each temperature data matrix corresponds to a temperature value, and obtaining the foot heat source in the human body heat source includes: determining the matrix point corresponding to the temperature value greater than the second threshold and less than the third threshold in the human body heat source as the alternative foot heat source; determining the minimum rectangle containing all the matrix points of the alternative foot heat source as the first rectangle; determining the center point of the first rectangle as the center point of the alternative foot heat source; the center point of the first rectangle is the intersection point of the two diagonals of the first rectangle; determining the matrix point corresponding to the temperature value greater than the fourth threshold in the human body heat source as the head heat source; determining the minimum rectangle containing all the matrix points of the head heat source as the second rectangle; determining the center point of the second rectangle as the center point of the head heat source; the center point of the second rectangle is the intersection point of the two diagonals of the second rectangle; obtaining the distance between the center point of the alternative foot heat source and the center point of the head heat source; determining the alternative foot heat source corresponding to the distance greater than the fifth threshold as the foot heat source; Obtaining the projection center point of the foot heat source on the ground includes: determining the center matrix point of the temperature data matrix to be identified as a reference matrix point; obtaining the offset between the reference matrix point and the center matrix point of the foot heat source; and obtaining the position of the projection center point according to the offset.
2. The method according to claim 1, characterized in that Each matrix point of each temperature data matrix corresponds to a temperature value, and determining the human body heat source to be identified in the temperature data matrix to be identified includes: Obtaining the highest temperature value and the lowest temperature value of each matrix point in the temperature data matrix to be identified in the temperature data matrix set; Determine the temperature fluctuation value of each matrix point in the temperature data matrix to be identified according to each of the highest temperature values and each of the lowest temperature values; Adding a first mark to a matrix point corresponding to a temperature fluctuation value greater than a first threshold value in the temperature data matrix to be identified; Adding a second mark to the matrix point with the first mark and the temperature value within the first preset temperature range in the temperature data matrix to be identified; the first mark is used to characterize the candidate human body temperature matrix point, and the second mark is used to characterize the human body temperature matrix point; The matrix points with the second mark are determined as the human body heat sources to be identified in the temperature data matrix to be identified.
3. The method according to claim 2, characterized in that Determining a first boundary of the human body heat source to be identified includes: Selecting a heat source boundary matrix point from the human body heat source to be identified, wherein there is a matrix point without a second mark at an adjacent position of the heat source boundary matrix point; The heat source boundary matrix point is determined as the first boundary of the human body heat source to be identified.
4. The method according to claim 1, characterized in that: Identifying the position of a human body according to the projection center point includes: The position of the projection center point is determined as the human body position.
5. A device for identifying the position of a human body, characterized in that: For executing the method for identifying the position of a human body according to any one of claims 1 to 4, the device comprises: A first acquisition module is configured to monitor a preset area and obtain a temperature data matrix set; the temperature data matrix set includes a plurality of temperature data matrices; A first determination module is configured to select a frame of temperature data matrix from the temperature data matrix set and determine it as the temperature data matrix to be identified; A second determination module is configured to determine a human body heat source in the temperature data matrix to be identified; A second acquisition module is configured to acquire a foot heat source from the human body heat source; A third acquisition module is configured to acquire a projection center point of the foot heat source on the ground; The recognition module is configured to recognize the position of the human body according to the projection center point.
6. A device for identifying a human body position, comprising a processor and a memory storing program instructions, characterized in that: The processor is configured to execute the method for identifying the position of a human body according to any one of claims 1 to 4 when running the program instructions.
7. A household appliance, characterized in that: The device for identifying the position of a human body as claimed in claim 6.
8. A readable storage medium storing program instructions, characterized in that: When the program instructions are executed, the method for identifying the position of a human body as claimed in any one of claims 1 to 4 is executed.
Citation Information
Patent Citations
Human body identification and locating method and system
CN105739339A
Equipment dormancy awakening method based on infrared array sensor
CN110134220A
Electric appliance and human body position detecting method and device thereof
CN110469939A