Temperature tracking method, air conditioning control method, system, device, medium and vehicle

Abstract

The present invention discloses a method and system for tracking human body temperature in a vehicle, a method and system for controlling vehicle air conditioning, an electronic device, a storage medium and a vehicle, wherein the method for tracking human body temperature in a vehicle comprises: determining a preliminary region of interest in an infrared image in the vehicle according to a partition template library; determining a target human body part, which is a region composed of pixel points whose pixel values ​​in the preliminary region of interest are greater than a corresponding adaptive threshold; and obtaining temperature change data of the target human body part according to multiple consecutive frames of infrared images in the vehicle. The method and vehicle of the present invention can improve the accuracy of temperature extraction, can realize dynamic temperature tracking to obtain temperature change data, and provide reliable and accurate data for temperature-based vehicle control strategies.

Description

Technical Field

[0001] The present invention relates to the field of vehicle technology, and in particular to a method for tracking human body temperature in a vehicle, a system for tracking human body temperature in a vehicle, a method for controlling vehicle air conditioning, a vehicle air conditioning control system, an electronic device, a storage medium and a vehicle. Background Art

[0002] In the prior art, human body temperature tracking technology based on infrared thermal imagers is mostly used for abnormal body temperature monitoring, or only extracts the temperature of the area of ​​interest in the infrared image in a static scene based on a template library. The temperature extraction is not detailed and accurate enough, and is not applicable to some scenarios. Summary of the invention

[0003] The present invention aims to solve at least one of the technical problems existing in the prior art. To this end, the first purpose of the present invention is to propose a method for tracking human body temperature in a vehicle, which can improve the accuracy of temperature extraction, dynamically track temperature to obtain temperature change data, and thus provide reliable and accurate data for temperature-based vehicle control strategies, which is suitable for vehicle environment adjustment scenarios.

[0004] The second objective of the present invention is to provide a system for tracking human body temperature in a vehicle.

[0005] The third object of the present invention is to provide a vehicle air conditioning control method.

[0006] A fourth objective of the present invention is to provide a vehicle air conditioning control system.

[0007] A fifth objective of the present invention is to provide an electronic device.

[0008] A sixth objective of the present invention is to provide a non-volatile readable storage medium.

[0009] A seventh objective of the present invention is to provide a vehicle.

[0010] In order to achieve the above-mentioned purpose, the method for tracking human body temperature in a vehicle in the first aspect of the embodiment of the present invention includes: determining a preliminary area of ​​interest in an infrared image in the vehicle according to a partition template library; determining a target human body part, wherein the target human body part is an area composed of pixel points in the preliminary area of ​​interest whose pixel values ​​are greater than a corresponding adaptive threshold; and obtaining temperature change data of the target human body part based on multiple consecutive frames of the infrared image in the vehicle.

[0011] According to the method for tracking human body temperature in a vehicle according to an embodiment of the present invention, a preliminary region of interest is obtained by preliminarily locating human body parts through a partition template library, and a target human body part in the preliminary region of interest is precisely located based on an adaptive threshold, thereby improving the accuracy of temperature extraction and realizing dynamic temperature tracking to obtain temperature change data, thereby providing reliable, accurate and timely data for temperature-based vehicle control strategies, which is suitable for in-vehicle environment adjustment scenarios.

[0012] In some embodiments, the partition template in the partition template library is an infrared image area including the target human body part constructed based on the position of the vehicle-mounted infrared thermal imager.

[0013] In some embodiments, the adaptive threshold is obtained according to a current temperature of the preliminary region of interest.

[0014] In some embodiments, the adaptive threshold is determined based on a current average temperature value of the preliminary region of interest, wherein the current average temperature value is obtained by performing spatial averaging and standard deviation on a pixel region corresponding to the preliminary region of interest.

[0015] In some embodiments, the adaptive threshold is obtained based on the mean and the standard deviation.

[0016] In some embodiments, the adaptive threshold is expressed as follows:

[0017] threshold=μ+m·σ;

[0018] Wherein, threshold is the adaptive threshold, μ is the mean, σ is the standard deviation, and m is a constant.

[0019] In some embodiments, m is an adjustable constant.

[0020] In some embodiments, the value of m satisfies: 1≤m≤3.

[0021] In some embodiments, the temperature change data of the target human body part includes a change curve of the average temperature of the target human body part.

[0022] In some embodiments, the target human body part includes at least one exposed part of the human body in the main driving seat and / or at least one exposed part of the human body in the co-pilot seat.

[0023] In order to achieve the above-mentioned purpose, the second aspect of the present invention proposes a human body temperature tracking system in a vehicle, comprising: at least one infrared thermal imager for collecting infrared images inside the vehicle; an infrared image processing device connected to the at least one infrared thermal imager, for obtaining temperature change data of a target human body part in the vehicle according to the human body temperature tracking method in the vehicle.

[0024] According to the in-vehicle human body temperature tracking system of an embodiment of the present invention, an infrared image processing device is used according to the in-vehicle human body temperature tracking method of the above embodiment, and a preliminary region of interest is obtained by preliminarily locating human body parts through a partition template library, and a target human body part in the preliminary region of interest is precisely located based on an adaptive threshold, thereby improving the accuracy of temperature extraction, and being able to dynamically track the temperature to obtain temperature change data, thereby providing reliable, accurate and timely data for temperature-based vehicle control strategies, and being suitable for in-vehicle environment adjustment scenarios.

[0025] In order to achieve the above-mentioned purpose, an embodiment of the third aspect of the present invention proposes a vehicle air-conditioning control method, comprising: obtaining vehicle air-conditioning control data based on temperature change data of a target human body part, wherein the temperature change data of the target human body part is obtained based on the in-vehicle human body temperature tracking method; controlling the operation of the vehicle air-conditioning according to the vehicle air-conditioning control data.

[0026] According to the vehicle air-conditioning control method of an embodiment of the present invention, the temperature change data of the target human body part is obtained by adopting the in-vehicle human body temperature tracking method of the above embodiment. The data is more accurate and timely. The vehicle air-conditioning operation is controlled according to the air-conditioning control data determined according to the temperature change data of the target human body part, which can improve the thermal comfort in the vehicle.

[0027] In some embodiments, the vehicle air-conditioning control data includes at least one of a vehicle air-conditioning target temperature, a vehicle air-conditioning compressor speed, and a blowing angle.

[0028] In order to achieve the above-mentioned purpose, the fourth aspect of the present invention proposes a vehicle air-conditioning control system, including: a data acquisition device, used to obtain vehicle air-conditioning control data based on the temperature change data of the target human body part; an air-conditioning control device, connected to the data acquisition device, for controlling the operation of the vehicle air-conditioning according to the vehicle air-conditioning control data.

[0029] According to the vehicle air-conditioning control system of an embodiment of the present invention, by adopting the vehicle air-conditioning control method of the above embodiment, the temperature change data of the target human body part is obtained, and the data is more accurate and timely. The vehicle air-conditioning operation is controlled according to the air-conditioning control data determined according to the temperature change data of the target human body part, which can improve the thermal comfort in the car.

[0030] In order to achieve the above-mentioned purpose, the fifth aspect of the present invention proposes an electronic device, comprising: at least one processor; a memory communicatively connected to the at least one processor; the memory stores a computer program executable by the at least one processor, and when the at least one processor executes the computer program, it implements the method for tracking human body temperature in a vehicle or the method for controlling the vehicle air conditioning.

[0031] According to the electronic device of the embodiment of the present invention, by executing the in-vehicle human body temperature tracking method of the above embodiment or the in-vehicle air conditioning control method of the above embodiment, more accurate and real-time in-vehicle human body temperature data can be obtained, and the in-vehicle environment can be adjusted based on the data to improve the thermal comfort in the vehicle.

[0032] In order to achieve the above-mentioned purpose, the sixth aspect of the present invention proposes a non-volatile readable storage medium on which a computer program is stored. When the computer program is executed, it implements the method for tracking human body temperature in a vehicle or the method for controlling the vehicle air conditioning.

[0033] In order to achieve the above-mentioned purpose, the seventh aspect of the present invention proposes a vehicle, which includes the electronic device mentioned above; or, the vehicle includes a vehicle-mounted infrared thermal imager and a controller, and the controller is connected to the vehicle-mounted infrared thermal imager for executing the method for tracking human body temperature in the vehicle.

[0034] According to the vehicle of the embodiment of the present invention, the accurate and timely temperature of the human body parts in the vehicle can be obtained, and based on this temperature, the environment in the vehicle can be adjusted more effectively to improve the thermal comfort of the environment in the vehicle.

[0035] In some embodiments, the vehicle also includes: an on-board air conditioner, which is connected to the controller, and the controller is also used to obtain on-board air conditioner control data based on the temperature change data of the target human body part, and control the operation of the on-board air conditioner according to the on-board air conditioner control data, wherein the temperature change data of the target human body part is obtained according to the in-vehicle human body temperature tracking method.

[0036] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0038] Figure 1 is a flow chart of a method for tracking human body temperature in a vehicle according to an embodiment of the present invention;

[0039] Figure 2 is a flow chart of a method for tracking human body temperature in a vehicle according to another embodiment of the present invention;

[0040] Figure 3 is a schematic diagram of a temperature variation curve of a target human body part according to an embodiment of the present invention;

[0041] Figure 4 is a flow chart of obtaining a preliminary region of interest based on a partition template library according to an embodiment of the present invention;

[0042] Figure 5 is a flow chart of determining a target human body part based on an adaptive threshold according to an embodiment of the present invention;

[0043] Figure 6 (1) is a schematic diagram of the infrared image inside the car;

[0044] Figure 6 (2) is a schematic diagram of the target human body part to be identified;

[0045] Figure 7 is a block diagram of a system for tracking human body temperature in a vehicle according to an embodiment of the present invention;

[0046] Figure 8 is a flow chart of a vehicle air conditioning control method according to an embodiment of the present invention;

[0047] Fig. 9 is a block diagram of a vehicle air conditioning control system according to an embodiment of the present invention;

[0048] Fig.10 is a block diagram of an electronic device according to an embodiment of the present invention;

[0049] Fig.11 is a block diagram of a vehicle according to one embodiment of the present invention;

[0050] Fig.12 is a block diagram of a vehicle according to another embodiment of the present invention. DETAILED DESCRIPTION

[0051] Embodiments of the present invention are described in detail below. The embodiments described with reference to the accompanying drawings are exemplary. Embodiments of the present invention are described in detail below.

[0052] The research on the thermal environment of vehicle riding space and the thermal comfort of passengers can not only improve the energy utilization rate of the whole vehicle, reduce the impact of the external environment on the thermal environment inside the vehicle, and meet the urgent need for scientific and efficient thermal management of the thermal environment inside the vehicle. At the same time, it can also provide scientific basis and theoretical guidance for the formulation of comfortable and energy-saving vehicle thermal environment standards, which has far-reaching significance for building an energy-saving, comfortable and safe vehicle riding environment.

[0053] The infrared thermal imager adopts a hybrid architecture (CMOS-MEMS), that is, the fusion technology of thermopile and micro-radiation pyroelectric sensor architecture, which has the advantages of scalability, easy calibration, low power consumption, and low cost. The infrared camera adopts wafer-level vacuum packaging of high-temperature stable materials, has no self-heating phenomenon and does not require a shutter, and has improved life and reliability. The performance can meet the automotive grade level. Based on the above infrared imaging technology, by reasonably arranging infrared cameras on the whole vehicle, it can monitor the in-vehicle environmental parameters and occupant physiological parameters in real time, identify the target parts of the human body and the in-vehicle cabin environment, extract the skin temperature values ​​of exposed target parts such as the face and hands of the human body, and realize the temperature tracking of multiple parts of the human body.

[0054] Reference below Figure 1-Figure 6 A method for tracking human body temperature in a vehicle according to an embodiment of the present invention is described.

[0055] Figure 1 is a flow chart of a method for tracking human body temperature in a vehicle according to an embodiment of the present invention. Figure 1 As shown, the method for tracking human body temperature in a vehicle according to an embodiment of the present invention includes steps S1-S3.

[0056] S1, determining the preliminary region of interest in the infrared image inside the vehicle according to the partition template library.

[0057] Among them, the infrared image inside the car can be acquired by a vehicle-mounted infrared thermal imager. The infrared image inside the car can reflect the temperature distribution of the area inside the car, including human bodies, objects, etc.

[0058] Infrared images can reflect temperature distribution, but cannot identify specific parts of an object. Therefore, in the present application, partition templates corresponding to things such as different locations in the car and different parts of the human body can be established, and multiple partition templates for different locations and different parts in the car constitute a partition template library. In an embodiment of the present invention, the partition template library can include regional templates that match different locations in the car and different parts of the human body such as the face, neck, and hands.

[0059] Because the temperature distribution areas of the infrared images collected by the thermal imagers at different locations in the vehicle are different, in some embodiments, the partition templates in the partition template library are infrared image areas including target human body parts constructed based on the locations of the vehicle-mounted infrared thermal imagers, for example, including the main driver's seat area, the co-driver's seat area, the front or rear seat area, the infrared image area of ​​the human face, the infrared image area of ​​the hands, etc.

[0060] Specifically, the image area that matches the partition template in the partition template library, i.e., the preliminary area of ​​interest, can be obtained in the infrared image inside the vehicle. For example, the exposed parts of the human body such as the face area and the hand area in multiple different areas inside the vehicle that are preliminarily determined based on the partition template are closest to the ambient temperature inside the vehicle.

[0061] S2, determining the target human body part, where the target human body part is the area consisting of pixel points whose pixel values ​​are greater than the corresponding adaptive threshold in the preliminary region of interest.

[0062] In some embodiments, the target human body part may be a part that is directly affected by the environment, such as an exposed part of the human body or other parts, specifically, the human face, human hands, etc.

[0063] Human body temperature is affected by ambient temperature, but human body temperature is different from ambient temperature. Therefore, in the embodiment of the present invention, an adaptive threshold is set, which can be a correlation threshold between human body temperature and ambient temperature, and will vary with changes in ambient temperature and human body temperature, so it is called an adaptive threshold.

[0064] Specifically, the preliminary regions of interest may include multiple regions, such as the facial region of the person in the main driver's seat, the human hand region of the co-driver's seat, the facial region of the person in the back row, etc. Each preliminary region of interest corresponds to an adaptive threshold of the region. The pixel value of the pixel area corresponding to the preliminary region of interest is compared with the adaptive threshold of the region. The region composed of pixel points whose pixel value is greater than the corresponding adaptive threshold is the target human body part corresponding to the preliminary region of interest, such as the human face area, human hand area, etc. In this way, the precise positioning of the target human body part can be dynamically achieved.

[0065] S3, obtaining temperature change data of the target human body part according to multiple consecutive frames of infrared images inside the vehicle.

[0066] Specifically, since the ambient temperature and human body temperature are changing, and the people in the car are also active, the target human body part is determined based on the adaptive threshold, and the temperature of each target human body part is tracked based on multiple frames of continuous in-car infrared images, i.e., the video stream of in-car infrared images, to obtain the temperature change data of each target human body part, such as the temperature change curve, and then the vehicle can control the vehicle environment adjustment equipment, such as the air conditioner, in real time based on the temperature change data to build a high thermal comfort in-car environment.

[0067] According to the method for tracking human body temperature in a vehicle in an embodiment of the present invention, a preliminary region of interest is obtained by preliminarily locating human body parts through a partition template library, and a target human body part in the preliminary region of interest is precisely located based on an adaptive threshold, thereby improving the accuracy of temperature extraction and realizing dynamic temperature tracking to obtain temperature change data, thereby providing reliable, accurate and timely data for temperature-based vehicle control strategies.

[0068] In some embodiments of the present invention, the target human body parts may include infrared image areas of different parts of any human body in the vehicle, for example, the face area, hand area, etc. of the front row human body, the face area, hand area, neck area, etc. of the back row human body, the face, hand, neck area, etc. of the main driver's seat, and the face, hand, neck area, etc. of the co-pilot's seat.

[0069] Furthermore, considering that the seating position of the passengers in the vehicle cabin is relatively fixed and the posture of the passenger and the front passenger seat changes little during driving, a partition template library matching the human body parts of the main driver's seat and the front passenger seat can be established. For example, in some embodiments, the target human body parts include at least one exposed part of the main driver's seat and / or at least one exposed part of the front passenger's seat, for example, it can include at least one of the face of the main driver's seat, the hands of the main driver's seat, and the face of the front passenger's seat.

[0070] In some embodiments, the temperature change data of the target human body part may include a change curve of the average temperature of the target human body part, or a data table of the temperatures corresponding to each target human body part, and so on.

[0071] For example, taking the target human body parts including the face of the person in the main driver's seat, the hands of the person in the main driver's seat and the face of the person in the front passenger's seat as an example, a partition template library is established to perform initial positioning of the face position of the person in the main driver's seat, the hand position of the person in the main driver's seat and the face position of the person in the front passenger's seat, that is, to obtain the face area of ​​the person in the main driver's seat, the hand area of ​​the person in the main driver's seat and the face area of ​​the person in the front passenger's seat that are preliminarily identified based on the partition template.

[0072] On the basis of establishing a partition template library, the facial position of the occupant in the main driver's seat, the hand position of the occupant in the main driver's seat, and the facial position of the occupant in the front passenger's seat are precisely positioned in different regions. That is, precise positioning is performed based on the adaptive thresholds corresponding to the face and hands of the person in the main driver's seat and the face of the person in the front passenger's seat, respectively, to obtain the precise areas of the face and hands of the person in the main driver's seat and the face of the person in the front passenger's seat.

[0073] Furthermore, temperature tracking is performed based on the image data video stream collected by the infrared thermal imager, and the change curves of the average facial temperature of the occupant in the main driver's seat, the average hand temperature of the occupant in the main driver's seat, and the average facial temperature of the occupant in the front passenger's seat are output. This can be used as a basis for subsequent analysis of the thermal comfort of the occupants in the car and for intelligent regulation of the vehicle's air-conditioning system.

[0074] Based on the above description, Figure 2 is a flow chart of a method for tracking human body temperature in a vehicle according to another embodiment of the present invention. Figure 2 As shown, specifically including:

[0075] S11, the vehicle-mounted infrared thermal imager is started to collect data, that is, the vehicle-mounted infrared thermal imager collects image data video stream as input data for data processing.

[0076] S12, analyzing the control positions of the vehicle-mounted infrared thermal imagers in the vehicle, and creating a partition template library based on the characteristics that the seating positions of the passengers in the cabin are relatively fixed and the postures of the driver and co-driver passengers change little during driving.

[0077] S13, performing initial positioning of the main driver's face position, the main driver's hand position, and the co-driver's face position based on the partition template library.

[0078] S14, performing adaptive threshold detection on each area respectively, and accurately positioning the main driver's face position, the main driver's hand position and the co-driver's face position based on the adaptive threshold.

[0079] S15, tracking the temperature of the main driver's face, the main driver's hand, and the co-driver's face based on the position information obtained by precise positioning.

[0080] S16, output the variation curve of the average temperature of each part.

[0081] Figure 3 It is a schematic diagram of the temperature change curve of the target human body part according to an embodiment of the present invention, wherein the change curves P1, P2 and P3 respectively represent the tracking results of the average facial temperature of the occupant in the main driver's seat, the average hand temperature of the occupant in the main driver's seat and the average facial temperature of the occupant in the co-pilot's seat.

[0082] Based on the above change curve, the adjustment control parameters of the corresponding vehicle environment adjustment equipment, such as the vehicle air conditioner, can be set for the area where the curve changes quickly at the beginning and the area where the change is relatively stable later, so as to create a more thermally comfortable in-vehicle environment.

[0083] Figure 4 FIG. 1 is a flowchart of obtaining a preliminary region of interest based on a partition template library according to an embodiment of the present invention. Figure 4 As shown, specifically including:

[0084] S401, the vehicle-mounted infrared thermal imager collects image data video stream as input data for data processing.

[0085] S402, analyzing the control positions of the vehicle-mounted infrared thermal imagers in the vehicle, and creating a partition template library based on the characteristics that the seating positions of the passengers in the cabin are relatively fixed and the postures of the driver and co-driver passengers change little during driving.

[0086] S403, performing image cropping based on the pixel areas corresponding to the three regions of interest in the partition template library, for example, determining the facial pixel area of ​​the passenger in the main driver's seat: [0:30, 30:62], the hand pixel area of ​​the passenger in the main driver's seat: [0:30, 62:80], and the facial pixel area of ​​the passenger in the co-pilot's seat: [0:30, 0:30].

[0087] S404, obtaining the initial positioning results of the main driver's face position, the main driver's hand position, and the co-driver's face position, that is, the initial region of interest.

[0088] In some embodiments of the present invention, the adaptive threshold is obtained based on the current temperature of the preliminary region of interest. The preliminary region of interest includes the distribution of the temperature of the human body parts and the ambient temperature in the vehicle in the region. The adaptive threshold is the correlation value of the human body temperature and the ambient temperature, which changes with the changes of the ambient temperature and the human body temperature. Therefore, the temperature region of the target human body position can be dynamically and accurately located based on the adaptive threshold.

[0089] The adaptive threshold is determined according to the current average temperature value of the preliminary region of interest, wherein the current average temperature value is obtained by performing spatial domain averaging and standard deviation on the pixel region corresponding to the preliminary region of interest.

[0090] Specifically, the infrared thermal imager collects infrared images to reflect temperature distribution, and calculates the pixel average value in the spatial domain for the pixel area corresponding to the preliminary area of ​​interest, which is equivalent to obtaining the average temperature value of the preliminary area of ​​interest, and corrects it with the standard deviation of the pixel area of ​​the preliminary area of ​​interest, so as to obtain an adaptive threshold suitable for the current temperature distribution.

[0091] In some embodiments, the adaptive threshold is obtained based on the mean and the standard deviation. For example, the adaptive threshold may be a function of the mean and the standard deviation or may satisfy a mapping relationship between the three or a model satisfying the three.

[0092] In some embodiments, the adaptive threshold may be expressed as follows:

[0093] threshold=μ+m·σ;

[0094] Among them, threshold is the adaptive threshold, μ is the mean obtained by averaging in the spatial domain, σ is the standard deviation, and m is a constant.

[0095] The above formula is used as an example, and other suitable expressions or mapping relationships of adaptive thresholds may also be used.

[0096] In some embodiments, m may be an adjustable constant, which may improve the adaptability of the adaptive threshold value to facilitate the comfort adjustment of the in-vehicle temperature.

[0097] Furthermore, considering that the temperature distribution can generally be Gaussian, when the value of m satisfies: 1≤m≤3, for example, m=1 or m=2 or m=3, the adaptive threshold can include most of the area. Therefore, a value range of m between 1 and 3 can obtain better results, and the image processing workload will not be too large.

[0098] Figure 5 is a flow chart of determining a target human body part based on an adaptive threshold according to an embodiment of the present invention. Figure 5 As shown, specifically including:

[0099] S501, performing regional processing based on the preliminary area of ​​interest, for example, performing regional processing based on the initial positioning results of the main driver's seat face position, the main driver's seat hand position, and the co-driver's seat face position.

[0100] S502, performing spatial domain mean μ and standard deviation σ processing on the pixel areas corresponding to the three regions of interest in the partition template library.

[0101] S503, obtaining an adaptive threshold: threshold=μ+m·σ, where m is an adjustable parameter, 1≤m≤3.

[0102] S504, determine whether the pixel value of each area is greater than the adaptive threshold, if so, proceed to step S505, otherwise proceed to step S507.

[0103] S505: Mark pixel labels.

[0104] S506, the area formed by the marked pixel points is the precise positioning result, for example, the precise positioning results of the main driver's face position, the main driver's hand position, and the co-driver's face position are output.

[0105] S507: The pixel point is not marked.

[0106] like Figure 6 is a schematic diagram of a target human body part according to an embodiment of the present invention, wherein: Figure 6 (1) is the infrared image inside the car. Figure 6 (2) is a schematic diagram of the target human body part to be identified.

[0107] The method for tracking human body temperature in a vehicle according to an embodiment of the present invention can realize the real-time extraction of the temperatures of multiple parts of the human body from the image data video stream collected by an infrared thermal imager, and finally output the temperature change curves of multiple parts of the human body that change with the in-vehicle environment, thereby providing data reference for the intelligent control of vehicle-mounted environmental adjustment equipment such as a vehicle-mounted air-conditioning system.

[0108] Based on the method for tracking human body temperature in a vehicle in the above embodiment, a second embodiment of the present invention provides a system for tracking human body temperature in a vehicle.

[0109] Figure 7 is a block diagram of a system for tracking human body temperature in a vehicle according to an embodiment of the present invention. Figure 7 As shown, the in-vehicle human body temperature tracking system 1 includes at least one infrared thermal imager 1001 and an infrared image processing device 1002 .

[0110] At least one infrared thermal imager 1001 is used to collect infrared images inside the vehicle. For example, it can be one infrared thermal imager 1001, for example, set in front of the main driving position or the co-driver position or on the side of the vehicle, and can collect infrared images of various positions in the vehicle. Alternatively, multiple infrared thermal imagers are set at different positions in the vehicle to facilitate the collection of infrared images of different areas in the vehicle.

[0111] The infrared image processing device 1002 is connected to at least one infrared thermal imager 1001 and is used to obtain temperature change data of a target human body part in the vehicle according to the in-vehicle human body temperature tracking method of the above embodiment.

[0112] Furthermore, the temperature change data can be provided to a control unit in the vehicle that needs to perform a control strategy based on human body temperature, such as an on-board air conditioning controller, so as to provide the required temperature data for vehicle-related control.

[0113] According to the in-vehicle human body temperature tracking system 1 of the embodiment of the present invention, the in-vehicle human body temperature tracking method of the above embodiment is executed through the infrared image processing device 1002, and the human body parts are preliminarily located through the partition template library, that is, the preliminary region of interest is obtained, and the target human body parts in the preliminary region of interest are precisely located based on the adaptive threshold, which improves the accuracy of temperature extraction, and can realize dynamic tracking of temperature to obtain temperature change data, thereby providing reliable, accurate and timely data for temperature-based vehicle control strategies.

[0114] Based on the human body temperature data obtained by the method of the above embodiment, an analysis of the thermal comfort of the occupants can be carried out, and the vehicle air conditioning can be intelligently adjusted based on the human body thermal regulation model, making the vehicle air conditioning more intelligent and improving the comfort of the vehicle cabin environment. This will essentially innovate smart air conditioning and redefine the standard of human thermal comfort.

[0115] Figure 8 is a flow chart of a vehicle air conditioning control method according to an embodiment of the present invention. Figure 8 As shown, the vehicle air conditioning control method includes:

[0116] S101, obtaining vehicle air conditioning control data according to the temperature change data of the target human body part, wherein the temperature change data of the target human body part is obtained according to the in-vehicle human body temperature tracking method of the above embodiment. The specific obtaining process can be referred to the description of the above example and will not be repeated here.

[0117] Among them, a conversion model or a corresponding function or a mapping relationship between the vehicle air-conditioning control data and the temperature change data of the target human body part can be established to determine the corresponding vehicle air-conditioning control parameters based on the temperature change data.

[0118] In some embodiments, the vehicle air-conditioning control data may include at least one of the vehicle air-conditioning target temperature, the vehicle air-conditioning compressor speed, the blowing angle, and the air outlet opening.

[0119] S102, controlling the operation of the vehicle air conditioner according to the vehicle air conditioner control data.

[0120] According to the vehicle air-conditioning control method of an embodiment of the present invention, the temperature change data of the target human body part is obtained by adopting the in-vehicle human body temperature tracking method of the above embodiment. The data is more accurate and timely. The vehicle air-conditioning operation is controlled according to the air-conditioning control data determined according to the temperature change data of the target human body part, which can improve the thermal comfort in the vehicle.

[0121] Reference below Fig. 9 A vehicle air conditioning control system according to an embodiment of the present invention is described.

[0122] Fig. 9 is a block diagram of a vehicle air conditioning control system according to an embodiment of the present invention, Fig. 9 As shown, the vehicle air conditioning control system 110 includes: a data acquisition device 111 and an air conditioning control device 112 .

[0123] In some embodiments, the data acquisition device 111 can be used to obtain vehicle air conditioning control data based on temperature change data of the target human body part, wherein the temperature change data of the target human body part is obtained according to the in-vehicle human body temperature tracking method described in the above embodiment.

[0124] In some embodiments, the air conditioning control device 112 is connected to the data acquisition device 111, and is used to control the operation of the vehicle air conditioning according to the vehicle air conditioning control data. Specifically, the air conditioning control device 112 may include a control algorithm, a control logic, and a hardware device for executing control commands, and is used to adjust the operating state of the air conditioning system according to the temperature change data of the target human body part to provide more comfortable and effective temperature regulation.

[0125] According to the vehicle air-conditioning control system 110 of the embodiment of the present invention, by adopting the vehicle air-conditioning control method of the above embodiment, the temperature change data of the target human body part is obtained, and the data is more accurate and timely. The vehicle air-conditioning operation is controlled according to the air-conditioning control data determined according to the temperature change data of the target human body part, which can improve the thermal comfort in the car.

[0126] The fifth aspect of the present invention further provides an electronic device, such as Fig.10 As shown, the electronic device 10 includes at least one processor 11 and a memory 12 communicatively connected to the at least one processor 11 .

[0127] Among them, the memory 12 stores a computer program that can be executed by at least one processor 11. When the at least one processor 11 executes the computer program, the method for tracking the human body temperature in the vehicle or the method for controlling the vehicle air conditioning in the above embodiment is implemented.

[0128] In an embodiment, the electronic device 10 may be a controller for controlling an in-vehicle environmental conditioning device such as an in-vehicle air conditioner, or a mobile terminal, an in-vehicle terminal, or a thermal management controller of the vehicle.

[0129] According to the electronic device 10 of the embodiment of the present invention, by executing the in-vehicle human body temperature tracking method of the above embodiment or the in-vehicle air conditioning control method of the above embodiment, more accurate and real-time in-vehicle human body temperature data can be obtained, and the in-vehicle environment can be adjusted based on the data to improve the thermal comfort in the vehicle.

[0130] The sixth aspect of the present invention further proposes a non-volatile readable storage medium on which a computer program is stored. When the computer program is executed, the method for tracking human body temperature in a vehicle or the method for controlling vehicle air conditioning in the above embodiment is implemented.

[0131] In an embodiment, the non-volatile readable storage medium may be a non-transitory storage medium, for example, including: a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and other media that can store program codes, or may be a transient storage medium.

[0132] Based on the above embodiments, a seventh aspect of the present invention further proposes a vehicle.

[0133] like Fig.11 As shown, a vehicle 100 includes the electronic device 10 of the above embodiment.

[0134] Or, if Fig.10 As shown, the vehicle 100 includes a vehicle-mounted infrared thermal imager 101 and a controller 102 . The controller 102 is connected to the vehicle-mounted infrared thermal imager 101 and is used to execute the in-vehicle human body temperature tracking method of the above embodiment.

[0135] According to the vehicle 100 of the embodiment of the present invention, the accurate and timely temperature of the human body parts in the vehicle can be obtained, and based on this temperature, the environment in the vehicle can be adjusted more effectively to improve the thermal comfort of the environment in the vehicle.

[0136] like Fig.12As shown, the vehicle 100 also includes an onboard air conditioner 103, which is connected to the controller 102. The controller 102 is also used to obtain onboard air conditioner control data based on the temperature change data of the target human body part, and control the operation of the onboard air conditioner based on the onboard air conditioner control data, wherein the temperature change data of the target human body part is obtained according to the in-vehicle human body temperature tracking method of the above embodiment.

[0137] By adopting the in-vehicle human body temperature tracking method of the above embodiment to obtain the temperature change data of the target human body part, the data is more accurate and timely. The air-conditioning control parameters determined according to the temperature change data of the target human body part control the operation of the vehicle air-conditioning, which can more accurately and effectively adjust the temperature in the vehicle and improve the thermal comfort in the vehicle.

[0138] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples" or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example.

[0139] Although the embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the claims and their equivalents.

Claims

1. A method for tracking human body temperature in a vehicle, It is characterized in that include: Determine a preliminary region of interest in the infrared image inside the vehicle according to a target partition template in a partition template library; Determine a target human body part, the target human body part is a region composed of pixel points in the preliminary region of interest whose pixel values ​​are greater than a corresponding adaptive threshold, and the target human body part is an exposed human body part; Obtaining temperature change data of the target human body part according to multiple consecutive frames of the in-vehicle infrared images; The adaptive threshold is expressed as follows: threshold=μ+m·σ; Wherein, threshold is the adaptive threshold, μ is the mean value obtained by performing spatial domain solution on the pixel area corresponding to the preliminary region of interest, σ is the standard deviation obtained by performing spatial domain solution on the pixel area corresponding to the preliminary region of interest, and m is a constant.

2. The method for tracking human body temperature in a vehicle according to claim 1, It is characterized in that The target partition template is an infrared image area including the target human body part constructed based on the position of the vehicle-mounted infrared thermal imager.

3. The method for tracking human body temperature in a vehicle according to claim 1, It is characterized in that The m is an adjustable constant.

4. The method for tracking human body temperature in a vehicle according to claim 3, It is characterized in that The value of m satisfies: 1≤m≤3.

5. The method for tracking human body temperature in a vehicle according to claim 1, It is characterized in that The temperature change data of the target human body part includes a change curve of the average temperature of the target human body part.

6. The method for tracking human body temperature in a vehicle according to any one of claims 1 to 5, It is characterized in that The target human body part includes at least one exposed part of the human body in the main driver's seat and / or at least one exposed part of the human body in the co-pilot's seat.

7. A human body temperature tracking system in a car, It is characterized in that include: At least one infrared thermal imager, used for collecting infrared images inside the vehicle; The infrared image processing device is connected to the at least one infrared thermal imager and is used to obtain the temperature change data of the target human body part in the vehicle according to the method for tracking the temperature of the human body in the vehicle according to any one of claims 1 to 6.

8. A vehicle air conditioning control method, It is characterized in that include: Obtaining vehicle air conditioning control data according to temperature change data of a target human body part, wherein the temperature change data of the target human body part is obtained by the method for tracking human body temperature in a vehicle according to any one of claims 1 to 6; The operation of the vehicle air conditioner is controlled according to the vehicle air conditioner control data.

9. The vehicle air conditioning control method according to claim 8, It is characterized in that The vehicle air conditioner control data includes at least one of a vehicle air conditioner target temperature, a vehicle air conditioner compressor speed, and a blowing angle.

10. A vehicle air conditioning control system, It is characterized in that include: A data acquisition device, used for obtaining vehicle air conditioning control data according to temperature change data of a target human body part, wherein the temperature change data of the target human body part is obtained according to the method for tracking human body temperature in a vehicle according to any one of claims 1 to 6; An air conditioning control device is connected to the data acquisition device and is used to control the operation of the vehicle air conditioning according to the vehicle air conditioning control data.

11. An electronic device, It is characterized in that include: at least one processor; a memory communicatively coupled to the at least one processor; The memory stores a computer program that can be executed by the at least one processor. When the at least one processor executes the computer program, it implements the method for tracking human body temperature in a vehicle as described in any one of claims 1 to 6 or the method for controlling the vehicle air conditioning as described in claim 8 or 9.

12. A non-volatile readable storage medium having a computer program stored thereon, It is characterized in that When the computer program is executed, it implements the method for tracking the temperature of a human body in a vehicle as described in any one of claims 1 to 6 or the method for controlling the vehicle air conditioning as described in claim 8 or 9.

13. A vehicle, It is characterized in that The vehicle comprises the electronic device of claim 11; Alternatively, the vehicle includes an on-board infrared thermal imager and a controller, and the controller is connected to the on-board infrared thermal imager and is used to execute the method for tracking human body temperature in a vehicle as described in any one of claims 1-6.

14. The vehicle according to claim 13, It is characterized in that The vehicle further comprises: A vehicle air conditioner, the vehicle air conditioner is connected to the controller, and the controller is also used to obtain vehicle air conditioner control data according to the temperature change data of the target human body part, and control the operation of the vehicle air conditioner according to the vehicle air conditioner control data, wherein the temperature change data of the target human body part is obtained according to the in-vehicle human body temperature tracking method.

Images