Temperature tracking method and system, air conditioner control method and system, device, medium, and vehicle

Abstract

An in-vehicle human body temperature tracking method, comprising: determining a preliminary region of interest in an in-vehicle infrared image on the basis of a partition template library; determining a target human body part, the target human body part being a region composed of pixel points having pixel values greater than a corresponding adaptive threshold in the preliminary region of interest; and acquiring temperature change data of the target human body part on the basis of a plurality of consecutive in-vehicle infrared image frames.

Description

Temperature tracking method, air conditioner control method, system, device, medium and vehicle

[0001] The present application claims priority from the Chinese patent application No. 202410978069.5 filed on July 22, 2024, and entitled "Temperature tracking method, air conditioner control method, system, device, medium and vehicle", the content of which is incorporated herein by reference in its entirety. TECHNICAL FIELD

[0002] The present application relates to the technical field of vehicles, and in particular to an in-vehicle human body temperature tracking method, an in-vehicle human body temperature tracking system, an in-vehicle air conditioner control method, an in-vehicle air conditioner control system, an electronic device, a storage medium and a vehicle. BACKGROUND

[0003] In the prior art, human body temperature tracking technology based on an infrared thermal imager is mostly used for abnormal temperature monitoring, or only based on a template library to extract the temperature of a region of interest in an infrared image in a static scene, which is not accurate enough and is not applicable in some scenarios.

[0004] DISCLOSURE

[0005] The present application aims to at least solve one of the technical problems in the prior art. To this end, the first object of the present application is to provide an in-vehicle human body temperature tracking method, which can improve the accuracy of temperature extraction and can realize dynamic tracking of temperature to obtain temperature change data, thereby providing reliable and accurate data for temperature-based vehicle control strategies and being applicable to in-vehicle environment adjustment scenarios.

[0006] The second object of the present application is to provide an in-vehicle human body temperature tracking system.

[0007] The third object of the present application is to provide an in-vehicle air conditioner control method.

[0008] The fourth object of the present application is to provide an in-vehicle air conditioner control system.

[0009] The fifth object of the present application is to provide an electronic device.

[0010] The sixth object of the present application is to provide a non-volatile readable storage medium.

[0011] The seventh object of the present application is to provide a vehicle.

[0012] To achieve the above object, the in-vehicle human body temperature tracking method comprises the following steps: determining a preliminary region of interest in an in-vehicle infrared image according to a partition template library; determining a target human body part, which is a region formed by pixel points with pixel values greater than a corresponding adaptive threshold in the preliminary region of interest; and obtaining temperature change data of the target human body part according to a plurality of continuous in-vehicle infrared images.

[0013] According to the in-vehicle human body temperature tracking method, the target human body part in the preliminary region of interest is precisely positioned based on the adaptive threshold after the human body part is preliminarily positioned to obtain the preliminary region of interest through the partition template library, thereby improving the temperature extraction accuracy and realizing dynamic tracking of temperature to obtain temperature change data, so as to provide reliable, accurate and timely data for a temperature-based vehicle control strategy, and the method is suitable for in-vehicle environment adjustment scenarios.

[0014] In some embodiments, the partition template in the partition template library is an infrared image region including the target human body part constructed based on the position of the vehicle-mounted infrared thermal imager.

[0015] In some embodiments, the adaptive threshold is obtained according to the current temperature of the preliminary region of interest.

[0016] In some embodiments, the adaptive threshold is determined according to a current average temperature value of the preliminary region of interest, wherein the current average temperature value is obtained by spatially averaging and obtaining a standard deviation of a pixel region corresponding to the preliminary region of interest.

[0017] In some embodiments, the adaptive threshold is obtained according to the mean value and the standard deviation.

[0018] In some embodiments, the adaptive threshold is expressed as follows: threshold = μ + m·σ.

[0019] wherein threshold is the adaptive threshold, μ is the mean value, σ is the standard deviation, and m is a constant.

[0020] In some embodiments, the m is an adjustable constant.

[0021] In some embodiments, the value of m satisfies: 1 ≤ m ≤ 3.

[0022] In some embodiments, the temperature change data of the target human body part includes a change curve of the average temperature of the target human body part.

[0023] In some embodiments, the target human body part includes at least one exposed part of a human body at a main driving position and / or at least one exposed part of a human body at a co-driver position.

[0024] To achieve the above object, the application provides a human body temperature tracking system in a vehicle, comprising: at least one infrared thermal imager, configured to collect an infrared image in the vehicle; and an infrared image processing device, connected to the at least one infrared thermal imager, configured to obtain temperature change data of a target human body part of a human body in the vehicle according to the human body temperature tracking method in the vehicle.

[0025] According to the human body temperature tracking system in the vehicle provided by the application, the infrared image processing device obtains the temperature change data of the target human body part according to the human body temperature tracking method in the vehicle, and the temperature extraction accuracy is improved by performing preliminary positioning on the human body part through the partition template library and performing fine positioning on the target human body part in the preliminary region of interest based on the adaptive threshold, so that the temperature change data can be obtained through dynamic tracking, and reliable, accurate and timely data can be provided for a vehicle control strategy based on temperature, and the system is suitable for an in-vehicle environment adjustment scene.

[0026] To achieve the above object, the application provides a vehicle air conditioner control method, comprising: obtaining vehicle air conditioner control data according to temperature change data of a target human body part, wherein the temperature change data of the target human body part is obtained according to the human body temperature tracking method in the vehicle; and controlling the vehicle air conditioner to operate according to the vehicle air conditioner control data.

[0027] According to the vehicle air conditioner control method provided by the application, the temperature change data of the target human body part is obtained by using the human body temperature tracking method in the vehicle, and the data is more accurate and timely, and the vehicle air conditioner is controlled to operate according to the vehicle air conditioner control data determined according to the temperature change data of the target human body part, so that the in-vehicle thermal comfort can be improved.

[0028] In some embodiments, the vehicle air conditioner control data comprises at least one of a target temperature of the vehicle air conditioner, a rotation speed of a compressor of the vehicle air conditioner and a blowing angle.

[0029] To achieve the above object, the application provides a vehicle air conditioner control system, comprising: a data acquisition device, configured to obtain vehicle air conditioner control data according to temperature change data of a target human body part; and an air conditioner control device, connected to the data acquisition device, configured to control the vehicle air conditioner to operate according to the vehicle air conditioner control data.

[0030] According to the vehicle air conditioner control system provided by the application, the temperature change data of the target human body part is obtained by using the vehicle air conditioner control method, and the data is more accurate and timely, and the vehicle air conditioner is controlled to operate according to the vehicle air conditioner control data determined according to the temperature change data of the target human body part, so that the in-vehicle thermal comfort can be improved.

[0031] To achieve the above object, the fifth aspect of the present application provides an electronic device, comprising: at least one processor; a memory connected with the at least one processor; the memory stores computer instructions which can be executed by the at least one processor, and the at least one processor executes the computer instructions to implement the in-vehicle human body temperature tracking method or the vehicle-mounted air conditioner control method.

[0032] According to the electronic device provided by the embodiments of the present application, the in-vehicle human body temperature data can be obtained more accurately and in real time by executing the in-vehicle human body temperature tracking method or the vehicle-mounted air conditioner control method, and the in-vehicle environment can be adjusted based on the data, so that the in-vehicle thermal comfort can be improved.

[0033] To achieve the above object, the sixth aspect of the present application provides a non-volatile readable storage medium, which stores computer instructions, and the computer instructions are executed to implement the in-vehicle human body temperature tracking method or the vehicle-mounted air conditioner control method.

[0034] To achieve the above object, the seventh aspect of the present application provides a vehicle, which comprises the electronic device, or the vehicle comprises a vehicle-mounted infrared thermal imager and a controller, the controller is connected with the vehicle-mounted infrared thermal imager, and is used to execute the in-vehicle human body temperature tracking method.

[0035] According to the vehicle provided by the embodiments of the present application, the temperature of the in-vehicle human body part can be obtained accurately and in real time, and the in-vehicle environment can be adjusted more effectively based on the temperature, so that the in-vehicle thermal comfort can be improved.

[0036] In some embodiments, the vehicle further comprises a vehicle-mounted air conditioner connected with the controller, and the controller is further used to obtain vehicle-mounted air conditioner control data according to the temperature change data of the target human body part, and control the vehicle-mounted air conditioner to operate according to the vehicle-mounted air conditioner control data, wherein the temperature change data of the target human body part is obtained according to the in-vehicle human body temperature tracking method.

[0037] Additional aspects and advantages of the present application will be in part apparent and in part pointed out hereinafter. BRIEF DESCRIPTION OF DRAWINGS

[0038] The above and / or additional aspects and advantages of the present application will become apparent and be readily appreciated from the following description, including the appended drawings, wherein:

[0039] Fig. 1 is a flow chart of an in-vehicle human body temperature tracking method according to an embodiment of the present application;

[0040] Fig. 2 is a flow chart of a method for tracking the temperature of a human body in a vehicle according to another embodiment of the present application;

[0041] Fig. 3 is a schematic diagram of a temperature variation curve of a target human body part according to an embodiment of the present application;

[0042] Fig. 4 is a flow chart of obtaining a preliminary region of interest based on a partitioned template library according to an embodiment of the present application;

[0043] Fig. 5 is a flow chart of determining a target human body part based on an adaptive threshold according to an embodiment of the present application;

[0044] Fig. 6(1) is a schematic diagram of an infrared image in a vehicle;

[0045] Fig. 6(2) is a schematic diagram of a recognized target human body part;

[0046] Fig. 7 is a block diagram of a system for tracking the temperature of a human body in a vehicle according to an embodiment of the present application;

[0047] Fig. 8 is a flow chart of a method for controlling a vehicle air conditioner according to an embodiment of the present application;

[0048] Fig. 9 is a block diagram of a system for controlling a vehicle air conditioner according to an embodiment of the present application;

[0049] Fig. 10 is a block diagram of an electronic device according to an embodiment of the present application;

[0050] Fig. 11 is a block diagram of a vehicle according to an embodiment of the present application;

[0051] Fig. 12 is a block diagram of a vehicle according to another embodiment of the present application. DETAILED DESCRIPTION

[0052] Embodiments of the present application are described in detail below with reference to the accompanying drawings. The embodiments described below with reference to the accompanying drawings are exemplary, and embodiments of the present application are described in detail below.

[0053] The study of the thermal environment of a vehicle passenger space and the thermal comfort of an occupant can not only improve the energy utilization rate of the vehicle and reduce the influence of the external environment on the thermal environment of the vehicle, but also meet the urgent need for scientific and efficient thermal management of the thermal environment of the vehicle. At the same time, it can provide scientific basis and theoretical guidance for formulating comfortable and energy-saving standards for the thermal environment of the vehicle, and has far-reaching significance for building an energy-saving, comfortable and safe automobile passenger space.

[0054] The infrared thermal imager adopts a hybrid architecture (CMOS-MEMS), that is, a thermocouple and microbolometer sensor architecture fusion technology, and has the advantages of scalability, easy calibration, low power consumption, low cost, etc. The infrared camera adopts wafer-level vacuum packaging of high-temperature stable material, has no self-heating phenomenon and does not need a shutter, and the service life and reliability are improved, and the performance can meet the vehicle level. Based on the above infrared imaging technology, by reasonably arranging the infrared camera on the vehicle, the vehicle interior environment parameters and occupant physiological parameters can be monitored in real time, the human body target parts and the vehicle interior cabin environment are identified, the skin temperature values of the exposed target parts such as the human face and the hands are extracted, and the human body multi-part temperature tracking is realized.

[0055] The vehicle interior human body temperature tracking method according to the embodiments of the present application is described below with reference to FIGS. 1-6.

[0056] FIG. 1 is a flowchart of a vehicle interior human body temperature tracking method according to an embodiment of the present application. As shown in FIG. 1, the vehicle interior human body temperature tracking method according to the embodiments of the present application includes steps S1-S3.

[0057] S1, determining a preliminary region of interest in the vehicle interior infrared image according to a partition template library.

[0058] The vehicle interior infrared image can be obtained by a vehicle-mounted infrared thermal imager. The vehicle interior infrared image can reflect the temperature distribution of the vehicle interior region including the human body, objects, etc.

[0059] The infrared image can reflect the temperature distribution, but cannot identify the specific parts of the object. Therefore, in the present application, a partition template corresponding to the things such as different positions in the vehicle interior and different parts of the human body can be established, and a plurality of partition templates of different positions in the vehicle interior and different parts of the human body constitute a partition template library. In the embodiments of the present application, the partition template library can include region templates matched with different positions in the vehicle interior and different parts of the human body, such as the face, the neck, the hands, etc.

[0060] Because the temperature distribution regions of the vehicle interior infrared image collected by the thermal imager set at different positions in the vehicle interior are different, in some embodiments, the partition templates in the partition template library are infrared image regions including target human body parts constructed based on the positions of the vehicle-mounted infrared thermal imager. For example, infrared image regions including the main driver position region, the co-driver region, the front or rear region, the human face region, the hand region, etc.

[0061] In some embodiments, the image region in the vehicle interior infrared image matched with the partition template, that is, the preliminary region of interest, can be obtained according to the partition template in the partition template library, for example, the face region, the hand region, etc. of the human body in a plurality of different regions in the vehicle interior preliminarily determined based on the partition template, so as to be closest to the temperature of the vehicle interior environment.

[0062] S2, determine the target human body part, the target human body part is a region composed of pixel points with pixel values greater than the corresponding adaptive threshold in the preliminary region of interest.

[0063] In some embodiments, the target human body part can be a part directly affected by the environment, such as a bare part of the human body or other parts, such as the face of the human body, the hands of the human body, etc.

[0064] The temperature of the human body is affected by the temperature of the environment, but the temperature of the human body is different from the temperature of the environment. Therefore, in the embodiments of the present application, an adaptive threshold is set, which can be a correlation threshold of the temperature of the human body and the temperature of the environment, and will be different with the change of the temperature of the environment and the temperature of the human body, so it is called adaptive threshold.

[0065] In some embodiments, the preliminary region of interest can include multiple regions, such as the face region of the human body in the main driver seat, the hand region of the human body in the co-driver seat, the face region of the human body in the back seat, etc., and each preliminary region of interest corresponds to an adaptive threshold of the region. The pixel values of the pixel region corresponding to the preliminary region of interest are compared with the adaptive threshold of the region, and the region composed of pixel points with pixel values greater than the corresponding adaptive threshold is the target human body part corresponding to the preliminary region of interest, such as the face region of the human body, the hand region of the human body, etc. Thus, the accurate positioning of the target human body part can be dynamically realized.

[0066] S3, obtain temperature change data of the target human body part according to the continuous multiple frames of the infrared images in the vehicle.

[0067] In some embodiments, since the temperature of the environment and the temperature of the human body are changing, and the people in the vehicle are also active. Therefore, based on the adaptive threshold, the target human body part is determined, and based on the multiple continuous infrared images in the vehicle, i.e., the video stream of the infrared images in the vehicle, the temperature of each target human body part is tracked to obtain the temperature change data of each target human body part, such as the temperature change curve. Further, the vehicle can control the vehicle-mounted environmental regulation device, such as the air conditioner, in real time based on the temperature change data, and build a vehicle environment with high thermal comfort.

[0068] According to the human body temperature tracking method in the vehicle according to the embodiments of the present application, the human body part is preliminarily positioned by the partition template library to obtain the preliminary region of interest, and the target human body part in the preliminary region of interest is accurately positioned based on the adaptive threshold, which improves the temperature extraction accuracy, can realize dynamic tracking of the temperature to obtain the temperature change data, and thus provides reliable, accurate and timely data for the vehicle control strategy based on the temperature.

[0069] In some embodiments of the present application, the target human body part can include infrared image regions of different parts of any human body in the vehicle, for example, front-row human face region, hand region, etc., rear-row human face region, hand region, neck region, etc., main driver seat human face, hand, neck, etc. region, co-driver seat human face, hand, neck, etc. region.

[0070] In some embodiments, considering the characteristics that the occupant seating position in the vehicle cabin is relatively fixed and the main and co-driver occupant posture changes little during driving, a partition template library matched with the main driver seat human body part and the co-driver seat human body part can be established. For example, in some embodiments, the target human body part includes at least one exposed part of the main driver seat human body and / or at least one exposed part of the co-driver seat human body, for example, can include at least one of the main driver seat human face, the main driver seat human hand, and the co-driver seat human face.

[0071] In some embodiments, the temperature change data of the target human body part can include a change curve of the average temperature of the target human body part, or a data table of the temperature corresponding to each target human body part, etc.

[0072] For example, taking the target human body part including the main driver seat human face, the main driver seat human hand, and the co-driver seat human face as an example, a partition template library is established, and the preliminary positioning of the main driver seat occupant face position, the preliminary positioning of the main driver seat occupant hand position, and the preliminary positioning of the co-driver seat occupant face position are performed, that is, the main driver seat human face region, the main driver seat human hand region, and the co-driver seat human face region are obtained based on the preliminary identification of the partition template.

[0073] Based on the establishment of the partition template library, the fine positioning of the main driver seat occupant face position, the fine positioning of the main driver seat occupant hand position, and the fine positioning of the co-driver seat occupant face position are performed, that is, the fine positioning is performed based on the adaptive threshold corresponding to the main driver seat human face and hand and the co-driver seat human face, respectively, to obtain the accurate regions of the main driver seat human face and hand and the co-driver seat human face.

[0074] In some embodiments, temperature tracking is performed based on the image data video stream collected by the infrared thermal imager, and the change curve of the average temperature of the main driver seat occupant face, the average temperature of the main driver seat occupant hand, and the average temperature of the co-driver seat occupant face is outputted, which can be used as a basis for subsequent analysis of the thermal comfort of the vehicle occupant and intelligent control of the vehicle-mounted air conditioning system.

[0075] Based on the above description, FIG. 2 is a flowchart of a vehicle human body temperature tracking method according to another embodiment of the present application, as shown in FIG. 2, which specifically includes:

[0076] S11, the vehicle-mounted infrared thermal imager is started to collect data. That is, the vehicle-mounted infrared thermal imager collects image data video stream as input data for data processing.

[0077] S12, the position of the vehicle-mounted infrared thermal imager in the vehicle is analyzed, and based on the characteristics that the seating position of the passengers in the vehicle cabin is relatively fixed and the postures of the main and deputy drivers change little during driving, a partition template library is created.

[0078] S13, the initial positioning of the face position of the main driver seat, the hand position of the main driver seat, and the face position of the deputy driver seat is performed based on the partition template library.

[0079] S14, adaptive threshold detection is performed on each region, and the fine positioning of the face position of the main driver seat, the hand position of the main driver seat, and the face position of the deputy driver seat is performed based on the adaptive threshold.

[0080] S15, temperature tracking of the face of the main driver seat, the hand of the main driver seat, and the face of the deputy driver seat is performed based on the position information obtained by the fine positioning.

[0081] S16, the change curve of the average temperature of each part is output.

[0082] Fig. 3 is a schematic diagram of the temperature change curve of the target human body part according to one embodiment of the present application, wherein the change curves P1, P2, and P3 respectively represent the tracking results of the average temperature of the face of the main driver position passenger, the average temperature of the hand of the main driver position passenger, and the average temperature of the face of the deputy driver position passenger.

[0083] Based on the above change curves, the adjustment control parameters of the vehicle-mounted environmental adjustment device such as the vehicle-mounted air conditioner can be set for the regions where the curve changes quickly at the beginning and the regions where the curve changes relatively smoothly later, so as to build a higher thermal comfort vehicle environment.

[0084] Fig. 4 is a flowchart for obtaining a preliminary region of interest based on a partition template library according to one embodiment of the present application, as shown in Fig. 4, which specifically includes:

[0085] S401, the vehicle-mounted infrared thermal imager collects image data video stream as input data for data processing.

[0086] S402, the position of the vehicle-mounted infrared thermal imager in the vehicle is analyzed, and based on the characteristics that the seating position of the passengers in the vehicle cabin is relatively fixed and the postures of the main and deputy drivers change little during driving, a partition template library is created.

[0087] S403, image cropping is performed according to the pixel region corresponding to the three regions of interest in the partition template library, for example, the pixel region of the face of the passenger in the driver position is determined as [0:30, 30:62], the pixel region of the hand of the passenger in the driver position is determined as [0:30, 62:80], and the pixel region of the face of the passenger in the co-driver position is determined as [0:30, 0:30].

[0088] S404, the initial positioning result of the face position of the driver position, the hand position of the driver position, and the face position of the co-driver position is obtained, that is, the preliminary region of interest.

[0089] In some embodiments of the present application, the adaptive threshold is obtained according to the current temperature of the preliminary region of interest. The preliminary region of interest includes the distribution of the temperature of the human body part in the region and the temperature of the environment in the vehicle, and the adaptive threshold is the correlation value of the human body temperature and the environment temperature, which changes with the change of the environment temperature and the human body temperature, so that the temperature region of the target human body position can be accurately positioned based on the adaptive threshold.

[0090] The adaptive threshold is determined according to the current average temperature value of the preliminary region of interest, wherein the current average temperature value is obtained by spatially averaging and standard deviation of the pixel region corresponding to the preliminary region of interest.

[0091] In some embodiments, the infrared thermal imager collects infrared images to reflect the temperature distribution, the pixel average value of the pixel region corresponding to the preliminary region of interest is obtained in the spatial domain, which is equivalent to obtaining the average temperature value of the preliminary region of interest, and the adaptive threshold is corrected by the standard deviation of the pixel region of the preliminary region of interest, so that the adaptive threshold suitable for the current temperature distribution can be obtained.

[0092] In some embodiments, the adaptive threshold is obtained according to the mean and standard deviation, for example, the adaptive threshold can be a function of the mean and standard deviation or satisfy the mapping corresponding relationship of the three or the model satisfied by the three.

[0093] In some embodiments, the adaptive threshold can be expressed as follows: threshold=μ+m·σ;

[0094] Wherein, threshold is the adaptive threshold, μ is the mean value obtained by spatially averaging, σ is the standard deviation, and m is a constant.

[0095] The above formula is used as an example, and other suitable expressions or mapping relationships of the adaptive threshold can also be used.

[0096] In some embodiments, m can be an adjustable constant, which can improve the adaptability of the adaptive threshold to facilitate the comfort adjustment of the temperature in the vehicle.

[0097] In some embodiments, considering that the temperature distribution can generally be Gaussian distribution, when the value of m satisfies: 1≤m≤3, for example, m=1 or m=2 or m=3, the adaptive threshold can include most of the regions, therefore, the value of m in the range of 1 to 3 can obtain better results, and the image processing workload is not too large.

[0098] FIG. 5 is a flowchart of determining a target human body part based on an adaptive threshold according to an embodiment of the present application, as shown in FIG. 5, which specifically includes:

[0099] S501, performing regional processing based on the preliminary region of interest, for example, performing regional processing based on the preliminary positioning results of the driver face position, the driver hand position, and the copilot face position.

[0100] S502, performing spatial mean μ and standard deviation σ processing on the pixel regions corresponding to the three regions of interest in the regional template library.

[0101] S503, obtaining an adaptive threshold: threshold=μ+m·σ, wherein m is an adjustable parameter, 1≤m≤3.

[0102] S504, respectively judging whether the pixel values of each region are greater than the adaptive threshold, if yes, proceeding to step S505, otherwise, proceeding to step S507.

[0103] S505, performing pixel point label marking.

[0104] S506, the region composed of the marked pixel points is the accurate positioning result, for example, outputting the accurate positioning results of the driver face position, the driver hand position, and the copilot face position.

[0105] S507, not marking the pixel points.

[0106] FIG. 6 is a schematic diagram of a target human body part according to an embodiment of the present application, wherein (1) in FIG. 6 is an infrared image in the vehicle, and (2) in FIG. 6 is a schematic diagram of a recognized target human body part.

[0107] The in-vehicle human body temperature tracking method of the embodiments of the present application can realize real-time extraction of the temperature of multiple parts of the human body from the image data video stream collected by the infrared thermal imager, and finally output the temperature change curve of the multiple parts of the human body changing with the in-vehicle environment, thereby providing data reference for intelligent control of the vehicle-mounted environmental regulation equipment such as the vehicle-mounted air conditioning system.

[0108] Based on the in-vehicle human body temperature tracking method of the above embodiments, the present application proposes an in-vehicle human body temperature tracking system.

[0109] Fig. 7 is a block diagram of an in-vehicle human body temperature tracking system according to an embodiment of the present application. As shown in Fig. 7, the in-vehicle human body temperature tracking system 1 comprises at least one infrared thermal imager 1001 and an infrared image processing device 1002.

[0110] The at least one infrared thermal imager 1001 is configured to acquire infrared images of the vehicle interior. For example, there can be one infrared thermal imager 1001, which is arranged in front of the driver seat or the front passenger seat or on the side of the vehicle interior, and which is configured to acquire infrared images of various positions in the vehicle interior. Alternatively, a plurality of infrared thermal imagers can be arranged at different positions in the vehicle interior to acquire infrared images of different regions in the vehicle interior.

[0111] The infrared image processing device 1002 is connected to the at least one infrared thermal imager 1001 and is configured to obtain temperature variation data of the target human body part of the human body in the vehicle interior according to the in-vehicle human body temperature tracking method of the above embodiments.

[0112] Further, the temperature variation data can be provided to a controller in the vehicle that needs to perform a control strategy based on the temperature of the human body, such as a vehicle-mounted air conditioner controller, so that the required temperature data can be provided for vehicle-related control.

[0113] According to the in-vehicle human body temperature tracking system 1 of the embodiments of the present application, the in-vehicle human body temperature tracking method of the above embodiments is performed by the infrared image processing device 1002, the human body part is preliminarily positioned by the partition template library to obtain a preliminary region of interest, and the target human body part in the preliminary region of interest is precisely positioned based on the adaptive threshold, which improves the temperature extraction accuracy and enables dynamic tracking of the temperature to obtain temperature variation data, thereby providing reliable, accurate and timely data for temperature-based vehicle control strategies.

[0114] Based on the human body temperature data obtained by the method of the above embodiments, analysis of the thermal comfort of the occupants can be performed, intelligent control of the vehicle-mounted air conditioner can be performed based on a human body thermal regulation model, the vehicle-mounted air conditioner can be made more intelligent, and the comfort of the vehicle interior cabin environment can be improved, which essentially innovates the intelligent air conditioner and redefines the standard of human body thermal comfort.

[0115] Fig. 8 is a flowchart of a vehicle-mounted air conditioner control method according to an embodiment of the present application. As shown in Fig. 8, the vehicle-mounted air conditioner control method comprises the following steps.

[0116] S101, obtaining vehicle-mounted air conditioner control data according to temperature variation data of a target human body part, wherein the temperature variation data of the target human body part is obtained according to the in-vehicle human body temperature tracking method of the above embodiments, and the specific obtaining process can refer to the description of the above examples, which will not be described here.

[0117] The conversion model or corresponding function or mapping relationship of the vehicle air conditioner control data and the temperature change data of the target human body part can be established, so as to determine the corresponding vehicle air conditioner control parameter based on the temperature change data.

[0118] In some embodiments, the vehicle air conditioner control data can include at least one of a vehicle air conditioner target temperature, a vehicle air conditioner compressor rotating speed, a blowing angle, and an air outlet opening degree.

[0119] In S102, the vehicle air conditioner is controlled to operate according to the vehicle air conditioner control data.

[0120] According to the vehicle air conditioner control method, the temperature change data of the target human body part is obtained by using the in-vehicle human body temperature tracking method, the data is more accurate and timely, and the vehicle air conditioner is controlled to operate according to the air conditioner control data determined based on the temperature change data of the target human body part, so that the in-vehicle thermal comfort can be improved.

[0121] The vehicle air conditioner control system according to an embodiment of the present application is described below with reference to FIG. 9.

[0122] FIG. 9 is a block diagram of a vehicle air conditioner control system according to an embodiment of the present application. As shown in FIG. 9, the vehicle air conditioner control system 110 includes a data acquisition device 111 and an air conditioner control device 112.

[0123] In some embodiments, the data acquisition device 111 can be configured to obtain vehicle air conditioner control data based on temperature change data of a target human body part, wherein the temperature change data of the target human body part is obtained based on the in-vehicle human body temperature tracking method described in the above embodiments.

[0124] In some embodiments, the air conditioner control device 112 is connected to the data acquisition device 111 and is configured to control the vehicle air conditioner to operate based on the vehicle air conditioner control data. The air conditioner control device 112 can include a control algorithm, a control logic, and a hardware device for executing a control command, and is configured to adjust the operating state of the air conditioner system based on the temperature change data of the target human body part, so as to provide more comfortable and effective temperature regulation.

[0125] According to the vehicle air conditioner control system 110, the temperature change data of the target human body part is obtained by using the vehicle air conditioner control method, the data is more accurate and timely, and the vehicle air conditioner is controlled to operate according to the air conditioner control data determined based on the temperature change data of the target human body part, so that the in-vehicle thermal comfort can be improved.

[0126] The electronic device 10 according to the fifth aspect of the present application includes at least one processor 11 and a memory 12 connected to the at least one processor 11 in communication.

[0127] The computer instructions stored in the memory 12 can be executed by the at least one processor 11 to implement the in-vehicle human body temperature tracking method of the above embodiments or the vehicle-mounted air conditioner control method of the above embodiments.

[0128] In an embodiment, the electronic device 10 can be a controller for controlling a vehicle-mounted environment adjustment device such as a vehicle-mounted air conditioner, or a mobile terminal, or a vehicle-mounted terminal, or a thermal management controller of a vehicle.

[0129] According to the electronic device 10 of the embodiments of the present application, by executing the in-vehicle human body temperature tracking method of the above embodiments or the vehicle-mounted air conditioner control method of the above embodiments, more accurate and real-time in-vehicle human body temperature data can be obtained, and the in-vehicle environment can be adjusted based on the data, thereby improving the in-vehicle thermal comfort.

[0130] The sixth aspect of the embodiments of the present application further provides a non-volatile readable storage medium having computer instructions stored thereon, and the computer instructions are executed to implement the in-vehicle human body temperature tracking method of the above embodiments or the vehicle-mounted air conditioner control method.

[0131] In an embodiment, the non-volatile readable storage medium can be a non-transitory storage medium, for example, including a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and the like, and can also be a transitory storage medium.

[0132] Based on the above embodiments, the seventh aspect of the embodiments of the present application further provides a vehicle.

[0133] As shown in FIG. 11, the vehicle 100 includes the electronic device 10 of the above embodiments.

[0134] Alternatively, as shown in FIG. 10, the vehicle 100 includes a vehicle-mounted infrared thermal imager 101 and a controller 102, the controller 102 is connected with the vehicle-mounted infrared thermal imager 101 and is configured to execute the in-vehicle human body temperature tracking method of the above embodiments.

[0135] According to the vehicle 100 of the embodiments of the present application, accurate and timely in-vehicle human body part temperature can be obtained, and the in-vehicle environment can be adjusted more effectively based on the temperature, thereby improving the in-vehicle environment thermal comfort.

[0136] As shown in FIG. 12, the vehicle 100 further comprises a vehicle air conditioner 103, the vehicle air conditioner 103 being connected with the controller 102, the controller 102 being further configured to obtain vehicle air conditioner control data according to the temperature change data of the target human body part, and control the vehicle air conditioner to operate according to the vehicle air conditioner control data, wherein the temperature change data of the target human body part is obtained according to the in-vehicle human body temperature tracking method of the above embodiment.

[0137] By using the in-vehicle human body temperature tracking method of the above embodiment to obtain the temperature change data of the target human body part, the data is more accurate and timely, and the air conditioner control parameter determined according to the temperature change data of the target human body part can control the vehicle air conditioner to operate more accurately and effectively, so as to adjust the in-vehicle temperature more accurately and effectively, and improve the in-vehicle thermal comfort.

[0138] In the description of the present specification, the description of the terms "one embodiment", "some embodiments", "exemplary embodiment", "example", "specific example" or "some examples" means that the specific features, structures, materials or characteristics described in connection with the embodiment or example are contained in at least one embodiment or example of the present application. In the present specification, the exemplary description of the above terms does not necessarily mean the same embodiment or example.

[0139] Although the embodiments of the present application have been shown and described, those skilled in the art can understand that various changes, modifications, replacements and variations can be made to the embodiments without departing from the principles and purposes of the present application, and the scope of the present application is defined by the claims and their equivalents.

Claims

1. An in-vehicle human body temperature tracking method, wherein, The method comprises: determining a preliminary region of interest in an infrared image of a vehicle interior according to a partition template library; determining a target human body part, the target human body part being a region of pixels in the preliminary region of interest with pixel values greater than a corresponding adaptive threshold; and obtaining temperature change data of the target human body part according to a plurality of continuous infrared images of the vehicle interior.

2. The in-vehicle human body temperature tracking method according to claim 1, wherein The partition template in the partition template library is an infrared image region including the target human body part constructed based on a position of a vehicle-mounted infrared thermal imager.

3. The in-vehicle human body temperature tracking method according to any one of claims 1-2, characterized in that, The adaptive threshold is obtained according to a current temperature of the preliminary region of interest.

4. The method according to claim 3, wherein The adaptive threshold is determined according to a current average temperature value of the preliminary region of interest, wherein the current average temperature value is obtained by spatially averaging and obtaining a standard deviation of a pixel region corresponding to the preliminary region of interest.

5. The in-vehicle human body temperature tracking method according to claim 4, wherein The adaptive threshold is obtained according to the mean value and the standard deviation.

6. The in-vehicle human body temperature tracking method according to claim 5, wherein The adaptive threshold is expressed as: threshold = μ + m·σ. wherein threshold is the adaptive threshold, μ is the mean value, σ is the standard deviation, and m is a constant.

7. The in-vehicle human body temperature tracking method according to claim 6, wherein The m is an adjustable constant.

8. The in-vehicle human body temperature tracking method according to claim 7, wherein The value of m satisfies: 1 ≤ m ≤ 3.

9. The in-vehicle human body temperature tracking method according to any one of claims 1-8, wherein, The temperature change data of the target human body part includes a change curve of an average temperature of the target human body part.

10. The in-vehicle human body temperature tracking method according to any one of claims 1-9, wherein, The target human body part includes at least one exposed part of a driver and / or at least one exposed part of a front passenger.

11. An in-vehicle human body temperature tracking system, wherein, The system comprises: at least one infrared thermal imager configured to collect infrared images of a vehicle interior; and an infrared image processing device connected to the at least one infrared thermal imager and configured to obtain temperature change data of a target human body part of a human body in the vehicle interior according to the method of tracking the temperature of a human body in a vehicle interior according to any one of claims 1-10.

12. A vehicle air-conditioning control method, wherein The method comprises: obtaining vehicle-mounted air conditioner control data according to temperature change data of a target human body part, wherein the temperature change data of the target human body part is obtained according to the method of tracking the temperature of a human body in a vehicle interior according to any one of claims 1-10; and controlling a vehicle-mounted air conditioner to operate according to the vehicle-mounted air conditioner control data.

13. The vehicle-mounted air conditioning control method according to claim 12, wherein The vehicle-mounted air conditioner control data includes at least one of a target temperature of the vehicle-mounted air conditioner, a rotation speed of a compressor of the vehicle-mounted air conditioner, and a blowing angle.

14. A vehicle air conditioning control system wherein, The system comprises: a data acquisition device configured to obtain vehicle-mounted air conditioner control data according to temperature change data of a target human body part, wherein the temperature change data of the target human body part is obtained according to the method of tracking the temperature of a human body in a vehicle interior according to any one of claims 1-10; and an air conditioner control device connected to the data acquisition device and configured to control a vehicle-mounted air conditioner to operate according to the vehicle-mounted air conditioner control data.

15. An electronic device, comprising: The system comprises: at least one processor; and a memory in communication connection with the at least one processor; the memory stores computer instructions executable by the at least one processor, and the at least one processor executes the computer instructions to implement the method of tracking the temperature of a human body in a vehicle interior according to any one of claims 1-10 or to implement the vehicle-mounted air conditioner control method according to claim 12 or 13.

16. A non-transitory readable storage medium having stored thereon computer instructions, wherein, The computer instructions, when executed, implement the in-vehicle human body temperature tracking method of any one of claims 1-10 or implement the in-vehicle air conditioner control method of claim 12 or 13.

17. A vehicle, wherein, The vehicle comprises the electronic device of claim 15. Alternatively, the vehicle comprises an in-vehicle infrared thermal imager and a controller connected with the in-vehicle infrared thermal imager, and the controller is configured to execute the in-vehicle human body temperature tracking method of any one of claims 1-10.

18. The vehicle of claim 17, wherein, The vehicle further comprises: an in-vehicle air conditioner connected with the controller, and the controller is further configured to obtain in-vehicle air conditioner control data according to the temperature change data of the target human body part, and control the in-vehicle air conditioner to operate according to the in-vehicle air conditioner control data, wherein the temperature change data of the target human body part is obtained according to the in-vehicle human body temperature tracking method.

Images