Passenger compartment temperature control method, and system and vehicle

Abstract

A passenger compartment temperature control method, and a system and a vehicle. The method comprises: receiving a temperature distribution heat map collected by an infrared imaging apparatus, and receiving an occupant image captured by a camera (step 200), wherein the occupant image refers to an image including an occupant in a passenger compartment; acquiring an actual body surface temperature of the occupant in the passenger compartment (step 210); and on the basis of the temperature distribution heat map, the occupant image and the actual body surface temperature, controlling an air output volume and / or an air output temperature at an air outlet in a temperature control region (step 220), wherein the air output volume and / or the air output temperature are / is used for adjusting the actual body surface temperature of the occupant to a target body surface temperature.

Description

A method, system and vehicle for controlling temperature in the passenger compartment

[0001] This application claims priority to Chinese Patent Application No. 202411725496.9, filed on November 28, 2024, entitled "A method, system and vehicle for controlling temperature in a passenger compartment", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of temperature control technology, and provides a method, system and vehicle for controlling the temperature of the passenger compartment. Background Technology

[0003] With the rapid development of the automotive industry and the increasing demands of consumers for automotive comfort, vehicles are gradually evolving into intelligent private spaces that integrate entertainment. As an important device for regulating the in-vehicle environment, automotive air conditioning is experiencing a growing demand for intelligence and personalization.

[0004] In related technologies, automotive air conditioning temperature control systems mainly rely on temperature sensors to detect the temperature inside the vehicle and control the airflow and temperature of the air conditioner according to the preset target temperature, so that the temperature inside the vehicle reaches the set temperature.

[0005] However, the above temperature control methods ignore the individual temperature sensitivity differences of passengers and the temperature differences in different locations in the passenger compartment, resulting in unsatisfactory temperature control effects and failing to meet the personalized needs of passengers.

[0006] Application content

[0007] In view of this, in order to solve the above-mentioned technical problems or some of the technical problems, this application provides a method for temperature control of the passenger cabin.

[0008] On one hand, this application provides a method for controlling the temperature of the passenger compartment, executed by a vehicle air conditioning controller, the method comprising:

[0009] The device receives a temperature distribution thermal map collected by an infrared imaging device, and receives images of the driver and passengers captured by a camera, wherein the images of the driver and passengers refer to images of the passenger compartment containing the driver and passengers.

[0010] Obtain the actual body surface temperature of the occupants inside the passenger compartment;

[0011] Based on the temperature distribution heat map, the image of the driver and passengers, and the actual body surface temperature, the air volume and / or air temperature of the air outlet in the temperature control area are controlled. The air volume and / or air temperature are used to adjust the actual body surface temperature of the driver and passengers to achieve the target body surface temperature.

[0012] In one possible embodiment, obtaining the actual body surface temperature of the occupants inside the passenger compartment includes:

[0013] The temperature distribution in the thermal image is synchronously transformed to the image of the driver and passengers;

[0014] Extract the target area containing the face of the driver / passenger from the image of the driver / passenger, and use the average temperature value of the target area as the actual body surface temperature of the driver / passenger.

[0015] In one possible embodiment, the method further includes:

[0016] Extract the target region, compare the target region with a pre-stored facial image, and determine the identity of the driver or passenger corresponding to the target region;

[0017] The target's body surface temperature is read based on the identity of the driver and passengers.

[0018] In one possible embodiment, the method further includes:

[0019] Determine the motion state of the occupants within the occupant compartment, the motion state being used to indicate the movement of the occupants within the occupant compartment;

[0020] When the motion state indicates that the driver or passenger is asleep, the target body surface temperature is set to a second target body surface temperature in the sleep state;

[0021] When the motion state indicates that the driver or passenger is in motion, the target body surface temperature is set as the first target body surface temperature;

[0022] Wherein, the second target body surface temperature of the driver or passenger is higher than or equal to the first target body surface temperature.

[0023] In one possible embodiment, the occupant image comprises n image frames that are sequentially arranged, and each image frame includes the facial region of the occupant, where n is a positive integer greater than 1.

[0024] The method further includes:

[0025] Determine the location of the facial region within the n image frames to obtain n facial positions;

[0026] Determine the closure status of the eyes within the facial region in the n image frames, wherein the closure status is used to indicate the closure state of the driver's eyes;

[0027] In response to the n facial positions being the same and the eyes being closed indicating a closed eye state, the movement state of the driver / passenger is determined to be sleep;

[0028] In response to the different facial positions of the n faces and / or the closed state of the eyes indicating an open state, the movement state of the driver or passenger is determined as the movement.

[0029] In one possible embodiment, the method further includes:

[0030] Determine the first facial region of the driver / passenger in the (i+1)th image frame, and determine the second facial region of the driver / passenger in the i-th image frame, where i is a positive integer greater than or equal to 1 and i+1 is less than or equal to n;

[0031] Based on the first facial region and the second facial region, the position change state of the driver / passenger in the passenger compartment is determined;

[0032] In response to the position change state indicating that the position of the driver or passenger has not changed, a first closure state of the driver or passenger's eyes in the first facial region is determined, and a second closure state of the driver or passenger's eyes in the first facial region and the second facial region is determined;

[0033] In response to both the first and second closure conditions indicating that the driver's eyes are closed, the counter's count value is incremented by a preset value; in response to the first and / or second closure conditions indicating that the driver's eyes are open, the counter's count value is reset to zero.

[0034] In response to the position change state indicating a change in the position of the driver or passenger, the counter value is reset to zero;

[0035] In response to the counter value reaching a target threshold, the movement state of the driver or passenger is determined to be sleep.

[0036] In one possible embodiment, the method further includes:

[0037] Based on the image of the driver and passenger, a third distance is determined from the facial area of ​​the driver and passenger to the air outlet;

[0038] Based on the third distance, adjust the air volume and / or the air temperature of the air outlet.

[0039] In one possible embodiment, determining the distance between the driver / passenger's facial region and the air vent based on the driver / passenger image includes:

[0040] Determine the first position of the center of the air outlet in the image of the driver and passengers;

[0041] Determine a second location of the facial region in the driver / passenger image;

[0042] The third distance is determined based on the first position and the second position.

[0043] On the other hand, embodiments of this application provide a passenger cabin temperature control device, the device comprising:

[0044] The receiving module is used to receive the temperature distribution thermal map collected by the infrared imaging device, and to receive the driver and passenger images captured by the camera, wherein the driver and passenger images refer to the images of the driver and passenger in the passenger compartment;

[0045] The acquisition module is used to acquire the actual body surface temperature of the occupants in the passenger compartment;

[0046] The control module is used to control the air volume and / or air temperature of the air outlet in the temperature control area based on the temperature distribution heat map, the image of the driver and passenger, and the actual body surface temperature. The air volume and / or air temperature are used to adjust the actual body surface temperature of the driver and passenger to achieve the target body surface temperature.

[0047] On the other hand, embodiments of this application provide a computer device, which includes a processor and a memory, wherein the memory stores at least one program, which is loaded and executed by the processor to implement the crew cabin temperature control method as described above.

[0048] On the other hand, embodiments of this application provide a computer-readable storage medium storing at least one segment of data, which is loaded and executed by a processor to implement the crew cabin temperature control method as described above.

[0049] On the other hand, embodiments of this application provide a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the occupant cabin temperature control method as described above.

[0050] On the other hand, embodiments of this application provide a passenger cabin temperature control system, the system comprising:

[0051] A vehicle seat, wherein a temperature control area is provided at the vehicle seat, and the temperature control area includes an air outlet;

[0052] An infrared imaging device is installed at the front of the vehicle and is used to collect a thermal map of the temperature distribution inside the passenger compartment of the vehicle.

[0053] The camera is positioned in front of the vehicle and is used to capture images of the occupants in the passenger compartment to obtain images of the occupants.

[0054] The vehicle air conditioning controller is used to adjust the air volume and / or air temperature of the air outlet based on the temperature distribution heat map, the image of the driver and passenger, and the actual body surface temperature of the driver and passenger, so as to make the actual body surface temperature of the driver and passenger reach the target body surface temperature.

[0055] On the other hand, this application provides a vehicle in which a passenger compartment temperature control system is integrated;

[0056] The crew cabin temperature control system includes:

[0057] A vehicle seat, wherein a temperature control area is provided at the vehicle seat, and the temperature control area includes an air outlet;

[0058] An infrared imaging device is installed at the front of the vehicle and is used to collect a thermal map of the temperature distribution inside the passenger compartment of the vehicle.

[0059] The camera is positioned in front of the vehicle and is used to capture images of the occupants in the passenger compartment to obtain images of the occupants.

[0060] The vehicle air conditioning controller is used to adjust the air volume and / or air temperature of the air outlet based on the temperature distribution heat map, the image of the driver and passenger, and the actual body surface temperature of the driver and passenger, so as to make the actual body surface temperature of the driver and passenger reach the target body surface temperature.

[0061] In this embodiment, the air volume and temperature of the air outlet in the temperature control zone of the passenger are controlled based on the actual body surface temperature of the passenger and the set target body surface temperature, so as to realize the zoned control of the temperature in the passenger cabin and better meet the personalized needs of users. Attached Figure Description

[0062] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0063] Figure 1 is a schematic diagram of the structure of a passenger cabin temperature control system provided in an exemplary embodiment of this application;

[0064] Figure 2 is a flowchart of a passenger cabin temperature control method provided in an exemplary embodiment of this application;

[0065] Figure 3 is a flowchart of a temperature control method for the passenger compartment provided in another exemplary embodiment of this application;

[0066] Figure 4 is a flowchart of a passenger cabin temperature control method provided in another exemplary embodiment of this application.

[0067] The accompanying drawings illustrate specific embodiments of this application, which will be described in more detail below. These drawings and descriptions are not intended to limit the scope of the concept in any way, but rather to illustrate the concept of this application to those skilled in the art through reference to particular embodiments. Detailed Implementation

[0068] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0069] Unless otherwise defined, all technical terms used in the embodiments of this application have the same meaning as commonly understood by one of ordinary skill in the art.

[0070] Figure 1 is a schematic diagram of the passenger cabin temperature control system provided in an embodiment of this application. For ease of explanation, only the parts related to the embodiment of this application are shown. The system includes:

[0071] The vehicle seats are equipped with a temperature-controlled area, which includes air vents.

[0072] Optionally, the vehicle includes multiple seats, each seat corresponds to a temperature control zone, and each temperature control zone is equipped with an air vent. That is, the vehicle includes multiple air vents 100.

[0073] An infrared imaging device 110 is installed at the front of the vehicle to collect a thermal map of the temperature distribution inside the passenger compartment. Schematic, the infrared imaging device is positioned at the front windshield or above the center rearview mirror to ensure coverage of the entire vehicle interior.

[0074] Camera 120 is positioned at the front of the vehicle to capture images of the occupants inside the vehicle's passenger compartment and obtain images of the occupants.

[0075] The vehicle air conditioning controller 130 is used to adjust the air volume and / or air temperature of the air outlet based on a temperature distribution heat map, an image of the driver and passengers, and the actual body surface temperature of the driver and passengers, so as to make the actual body surface temperature of the driver and passengers reach the target body surface temperature.

[0076] Optionally, the infrared imaging device 110 and the camera 120 establish a communication connection with the vehicle air conditioning controller 130. This communication connection can be a wireless communication connection or a wired communication connection, and this application does not limit it in this regard.

[0077] Figure 2 is a flowchart of a passenger compartment temperature control method provided in an exemplary embodiment of this application, which is executed by the vehicle air conditioning controller shown in Figure 1. The method includes the following steps, specifically steps 200 to 220.

[0078] Step 200: Receive the temperature distribution thermal map collected by the infrared imaging device, and receive the images of the driver and passengers captured by the camera.

[0079] Optionally, the infrared imaging device and camera are components installed inside the vehicle, and are positioned at the front of the vehicle, such as at the rearview mirror. In another optional embodiment, the infrared imaging device and camera may be positioned in the same or different locations, and this application is not limited thereto.

[0080] The infrared imaging device is used to collect infrared thermal images of the crew cabin to obtain temperature distribution thermal images.

[0081] Optionally, an infrared imaging device is a device that uses infrared thermal imaging technology to convert the infrared radiation energy emitted from the surface of the crew cabin into a visual temperature distribution heat map. The temperature distribution heat map uses different colors or grayscale to intuitively represent the temperature differences at various points on the surface of the crew cabin, thereby reflecting the temperature.

[0082] Optionally, the infrared imaging device takes itself as the starting point, collects infrared radiation emitted from each location in the crew cabin, focuses the infrared radiation onto the detector in the infrared imaging device, the detector converts the infrared radiation into an electrical signal, converts the electrical signal into a temperature matrix, and maps it to obtain a temperature distribution heat map.

[0083] The camera is used to capture images inside the passenger compartment. In this embodiment, the camera captures images of the occupants inside the passenger compartment to obtain occupant images; that is, the occupant images captured by the camera include the occupants.

[0084] Step 210: Obtain the actual body surface temperature of the occupants in the passenger compartment.

[0085] Optionally, actual body surface temperature refers to the real physical temperature felt by the skin surface of the driver or passenger.

[0086] In this embodiment of the application, the temperature distribution in the temperature distribution heat map is synchronously transformed into the image of the driver and passengers.

[0087] Extract the target area containing the driver's or passenger's face from the driver's or passenger's image, and use the average temperature value of the target area as the driver's or passenger's actual body surface temperature.

[0088] Based on the working principle of the infrared imaging device, the passenger compartment area and the passenger area captured in the image are determined. Combined with the temperature matrix determined by the infrared imaging device, the first temperature matrix corresponding to the passenger compartment area and the second temperature matrix corresponding to the passenger area are determined.

[0089] The first temperature matrix is ​​synchronously transformed into the image of the driver and passengers to obtain a thermal map of the driver and passengers area.

[0090] The second temperature matrix is ​​synchronously transformed into the crew cabin image to obtain a thermal map of the crew cabin area.

[0091] The image of the driver and passengers is formed by stitching together the images of the driver and passengers and the passenger compartment.

[0092] By fusing the thermal images of the driver and passenger areas and the passenger compartment area, a thermal image of the temperature distribution of the driver and passenger corresponding to the images of the driver and passenger is obtained.

[0093] In this embodiment of the application, multiple temperature values ​​contained in the first temperature matrix are obtained, and the multiple temperature values ​​are used to characterize the body surface temperature of the driver and passengers.

[0094] The actual body surface temperature of the driver and passengers is determined based on multiple temperature values.

[0095] Optionally, the average of multiple temperature values ​​can be used to determine the actual body surface temperature.

[0096] Optionally, the target area where the driver's face is located in the driver's image is extracted, the target temperature matrix corresponding to the target area is determined from the first temperature matrix, and the average value of multiple temperature values ​​in the target temperature matrix is ​​determined as the actual body surface temperature.

[0097] In some embodiments, an eye-based intelligent recognition model is used to extract (identify) the target region containing the driver's or passenger's face from an image of the driver or passenger.

[0098] In a schematic manner, an image of a driver or passenger is input into an eye-based intelligent recognition model. The model extracts facial features from the image and, in response to a match between the facial features and target eye features, identifies the region containing those facial features as the target region. The eye-based intelligent recognition model can be implemented using any type of artificial intelligence model, and this application does not limit its implementation.

[0099] In the above embodiments, by synchronously transforming the temperature distribution heat map with the image of the driver and passengers, the misalignment between temperature and pixels in the image caused by visual differences, lens distortion, or deviations in the installation position of components (infrared acquisition device and / or camera) is eliminated, ensuring that the subsequent determination of the actual body surface temperature applies to the actual area where the person is located, thereby improving the accuracy of determining the actual body surface temperature of the driver and passengers to a certain extent.

[0100] Step 220: Based on the temperature distribution heat map, the image of the driver and passengers, and the actual body surface temperature, control the air volume and / or air temperature of the air outlet in the temperature control area.

[0101] For illustrative purposes, the outlet air temperature refers to the air temperature delivered into the passenger compartment from the temperature-controlled area, and the outlet air volume refers to the air volume delivered into the passenger compartment from the temperature-controlled area.

[0102] Among them, the air volume and / or air temperature are used to adjust the actual body surface temperature of the driver and passengers to achieve the target body surface temperature.

[0103] In this application embodiment, the target body surface temperature refers to the temperature desired by the driver and passengers. The target body surface temperature can be preset by the driver and passengers or it can be a real-time temperature determined based on the ambient temperature and temperature distribution heat map. This application does not limit it in this way.

[0104] In some embodiments, a target region containing the driver's eyes is extracted from the driver's image, and the target region is compared with a pre-stored facial image to determine the identity of the driver corresponding to the target region.

[0105] The body surface temperature of the target is read based on the identity of the driver and passengers.

[0106] To illustrate, the vehicle stores a table that corresponds to the identity and temperature of the driver or passenger. This table records the correspondence between the driver or passenger, their facial image, and the desired interior temperature of the vehicle (which has the same meaning as the target body surface temperature).

[0107] The target region where the eyes of the driver and passenger are located in the driver and passenger image is determined by using an eye-based intelligent recognition model.

[0108] Determine whether the target region matches a facial image recorded in the aforementioned relationship table. In response to a match between the target region and a target facial image in the aforementioned relationship table, determine the identity of the driver or passenger matching the target facial image and the target's body surface temperature based on the aforementioned relationship table.

[0109] In the above embodiments, the extracted target area is compared with the locally stored face template, and the target body surface temperature corresponding to the driver and passenger is retrieved using a unique identity index. This enables the passenger cabin temperature control method provided in this application embodiment to accurately adapt to individual individuals, take into account individual differences, and improve the flexibility of temperature control adjustment.

[0110] In some embodiments, the ambient temperature of the vehicle's surroundings is obtained by a temperature sensor located outside the vehicle.

[0111] Based on ambient temperature and actual body surface temperature, the target body surface temperature required for the driver and passenger in the driver and passenger image is determined.

[0112] To illustrate, obtain the temperature matrix corresponding to the temperature distribution heatmap, and determine the maximum temperature value from the temperature matrix.

[0113] In response to a maximum temperature value being equal to or less than the actual body surface temperature, a first temperature value is determined as the target body surface temperature, wherein this process is used to cool down the occupants.

[0114] In response to a maximum temperature value being lower than the actual body surface temperature, this process is used to warm up the occupants.

[0115] In some embodiments, the motion state of the occupants in the passenger compartment is determined.

[0116] The motion status is used to indicate the movement of the occupants in the passenger compartment.

[0117] When the driver / passenger is indicated to be asleep during exercise, the target body surface temperature is set to the second target body surface temperature during sleep; when the driver / passenger is indicated to be active during exercise, the target body surface temperature is set to the first target body surface temperature; wherein the second target body surface temperature of the driver / passenger is higher than or equal to the first target body surface temperature.

[0118] That is, the state of drivers and passengers is divided into sleep and non-sleep (exercise) states. Combining the two different states of exercise, the desired target body surface temperature of drivers and passengers is divided into the first target body surface temperature in the active state and the second target body surface temperature in the sleep state. The second target body surface temperature of the same driver or passenger is generally higher than the first target body surface temperature.

[0119] In some embodiments, the first target body surface temperature and the second target body surface temperature are both personalized parameters preset by the driver or passenger. Alternatively, the second target body surface temperature is the temperature formed by increasing the first target body surface temperature by a specified temperature degree, or the first target body surface temperature is the temperature formed by decreasing the second target body surface temperature by a specified temperature reading.

[0120] Optionally, when occupants adjust the air conditioning temperature in the passenger compartment, their facial information is captured. The vehicle's air conditioning controller associates and stores this facial information with the adjusted air conditioning temperature, such as in the aforementioned relationship table. The next time an occupant enters the passenger compartment, a camera captures their image and sends it to the vehicle's air conditioning controller. The controller analyzes whether the image matches the relationship table. If the facial information matches the relationship table, the controller reads the target temperature corresponding to that facial information from the table and controls the airflow and / or air temperature at the vents to reach that target temperature.

[0121] Optionally, the vehicle establishes a communication connection with a smart terminal. Passengers register their facial information and input their desired target air conditioning temperature on the smart terminal, which stores the correspondence between the facial information and the target air conditioning temperature. When the smart terminal determines that the passenger is in the vehicle's usage scenario, it sends the facial information and the corresponding target air conditioning temperature to the vehicle's air conditioning controller. The vehicle's air conditioning controller then controls the airflow and / or air temperature at the vents to achieve the target air conditioning temperature.

[0122] The vehicle usage scenario refers to the situation in which the driver and passengers are driving the vehicle. The methods for determining whether the driver and passengers are in a vehicle usage scenario include, but are not limited to, at least one of the following methods.

[0123] The first method involves acquiring the usage mode of applications within the smart terminal. These applications offer multiple usage modes, each with different user habits, interface appearance, and control methods. One of these modes is a vehicle mode. When the application indicates vehicle mode, it confirms that the driver / passenger is in a vehicle-centric usage scenario. For example, if the smart terminal is running a music application currently in vehicle mode (where the audio source is connected to the vehicle), the smart terminal, upon confirming this mode, displays the air conditioning configuration interface. This interface prompts the driver / passenger to input facial information and the target air conditioning temperature. The interface includes facial input controls and temperature input controls. Upon receiving a touch operation on the facial input controls, the smart terminal's camera captures the driver / passenger's facial information. Similarly, upon receiving a touch operation on the temperature input controls, the target air conditioning information input by the driver / passenger is acquired.

[0124] The second method involves a speed sensor embedded in the smart terminal. The smart terminal acquires speed information collected by the sensor. Upon matching this speed information with a preset speed range (e.g., 40-100 km / h), it determines that the driver and passengers are in a vehicle usage scenario. After confirming the driver and passengers are in a vehicle usage scenario, the air conditioning configuration interface is displayed to complete the input of facial information and the target air conditioning temperature.

[0125] Schematic, as shown in Figure 3, Figure 3 illustrates a flowchart of a passenger compartment temperature control method provided by another exemplary embodiment. This flowchart includes detecting the movement state of occupants within the passenger compartment (step 300). In response to a movement state indicating movement, the current target body surface temperature is set to a first target body surface temperature (step 310); in response to a movement state indicating sleep, the current target body surface temperature is set to a second target body surface temperature (step 320). Steps 300 to 320 are performed by the vehicle; details are described above and will not be repeated here.

[0126] In the above embodiments, by judging the movement status of the occupants in the passenger cabin in real time and calling up the body surface temperature that is adapted to the movement status, on the one hand, it compensates for the natural decrease in body temperature caused by the decrease in metabolic rate during sleep, avoiding excessive cold stimulation; on the other hand, it prevents the risk of overheating due to metabolic heat generation during exercise, achieving precise matching between temperature and human metabolic needs, and improving the comfort of occupants during the ride / drive process to a certain extent.

[0127] In some embodiments, the specific process for determining the motion state of the driver and passengers is as follows.

[0128] Optionally, the occupant image includes n image frames, which are sequentially continuous. Each image frame includes the facial region of the occupant, where n is a positive integer greater than 1.

[0129] The locations of the facial regions within n image frames are determined, resulting in n facial locations.

[0130] Optionally, the position here refers to the relative position of the facial area with respect to the vehicle's center of gravity.

[0131] To illustrate, let's take one image frame out of n image frames as an example. We need to determine the facial area of ​​the occupant in that image frame, and also identify the in-vehicle components appearing in the image frame. These in-vehicle components refer to components within the vehicle's passenger compartment. In-vehicle components include seat belts, seat backs, window glass, etc.

[0132] Determine the first relative position between the facial region and the in-vehicle components in the image frame.

[0133] Obtain vehicle component information, which records the relative positional relationships between the various components that make up the vehicle.

[0134] Based on vehicle component information and the first relative position, the position of the driver and passengers relative to the vehicle's center of gravity is determined, namely, the aforementioned facial position.

[0135] Determine the eye closure status within n image frames for each facial region. The closure status indicates the eye closure state of the occupant. If n facial positions are identical and the eye closure status indicates a closed eye state, the occupant's motion state is determined to be sleeping. If n facial positions are different and / or the eye closure status indicates an open eye state, the occupant's motion state is determined to be moving.

[0136] In the above embodiments, the motion state of the driver and passengers is determined by combining the facial position and eye closure status of n consecutive frames, which improves the accuracy of motion state determination to a certain extent and provides reliable data support for subsequent temperature control strategies.

[0137] In another alternative embodiment, a first facial region of the occupant within the (i+1)th image frame is determined, and a second facial region of the occupant within the ith image frame is determined.

[0138] Based on the first and second facial regions, the positional change status of the occupants in the passenger compartment is determined.

[0139] Optionally, determine the first vehicle interior component contained in the (i+1)th image frame, and determine the second vehicle interior component contained in the ith image frame, where i is a positive integer greater than or equal to 1 and i+1 is less than or equal to n.

[0140] Identify the target in-vehicle component that is the same as the first in-vehicle component and the second in-vehicle component, determine the first distance between the target in-vehicle component and the facial region in the (i+1)th image frame, and determine the second distance between the target in-vehicle component and the facial region in the i-th image frame.

[0141] Based on the relationship between the first and second distances, the positional changes of the occupants in the passenger compartment are determined.

[0142] The position change status is used to indicate whether the position of the occupants in the passenger compartment has changed.

[0143] In response to the first distance being equal to the second distance, it is determined that the positions of the occupants in the passenger compartment have not changed.

[0144] In response to the unequal first and second distances, it is determined that the positions of the occupants in the passenger compartment have changed.

[0145] Optionally, in response to a position change state indication that the position of the driver or passenger has not changed, a first closure of the driver or passenger's eyes in a first facial area is determined, and a second closure of the driver or passenger's eyes in a second facial area is determined.

[0146] In response to both the first and second closed states indicating that the driver's eyes are closed, the counter's count is incremented by a preset value, which is 1. In response to a position change state indicating a change in the driver's position, the counter's count is reset to zero.

[0147] In response to the indication that the driver's or passenger's eyes are open in the first closed condition and / or the second closed condition, the counter value is reset to zero.

[0148] In response to the counter value reaching the target threshold, the occupant's motion state is determined to be asleep, where the target threshold is a preset value.

[0149] In the above embodiments, a facial region comparison mechanism between the i-th image frame and the (i+1)-th image frame is adopted. The count value is accumulated only when the position of the driver or passenger does not change and the eyes are closed in two consecutive frames. Once the position changes or the eyes are open in any image frame, the counter is immediately reset to zero. This avoids misjudgment of sleep state caused by the driver or passenger blinking or light interference when identifying a single image frame, thereby improving the accuracy of sleep state judgment to a certain extent and reducing the misjudgment rate.

[0150] Indicatively, the vehicle's air conditioning controller detects the movement of occupants based on images captured by a camera. If the occupant's pose in the image remains unchanged across several consecutive frames, and their eyes are closed, the occupant is considered to be asleep. Otherwise, the occupant is considered to be in motion. The process of determining the sleep state includes the following steps S1 to S4.

[0151] S1. Compare the currently acquired driver and passenger image with the previous driver and passenger image to detect whether the driver and passenger's position in the image has changed.

[0152] S2. For occupants whose positions have not changed, proceed to step S3; for occupants whose positions have changed, reset the counter to zero and proceed to step S1.

[0153] S3. Detect whether the driver or passenger is in a closed-eye state. If the detection result is yes, increment the counter value by 1 and then execute the following step S4; if the detection result is no, reset the counter value to zero and execute the above step S1.

[0154] S4. If the counter value reaches the set counting threshold N (N is a positive integer), the corresponding driver or passenger is considered to be asleep.

[0155] The vehicle air conditioning controller periodically detects the movement status of the occupants in the passenger compartment. After the current detection time of the occupant's movement status, if the position of the occupant remains basically unchanged in N+1 consecutive occupant image frames during the subsequent detection period, the corresponding occupant is considered to be in a sleep state.

[0156] The system determines the target body surface temperature of each driver and passenger based on their movement status. The target body surface temperature will adapt to changes in the movement status of the driver and passengers. For example, if a child in the back seat falls asleep after playing for a while, the air volume and temperature of the air outlet in the temperature control area will adapt to change so that the child's actual body surface temperature is at the target body surface temperature corresponding to the two movement statuses, which greatly improves the user's comfort.

[0157] In this embodiment, a pose transformation T is pre-completed between the temperature distribution thermal image acquired by the infrared imaging device and the image of the driver and passengers acquired by the camera. After receiving the temperature distribution thermal image acquired by the infrared imaging device, the vehicle air conditioning controller transforms the temperature distribution in the thermal image to the driver and passenger image based on the pose transformation T. Target areas on the faces of each driver and passenger are extracted from the driver and passenger image, and the average temperature of the target area is used as the corresponding driver and passenger's body surface temperature. In this embodiment, a rectangular area is established centered on the breathing point (nose) on the face of each driver and passenger. This rectangular area is the target area, with a length of 300mm and a width of 200mm.

[0158] In this embodiment of the application, after receiving the driver and passenger image, the vehicle air conditioning controller extracts the facial image of each driver and passenger in the driver and passenger image, compares the facial image with the stored facial image to determine the identity of the driver and passenger corresponding to the facial image, and reads the target parameters set by the corresponding driver and passenger, including the target body surface temperature.

[0159] The vehicle air conditioning controller stores a personalized parameter table, which records the identity identifier of the driver and passenger, the link address of the facial image corresponding to the identity identifier, and the personalized parameters set by the driver and passenger corresponding to the identity identifier, including the target body surface temperature. The facial image of the driver and passenger is stored in the vehicle's storage unit. The storage unit can be integrated into the vehicle air conditioning controller or set independently of the vehicle air conditioning controller. This application does not limit this.

[0160] In this embodiment of the application, when the infrared imaging device and camera collect thermal images of the temperature distribution and images of the occupants in the passenger compartment, if the faces of the occupants are in a deflected state, it is impossible to extract complete facial images or only partial facial images from the occupant images. This means that it may be impossible to obtain the complete target area or to identify the occupants. Therefore, it is impossible to determine the actual body surface temperature and target body surface temperature of the occupants. Since the sampling frequency of the infrared imaging device and camera is high and the time difference between the current moment and the previous moment is very small, the actual body surface temperature and target body surface temperature of the occupants at the previous moment are used as the actual body surface temperature and target body surface temperature of the occupants at the current moment.

[0161] Figure 4 is a flowchart of a passenger cabin temperature control method provided in another exemplary embodiment of this application. This embodiment further includes the following steps based on the technical solutions involved in the above embodiments.

[0162] Step 400: Based on the driver and passenger images, determine the third distance between the driver and passenger's facial area and the air outlet.

[0163] Optionally, a first position of the air vent center in the occupant image is determined, and a second position of the facial region in the occupant image is determined. A third distance is determined based on the first and second positions.

[0164] Indicatively, identify in-vehicle components in images of drivers and passengers.

[0165] The distance between the interior components and the center of the air vent in the image of the driver and passengers is determined as the first position.

[0166] The distance between the vehicle interior components and the facial area in the image of the driver and passengers is determined as the second location.

[0167] In an optional embodiment, the above distance determination process can be determined using an artificial intelligence model, which is trained to predict the actual distance between two points in an image. The specific training process is consistent with the training methods in conventional application scenarios and will not be described in detail here.

[0168] The third distance is determined based on the first and second positions.

[0169] Schematic, obtaining vehicle component information of the vehicle, which records the relative positional relationships between the various components that make up the vehicle.

[0170] Based on the vehicle component information, a fourth distance between the in-vehicle components and the vehicle's center of gravity is determined.

[0171] Based on the first position, the second position, and the fourth distance, a third distance is determined. Illustratively, a first absolute value of the difference between the first position and the fourth distance is determined, and a second absolute value of the difference between the second position and the fourth distance is determined; the absolute value of the difference between the first and second absolute values ​​is then defined as the third distance.

[0172] Step 410: Adjust the air volume and / or air temperature of the air outlet according to the third distance.

[0173] Optionally, based on images of drivers and passengers captured by a camera, the distance between the driver's or passenger's face and the air outlet in their temperature-controlled area can be detected, and the air volume and temperature of the air outlet in their temperature-controlled area can be adjusted based on this distance.

[0174] In this embodiment of the application, the vehicle air conditioning controller stores a mapping table of air volume and air temperature under different temperature differences and different distances. The mapping table is obtained by vehicle calibration. Different temperature differences and distances are combined into a series of calibration points. Under the operating conditions corresponding to each calibration point, the air temperature under different air volume is calibrated, thereby forming the above mapping table.

[0175] Optionally, when the distance between the driver / passenger and the air vent is less than the target distance threshold, the airflow from the vent will be reduced to improve the user's driving experience and prevent large amounts of cold or hot air from blowing directly onto the user's face, causing discomfort. Furthermore, the aforementioned temperature difference is the difference between the driver / passenger's actual body surface temperature and the current target body surface temperature. When the distance between the driver / passenger and the air vent is greater than the target distance threshold, the airflow from the vent will be increased.

[0176] In some embodiments, the vehicle includes multiple seats, each with a corresponding temperature control zone. The location of the temperature control zone varies depending on the seat. For example, the temperature control zone for the driver's seat is located near the steering wheel, while the temperature control zones for the rear seats are located in the door area.

[0177] After receiving the images of the driver and passengers, the images are analyzed and extracted to determine the location of the target vehicle where the driver and passengers are located. The target vehicle location includes at least one of the following: driver's seat, front passenger seat, left rear seat, middle rear seat, and right rear seat.

[0178] Identify the target temperature control zone that matches the target vehicle location, and control the airflow and / or air temperature of the air outlet in the target temperature control zone so that the actual body surface temperature of the driver and passengers reaches the target body surface temperature.

[0179] Optionally, the airflow and / or air temperature at the outlet of the temperature-controlled zone can be controlled to maintain the target body surface temperature of the occupants for the required duration. Different temperature-controlled zones correspond to different target durations.

[0180] If the center of the temperature control zone is on the same horizontal plane as the center of the driver's or passenger's face (including horizontal planes parallel to the ground and horizontal planes perpendicular to the ground), the target duration is increased to delay the time required for the driver's or passenger's actual body surface temperature to reach the target body surface temperature.

[0181] If the center of the temperature control area is not on the same horizontal plane as the center of the driver's or passenger's face, reduce the target time and accelerate the time required for the driver's or passenger's actual body surface temperature to reach the target icon temperature.

[0182] In some embodiments, the target vehicle location of the occupant is determined, and the corresponding temperature control zone is determined. The center of the occupant's face is determined from the occupant image. The relative position of the face center with respect to the vehicle's center of gravity is determined (the process for determining the relative position is described above). Then, in conjunction with the temperature control zone corresponding to the target vehicle location, the distance between the face center and the center of the temperature control zone is determined. Subsequently, the airflow volume and / or airflow temperature of the air vents are adjusted based on this distance.

[0183] This application also provides a passenger cabin temperature control device, which includes the following components.

[0184] The receiving module is used to receive the temperature distribution thermal map collected by the infrared imaging device, and to receive the driver and passenger images captured by the camera, wherein the driver and passenger images refer to the images of the driver and passenger in the passenger compartment;

[0185] The acquisition module is used to acquire the actual body surface temperature of the occupants in the passenger compartment;

[0186] The control module is used to control the air volume and / or air temperature of the air outlet in the temperature control area based on the temperature distribution heat map, the image of the driver and passenger, and the actual body surface temperature. The air volume and / or air temperature are used to adjust the actual body surface temperature of the driver and passenger to achieve the target body surface temperature.

[0187] In this embodiment, the air volume and temperature of the air outlet in the temperature control zone of the passenger are controlled based on the actual body surface temperature of the passenger and the set target body surface temperature, so as to realize the zoned control of the temperature in the passenger cabin and better meet the personalized needs of users.

[0188] In this embodiment, the above-mentioned passenger compartment temperature control method is executed by a computer device; that is, the above-mentioned passenger compartment temperature control device is implemented as the computer device. Optionally, the computer device can be implemented as a mobile device, such as a vehicle-mounted terminal or other portable smart terminal. Typically, the computer device includes a processor and a memory.

[0189] The processor can be implemented in at least one of the following hardware forms: DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), and PLA (Programmable Logic Array).

[0190] The memory may include one or more computer-readable storage media, which may be non-transitory. The memory may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory are used to store at least one instruction, which is executed by a processor to implement the cabin temperature control method provided in the method embodiments of this application.

[0191] This application also provides a computer-readable storage medium storing at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the vehicle passenger compartment temperature control method provided in the above method embodiments.

[0192] This application provides a computer program product or computer program that includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the passenger compartment temperature control method provided in the above-described method embodiments.

[0193] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware, or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk. The above descriptions are merely optional embodiments of this application and are not intended to limit the application. Any modifications, equivalent substitutions, or improvements made within the spirit and principles of this application should be included within the scope of protection of this application.

[0194] This application also provides a vehicle that integrates the above-mentioned passenger compartment temperature control system. The passenger compartment temperature control system controls the air volume and air temperature of the air outlets in each temperature control zone in the passenger compartment in real time based on the personalized parameters set by the driver and passengers, so that the actual body surface temperature of the driver and passengers in the temperature control zone reaches the target body surface temperature under the current state.

[0195] Other embodiments of this application will readily occur to those skilled in the art upon consideration of the specification and practice of the application disclosed herein. This application is intended to cover any variations, uses, or adaptations of this application that follow the general principles of this application and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only.

[0196] It should be understood that this application is not limited to the precise structure described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope.

Claims

1. A method for controlling the temperature of a passenger compartment, executed by a vehicle air conditioning controller, the method comprising: The device receives a temperature distribution thermal map collected by an infrared imaging device, and receives images of the driver and passengers captured by a camera, wherein the images of the driver and passengers refer to images of the passenger compartment containing the driver and passengers. Obtain the actual body surface temperature of the occupants inside the passenger compartment; Based on the temperature distribution heat map, the image of the driver and passengers, and the actual body surface temperature, the air volume and / or air temperature of the air outlet in the temperature control area are controlled. The air volume and / or air temperature are used to adjust the actual body surface temperature of the driver and passengers to achieve the target body surface temperature.

2. The method according to claim 1, wherein, The process of obtaining the actual body surface temperature of the occupants inside the passenger compartment includes: The temperature distribution in the temperature distribution heatmap is synchronously transformed into the image of the driver and passengers; Extract the target area containing the face of the driver / passenger from the image of the driver / passenger, and use the average temperature value of the target area as the actual body surface temperature of the driver / passenger.

3. The method according to claim 1 or 2, wherein, The method further includes: The target region is extracted from the image of the driver and passenger, and the target region is compared with a pre-stored facial image to determine the identity of the driver and passenger corresponding to the target region; The target's body surface temperature is read based on the identity of the driver and passengers.

4. The method according to any one of claims 1 to 3, wherein, The method further includes: Determine the motion state of the occupants within the occupant compartment, the motion state being used to indicate the movement of the occupants within the occupant compartment; When the motion state indicates that the driver or passenger is asleep, the target body surface temperature is set to a second target body surface temperature in the sleep state; When the motion state indicates that the driver or passenger is in motion, the target body surface temperature is set as the first target body surface temperature; Wherein, the second target body surface temperature of the driver or passenger is higher than or equal to the first target body surface temperature.

5. The method according to any one of claims 1 to 4, wherein, The driver and passenger image includes n image frames, which are sequential in time. Each image frame includes the facial region of the driver and passenger, where n is a positive integer greater than 1. The method further includes: Determine the location of the facial region within the n image frames to obtain n facial positions; Determine the closure status of the eyes within the facial region in the n image frames, wherein the closure status is used to indicate the closure state of the driver's eyes; In response to the n facial positions being the same and the eyes being closed indicating a closed eye state, the movement state of the driver / passenger is determined to be sleep; In response to the different facial positions of the n faces and / or the closed state of the eyes indicating an open state, the movement state of the driver or passenger is determined as the movement.

6. The method according to any one of claims 1 to 5, wherein, The method further includes: Determine the first facial region of the driver / passenger in the (i+1)th image frame, and determine the second facial region of the driver / passenger in the i-th image frame, where i is a positive integer greater than or equal to 1 and i+1 is less than or equal to n; Based on the first facial region and the second facial region, the position change state of the driver / passenger in the passenger compartment is determined; In response to the position change state indicating that the position of the driver or passenger has not changed, a first closure state of the driver or passenger's eyes in the first facial region is determined, and a second closure state of the driver or passenger's eyes in the first facial region and the second facial region is determined; In response to both the first and second closure conditions indicating that the driver's eyes are closed, the counter's count value is incremented by a preset value; in response to the first and / or second closure conditions indicating that the driver's eyes are open, the counter's count value is reset to zero. In response to the position change state indicating a change in the position of the driver or passenger, the counter value is reset to zero; In response to the counter value reaching a target threshold, the movement state of the driver or passenger is determined to be sleep.

7. The method according to any one of claims 1 to 6, wherein, The method further includes: Based on the image of the driver and passenger, a third distance is determined from the facial area of ​​the driver and passenger to the air outlet; Based on the third distance, adjust the air volume and / or the air temperature of the air outlet.

8. The method according to any one of claims 1 to 7, wherein, Determining the distance between the driver / passenger's facial area and the air vent based on the driver / passenger image includes: Determine the first position of the center of the air outlet in the image of the driver and passengers; Determine a second location of the facial region in the driver / passenger image; The third distance is determined based on the first position and the second position.

9. A passenger compartment temperature control system, the system being integrated into a vehicle, the system comprising: A vehicle seat, wherein a temperature control area is provided at the vehicle seat, and the temperature control area includes an air outlet; An infrared imaging device is installed at the front of the vehicle and is used to collect a thermal map of the temperature distribution inside the passenger compartment of the vehicle. The camera is positioned in front of the vehicle and is used to capture images of the occupants in the passenger compartment to obtain images of the occupants. The vehicle air conditioning controller is used to adjust the air volume and / or air temperature of the air outlet based on the temperature distribution heat map, the image of the driver and passenger, and the actual body surface temperature of the driver and passenger, so as to make the actual body surface temperature of the driver and passenger reach the target body surface temperature.

10. A vehicle, said vehicle integrating a passenger compartment temperature control system; The crew cabin temperature control system includes: A vehicle seat, wherein a temperature control area is provided at the vehicle seat, and the temperature control area includes an air outlet; An infrared imaging device is installed at the front of the vehicle and is used to collect a thermal map of the temperature distribution inside the passenger compartment of the vehicle. The camera is positioned in front of the vehicle and is used to capture images of the occupants in the passenger compartment to obtain images of the occupants. The vehicle air conditioning controller is used to adjust the air volume and / or air temperature of the air outlet based on the temperature distribution heat map, the image of the driver and passenger, and the actual body surface temperature of the driver and passenger, so as to make the actual body surface temperature of the driver and passenger reach the target body surface temperature.

Images