Cooperative control method and device for vehicles, electronic equipment and medium

The driver's face feature information is obtained through the induction camera and the internal equipment of the car cockpit is automatically adjusted, which solves the problem of manual adjustment in the prior art that it is time-consuming and difficult to achieve the best state, and improves driving comfort and safety.

CN119078616AActive Publication Date: 2024-12-06CHINA FAW CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202411121297.7
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-15
Publication Date
2024-12-06
Estimated Expiration
2044-08-15

AI Technical Summary

Technical Problem

The adjustment of the internal equipment of the existing car cockpit needs to be manually adjusted one by one, which is time-consuming and difficult to ensure the best condition, affecting driving comfort and safety.

Method used

By receiving the driver's face feature information obtained by the induction camera, judging and retrieving corresponding adjustment data, and automatically adjusting the seat, inner rearview mirror and air outlet baffle to adapt to the driver's personal preferences.

Benefits of technology

It realizes adaptive adjustment of the cockpit environment, improves the driver's comfort and safety, and reduces the cumbersomeness and time of manual adjustment.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119078616A_ABST
    Figure CN119078616A_ABST
Patent Text Reader

Abstract

The invention provides a cooperative control method and device of a vehicle, electronic equipment and a medium, and the method comprises the steps: receiving face feature information of a driver, which is obtained by an induction camera; judging whether the face feature information of the driver is stored in a face feature storage library of the vehicle or not; if the face feature information of the driver is stored, first adjustment data corresponding to the face feature information of the driver is called, and a cab of the vehicle is adjusted according to the first adjustment data; and if the face feature information of the driver does not exist, calculating second adjustment data according to the seat position data adjusted by the driver, and adjusting the cockpit according to the second adjustment data. The second adjustment data is calculated according to the seat position data adjusted by the driver, so that self-adaptive adjustment of the cockpit is achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of vehicle intelligent control technology, and more specifically, to a vehicle collaborative control method, device, electronic device and medium. Background Art

[0002] Modern car cockpits integrate increasingly rich functions, aiming to fully meet passengers' high standards of comfort. The appropriate cockpit environment can not only provide drivers with a comfortable driving experience, but also improve driving safety.

[0003] However, the current method of adjusting the equipment inside the cockpit requires manual adjustments one by one based on the current driver's personal intuitive feelings every time the driver is changed, which is particularly cumbersome and time-consuming, and it is difficult to ensure that each adjustment can reach the optimal state, thus affecting driving comfort and safety. Summary of the invention

[0004] In view of this, the purpose of the present application is to provide a vehicle collaborative control method, device, electronic device and medium to overcome the above-mentioned problem that different devices inside the cabin need to be manually adjusted one by one.

[0005] In a first aspect, the present application provides a method for collaborative control of a vehicle, the method comprising: receiving facial feature information of a driver obtained from a sensing camera; determining whether the facial feature information of the driver is stored in a facial feature storage repository of the vehicle; if the facial feature information of the driver is stored, retrieving first adjustment data corresponding to the facial feature information of the driver to adjust the cockpit of the vehicle according to the first adjustment data; if the facial feature information of the driver is not stored, calculating second adjustment data according to seat position data adjusted by the driver, and adjusting the cockpit according to the second adjustment data.

[0006] In a possible implementation manner, the second adjustment data includes a first adjustment angle value of the interior rearview mirror of the vehicle, wherein the second adjustment data is calculated according to the seat position data adjusted by the driver, and the step of adjusting the cockpit according to the second adjustment data includes: obtaining the seat position data of the driver adjusting the driving seat, and controlling the sensing camera to capture the facial feature information of the driver after the driver adjusts the driving seat; determining the eye point in the facial feature information of the driver after the driver adjusts the driving seat, wherein the eye point is the coordinate of the center point of the driver's eyeball; taking the center point of the sensing camera as the coordinate origin, obtaining the interior rearview mirror of the vehicle. A first normal vector of the center point of the mirror surface of the mirror; calculating a first angle value between a first vector and the first normal vector, the first vector refers to a vector from the eye point to the center point of the mirror surface; calculating a second angle value between a second vector and the first normal vector, the second vector refers to a vector from the center point of the mirror surface to the center point of the rear windshield of the vehicle; controlling the interior rearview mirror to rotate so that the first angle value is equal to the second angle value; calculating a second normal vector of the center point of the mirror surface of the rotated interior rearview mirror; calculating a first adjustment angle value between the second normal vector and the first normal vector; and according to the first adjustment angle, controlling the interior rearview mirror to rotate to adjust the cockpit.

[0007] In a possible embodiment, according to the first adjustment angle value, the step of controlling the rotation of the rearview mirror to adjust the cockpit includes: mapping the first adjustment angle value to a three-dimensional coordinate system with the center point of the sensing camera as the coordinate origin, and obtaining an adjustment target value in the three-dimensional coordinate system; according to the current position of the rearview mirror and the adjustment target value, determining a first rotation angle value of the rearview mirror around a first coordinate axis of the three-dimensional coordinate system, a second rotation angle value around a second coordinate axis of the three-dimensional coordinate system, and a third rotation angle value around a third coordinate axis of the three-dimensional coordinate system; according to the first rotation angle value, the second rotation angle value, and the third rotation angle value, calculating the number of rotations required for the motor to control the rearview mirror to rotate to the first adjustment angle value; and controlling the motor to rotate the number of rotations to rotate the rearview mirror to the first adjustment angle value.

[0008] In a possible embodiment, the second adjustment data also includes a second adjustment angle value of a baffle of the air outlet located at the control panel of the vehicle, wherein the second adjustment data is calculated based on the seat position data adjusted by the driver, and the step of adjusting the cockpit based on the second adjustment data includes: determining the highest point in the facial feature information of the driver after the driver adjusts the driving seat; taking the center point of the sensing camera as the coordinate origin, obtaining a third normal vector of the center point of the air outlet; calculating a second adjustment angle value between the third vector and the third normal vector, the third vector referring to a vector from the highest point to the center point of the baffle; and according to the second adjustment angle value, controlling the baffle to rotate to adjust the cockpit.

[0009] In a possible embodiment, according to the second adjustment angle value, the step of controlling the baffle to rotate to adjust the cockpit includes: receiving a first start signal for starting the air conditioner; in response to the first start signal, controlling the start of the air conditioner of the vehicle; judging the working state of the air conditioner, the working state including the cooling state and the heating state; if the working state of the air conditioner is the cooling state, controlling the baffle to rotate in the first direction to the second adjustment angle value to discharge air from below the air outlet; if the working state of the air conditioner is the heating state, controlling the baffle to rotate in the second direction to the second adjustment angle value to discharge air from above the air outlet, the second direction being opposite to the first direction.

[0010] In a possible implementation, the step of receiving facial feature information of the driver obtained from a sensing camera includes: receiving a second start signal for starting the sensing camera; controlling the sensing camera to start in response to the second start signal; receiving a light signal sent by a light sensor, and determining whether the light intensity in the vehicle reaches an intensity threshold based on the light signal; if the intensity threshold is not reached, controlling the infrared lighting to start; sending a shooting signal to the sensing camera to control the sensing camera to capture the facial feature information of the driver under the illumination of the infrared lighting; if the intensity threshold is reached, directly sending the shooting signal to the sensing camera to control the sensing camera to capture the facial feature information of the driver.

[0011] In a possible implementation, the method further includes: when the facial feature information of the driver is not stored, obtaining the steering wheel position data adjusted by the driver; using the steering wheel position data as the third adjustment data corresponding to the driver; and storing the facial feature information of the driver and the corresponding second adjustment data and third adjustment data in the facial feature storage library.

[0012] In a second aspect, the present application provides a collaborative control device for a vehicle, the device comprising: a receiving module, receiving facial feature information of a driver obtained from a sensing camera; a judging module, judging whether the facial feature information of the driver is stored in a facial feature storage repository of the vehicle; a retrieving module, if the facial feature information of the driver is stored, retrieving first adjustment data corresponding to the facial feature information of the driver, so as to adjust the cockpit of the vehicle according to the first adjustment data; a calculating module, if the facial feature information of the driver is not stored, calculating second adjustment data according to the seat position data adjusted by the driver, and adjusting the cockpit according to the second adjustment data.

[0013] In the third aspect, the present application also provides an electronic device, comprising: a processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate through the bus, and when the machine-readable instructions are executed by the processor, the steps of a vehicle collaborative control method as described above are performed.

[0014] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of a vehicle cooperative control method as described above are executed.

[0015] The present application provides a method, device, electronic device and medium for cooperative control of a vehicle, wherein the method comprises: receiving facial feature information of a driver obtained from a sensing camera; determining whether the facial feature information of the driver is stored in the facial feature storage of the vehicle; if the facial feature information of the driver is stored, retrieving first adjustment data corresponding to the facial feature information of the driver, so as to adjust the cockpit of the vehicle according to the first adjustment data; if there is no facial feature information of the driver, calculating second adjustment data according to the seat position data adjusted by the driver, and adjusting the cockpit according to the second adjustment data. The present application calculates the second adjustment data through the seat position data adjusted by the driver to achieve adaptive adjustment of the cockpit.

[0016] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are specifically cited below and described in detail with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments will be briefly introduced below. It should be understood that the following drawings only show certain embodiments of the present application and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0018] Figure 1 A flowchart of a vehicle cooperative control method provided in an embodiment of the present application;

[0019] Figure 2 A flowchart of a collaborative control method for an interior rearview mirror provided in an embodiment of the present application;

[0020] Figure 3 A flowchart of a cockpit collaborative control method provided in an embodiment of the present application;

[0021] Figure 4 A flow chart of a coordinated control method of an air outlet baffle provided in an embodiment of the present application;

[0022] Figure 5 A flowchart of another cockpit collaborative control method provided in an embodiment of the present application;

[0023] Figure 6 A flowchart for obtaining driver facial feature information provided in an embodiment of the present application;

[0024] Figure 7 A flowchart of another vehicle cooperative control method provided in an embodiment of the present application;

[0025] Figure 8 A schematic diagram of the structure of a vehicle cooperative control device provided in an embodiment of the present application;

[0026] Fig. 9 A schematic diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0027] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0028] In order to enable those skilled in the art to use the contents of this application, the following implementation methods are given in combination with the specific application scenario "vehicle intelligent control technology". For those skilled in the art, the general principles defined here can be applied to other embodiments and application scenarios without departing from the spirit and scope of this application.

[0029] It is worth noting that before the present application was filed, the adjustment of the internal equipment of the car cabin mostly relied on the driver to make tedious manual adjustments one by one based on his personal intuitive feelings, and every time the driver was changed, the entire adjustment process had to start from scratch, which was not only time-consuming and labor-intensive, but also often lacked unified standards and accurate data support, resulting in the adjustment results being difficult to achieve the optimal comfort state for each driver. In addition, different drivers have different subjective feelings about comfort, and the errors that may exist in the manual adjustment process may make the cockpit environment after each adjustment different, which in turn affects the driving comfort and safety.

[0030] Based on this, the embodiments of the present application provide a vehicle collaborative control method, device, electronic device and medium to solve the problem in the prior art that different devices inside the cabin need to be manually adjusted one by one.

[0031] The defects existing in the above solutions are the results obtained by the inventor after practice and careful research. Therefore, the process of discovering the above problems and the solutions proposed by this application for the above problems below should be the contributions made by the inventor to this application during the application process.

[0032] The technical solutions in the present application will be clearly and completely described below in conjunction with the drawings in the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the present application generally described and shown in the drawings here can be arranged and designed in various different configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the present application for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0033] It should be noted that similar reference numerals and letters denote similar items in the following drawings, and therefore, once an item is defined in one drawing, further definition and explanation thereof is not required in subsequent drawings.

[0034] To facilitate understanding of the present application, the technical solution provided by the present application is described in detail below in conjunction with specific embodiments. Figure 1 As shown, Figure 1A flowchart of a vehicle cooperative control method provided in an embodiment of the present application. Figure 1 The cooperative control method of a vehicle shown is integrated and executed in an on-board controller of the vehicle.

[0035] like Figure 1 As shown, in step S101, facial feature information of the driver obtained from a sensing camera is received.

[0036] Specifically, the sensing camera can be a driver status monitoring (DMS) camera, which can be installed on the dashboard so that the DMS camera can fully capture the driver's face. The DMS camera can integrate a high-precision image sensor, which can quickly capture the driver's facial feature information and directly convert it into an electrical signal that is easy for digital devices to process. After the conversion is completed, the image signal acquisition circuit efficiently collects data from the image sensor and passes it to the video decoding circuit. The video decoding circuit accurately converts the analog image signal into a digital signal. Finally, these processed digital signals are transmitted to the computing unit for further analysis and judgment.

[0037] In step S102, it is determined whether the facial feature information of the driver is stored in the facial feature storage library of the vehicle.

[0038] Specifically, the operation unit determines whether there is memory information in the facial feature storage based on the processed digital signal. The facial feature storage is a database for storing pre-entered facial feature information and its corresponding identity information. The facial feature information in the facial feature storage may include data in multiple dimensions, such as geometric parameters of facial contours, relative positions of facial features, and texture features of skin. After receiving the processed digital signal, the operation unit extracts the driver's facial feature information from it. Then, the facial feature information is compared with the memory information in the facial feature storage.

[0039] If the facial feature information of the driver is stored, step S103 is executed: first adjustment data corresponding to the facial feature information of the driver is retrieved to adjust the cockpit of the vehicle according to the first adjustment data.

[0040] Specifically, if matching facial feature information is found, it means that the facial feature information of the driver is stored in the facial feature repository, and first adjustment data corresponding to the driver's facial feature information is stored. The first adjustment data refers to a set of parameters or settings associated with the driver's facial feature information. These parameters or settings are used for manual adjustments to the cockpit by the driver or optimization of the vehicle's cockpit environment settings. According to the first adjustment data, the system will automatically adjust the seat to the driver's preferred position, for example, adjusting the angle of the steering wheel to match the driver's driving habits, adjusting the rearview mirror to ensure that the driver has a good field of view, and adjusting the seat and the air outlet baffle of the cockpit air conditioner to provide a comfortable driving environment.

[0041] If the facial feature information of the driver is not stored, step S104 is executed: second adjustment data is calculated according to the seat position data adjusted by the driver, and the cockpit is adjusted according to the second adjustment data.

[0042] Specifically, if no matching information is found, it means that the driver's facial feature information does not exist in the vehicle's facial feature repository, and no adjustment data for adjusting the cockpit for the driver is stored. Therefore, the second adjustment data of the vehicle's interior rearview mirror and air outlet baffle can be calculated according to the driver's manual adjustment of the seat position based on pre-set standards, and the cockpit environment can be further adjusted or optimized based on the second adjustment data.

[0043] In a preferred example, Figure 2 A flowchart of a collaborative control method for an interior rearview mirror provided in an embodiment of the present application. Figure 2 The cooperative control method shown is executed in the above-mentioned on-board processor.

[0044] In step S201, the seat position data of the driver adjusting the driving seat is obtained, and the sensing camera is controlled to capture the facial feature information of the driver after adjusting the driving seat.

[0045] Specifically, the seat position data includes the fore-and-aft position, height, backrest angle, etc. When the driver adjusts the seat position, the system will record the seat position data at this time and capture the driver's facial feature information at the same time, calculate and determine the optimal adjustment angle of the rearview mirror that will enable the driver to obtain the best field of vision comfort in this specific seat position.

[0046] In step S202, the eye points in the facial feature information of the driver after the driver's adjustment to the driving seat are determined.

[0047] Specifically, the second adjustment data includes a first adjustment angle value of the vehicle's interior rearview mirror. The eye point is the center point of the line connecting the driver's two eyeballs. The seat position data is crucial for determining the driver's field of view. Different seat positions will cause the driver's line of sight and eye point coordinates to change. The first adjustment angle value refers to the angle value to which the vehicle's interior rearview mirror needs to be adjusted.

[0048] In step S203, the center point of the sensing camera is used as the coordinate origin to obtain a first normal vector of the center point of the mirror surface of the vehicle's interior rearview mirror.

[0049] Specifically, the center point of the sensing camera is set as the coordinate origin in the three-dimensional coordinate system, such as (0,0,0). The mirror center point refers to the geometric center point of the vehicle's interior rearview mirror. This point is located on the back of the rearview mirror and is a key intersection point of the mirror reflected light. The first normal vector describes the direction and angle of the mirror and is used to determine the position and visibility of the interior rearview mirror in the driver's line of sight.

[0050] In step S204, a first angle value between the first vector and the first normal vector is calculated.

[0051] Specifically, the first vector refers to the vector from the eye point to the center point of the mirror, which describes the direction and distance relationship between the driver's line of sight and the center point of the interior rearview mirror. The first normal vector describes the initial orientation or basic angle of the vehicle's interior rearview mirror. The first normal vector and the first vector can be used to calculate the angle between the driver's line of sight and the rearview mirror, so as to determine whether the interior rearview mirror needs to be adjusted to better meet the driver's line of sight needs. The first angle value can determine whether the interior rearview mirror needs to be adjusted and the direction and degree of adjustment. If the angle value is too large, it means that the interior rearview mirror may not be within the driver's line of sight and needs to be adjusted. If the angle value is moderate, it means that the position and angle of the interior rearview mirror have met the driver's line of sight needs.

[0052] In step S205, a second angle value between the second vector and the first normal vector is calculated.

[0053] Specifically, the second vector refers to the vector from the center point of the mirror to the center point of the vehicle's rear windshield. The center point of the vehicle's rear windshield refers to the geometric center point of the vehicle's rear windshield glass surface, which can be the intersection of the diagonals of the rear windshield glass. The second vector refers to the vector starting from the center point of the mirror and pointing to the center point of the vehicle's rear windshield. It describes the direction and distance relationship between the center point of the rearview mirror and the center point of the rear windshield. The first normal vector refers to the vector starting from the coordinate origin and perpendicular to the plane where the center point of the mirror is located. It describes the basic angle of the rearview mirror. The second angle value is an important basis for evaluating whether the position and angle of the rearview mirror are appropriate so that the driver can clearly observe the rear windshield. If the angle value is too large or too small, it will cause the driver's line of sight to be obstructed or the observation effect to be poor, so the rearview mirror needs to be adjusted.

[0054] In step S206, the interior rearview mirror is controlled to rotate so that the first angle value is equal to the second angle value.

[0055] Specifically, in steps S204 and S205, a first angle value, i.e., the angle between the vector from the eye point coordinates to the center point of the mirror and the first normal vector, and a second angle value, i.e., the angle between the vector from the center point of the mirror to the center point of the rear windshield and the first normal vector, are calculated respectively. In this step, the interior rearview mirror is rotated until the two angle values ​​are equal, so that the driver's line of sight can observe the center of the rear windshield through mirror reflection, and the orientation angle of the interior rearview mirror takes into account both the driver's line of sight requirements and the observation requirements of the rear windshield, thereby achieving a balance between the two.

[0056] In step S207 , a second normal vector of the center point of the mirror surface of the rotated interior rearview mirror and a first adjustment angle value between the second normal vector and the first normal vector are calculated.

[0057] Specifically, the second normal vector refers to the vector perpendicular to the plane where the center point of the mirror surface is located after the interior rearview mirror has undergone preliminary adjustment such as step S206. The first adjustment angle value refers to the angle between the second normal vector and the first normal vector, which represents the deviation angle between the orientation of the interior rearview mirror after the preliminary adjustment and the original orientation.

[0058] In step S208, according to the first adjustment angle, the interior rearview mirror is controlled to rotate to adjust the cockpit.

[0059] In a preferred example, Figure 3 A flowchart of a cockpit collaborative control method provided in an embodiment of the present application. Figure 3 The cooperative control method shown is executed in the above-mentioned on-board processor.

[0060] In step S301, the first adjustment angle value is mapped to a three-dimensional coordinate system with the center point of the sensing camera as the coordinate origin to obtain an adjustment target value in the three-dimensional coordinate system.

[0061] Specifically, the purpose of mapping is to convert the abstract adjustment angle value into a specific motion instruction in three-dimensional space, and the adjustment target value refers to the motion target point of the motion instruction so as to control the rotation of the rearview mirror.

[0062] In step S302, a first rotation angle value, a second rotation angle value, and a third rotation angle value are determined according to the current position of the interior rearview mirror and the adjustment target value.

[0063] Specifically, the adjustment target value is used to respectively determine a first rotation angle value of the interior rearview mirror around a first coordinate axis of the three-dimensional coordinate system, a second rotation angle value around a second coordinate axis of the three-dimensional coordinate system, and a third rotation angle value around a third coordinate axis of the three-dimensional coordinate system. The three rotation angles together describe the calculation process of the rotation angles of the interior rearview mirror around three axes in the three-dimensional coordinate system.

[0064] In step S303, the number of rotations required for the motor to control the interior rearview mirror to rotate to the first adjustment angle value is calculated according to the first rotation angle value, the second rotation angle value and the third rotation angle value.

[0065] Specifically, the three rotation angle values ​​are converted into the number of motor rotations. Each rotation angle corresponds to the rotation of the rearview mirror in a specific direction around a coordinate axis in three-dimensional space. The number of rotations of different axes can be calculated separately by three motors, or one motor can drive the movement of multiple axes and calculate the number of rotations based on the first adjustment angle value.

[0066] In step S304, the motor is controlled to rotate the above number of revolutions so that the interior rearview mirror rotates to a first adjustment angle value.

[0067] Specifically, according to the above number of rotations, the motor is controlled to drive the interior rearview mirror to rotate around different coordinate axes to a first adjustment angle value.

[0068] In a preferred example, Figure 4 A flow chart of a method for collaboratively controlling an air outlet baffle provided in an embodiment of the present application. Figure 4 The cooperative control method shown is executed in the above-mentioned on-board processor.

[0069] In step S401 , the highest point in the facial feature information of the driver after the driver adjusts the driving seat is determined.

[0070] Specifically, the second adjustment data also includes a second adjustment angle value of the baffle of the air outlet located at the control panel of the vehicle. The highest point refers to the uppermost point of the face, which may be the position of the hairline. Determination of the highest point helps to understand the relative height of the driver's head, and then adjust the internal equipment of the vehicle to ensure the driver's line of sight and comfort.

[0071] In step S402, the coordinate position of the sensing camera is used as the coordinate origin to obtain a third normal vector of the center point of the baffle of the air outlet of the vehicle.

[0072] In step S403, a second adjustment angle value between the third vector and the third normal vector is calculated.

[0073] Specifically, the third vector refers to the vector from the highest point to the center point of the baffle. The second adjustment angle value is obtained by calculating the angle between the third vector and the third normal vector. It indicates the angle that the air outlet baffle needs to rotate to optimize the airflow direction. This value will be used to adjust the baffle position of the air outlet to ensure that the airflow can better blow to the driver or passenger and improve comfort.

[0074] In step S404, according to the second adjustment angle value, the baffle is controlled to rotate to adjust the cockpit.

[0075] In a preferred example, Figure 5 A flowchart of another cockpit control method provided in an embodiment of the present application. Figure 5 The cooperative control method shown is executed in the above-mentioned on-board processor.

[0076] In step S501, a first start signal for starting an air conditioner is received.

[0077] In step S502, in response to the first start signal, the air conditioner of the vehicle is controlled to start.

[0078] In step S503, the working state of the air conditioner is determined.

[0079] Specifically, the air conditioner working state includes a cooling state and a heating state.

[0080] If the working state of the air conditioner is the cooling state, step S504 is executed: the baffle is controlled to rotate in the first direction to a second adjustment angle value so as to discharge air from the bottom of the air outlet.

[0081] Specifically, in the cooling state, in order to optimize the distribution and effect of the airflow, it is necessary to adjust the angle of the cockpit air outlet baffle. Rotating the baffle downward can direct the airflow to a lower position to ensure that the airflow can blow towards the driver in the most comfortable way.

[0082] If the working state of the air conditioner is the heating state, step S505 is executed: the baffle is controlled to rotate in the second direction to a second adjustment angle value so as to discharge air from above the air outlet.

[0083] Specifically, in the heating state, in order to increase the temperature inside the vehicle more quickly and maintain a comfortable temperature distribution, the angle of the air outlet baffle can be adjusted to blow the hot air in a second direction opposite to the first direction so that the hot air blows towards the driver's upper body.

[0084] In a preferred example, Figure 6 A flowchart for obtaining driver facial feature information is provided in an embodiment of the present application. Figure 6 The method shown is executed in the above-mentioned on-board processor.

[0085] In step S601, a second activation signal for activating a sensing camera is received.

[0086] In step S602, in response to the second start signal, the sensing camera is controlled to start.

[0087] In step S603, a light signal sent by the light sensor is received, and it is determined based on the light signal whether the light intensity in the vehicle reaches an intensity threshold.

[0088] Specifically, the light sensor is a sensor that can detect the intensity of ambient light. It can be installed on the rearview mirror of the vehicle or integrated into the DMS camera to monitor the light conditions in the vehicle in real time and send the light signal to the on-board controller for analysis. The signal generated by the light sensor indicates the current light intensity in the vehicle. This signal is an important basis for the control system to determine whether the infrared lighting needs to be activated. The intensity threshold is a preset value used to determine whether the current light intensity in the vehicle is sufficient to support the sensor camera to capture facial feature information normally.

[0089] If the intensity threshold is not reached, step S604 is executed: the infrared lighting lamp is controlled to start, and a shooting signal is sent to the sensing camera to control the sensing camera to capture the driver's facial feature information under the illumination of the infrared lighting lamp.

[0090] Specifically, an infrared illuminator is a lighting device that emits infrared light. It is used to provide lighting in low-light environments so that the camera can capture clear images. It can be installed on the vehicle's interior rearview mirror or integrated into the DMS camera to enhance the DMS camera's capture capabilities at night or in low light conditions. The light of the infrared illuminator refers to the lighting environment inside the vehicle after the infrared illuminator is activated and emits infrared light. In this environment, the DMS camera can capture the driver's facial feature information more clearly.

[0091] If the intensity threshold is reached, step S605 is executed: a shooting signal is directly sent to the sensing camera to control the sensing camera to capture the facial feature information of the driver.

[0092] Specifically, when the infrared lighting is not activated (ie, when the light intensity reaches the intensity threshold), the DMS camera can directly capture and transmit the driver's facial feature information.

[0093] In a preferred example, Figure 7 A flowchart of another vehicle cooperative control method provided in an embodiment of the present application. Figure 7 The cooperative control method shown is executed in the above-mentioned on-board processor.

[0094] In step S701, when there is no stored facial feature information of the driver, the steering wheel position data adjusted by the driver is also obtained.

[0095] Specifically, the steering wheel position data refers to the current position information of the steering wheel recorded by the vehicle system when the driver manually adjusts the steering wheel, including the rotation angle, tilt angle or position coordinates of the steering wheel.

[0096] In step S702, the steering wheel position data is used as the third adjustment data corresponding to the driver.

[0097] In step S703, the facial feature information of the driver and the corresponding second adjustment data and third adjustment data are stored in a facial feature storage library.

[0098] Specifically, storing in the facial feature repository means storing the driver's facial feature information and the corresponding second adjustment data, including seat position, interior rearview mirror angle, etc., together with the steering wheel position data in the third adjustment data into the facial feature repository. When the driver enters the vehicle again, the system can automatically recognize his facial feature information and quickly restore to the personalized driving environment set previously.

[0099] Based on the same inventive concept, a vehicle cooperative control device corresponding to a vehicle cooperative control method is also provided in an embodiment of the present application. Since the principle of solving the problem by the device in the embodiment of the present application is similar to the above-mentioned vehicle cooperative control method in the embodiment of the present application, the implementation of the device can refer to the implementation of the method, and the repeated parts will not be repeated.

[0100] Figure 8 A schematic diagram of the structure of a cooperative control device for a vehicle provided in an embodiment of the present application. Figure 8 The cooperative control device of a vehicle shown is executed in the above-mentioned vehicle-mounted processor. The cooperative control device of the vehicle includes:

[0101] The receiving module 801 receives the facial feature information of the driver obtained from the sensing camera.

[0102] The judgment module 802 judges whether the facial feature information of the driver is stored in the facial feature storage library of the vehicle.

[0103] The retrieving module 803 retrieves first adjustment data corresponding to the driver's facial feature information if the driver's facial feature information is stored, so as to adjust the cockpit of the vehicle according to the first adjustment data.

[0104] The calculation module 804 calculates second adjustment data according to the seat position data adjusted by the driver if the facial feature information of the driver is not stored, and adjusts the cockpit according to the second adjustment data.

[0105] See also Fig. 9 , Fig. 9 This is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application. Fig. 9 As shown in , the electronic device 900 includes a processor 910 , a memory 920 and a bus 930 .

[0106] The memory 920 stores machine-readable instructions executable by the processor 910. When the electronic device 900 is running, the processor 910 communicates with the memory 920 via the bus 930. When the machine-readable instructions are executed by the processor 910, the above-mentioned Figure 1 to Figure 7 The specific implementation of the steps of the control method in the method embodiment shown can be found in the method embodiment, and will not be repeated here.

[0107] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the computer program can execute the above-mentioned Figure 1 to Figure 7 The steps of a vehicle cooperative control method in the method embodiment shown in the figure, the specific implementation method can be found in the method embodiment, and will not be repeated here.

[0108] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0109] In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some communication interfaces, and the indirect coupling or communication connection of devices or units can be electrical, mechanical or other forms.

[0110] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0111] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0112] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a non-volatile computer-readable storage medium that is executable by a processor. Based on this understanding, the technical solution of the present application can essentially be embodied in the form of a software product, or in other words, the part that contributes to the prior art or the part of the technical solution. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0113] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application, rather than to limit them. The protection scope of the present application is not limited thereto. Although the present application is described in detail with reference to the above-mentioned embodiments, ordinary technicians in the field should understand that any technician familiar with the technical field can still modify the technical solutions recorded in the above-mentioned embodiments within the technical scope disclosed in the present application, or can easily think of changes, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application, and should be included in the protection scope of the present application. Therefore, the protection scope of the present application shall be based on the protection scope of the claims.

Claims

1. A vehicle cooperative control method, characterized in that: The method comprises: Receiving facial feature information of the driver obtained from the sensing camera; Determining whether the facial feature information of the driver is stored in the facial feature storage library of the vehicle; If the facial feature information of the driver is stored, retrieving first adjustment data corresponding to the facial feature information of the driver, so as to adjust the cockpit of the vehicle according to the first adjustment data; If the facial feature information of the driver is not stored, second adjustment data is calculated according to the seat position data adjusted by the driver, and the cockpit is adjusted according to the second adjustment data.

2. The method according to claim 1, characterized in that: The second adjustment data includes a first adjustment angle value of the interior rearview mirror of the vehicle, The step of calculating second adjustment data according to the seat position data adjusted by the driver, and adjusting the cockpit according to the second adjustment data comprises: Acquiring seat position data of the driver adjusting the driving seat, and controlling the sensing camera to capture facial feature information of the driver after the driver adjusts the driving seat; Determine the eye point in the facial feature information of the driver after the driver's seat is adjusted, the eye point being the coordinate of the center point of the driver's eyeball; Taking the center point of the sensing camera as the coordinate origin, obtaining a first normal vector of the center point of the mirror surface of the interior rearview mirror of the vehicle; Calculating a first angle between a first vector and the first normal vector, where the first vector refers to a vector from the eye point to the center point of the mirror surface; Calculating a second angle between a second vector and the first normal vector, wherein the second vector refers to a vector from the center point of the mirror surface to the center point of the rear windshield of the vehicle; Controlling the inner rearview mirror to rotate so that the first angle value is equal to the second angle value; Calculating a second normal vector of the center point of the mirror surface of the rotated interior rearview mirror; Calculating a first adjustment angle value between the second normal vector and the first normal vector; According to the first adjustment angle, the interior rearview mirror is controlled to rotate to adjust the cockpit.

3. The method according to claim 2, characterized in that According to the first adjustment angle value, the step of controlling the interior rearview mirror to rotate to adjust the cockpit includes: Mapping the first adjustment angle value to a three-dimensional coordinate system with the center point of the sensing camera as the coordinate origin, to obtain an adjustment target value in the three-dimensional coordinate system; According to the current position of the interior rearview mirror and the adjustment target value, respectively determining a first rotation angle value of the interior rearview mirror around a first coordinate axis of the three-dimensional coordinate system, a second rotation angle value around a second coordinate axis of the three-dimensional coordinate system, and a third rotation angle value around a third coordinate axis of the three-dimensional coordinate system; Calculating the number of rotations required by the motor to control the interior rearview mirror to rotate to the first adjustment angle value according to the first rotation angle value, the second rotation angle value and the third rotation angle value; The motor is controlled to rotate the number of revolutions so that the interior rearview mirror rotates to the first adjustment angle value.

4. The method according to claim 1 or 2, characterized in that: The second adjustment data also includes a second adjustment angle value of a baffle of an air outlet located at a control panel of the vehicle, The step of calculating second adjustment data according to the seat position data adjusted by the driver, and adjusting the cockpit according to the second adjustment data comprises: Determining the highest point in the facial feature information of the driver after the driver has adjusted the driving seat; Taking the center point of the sensing camera as the coordinate origin, obtaining a third normal vector of the center point of the air outlet; Calculating a second adjustment angle value between a third vector and the third normal vector, wherein the third vector refers to a vector from the highest point to the center point of the baffle; According to the second adjustment angle value, the baffle is controlled to rotate to adjust the cockpit.

5. The method according to claim 4, characterized in that According to the second adjustment angle value, the step of controlling the baffle to rotate to adjust the cockpit includes: receiving a first start signal for starting the air conditioner; In response to the first start signal, controlling the start of the air conditioner of the vehicle; Determining the working state of the air conditioner, wherein the working state includes a cooling state and a heating state; If the working state of the air conditioner is a cooling state, the baffle is controlled to rotate in the first direction to the second adjustment angle value so as to discharge air from below the air outlet; If the working state of the air conditioner is the heating state, the baffle is controlled to rotate in a second direction to the second adjustment angle value so as to discharge air from above the air outlet, and the second direction is opposite to the first direction.

6. The method according to claim 1, characterized in that The step of receiving the driver's facial feature information obtained from the sensing camera includes: Receiving a second start signal for starting the sensing camera; In response to the second start signal, controlling the sensing camera to start; receiving a light signal sent by a light sensor, and determining whether the light intensity in the vehicle reaches an intensity threshold according to the light signal; If the intensity threshold is not reached, the infrared lighting is controlled to start; Sending a shooting signal to the sensing camera to control the sensing camera to capture the facial feature information of the driver under the illumination of the infrared lighting; If the intensity threshold is reached, the shooting signal is directly sent to the sensing camera to control the sensing camera to capture the facial feature information of the driver.

7. The method according to claim 1, characterized in that The method further comprises: When the facial feature information of the driver is not stored, further acquiring the steering wheel position data adjusted by the driver; using the steering wheel position data as third adjustment data corresponding to the driver; The facial feature information of the driver and the corresponding second adjustment data and third adjustment data are stored in the facial feature storage library.

8. A vehicle cooperative control device, characterized in that: The device comprises: A receiving module receives the driver's facial feature information obtained from the sensing camera; A judgment module, for judging whether the facial feature information of the driver is stored in the facial feature storage library of the vehicle; a retrieving module, which retrieves first adjustment data corresponding to the facial feature information of the driver if the facial feature information of the driver is stored, so as to adjust the cockpit of the vehicle according to the first adjustment data; The calculation module calculates second adjustment data according to the seat position data adjusted by the driver if the facial feature information of the driver is not stored, and adjusts the cockpit according to the second adjustment data.

9. An electronic device, characterized in that: include: A processor, a memory and a bus, wherein the memory stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor and the memory communicate via the bus, and the processor executes the machine-readable instructions to perform the steps of any method as claimed in claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are executed.

Citation Information

Patent Citations

  • Cabin cooperative control system and method based on driver monitoring and recognition

    CN114889542A

  • Vehicle seat setting method and device based on face recognition and storage medium

    CN115959013A

  • Full-automatic rearview mirror adjusting method and system, vehicle and readable storage medium

    CN116176416A

  • Adjusting method of cockpit configuration, electronic equipment and computer readable storage medium

    CN117234619A

  • Control method and system for intelligently adjusting comfortable posture and vehicle

    CN118025054A