Vehicle cabin control method and system

Abstract

The invention discloses a vehicle cabin control method and system.The vehicle cabin control method is applied to a controller included in the cabin control system, the vehicle cabin control system further comprises a first camera and a second camera, the first camera is a camera arranged in a vehicle, and the second camera is a camera arranged outside the vehicle; the method comprises the following steps: acquiring first user information shot by a first camera and second user information shot by a second camera; according to the first user information and the second user information, the driving state information of the user in the vehicle is obtained through calculation; according to the driving state information, the seat state information and the body data of the different types of human bodies, target body data of the user in the vehicle is obtained through calculation; and controlling a target cabin function in the vehicle according to the target body data. Therefore, the function of the target cabin can be better and automatically adjusted, the user operation is simplified, and the personalized requirements of the user can be better met.

Description

Technical Field

[0001] The present invention relates to the field of automobile technology, and in particular to a vehicle cockpit control method and system. Background Art

[0002] With the continuous development of new energy vehicles and smart cockpit technology, the hardware configuration of vehicles is becoming more and more abundant, and the software function configuration is also becoming more and more abundant, which not only makes the vehicles have more functions and higher performance, but also provides a wider range of user experience options. However, this expansion of hardware and software functions has also brought new problems. For example, there are more and more functions that users need to learn and operate, which invisibly increases the user's usage threshold and time cost. For users who are not familiar with vehicle operation, these complex functions may become an obstacle for users to enjoy the full set of vehicle functions, thereby reducing the overall user experience and satisfaction. Since users may feel confused and inconvenienced during the operation of cockpit functions, their evaluation of the vehicle may also be affected. Therefore, how to better implement the vehicle cockpit function settings and provide users with a better experience has become an urgent problem to be solved. Summary of the invention

[0003] The purpose of the present invention is to solve the problem of how to better realize the setting of vehicle cockpit functions and provide users with a better experience. The present invention provides a vehicle cockpit control method, which can better automatically set or adjust the cockpit functions when different users drive or ride in the vehicle, simplify user operations, and better meet the different demands of users, help users better use the cockpit functions, and improve user experience. In order to solve the above technical problems, the embodiment of the present invention discloses a vehicle cockpit control method, which is applied to a controller included in a vehicle cockpit control system, and the vehicle cockpit control system also includes: a first camera and a second camera, the first camera is a camera set inside the vehicle, and the second camera is a camera set outside the vehicle. The vehicle cockpit control method includes:

[0004] Acquire first user information captured by a first camera and second user information captured by a second camera; calculate driving status information of the user in the vehicle based on the first user information and the second user information; calculate target body data of the user in the vehicle based on the driving status information, seat status information, and body data of different types of human bodies; and control a target cockpit function in the vehicle based on the target body data.

[0005] When controlling the vehicle cockpit using the above technical solution, the vehicle can obtain the first user information and the second user information based on the first camera and the second camera. Based on the first user information and the second user information, the driving and riding state information and the target body data of the user inside the vehicle can be determined. Based on the target body data, the target cockpit function of the vehicle can be controlled, that is, the target cockpit function in the vehicle can adjust the target cockpit function in the vehicle based on the driving and riding state information of the user and the target body data of the user obtained by the first camera and the second camera to achieve a better and faster adjustment of each function inside the vehicle cockpit. Thus, the target cockpit function in the vehicle can be adapted to different users driving or riding in the vehicle in real time to meet the personalized requirements of different users, thereby helping users use various functions better.

[0006] Further, the controller obtains the target body data of the user inside the vehicle based on the first camera and the second camera, providing a data basis for the automatic adjustment of the cockpit function, replacing the user's manual input, to help users use the target cockpit function better. Further, automatically setting the target cockpit function can help users with the setting and avoid potential safety hazards caused by manual setting by users. Especially during the vehicle driving process, the target body data of the user inside the vehicle can be obtained based on the first camera and the second camera, and the target cockpit function inside the vehicle cockpit can be adjusted based on the target body data without the driver inputting cockpit adjustment data, thus improving driving safety.

[0007] According to another specific embodiment of the present invention, a vehicle cockpit control method disclosed in the embodiment of the present invention, the first camera includes a driver monitoring system camera and a passenger monitoring system camera, and the first user information includes the user information captured by the driver monitoring system camera and the user information captured by the passenger monitoring system camera.

[0008] The second camera includes a left body camera and a right body camera, and the second user information includes the user information captured by the left body camera and the user information captured by the right body camera.

[0009] When controlling the vehicle cockpit using the above technical solution, the vehicle can obtain the user information in different states of the user based on the driver monitoring system camera and the passenger monitoring system camera, and by combining multiple driver monitoring system cameras and passenger monitoring system cameras inside the vehicle cabin, the user information in all directions inside the vehicle cabin can be obtained. Combining the image information of the user before getting into the vehicle obtained by multiple second cameras outside the vehicle cabin, the driving and riding state information of the user can be calculated more accurately, enabling the cockpit to provide appropriate function adjustments for different users when driving or riding in the vehicle, better and more quickly meeting the different demands of users, and helping users use various functions inside the vehicle cabin better.

[0010] Furthermore, the cameras of the driver monitoring system, the cameras of the passenger monitoring system, and multiple cameras outside the vehicle can automatically obtain user image information to calculate the driving and riding state information of the user, which can replace the user's manual input of relevant information, avoid potential safety hazards caused by manual settings by the user, and improve the safety of the user's driving or riding.

[0011] According to another specific embodiment of the present invention, in a vehicle cockpit control method disclosed by the embodiment of the present invention, the first user information includes: the facial image and trunk feature points of the user.

[0012] According to another specific embodiment of the present invention, in a vehicle cockpit control method disclosed by the embodiment of the present invention, the driving and riding state information includes: age information, gender information, eyeball position information, and body posture information.

[0013] According to another specific embodiment of the present invention, in a vehicle cockpit control method disclosed by the embodiment of the present invention, the target body data includes: height information, arm span information, leg length information, and body posture information of the user inside the vehicle.

[0014] When controlling the vehicle cockpit using the above solution, if the first user information includes the facial image and trunk feature points of the user, then the user's information can be accurately calculated from the facial image and trunk feature points of the user, further making the calculated driving and riding state information more accurate. The driving and riding state information of the user includes: age information, gender information, eyeball position information, and body posture information. Then, based on the driving and riding state information of the user, the seat state information, and different types of human body data, the height information, arm span information, leg length information, and body posture information of the user, that is, the target body data, can be accurately calculated. Therefore, when automatically adjusting the functions inside the cockpit based on the target body data, the target cockpit functions inside the vehicle can better meet the personalized needs of the user.

[0015] According to another specific embodiment of the present invention, in a vehicle cockpit control method disclosed by the embodiment of the present invention, the target cockpit functions at least include at least one of the following functions: steering wheel setting function, rear tailgate setting function, vehicle light setting function, window setting function, seat belt position setting function, screen setting function, resource allocation function.

[0016] According to another specific embodiment of the present invention, in a vehicle cockpit control method disclosed by the embodiment of the present invention, after controlling the target cockpit functions in the vehicle according to the target body data, the method further includes:

[0017] Receiving a setting operation of the user on the target cockpit function, and in response to the setting operation, performing corresponding control processing on the target cockpit function in the vehicle.

[0018] When controlling the vehicle cockpit using the above solution, after controlling the target cockpit function in the vehicle according to the target body data, that is, after the vehicle completes the automatic adjustment of the target cockpit function, the user can adjust the target cockpit function based on the setting operation, so that the target cockpit function further meets the user's needs.

[0019] Furthermore, when subsequently adjusting the target cockpit function based on the target body data, the setting information corresponding to the user's setting operation can be used to control the further adjustment of the target cockpit function after automatic adjustment, so that the target cockpit function better meets the user's needs.

[0020] According to another specific embodiment of the present invention, in a vehicle cockpit control method disclosed by the embodiment of the present invention, controlling the target cockpit function in the vehicle according to the target body data includes controlling the target cockpit function in the vehicle according to the target body data and a preset function control algorithm, and the function control algorithm is obtained based on the manual historical setting information of the target cockpit function.

[0021] When controlling the vehicle cockpit using the above technical solution, the function control algorithm is obtained by analyzing the manual setting information and updated based on the user's manual historical setting information, which can make each parameter of the target cockpit function calculated based on the function control algorithm more accurate and more in line with the user's requirement settings for the target cockpit function.

[0022] According to another specific embodiment of the present invention, in a vehicle cockpit control method disclosed by the embodiment of the present invention, the method further includes: when the vehicle cockpit control system meets a preset condition, obtaining first user information by shooting with a first camera and obtaining second user information by shooting with a second camera.

[0023] When controlling the vehicle cockpit using the above technical method, before the first camera and the second camera obtain the first user information and the second user information, first determine whether the vehicle cockpit control system meets the preset condition. When the vehicle cockpit meets the preset condition, obtain the first user information and the second user information, so as to ensure that the vehicle cockpit control system can adjust the target cockpit function of the vehicle based on the control of the controller, so that the target cockpit function meets the user's needs.

[0024] Furthermore, it can ensure that the vehicle can normally perform the automatic adjustment of each function in the vehicle cockpit, and avoid the need for the user to adjust the target cockpit function by himself when entering the vehicle due to the vehicle cockpit control system not meeting the preset condition.

[0025] An embodiment of the present invention also discloses a vehicle cabin control system, comprising: a first camera, a second camera and a controller, wherein the first camera is a camera built into the vehicle, and the second camera is a camera arranged outside the vehicle, wherein the first camera is used to capture first user information and send it to the controller; the second camera is used to capture second user information and send it to the controller; the controller is used to calculate the driving status information of the user in the vehicle based on the acquired first user information and second user information, calculate the target body data of the user in the vehicle based on the driving status information, seat status information, and different types of human body data, and control the target cabin function in the vehicle based on the target body data.

[0026] In the above-mentioned vehicle cockpit control system, the first camera and the second camera obtain the first user information and the second user information and send them to the controller. The controller can determine the driving status information and target body data of the user in the vehicle based on the first user information and the second user information, and control the target cockpit function of the vehicle based on the target body data. Therefore, based on the vehicle cockpit control system in the vehicle, it can automatically adjust the target cockpit function in the vehicle, so that the target cockpit function in the vehicle can better and faster adjust various functions in the vehicle cockpit to adapt to different users driving or riding the vehicle, meet the personalized requirements of different users, and further, help users better use various functions. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 A schematic flow chart of a vehicle cabin control method provided by an embodiment of the present invention;

[0028] Figure 2 A schematic flow chart of another vehicle cabin control method provided by an embodiment of the present invention;

[0029] Figure 3 A schematic flow chart of another vehicle cabin control method provided by an embodiment of the present invention;

[0030] Figure 4 A schematic structural diagram of a vehicle cabin control system provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0031] With the rapid development of new energy vehicles and smart cockpit technology, the hardware configuration of vehicles is becoming more and more abundant. Modern vehicles not only have more and more complex functions, but also provide a wider range of user experience options. However, this expansion of hardware and functions also brings many new challenges. Users need to learn and operate more and more functions, which invisibly increases their usage threshold and time cost.

[0032] For users who are not familiar with vehicle operation, these complex functions may become an obstacle for them to enjoy the full range of vehicle functions, thus reducing the overall user experience and satisfaction. Since users may feel confused and inconvenient during operation, their evaluation of the vehicle may also be affected accordingly.

[0033] With the increase in cockpit functions, the complexity of system interaction rises, resulting in a decline in interaction efficiency. Too many functions will confuse users and they don't know how to use some functions. Some functions require the driver to stare at the screen for a long time, which will cause great visual distraction, affect driving safety, and increase the risk of accidents. At the same time, too many functions will cause an excessive burden on the system, resulting in problems such as the car computer freezing and crashing, affecting the normal operation and driving safety of the vehicle.

[0034] Too many functions will lead to a phenomenon of function stacking in the cockpit, lacking user usage scenarios, making it difficult for users to find the functions they really need, or feeling cumbersome and inconvenient during use. And currently, the cockpit functions, page layouts, and visual styles lack distinctiveness, resulting in more serious functional homogenization, reducing the uniqueness of the functions themselves. However, it is difficult for users to feel the differentiation and unique value of the product.

[0035] Therefore, how to optimize function settings through intelligent means based on the existing cockpit hardware has become an urgent problem to be solved. Specifically, through an intelligent system, automatically adjusting and optimizing the cockpit function settings according to the needs and usage habits of different users can significantly improve the user experience without significantly increasing costs. This can not only enable users to use vehicle functions more conveniently but also enhance their overall satisfaction and evaluation of the vehicle.

[0036] To sum up, in the existing technology, there are problems such as increased operation difficulty, increased user learning cost, and impact on driving safety due to too many functions.

[0037] Regarding the above problems, the present application provides a vehicle cockpit control method and system. It obtains the image information of the user before getting into the vehicle through multiple cameras inside and outside the vehicle, combines the function settings of the vehicle cockpit with the preset body data of different types of people to calculate the body data of the user inside the vehicle. The controller provides adjustment information for each function based on the calculated body data, and at the same time, recovers the data of the user's manual fine-tuning after the adjustment is completed to improve the operation logic, providing a more comfortable automatic setting for the user.

[0038] The cockpit management method and system provided by the embodiments of the present application can be applied to function management. The cockpit functions provided by the present application can, but are not limited to, vehicle cockpits, living cabins, ship cabins, etc., which are cabins with multiple functions. The following is an example of a vehicle cockpit to illustrate the function control method and system of a multi-functional cabin. It should be noted that the following description of the cockpit control method and system is only for example and does not limit the cockpit provided by the present application.

[0039] Figure 1 It is a schematic flowchart of a vehicle cockpit control method provided by an embodiment of the present invention. As Figure 1 shown, the vehicle cockpit control method includes:

[0040] Step S1: Obtain the first user information captured by the first camera and the second user information captured by the second camera.

[0041] In a possible implementation manner of the vehicle cockpit control method of the present application, the specific method for the controller to obtain the first user information includes: The first camera installed in the vehicle continuously obtains the first user information and sends the first user information to the controller, and the controller receives the first user information. The specific method for the controller to obtain the second user information includes: The second camera installed outside the vehicle continuously obtains the second user information and sends the second user information to the controller, and the controller receives the second user information. The first user information and the second user information can be information corresponding to the same user in different states. The first user information can be the information of the in-vehicle user when inside the vehicle, and the second user information can be the information of the corresponding user when outside the vehicle.

[0042] Further, the first camera can be used to collect the information of all users in the vehicle and send it to the controller, and the first camera can be any camera installed in the vehicle. Additionally, multiple cameras in the vehicle can be simultaneously set as the first camera. The first user information can be the image information of all in-vehicle users captured by the first camera.

[0043] Further, the second camera can be used to capture the image information of the user before getting into the vehicle and send it to the controller, and the second camera can be any camera installed on the outside of the vehicle body. The second user information can be the image information of the user before getting into the vehicle captured by the second camera.

[0044] In the case where multiple first cameras are installed in the vehicle, the images of in-vehicle users at different angles can be captured based on the multiple first cameras, so that more comprehensive user information can be obtained. The second camera can capture the image information of the user in different states before entering the vehicle, which can provide the controller with the image information of the user before entering the vehicle, thus facilitating the controller to analyze the user information more accurately.

[0045] Furthermore, the types and quantities of the first camera and the second camera in the vehicle cockpit control system are not limited. The user can set the specific types and quantities of the first camera and the second camera based on requirements. Both the first user information and the second user information are obtained through legal authorization methods, and the user has been clearly informed of the purpose, scope, and processing method of the information collected before collection, etc.

[0046] Step S2: Calculate the driving and riding state information of the user in the vehicle based on the first user information and the second user information.

[0047] In a possible implementation manner of the vehicle cockpit control method of the present application, after the controller obtains the first user information and the second user information, the algorithm module in the controller calculates the driving and riding state information corresponding to the user in the vehicle based on the first user information and the second user information received by the controller. This driving and riding state information can be the physical state information of the user when in the vehicle.

[0048] Furthermore, in a possible implementation manner of the vehicle cockpit control method of the present application, the second camera may not be able to obtain valid second user information. At this time, the controller only receives the first user information, and the algorithm module in the controller calculates the driving and riding state information corresponding to the user in the vehicle based on the first user information received by the controller.

[0049] Step S3: Calculate the target body data of the user in the vehicle based on the driving and riding state information, the seat state information, and the body data of different types of human bodies.

[0050] In a possible implementation manner of the vehicle cockpit control method of the present application, the driving and riding state information may include the physical state of the user when in the vehicle and the position information of the user when in the vehicle. The seat state information can determine the angle information of the current seat, whether there is a user sitting on the current seat, and the position information of the seat in the vehicle cabin. The body data of different types of human bodies includes the body information corresponding to different types of human bodies, and this body information includes but is not limited to height, weight, and arm span. Thus, when determining the body data corresponding to the user in the vehicle based on the driving and riding state information and the body data of different types of human bodies, the body data of the user in the vehicle can be accurately calculated.

[0051] Further, the seat status information can be obtained by the controller in real time based on the vehicle control module. The body data of different types of people can be the body data of different genders and different age groups preset in the controller. The algorithm module in the controller calculates the target body data of the in-vehicle user based on the driving state information calculated according to the first user information and the second user information, the seat status information obtained in real time, and the preset body data of different types of people, and sends it to the cockpit intelligent adjustment module in the controller. The cockpit intelligent adjustment module calculates the target body data of the in-vehicle user, which can be used as the basis for adjusting the corresponding target cockpit function of the in-vehicle user, so as to facilitate the user to achieve personalized function settings.

[0052] It should be noted that the calculation of the target body data of the in-vehicle user by the algorithm module is not limited to the driving state and seat position of the in-vehicle user and the preset body data of different types. It can also be further calculated and analyzed based on the personal requirements input by the user and the user's personal habits as influencing factors to obtain the target body data of the in-vehicle user.

[0053] Step S4: Control the target cockpit function in the vehicle according to the target body data.

[0054] In a feasible implementation manner of the vehicle cockpit control method of the present application, when the algorithm module in the controller calculates the target body data, it sends the target body data to the cockpit intelligent adjustment module in the controller. The cockpit intelligent adjustment module generates the adjustment information corresponding to the target cockpit function based on the received target body data, and sends the adjustment information corresponding to the target cockpit function to the vehicle control module in the controller. The vehicle control module automatically adjusts the target cockpit function based on the adjustment information corresponding to the target cockpit function. Among them, the adjustment information includes the adjustment parameters of the target cockpit function. The vehicle control module adjusts each parameter of the target cockpit function based on the adjustment parameters to adjust the target cockpit function so that the target cockpit function meets the user's needs. In a possible implementation manner of the vehicle cockpit control method of the present application, the first camera and the second camera can obtain user information in real time, and determine the target body data corresponding to the in-vehicle user based on the user information. Based on the target body data, the adjustment information corresponding to the target cockpit function to be adjusted by the user can be generated, and the target cockpit function can be adjusted in real time based on the adjustment information, so that the vehicle cockpit adjusts the target cockpit function in real time based on the target body data corresponding to the user to meet the needs of different users. Further, the controller can generate the adjustment information corresponding to the target cockpit function based on one or more of the target body data, adjust each target cockpit function based on the adjustment information, and the target cockpit function can be one or more of the cabin functions, and multiple target cockpit functions in the cabin can be adjusted simultaneously.

[0055] Furthermore, when the cockpit function does not support automatic adjustment, voice broadcast reminders can be given to the user to provide reference for the user to use the functions in the cockpit and facilitate the user to better use the cockpit functions.

[0056] The vehicle cockpit control method may include:

[0057] When the first camera is a Driver Monitoring System (DMS) camera and an Occupancy Monitoring System (OMS) camera, the first user information includes the user information captured by the Driver Monitoring System (DMS) camera and the user information captured by the Occupancy Monitoring System (OMS) camera.

[0058] In a feasible implementation manner of the vehicle cockpit control method of the present application, the Driver Monitoring System (DMS) camera in the first camera can capture the body information, facial image and torso feature points of the driver, and the Occupancy Monitoring System (OMS) can capture the facial image and torso feature points of the passenger. The first camera can also be a camera provided on the top of the vehicle cabin, so as to be able to capture the user's information omnidirectionally. When the second camera is a left-side body camera and a right-side body camera, the second user information includes the image information of the user before getting into the vehicle captured by the left-side body camera and the right-side body camera.

[0059] The second camera can be any camera provided on the outside of the vehicle body. For example, both the left-side body camera and the right-side body camera can be used as the second camera to better capture the image information of the user before getting into the vehicle. The combination of multiple cameras can more accurately calculate the driving and riding state information of the users in the vehicle.

[0060] The first user information can be the facial image and torso feature points of the user in the vehicle. The user information can be determined based on the facial image and torso feature points of the user in the vehicle. The user information includes, but is not limited to, user ID, user image information, gender information, age information, body posture information, sitting posture information. And the manual history information of the user can be determined based on the determined user information. Further, the users in the vehicle include: the driver, the front passenger and the rear passengers.

[0061] Further, in the vehicle cockpit control method disclosed in some other specific embodiments of the present invention, the first user information may also include relevant information of other user information reflecting the user other than the above information, which can be set as needed to be based on other information of the user obtained by the first camera.

[0062] The DMS camera and the OMS camera can capture the facial images and torso feature points of the driver, the front passenger, and the rear passengers, providing more comprehensive user information for the algorithm module. The image information of the user before getting into the vehicle captured by the second camera can provide the user information when the user is outside the vehicle, providing different user information for the calculation of the algorithm module, making the calculated driving and riding state information of the user more accurate.

[0063] In the vehicle cockpit control method disclosed in another specific embodiment of the present invention, the driving and riding state information includes: age information, gender information, eyeball position information, body posture information.

[0064] In some other specific embodiments of the present invention, the driving and riding state information may also include information or data other than the above information that reflects the driving and riding conditions of the users in the vehicle, which can be set as needed.

[0065] In the vehicle cockpit control method disclosed in another specific embodiment of the present invention, the target body data includes the height information, arm span information, leg length information, and body posture information of the users in the vehicle.

[0066] In the vehicle cockpit control method disclosed in another specific embodiment of the present invention, the cockpit intelligent adjustment module of the controller can determine the parameters that need to be adjusted for the corresponding target cockpit function based on the height, arm span, leg length, and body posture of the user. For example, the seat height, angle, front-back position, and seat belt length can be determined based on the user's height information, leg length information, arm span information, and body posture information.

[0067] Among them, the target body data is calculated by the algorithm module based on the driving and riding state information of the users in the vehicle, the seat state information, and the body data of different types of human bodies.

[0068] Further, personalized function settings can be provided for the users in the vehicle based on the target body data of the users in the vehicle. After adjusting the target cockpit function based on the target body data, it can effectively avoid the users from making large-scale manual adjustments to the current target cockpit function.

[0069] Further, in some other specific embodiments of the present invention, the target body data may also include information or data such as the body type, weight, vision requirements, and operation habits of the users in the vehicle, which can be set as needed.

[0070] In the vehicle cockpit control method disclosed in another specific embodiment of the present invention, the target cockpit functions at least include at least one of the following functions: steering wheel setting function, rear tailgate setting function, vehicle lamp setting function, window setting function, seat belt position setting function, screen setting function, and resource allocation function.

[0071] In the vehicle cockpit control method disclosed in another specific embodiment of the present invention, the cockpit intelligent adjustment module generates adjustment information corresponding to the target cockpit function based on the calculated target body data, and the vehicle control module adjusts the target cockpit function based on the received adjustment information corresponding to the target cockpit function.

[0072] In the vehicle cockpit control method disclosed in another specific embodiment of the present invention, the target cockpit functions include at least one of the steering wheel setting function, rear tailgate setting function, vehicle lamp setting function, window setting function, seat belt position setting function, screen setting function, and resource allocation function. The specific method for generating adjustment information corresponding to the target cockpit function based on the calculated target body data and adjusting the target cockpit function based on the adjustment information may include:

[0073] When the target cockpit function is the steering wheel setting function, the vehicle control module automatically adjusts the position of the steering wheel based on the received adjustment information corresponding to the steering wheel setting function, and when the target body data changes, it performs automatic adjustment to always keep the position of the steering wheel in a proper state. For example, when the user moves backward, the steering wheel moves away from the user. When the user's body posture changes and the camera captures that the characteristic points of the user's torso change, the corresponding driving state information changes, and the controller regenerates the adjustment information according to the new driving state information, and the steering wheel is automatically adjusted again.

[0074] When the target cockpit function is the rear tailgate setting function, the vehicle control module automatically adjusts the height of the rear tailgate based on the received adjustment information corresponding to the rear tailgate setting function to facilitate the user's operation. The adjustment information is generated by the cockpit intelligent adjustment module based on the received driver height information and arm span information.

[0075] When the target cockpit function is the vehicle lamp setting function, the vehicle control module automatically adjusts the setting of the vehicle lamps based on the received adjustment information corresponding to the vehicle lamp setting function. The vehicle lamp adjustment information of the vehicle is generated based on the user's line of sight position information. When driving at night, the vehicle high and low beam lights are switched according to the driver's line of sight position information, and the turning on and off of the interior lights are adjusted according to the user's line of sight position information, improving the driving safety of the driver and the usage experience of the passengers in the vehicle.

[0076] When the target cockpit function is the window setting function, the vehicle control module automatically adjusts the set height of the window for each door when it is opened based on the received adjustment information corresponding to the window setting function, reducing the risk of window collision and enhancing the experience of opening and closing frameless doors.

[0077] Specifically, when the height of the user in the vehicle is greater than or equal to the threshold of the window height, there is no need to adjust the window height. When the height of the user in the vehicle is less than the threshold of the window adjustment, the window height is automatically adjusted to the specified position with reference to the height correspondence of the user in the vehicle. The threshold is the height of the user's head in the driving and riding state.

[0078] When the target cockpit function is the seat belt position setting function, the vehicle control module automatically adjusts the seat belt position based on the received adjustment information corresponding to the seat belt position setting function, enhancing the safety and comfort when wearing the seat belt.

[0079] Specifically, if the hardware configuration of the seat belt supports automatic adjustment of the seat belt position, the seat belt is adjusted to a suitable position in response to the adjustment information; if the seat belt position interferes with the driver's neck, the driver is prompted to lower the seat belt position and the seat belt position is automatically lowered; if the seat belt position interferes with the driver's arm, the driver is prompted to raise the seat belt position and the seat belt position is automatically raised.

[0080] When the target cockpit function is the screen setting function, the front row screen is set so that the cockpit intelligent adjustment module generates corresponding adjustment information based on the riding state information of the driver and passenger in the front row, the line of sight position information of the driver, the line of sight position information of the passenger in the co-pilot, etc. recorded by the first camera and sends it to the vehicle control module. The vehicle control module automatically adjusts the front row screen setting in response to the adjustment information, reducing the occurrence of phenomena such as screen ghosting and burn-in caused by the screen displaying a single picture for a long time.

[0081] Furthermore, when the picture displayed on the front row screen has not changed for a preset time and the line of sight positions of the driver and passenger in the front row are not on the front row screen, the screen refresh rate is adjusted to the lowest in response to the adjustment information, and the screen brightness is reduced while changing the display picture of the screen, performing operations such as color adjustment of the picture or offsetting the picture position and changing the display content. Among them, the preset time can be any length of time, and the user can determine it based on needs.

[0082] The rear row screen is set so that the cockpit intelligent adjustment module generates adjustment information based on the riding situation in the rear row recognized by the first camera and the line of sight position information of the rear row passengers, etc. and sends it to the vehicle control module. The vehicle control module automatically adjusts the rear row screen setting in response to the adjustment information, reducing the occurrence of phenomena such as screen ghosting and burn-in caused by the screen displaying a single picture for a long time.

[0083] Specifically, when there are no passengers in the rear row or the rear passengers have not viewed the rear screen for a long time, the response adjustment information is used to reduce the screen refresh rate and brightness, and at the same time, the display screen of the screen is changed, the color of the screen is adjusted, the position of the screen is offset, the display content is changed, etc.

[0084] When the target cockpit function is a resource allocation function, the cockpit intelligent adjustment module generates corresponding adjustment information based on the seating conditions of all in-vehicle users and the line-of-sight position information of in-vehicle users, etc., and sends the adjustment information to the vehicle control module. The vehicle control module dynamically adjusts the running priorities of the applications on each screen in the vehicle in response to the adjustment information, allocates more system resources to the currently viewed and used screen, and releases the resources of the unused and unviewed screens to the screens in need, so as to optimize the resource allocation of the in-vehicle system and improve the fluency of the in-vehicle system.

[0085] Specifically, when there is no one sitting in the corresponding position of the screen and the screen is not in use, the system resources occupied by the screen will be released as much as possible, and the loss of the screen itself will be reduced; the application processes running on the corresponding screen will be closed to release system resources as much as possible; if the screen does not need to continue to be lit, the screen will be automatically managed. If the screen still needs to be in the lit state, the display frame rate of the screen will be reduced, and the rendering frame rate, resolution, and polygon count of the screen will be reduced.

[0086] If there is someone sitting in the corresponding position of the screen but not using it, when the screen is in the closed state, the application processes designed for the screen will be closed to release system resources as much as possible; if the screen is in the open state, the display frame rate of the screen will be reduced, and the rendering frame rate, resolution, and polygon count of the screen will be reduced; in addition, for the running processes, the priority will be reduced, and the system resources occupied by the processes corresponding to the screen will be recycled first.

[0087] If there is someone sitting in the corresponding position of the screen and it is in the use state, the multiple screens in use will be sorted according to whether there are in-vehicle users sitting in the corresponding positions of all screens, whether the line-of-sight position of the in-vehicle users is on the corresponding screen, whether there is a touch screen operation on the screen, etc. For the screen with a higher priority, the corresponding application priority is also higher, and the system resources it occupies are not easily recycled.

[0088] The member position corresponding to each screen is recognized at regular intervals, and the data is processed to eliminate jitter for refreshing the usage and priority of the screen, and the above operations are automatically repeated.

[0089] It should be noted that in addition to the above function adjustments, the target cockpit function can also be the adjustment of the rearview mirror position, the adjustment of the driving mode, the adjustment of the windshield wiper, etc.

[0090] Furthermore, since the target cockpit function is a cockpit function that can be adjusted based on the target body data calculated from the user's driving state information, seat state information, and body data of different types of preset human bodies, the target cockpit function includes, but is not limited to, the various functions described above. In the vehicle cockpit control method disclosed in some other specific embodiments of the present invention, the target cockpit function may also include other functions that can be automatically adjusted based on the target body data in addition to the above functions. The user can determine the specific target cockpit function based on specific needs and specific application scenarios.

[0091] In the vehicle cockpit control method disclosed in another specific embodiment of the present invention, after controlling the target cockpit function in the vehicle according to the target body data, the vehicle cockpit control method further includes: receiving a setting operation of the user on the target cockpit function, and in response to the setting operation, performing corresponding control processing on the target cockpit function of the vehicle.

[0092] The vehicle cockpit control system includes a display screen. After the target cockpit function completes automatic adjustment, if the user adjusts a certain target cockpit function in the vehicle, the user performs a setting operation on the display screen. The display screen generates setting information, where the setting information includes parameters corresponding to the target cockpit function, and sends the setting information to the vehicle control module in the controller. The vehicle control module adjusts the target cockpit function based on the parameters corresponding to the target cockpit function in the setting information. Furthermore, after the user performs a setting operation on the target cockpit function and adjusts the target cockpit function, the controller performs corresponding automatic adjustment on the target cockpit function related to the target cockpit function to ensure that all functions in the cabin meet the user's personalized requirements.

[0093] Furthermore, while the vehicle cockpit control system adjusts the target cockpit function based on the user's setting operation, it collects the parameters corresponding to the target cockpit function included in the setting information corresponding to the user's setting operation, and continuously iteratively optimizes the algorithm logic for automatic adjustment of each function based on the parameters corresponding to the target cockpit function in the setting information corresponding to each user's setting operation. It can also adjust the body data of different types of human bodies used to calculate the target body data.

[0094] It should be noted that the setting operation of the user on the target cockpit function can also be an adjustment of their own sitting posture and driving state.

[0095] In the vehicle cockpit control method disclosed in another specific embodiment of the present invention, controlling the target cockpit function in the vehicle according to the target body data includes: controlling the target cockpit function in the vehicle according to the target body data and a preset function control algorithm, where the function control algorithm is obtained based on the user's manual historical setting information of the target cockpit function.

[0096] Specifically, when the user adjusts various functions in the vehicle cockpit, the system collects the user's manual historical setting information and continuously iterates through the user's manual historical setting information to improve the algorithm logic in the function control algorithm.

[0097] Specifically, in an implementation method that the vehicle cockpit control method of the present application may achieve, after the user manually adjusts a certain function, one or more functions will change synchronously. At this time, the controller collects the change information of all functions in the vehicle cockpit simultaneously.

[0098] It should be noted that the content collected by the system is not limited to the user's manual historical setting information, but also includes the parameters of other target cockpit functions affected by the target cockpit function adjusted by the user and the user's usage habits of the target cockpit function, etc.

[0099] Reference Figure 2 , Figure 2 is a schematic flowchart of another vehicle cockpit control method provided by an embodiment of the present invention. In the vehicle cockpit control method disclosed in another specific embodiment of the present invention, when the vehicle cockpit control system meets a preset condition, the first user information is obtained by shooting through the first camera and the second user information is obtained by shooting through the second camera.

[0100] Reference Figure 2 , in the vehicle cockpit control method disclosed in another specific embodiment of the present invention, before the first camera and the second camera obtain user information, the vehicle cockpit control method further includes: Step S0: The vehicle cockpit control system automatically determines whether the current vehicle cockpit control system meets the preset condition, that is, determines whether the system reaches the activation condition. The preset conditions include: the in-vehicle system in the vehicle cockpit control system has been started, the cameras in the vehicle cockpit control system have been turned on, the camera permissions in the vehicle cockpit control system have been authorized, the target cockpit function switch has been turned on, and the camera status in the vehicle cockpit control system is normal. Among them, the cameras in the vehicle cockpit control system include the first camera and the second camera. When the current vehicle cockpit control system meets the preset condition, that is, when the system reaches the activation condition, step S1 is executed, that is, the first user information is obtained by shooting through the first camera, that is, and the second user information is obtained by shooting through the second camera, so as to facilitate the execution of subsequent step S2, step S3, and step S4; when the current vehicle cockpit control system does not meet the preset condition, step S6 is executed: the vehicle cockpit control system controls the in-vehicle system to start, the camera to be turned on, the target function switch to be turned on, reminds the user to authorize the camera permissions, and reminds the user to check the camera status, so as to facilitate the vehicle cockpit control system to meet the preset condition.

[0101] Reference Figure 2, Based on the above, after controlling the target cockpit function in the vehicle according to the target body data, that is, after executing step S4, the user can also perform setting operations on the display screen in the vehicle and / or the adjustment button corresponding to the target function according to their own needs to further adjust the target cockpit function. At this time, the controller records the parameters corresponding to the target cockpit function in the setting information corresponding to the user's setting operation to iteratively optimize the algorithm logic for automatic adjustment of the target cockpit function based on the parameters corresponding to the target cockpit function in the setting information corresponding to the user's setting operation. Therefore, the vehicle cockpit control method further includes: Step S5: When the user performs a setting operation, the controller records the parameters corresponding to the target cockpit function in the setting information corresponding to the user's setting operation to iteratively optimize the algorithm logic for automatic adjustment of the target cockpit function based on the parameters corresponding to the target cockpit function in the setting information corresponding to the user's setting operation.

[0102] Figure 3 is a schematic flowchart of another vehicle cockpit control method provided by an embodiment of the present invention. In Figure 3 In the shown control method, when the first camera is a DMS camera and an OMS camera, and the second camera is any external vehicle camera, the control method includes: When the vehicle cockpit control system starts to run, Step S00: Determine that the vehicle cockpit control system reaches the activation condition; Step S11: Obtain the in-cockpit image information through the DMS camera and the OMS camera, and combine the external vehicle camera to obtain the image information of the user before getting into the vehicle. This image information is used to assist in calculating the driving data, and further, to assist in calculating the human body data, that is, execute step S1. Among them, the first user information is the in-cockpit image information of the user, and the second user information is the image information of the user before getting into the vehicle. Obtaining the in-cockpit image information through the DMS camera and the OMS camera, and obtaining the image information of the user before getting into the vehicle through the external vehicle camera are operations performed by multiple cameras respectively; Step S22: Based on the obtained in-cockpit image information and the image information of the user before getting into the vehicle, calculate the driving data of the in-vehicle user, that is, execute step S2. Among them, the driving state information includes the driving data; Step S33: Combine the driving data with the seat position information and the body data of different genders and age groups to calculate the human body data, that is, execute step S3. Among them, the seat state information is the seat position information, the body data of different types of human bodies are the body data of different genders and age groups, and the target body data is the human body data; Step S44: Output the human body data to each function for automatic setting, that is, execute step S4. Among them, each function is each target function; Step S55: After automatic setting, the vehicle cockpit control system records the data manually fine-tuned by the user, and the user iteratively optimizes the accuracy of the algorithm, that is, execute step S5. Among them, the user's setting operation is the user's manual fine-tuning operation, and the setting information includes: the data manually fine-tuned by the user.

[0103] Furthermore, based on the above, the first camera is a DMS camera and an OMS camera. The first camera captures the first user information, that is, the user information inside the vehicle cockpit is obtained through the DMS camera and the OMS camera. The second camera can be any camera installed outside the vehicle body. The second camera captures the second user information. The second camera can capture the image information of the user in different states before entering the vehicle, that is, the image information of the user before getting into the vehicle is obtained based on the external camera of the vehicle.

[0104] Furthermore, the preset conditions include, but are not limited to, that the in-vehicle system in the vehicle cockpit control system has been started, the camera in the vehicle cockpit control system has been turned on, the camera permissions in the vehicle cockpit control system have been authorized, the target cockpit function switch has been turned on, and the camera status in the vehicle cockpit control system is normal. For specific preset conditions, the user can determine them based on the requirements and the structure required to execute the above steps in the vehicle cockpit control system, which is not limited here.

[0105] Figure 4 The structural schematic diagram of the vehicle cockpit control system disclosed in another specific embodiment of the present invention. The vehicle cockpit control system includes a first camera, a second camera, and a controller. The first camera is a camera built into the vehicle, and the second camera is a camera installed outside the vehicle. Among them, the second camera is used to capture the first user information and send it to the controller; the second camera is used to capture the second user information and send it to the controller; the controller is used to calculate the driving and riding state information of the user inside the vehicle based on the obtained first user information and second user information, calculate the target body data of the user inside the vehicle according to the driving and riding state information, the seat state information, and the body data of different types of people, and control the target cockpit function in the vehicle according to the target body data.

[0106] Furthermore, the controller includes: an algorithm module, a vehicle control module, and a cockpit intelligent adjustment module; the vehicle control module is used to obtain the status information of various functions in the vehicle cockpit in real time, that is, to obtain the cockpit control information. The vehicle control module is also used to adjust the setting algorithms of each function in response to the adjustment information of the cockpit intelligent adjustment module. The algorithm module is used to receive the first user information, the second user information, and the cockpit control information sent by the first camera, the second camera, and the vehicle control module, and calculate the target body data of the user inside the vehicle in combination with the preset body data of different types of people. The cockpit control information includes: seat state information. The cockpit intelligent adjustment module is used to receive the target body data of the user inside the vehicle and generate the adjustment information corresponding to the target cockpit function according to different body data.

[0107] Furthermore, the vehicle control module is also used to adjust the parameter settings of each function in the cockpit automatically in response to the adjustment information of the cockpit intelligent adjustment module.

[0108] It should be noted that, in addition to the embodiments of the present invention described in the above specific embodiments, those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. Although the description of the present invention is introduced in conjunction with preferred embodiments, this does not mean that the features of this invention are limited to this embodiment. On the contrary, the purpose of introducing the invention in conjunction with the embodiment is to cover other alternatives or modifications that may be extended based on the claims of the present invention. In order to provide a deep understanding of the present invention, many specific details are included in the above description, and the present invention can also be implemented without using these details. In addition, in order to avoid confusion or obscuring the focus of the present invention, some specific details will be omitted in the description. It should be noted that, without conflict, the embodiments in the present invention and the features in the embodiments can be combined with each other.

[0109] It should be noted that in this specification, similar reference numerals and letters denote similar items in the following drawings. Therefore, once an item is defined in one drawing, it does not need to be further defined and explained in subsequent drawings.

[0110] In the description of this embodiment, it should be noted that the orientation or positional relationship indicated by terms such as "upper", "lower", "inner", "bottom", etc. is based on the orientation or positional relationship shown in the drawings, or the orientation or positional relationship in which the inventive product is usually placed during use. It is only for the convenience of describing the present invention and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the present invention.

[0111] Terms such as "first", "second", etc. are only used for distinguishing descriptions and cannot be understood as indicating or implying relative importance.

[0112] In the description of this embodiment, it should also be noted that unless otherwise clearly specified and limited, the terms "set", "connected", "connected to" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in this embodiment can be understood according to specific situations.

[0113] Although the present invention has been illustrated and described with reference to certain preferred embodiments thereof, those of ordinary skill in the art should understand that the above is a further detailed description of the present invention in connection with specific embodiments, and it cannot be determined that the specific implementation of the present invention is limited only to these descriptions. Those skilled in the art can make various changes in form and detail, including making several simple deductions or substitutions, without departing from the spirit and scope of the present invention.

Claims

1. A vehicle cockpit control method, characterized in that, Applied to the controller included in the vehicle cockpit control system, the vehicle cockpit control system further includes: a first camera and a second camera, the first camera is a camera disposed inside the vehicle, and the second camera is a camera disposed outside the vehicle. The method includes: Obtain first user information captured by the first camera and second user information captured by the second camera; Calculate the driving state information of the user inside the vehicle according to the first user information and the second user information; Calculate the target body data of the user inside the vehicle according to the driving state information, the seat state information, and the body data of different types of people; Control the target cockpit function in the vehicle according to the target body data.

2. The vehicle cockpit control method according to claim 1, wherein The first camera includes a driver monitoring system camera and a passenger monitoring system camera, and the first user information includes the user information captured by the driver monitoring system camera and the user information captured by the passenger monitoring system camera; The second camera includes a left-side body camera and a right-side body camera, and the second user information includes the user information captured by the left-side body camera and the user information captured by the right-side body camera.

3. The vehicle cockpit control method according to claim 1, wherein, The first user information includes the facial image and torso feature points of the user inside the vehicle.

4. The vehicle cockpit control method according to claim 1, characterized in that, The driving state information includes age information, gender information, eyeball position information, and body posture information.

5. The vehicle cockpit control method according to claim 1, wherein, The target body data includes height information, arm span information, leg length information, and body posture information.

6. According to claim 1, characterized in that: The target cockpit function includes at least one of the following functions: steering wheel setting function, tailgate setting function, headlight setting function, window setting function, seat belt position setting function, screen setting function, and resource allocation function.

7. The vehicle cockpit control method according to any one of claims 1-6, characterized in that, After controlling the target cockpit function in the vehicle according to the target body data, the method further includes: Receive a setting operation of the user on the target cockpit function, and in response to the setting operation, perform corresponding control processing on the target cockpit function in the vehicle.

8. The vehicle cockpit control method according to any one of claims 1-7, characterized in that, Controlling the target cockpit function in the vehicle according to the target body data includes: Controlling the target cockpit function in the vehicle according to the target body data and a preset function control algorithm, and the function control algorithm is obtained based on the manual historical setting information of the user on the target cockpit function.

9. The vehicle cockpit control method according to any one of claims 1-8, characterized in that, The method further includes: When a preset condition is met, obtain the first user information by shooting with the first camera and obtain the second user information by shooting with the second camera.

10. A vehicle cockpit control system, characterized in that, Including: A first camera, a second camera, and a controller. The first camera is a camera built inside the vehicle, and the second camera is a camera disposed outside the vehicle. Among them, The first camera is used to capture first user information and send it to the controller; The second camera is used to capture second user information and send it to the controller; The controller is configured to calculate the driving and riding state information of the in-vehicle user based on the acquired first user information and the second user information, calculate the target body data of the in-vehicle user according to the driving and riding state information, the seat state information, and the body data of different types of people, and control the target cockpit function in the vehicle according to the target body data.

Images