Cockpit adjustment methods, devices, tips, and vehicles
The cockpit adjustment method uses 3D spatial position information to enable one-time precise adjustments of vehicle components, addressing repetitive operation issues and enhancing user experience and safety.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- YINWANG INTELLIGENT TECHNOLOGIES CO LTD
- Filing Date
- 2024-01-25
- Publication Date
- 2026-06-08
AI Technical Summary
Existing cockpit adjustment methods require users to repeatedly perform operations on physical buttons or controls, increasing operational difficulty and affecting user experience and comfort.
A cockpit adjustment method that utilizes three-dimensional spatial position information to precisely adjust seat and other components based on user body size and posture, allowing for one-time accurate adjustments without re-adjusting the seat during subsequent adjustments.
Enhances user experience by reducing repetitive actions and ensuring precise adjustments that meet safety and comfort requirements, maintaining user posture and improving driving conditions.
Smart Images

Figure 2026518410000001_ABST
Abstract
Description
Technical Field
[0001] This application claims the priority of Chinese Patent Application No. 202310415340.X, titled "COCKPIT ADJUSTMENT METHOD AND APPARATUS, CHIP, AND VEHICLE", filed with the China National Intellectual Property Administration on April 11, 2023, the entire content of which is incorporated herein by reference.
[0002] This application relates to the field of artificial intelligence technology, and in particular, to a cockpit adjustment method and apparatus, a chip, and a vehicle.
Background Art
[0003] Currently, based on the user's driving requirements, comfort, etc., the user can adjust hardware devices in the vehicle cockpit, such as seats, steering wheels, central control screens, or rearview mirrors. In some adjustment solutions, the user can perform operations on adjustment buttons, adjustment devices, etc. corresponding to the hardware devices to adjust the hardware devices. In some other adjustment solutions, adjustment controls corresponding to some hardware devices may be displayed on the central control screen, and the user may perform operations on the corresponding controls on the central control screen without adjusting physical buttons.
[0004] However, in these adjustment solutions, when adjusting hardware devices, the user usually cannot complete the adjustment at one time and needs to repeatedly perform operations on physical buttons, controls, etc. multiple times. This not only increases the difficulty and complexity of operation for the user, but also affects the user experience.
Summary of the Invention
Means for Solving the Problems
[0005] Embodiments of this application provide a cockpit adjustment method and apparatus, a chip, and a vehicle. This prevents the user from repeatedly performing multiple actions on a single cockpit component, thus improving the user experience. This also allows for more precise adjustment of adjustable components, including seats, to meet safety and comfort requirements.
[0006] To achieve the above-mentioned objectives, the following technical solutions are used in embodiments of this application.
[0007] According to a first embodiment, a cockpit adjustment method is provided. In this method, after the user is seated in the seat, first three-dimensional spatial position information of the user in the cockpit can be obtained, the cockpit includes a seat and adjustable components, the adjustable components including one or more of the steering wheel, rearview mirror, and head-up display image capture pictures. Then, the user's body size information is determined based on the first three-dimensional spatial position information, and the seat setting items of the seat are adjusted based on the body size information, the seat setting items including one or more of the seat angle, position, and height. After the seat setting items are adjusted, second three-dimensional spatial position information of the user in the cockpit is obtained. Finally, based on the second three-dimensional spatial position information, the component setting items of the adjustable components are adjusted, the component setting items including one or more of the position, height, angle, and size of the adjustable components.
[0008] The first and second three-dimensional (3D) spatial position information represent the user's 3D information at different points in time and / or different poses in 3D space, respectively. The 3D spatial position information includes three-dimensional information, and the user represented by the information is three-dimensional. Based on the 3D spatial position information, the user's body size information can be more accurately reconstructed or determined, and the seat, adjustable components, etc., in the cockpit can be adjusted more precisely.
[0009] In some possible application scenarios, user body size information may include, but is not limited to, eye position, height, contour, weight, arm length, leg length, etc.
[0010] In addition, in the cockpit adjustment method, the seat angle, position, and height are adjusted first, and the seat does not need to be readjusted when other adjustable components are adjusted afterward. Therefore, after the user sits in the adjusted seat, it can be understood that the user's posture remains unchanged or has only a slight change. In this case, adjustments to other adjustable components do not affect the previously adjusted seat, and the position, angle, height, size, etc. of other adjustable components can be adjusted more precisely based on the user's three-dimensional spatial position information obtained after the seat has been adjusted. This prevents the user from repeatedly performing actions or adjustments on a single component, and also makes adjustments to adjustable components, including the seat, more precise, meeting user requirements and ensuring a good user experience.
[0011] In the implementation of the first embodiment, when acquiring the first three-dimensional spatial position information in the method described above, first prompt information may be displayed after the user sits in the seat, and the first prompt information is used to remind the user to adjust their seating posture. After displaying the first prompt information for a predetermined period, the user's pose information in the cockpit is acquired, and the pose information includes one or more of the user's body image, point cloud information, and radar imaging information. Finally, the user's first three-dimensional spatial position information in the cockpit's spatial coordinate system is determined based on the pose information.
[0012] In addition, in some possible application scenarios, user pose information within the cockpit may be acquired by sensors or the like. In some other possible application scenarios, the method of displaying the first prompt information may include, but is not limited to, displaying the first prompt information or broadcasting the first prompt information.
[0013] In the implementation described above, the first prompt information can enable the user to adopt a more accurate posture. Since the user spends a certain amount of time adjusting their posture after receiving the first prompt information, the pose information is acquired only after the first prompt information has been displayed for a predetermined period of time. In this way, sufficient time is provided for the user to adjust their posture, ensuring that the user's posture meets the requirements of the first prompt information, or that the user's posture is standard, ensuring that the acquired pose information is more accurate. In addition, in the method described above, the first three-dimensional spatial position information may alternatively be determined based on multiple types of pose information. For example, the first three-dimensional spatial position information may be determined based on human body images, point cloud information, and radar imaging information.
[0014] In the implementation of the first embodiment, when adjusting the seat setting items of a seat in the method described above, a pre-configured configuration parameter that matches the body size information of the seat setting item may be obtained first, and then one or more of the seat angle, position, and height are adjusted based on the pre-configured configuration parameter of the seat setting item.
[0015] In the implementation described above, the pre-configured configuration parameters may be pre-set, or they may be obtained by performing constraint calculations on the user's body size information in terms of line of sight safety and spatial comfort. After the seat is adjusted based on the pre-configured configuration parameters, the seat height, position, angle, etc., can better match the user's current posture or body size, and can also accommodate the user's driving habits to ensure driving safety and comfort.
[0016] In the implementation of the first embodiment, when adjusting the component settings of an adjustable component in the method described above, the user's eye position, upper body position, and arm length can be determined based on second three-dimensional spatial position information. Next, the preset configuration parameters of the steering wheel setting items are obtained, and these preset configuration parameters match the eye position, upper body position, and arm length. Finally, the height and angle of the steering wheel are adjusted based on the preset configuration parameters of the steering wheel setting items.
[0017] In the implementation described above, the pre-set configuration parameters may be pre-set or obtained by performing constraint calculations on the user's eye position and arm length from the perspective of visual safety and spatial comfort. After the steering wheel is adjusted based on the pre-set configuration parameters, the height, angle, etc. of the steering wheel can better match the user's current posture and satisfy the user's driving habits, thereby ensuring driving safety and comfort.
[0018] In the implementation of the first embodiment, when adjusting the setting items of the adjustable components in the method described above, the position of the user's eyes can be determined based on second three-dimensional spatial position information. Then, the preset configuration parameters of the head-up display's captured picture that match the position of the eyes are obtained, and the position and size of the head-up display's captured picture are adjusted based on the preset configuration parameters of the head-up display's captured picture.
[0019] In the implementation described above, the pre-set configuration parameters may be those that have been pre-set, or they may be obtained by performing constraint calculations on the user's eye position, etc., from the viewpoint of visual safety and spatial comfort. After adjusting the captured picture of the head-up display based on the pre-set configuration parameters, the position, size, etc., of the captured picture of the head-up display can better match the user's current posture, satisfy the user's driving habits, and guarantee driving safety and comfort.
[0020] In the implementation of the first embodiment, when adjusting the setting items of the adjustable components in the method described above, the user's eye position can be determined based on second three-dimensional spatial position information. Next, based on the eye position and the size of the vehicle, the preset configuration parameters of the rearview mirror are determined, and the angle of the rearview mirror is adjusted based on the preset configuration parameters of the rearview mirror.
[0021] In the implementation described above, the pre-set configuration parameters are determined according to the implementation safety requirements. After the rearview mirror is adjusted based on the pre-set configuration parameters, the user can see an image that meets the pre-set conditions from the rearview mirror in their current position. The angle of the rearview mirror can also be adjusted to better match the user's current position and accommodate the user's driving habits, thus ensuring driving safety and comfort.
[0022] In the implementation of the first embodiment, when acquiring the second three-dimensional spatial position information of the user in the cockpit using the method described above, the second prompt information may be displayed first after the seat setting items of the seat have been adjusted, and the second prompt information is used to remind the user to adjust the seat setting items of the seat. After the second prompt information is displayed, the first adjustment operation performed by the user on the seat setting items is received. Then, in response to the first adjustment operation, the seat setting items are readjusted, and the current second three-dimensional spatial position information of the user in the cockpit is acquired.
[0023] In the implementation described above, automatic seat adjustment may not meet the user's requirements, driving habits, etc., so a second prompt is displayed to remind the user to perform manual adjustments. After receiving the second prompt, the user may perform the first adjustment operation on the seat settings to ensure that the seat angle, position, and height better meet the user's requirements or driving habits.
[0024] In the implementation of the first embodiment, in the method described above, in response to the first adjustment operation, the first configuration parameters of the seat setting item obtained through the first adjustment operation may be further stored, and then the first configuration parameters of the seat setting item are associated with a user.
[0025] In the implementation of the first embodiment, in the method described above, a third prompt information may be displayed after the component setting item of the adjustable component has been adjusted, the third prompt information is used to remind the user to adjust the component setting item of the adjustable component. After the third prompt information is displayed, a second adjustment operation performed by the user on the component setting item is received. Then, in response to the second adjustment operation, the component setting item is readjusted and the first configuration parameter of the component setting item obtained through the second adjustment operation is stored. Finally, the first configuration parameter of the component setting item is associated with the user.
[0026] In the implementation described above, after the component settings of adjustable components other than seats have been adjusted, a third prompt may be displayed to remind the user to manually adjust the component settings of the adjustable components. After receiving the third prompt, the user may perform a second adjustment operation on the component settings to ensure that the angle, position, height, size, etc. of the adjustable components better meet the user's requirements or driving habits.
[0027] In the implementation of the first aspect, in the above method, after the same user sits on the seat again, the cockpit configuration parameters associated with the user can be further obtained, and the cockpit configuration parameters include the first configuration parameters of the stored seat setting items and the first configuration parameters of the component setting items. Next, based on the cockpit configuration parameters, the seat setting items and the component setting items are adjusted separately.
[0028] In the above implementation, one user may drive the vehicle multiple times. However, if it is necessary to perform linkage adjustment on the seat and other adjustable components before each driving, the efficiency of cockpit adjustment will be significantly reduced. Based on this, when the user drives the vehicle for the first time, the user may be prompted to adjust the posture and perform linkage adjustment on the seat and other adjustable components. The configuration parameters of the seat setting items and the configuration parameters of the component setting items of the adjustable components obtained through the adjustment are stored and associated with the current user. When the same user drives the vehicle again, a series of configuration parameters corresponding to the user may be directly obtained, and the seat and other adjustable components are directly adjusted based on the configuration parameters. The positions, heights, angles, sizes, etc. of the seat and other adjustable components adjusted during the first driving are to meet the driving safety requirements and driving comfort requirements of the user. When the same user drives the vehicle again, the seat and other adjustable components are directly adjusted by using the configuration parameters of the seat setting items and the component setting items obtained through the adjustment during the first driving. As a result, the seat and other adjustable components can also meet the driving safety requirements and driving comfort requirements of the user.
[0029] In the implementation form of the first aspect, in the above method, after the seat setting items and component setting items are adjusted based on the cockpit configuration parameters related to the user, a second configuration parameter that matches the current body size information of the seat setting items may be further obtained. In addition, when the difference between the second configuration parameter of the seat setting items and the first configuration parameter of the seat setting items is greater than or equal to a preset difference, the seat setting items are adjusted based on the second configuration parameter of the seat setting items.
[0030] In the above implementation form, since the user's body size, sitting posture, etc. may change during the non-first driving of the user, after the seat setting items are adjusted based on the cockpit configuration parameters associated with the user, a second configuration parameter of the seat setting items that matches the current body size information may be alternatively re-obtained. When the difference between the current second configuration parameter of the seat setting items and the first configuration parameter of the seat setting items in the cockpit configuration parameters obtained by the vehicle is large, the seat setting items may be readjusted based on the current second configuration parameter of the seat setting items. As a result, the adjusted angle, height, position, etc. of the seat meet the safety requirements and comfort requirements of the user in the current state.
[0031] In the implementation form of the first aspect, in the above method, after the seat setting items are adjusted based on the second configuration parameter of the seat setting items, a second configuration parameter of the component setting items that matches the current second three-dimensional space position information of the user may be further obtained. In addition, when the difference between the second configuration parameter of the component setting items and the first configuration parameter of the component setting items is greater than or equal to a predetermined difference, the component setting items are adjusted based on the second configuration parameter of the component setting items.
[0032] In the implementation described above, after readjusting the seat settings, the current second configuration parameter of the component setting item of the further adjustable component is obtained. If there is a large difference between the current second configuration parameter of the component setting item and the first configuration parameter of the component setting item in the cockpit configuration parameters obtained by the vehicle, the component setting item can be readjusted based on the current second configuration parameter of the component setting item so that the adjusted angle, height, position, size, etc. of the adjustable component meet the user's safety and comfort requirements in the current state.
[0033] According to a second embodiment, a cockpit adjustment device is provided, comprising a first information acquisition module, a first adjustment module, a second information acquisition module, and a second adjustment module. The first information acquisition module is configured to acquire first three-dimensional spatial position information of the user in the cockpit after the user has sat in the seat. The first adjustment module is configured to determine the user's body size information based on the first three-dimensional spatial position information and to adjust the seat setting items of the seat based on the body size information. The second information acquisition module is configured to acquire second three-dimensional spatial position information of the user in the cockpit after the seat setting items have been adjusted. The second adjustment module is configured to adjust the component setting items of the adjustable components based on the second three-dimensional spatial position information.
[0034] The cockpit includes a seat and adjustable components. The adjustable components include one or more of the following: the steering wheel, rearview mirror, and head-up display image. Component settings include one or more of the following: position, height, angle, and size of the adjustable components. Seat settings include one or more of the following: angle, position, and height of the seat.
[0035] In the implementation of the second embodiment, the first adjustment module is further configured to obtain a preset configuration parameter that matches the body size information of the seat setting item, and to adjust one or more of the seat angle, position, and height based on the preset configuration parameter of the seat setting item.
[0036] In the implementation of the second embodiment, the second adjustment module is further configured to determine the user's eye position, upper body position, and arm length based on second three-dimensional spatial position information, obtain a preset configuration parameter for the steering wheel setting item, the preset configuration parameter being the eye position, upper body position, and arm length, and adjust the height and angle of the steering wheel based on the preset configuration parameter for the steering wheel setting item.
[0037] In the implementation of the second embodiment, the second adjustment module is further configured to determine the position of the user's eyes based on the second three-dimensional spatial position information, obtain pre-configured configuration parameters of the head-up display image captured picture that match the eye position, and adjust the position and size of the head-up display image captured picture based on the pre-configured configuration parameters of the head-up display image captured picture.
[0038] In the implementation of the second embodiment, the second adjustment module is further configured to determine the user's eye position based on second three-dimensional spatial position information, determine preset configuration parameters of the rearview mirror based on the eye position and vehicle size, and adjust the angle of the rearview mirror based on the preset configuration parameters of the rearview mirror.
[0039] In the implementation of the second embodiment, the second information acquisition module is further configured to display a second prompt after adjusting the seat setting items of the seat, receive a first adjustment action performed by the user on the seat setting items after displaying the second prompt information, readjust the seat setting items in response to the first adjustment action, and acquire the user's current second three-dimensional spatial position information within the cockpit. The second prompt information is used to remind the user to adjust the seat setting items of the seat.
[0040] In the implementation of the second embodiment, the cockpit adjustment device further includes an association module. The association module is configured to store a first configuration parameter of a seat setting item obtained by the first adjustment operation in response to the first adjustment operation, and to associate the first configuration parameter of the seat setting item with a user.
[0041] In the implementation of the second embodiment, the second adjustment module is further configured to display a third prompt after the component setting item of an adjustable component has been adjusted, to receive a second adjustment operation performed by the user on the component setting item after the third prompt information has been displayed, and to readjust the component setting item in accordance with the second adjustment operation. In addition, the association module is further configured to store a first configuration parameter of the component setting item obtained through the second adjustment operation and to associate the first configuration parameter of the component setting item with the user. The third prompt information is used to remind the user to adjust the component setting item of an adjustable component.
[0042] In the implementation of the second embodiment, the cockpit adjustment device further includes a third adjustment module. The third adjustment module is configured to retrieve cockpit configuration parameters associated with the user after the same user sits in the seat again, the cockpit configuration parameters including a first configuration parameter for a stored seat setting item and a first configuration parameter for a component setting item, and to adjust the seat setting item and the component setting item separately based on the cockpit configuration parameters.
[0043] In the implementation of the second embodiment, the first adjustment module is further configured to adjust seat setting items and component setting items based on cockpit configuration parameters associated with the user, then obtain a second configuration parameter that matches the current body size information of the seat setting item, and if the degree of difference between the second configuration parameter of the seat setting item and the first configuration parameter of the seat setting item is greater than or equal to a predetermined degree of difference, adjust the seat setting item based on the second configuration parameter of the seat setting item.
[0044] In the implementation of the second embodiment, the second adjustment module is further configured to adjust the seat setting item based on the second configuration parameter of the seat setting item, then obtain the second configuration parameter of the component setting item that matches the user's current second three-dimensional spatial position information, and if the degree of difference between the second configuration parameter of the component setting item and the first configuration parameter of the component setting item is greater than or equal to a preset degree of difference, then adjust the component setting item based on the second configuration parameter of the component setting item.
[0045] According to a third aspect, a chip is provided, comprising memory and one or more processors. The memory is coupled to the processors. The memory stores computer program code, which includes computer instructions. When the computer instructions are executed by the processors, the chip becomes capable of performing a cockpit adjustment method according to either the first aspect or one of the implementations of the first aspect.
[0046] According to a fourth aspect, a vehicle is provided. The vehicle's cockpit includes a first controller, a second controller, sensors, a seat, and adjustable components. The adjustable components include one or more of the following: a steering wheel, a rearview mirror, and a head-up display image. The first controller is connected separately to the seat and the adjustable components. The second controller is connected to the sensors. The first controller is connected to the second controller. The second controller is configured to acquire pose information of the user in the cockpit via the sensors, the pose information including one or more of the user's body image, point cloud information, and radar image information. The first controller is configured to acquire pose information from the second controller and, after the user sits in the seat, acquire first three-dimensional spatial position information of the user in the cockpit based on the pose information. The first controller is configured to determine the user's body size information based on the first three-dimensional spatial position information and to adjust seat setting items of the seat based on the body size information, the seat setting items further include one or more of the seat angle, position, and height. The first controller is further configured to obtain pose information from the second controller and second three-dimensional spatial position information of the user in the cockpit after the seat setting items have been adjusted. The first controller is configured to adjust the component setting items of the adjustable components based on the second three-dimensional spatial position information, the component setting items further include one or more of the position, height, angle and size of the adjustable components.
[0047] According to the fifth aspect, a vehicle is provided which includes a cockpit adjustment device according to the second aspect or a chip according to the third aspect.
[0048] According to the sixth aspect, a computer-readable storage medium is provided, which includes computer instructions. When the computer instructions are executed on the chip, the chip becomes capable of performing a cockpit adjustment method according to either the first aspect or one of the implementations of the first aspect.
[0049] According to the seventh aspect, a computer program product is provided. When the computer program product is executed on a computer, the computer becomes capable of performing a cockpit adjustment method according to either the first aspect or one of the implementations of the first aspect.
[0050] It will be understood that the advantages that can be achieved by the cockpit adjustment device according to the second embodiment, the chip according to the third embodiment, the vehicle according to the fourth embodiment, the vehicle according to the fifth embodiment, the computer-readable storage medium according to the sixth embodiment, and the computer program product according to the seventh embodiment can be referenced to the advantages of the first embodiment or any one of the possible design schemes of the first embodiment. Further details are not described here again. [Brief explanation of the drawing]
[0051] [Figure 1] This is a diagram of a communication system according to one embodiment of the present application. [Figure 2] This is a diagram showing the structure of a vehicle according to one embodiment of this application. [Figure 3] This is a first diagram of the structure of a vehicle cockpit according to one embodiment of the present application. [Figure 4] This is a second diagram showing the structure of a vehicle cockpit according to one embodiment of the present application. [Figure 5] This is a schematic flowchart of a vehicle cockpit adjustment method according to one embodiment of this application. [Figure 6] This figure shows prompt information according to one embodiment of the present application. [Figure 7] This figure shows how to acquire three-dimensional spatial position information of the head according to one embodiment of this application. [Figure 8] This figure shows how to obtain pre-set configuration parameters for seat setting items according to one embodiment of this application. [Figure 9] This is a diagram illustrating the spatial comfort requirements for a seat according to one embodiment of this application. [Figure 10] This is a diagram illustrating the spatial comfort requirements for human joints according to one embodiment of this application. [Figure 11] This is the first figure of a visual safety requirement according to one embodiment of the present application. [Figure 12] This figure shows how to obtain pre-set configuration parameters for steering wheel settings according to one embodiment of this application. [Figure 13] This is a second figure illustrating the visual safety requirement according to one embodiment of the present application. [Figure 14] This is a diagram illustrating the spatial safety requirements according to one embodiment of this application. [Figure 15] This is a diagram illustrating the grip comfort requirements according to one embodiment of this application. [Figure 16] This figure shows how to adjust the steering wheel setting items according to one embodiment of the present application. [Figure 17] This is a diagram showing an image of a door handle on a rearview mirror according to one embodiment of the present application. [Figure 18(a)] This is a diagram of an imaging picture of a rearview mirror that satisfies pre-set conditions according to one embodiment of the present application. [Figure 18(b)] This is a diagram of an imaging picture of a rearview mirror that satisfies pre-set conditions according to one embodiment of the present application. [Figure 19] This is a diagram showing the structure of a chip according to one embodiment of this application. [Modes for carrying out the invention]
[0052] The following describes the technical solutions in the embodiments of this application with reference to the accompanying drawings. In the description of this application, " / " indicates an "or" relationship between related objects unless otherwise specified. For example, A / B may indicate A or B. In this application, "and / or" describes only an association relationship between related objects and indicates that three relationships may exist. For example, A and / or B may indicate the following three cases: that only A exists, that both A and B exist, and that only B exists, and A and B may be singular or plural. In addition, in the description of this application, "plural" means two or more unless otherwise specified. "At least one of the following items" or a similar expression indicates any combination of items, including one or any combination of the following items. For example, at least one of a, b, or c may refer to a, b, c, a and b, a and c, b and c, or a, b, and c, where a, b, and c may be singular or plural. In addition, in order to clearly describe the technical solutions in the embodiments of this application, terms such as “first,” “second,” etc., are used in the embodiments of this application to distinguish identical or similar items having essentially the same function or purpose. Those skilled in the art will understand that terms such as “first,” “second,” etc., do not limit the number or order of execution, and do not indicate a clear distinction. In addition, in the embodiments of this application, terms such as “example,” “for example,” etc., are used to give an example, illustration, or explanation. Any embodiment or design scheme described as “example” or “for example” in the embodiments of this application should not be construed as being preferable or advantageous over another embodiment or design scheme. More precisely, terms such as “example,” “for example,” etc., are intended to present related concepts in a particular way for ease of understanding.
[0053] In addition, the service scenarios described in the embodiments of this application are intended to more clearly illustrate the technical solutions in the embodiments of this application and do not constitute a limitation on the technical solutions provided in the embodiments of this application. Those skilled in the art will know that the technical solutions provided in the embodiments of this application are also applicable to similar technical problems arising from the emergence of new service scenarios.
[0054] Currently, a vehicle's cockpit includes multiple adjustable hardware devices such as seats, a steering wheel, a central control screen, and rearview mirrors. Users can adjust the height, angle, and orientation of these hardware devices based on their driving requirements, comfort, and other factors.
[0055] In some adjustment solutions, the user may manually adjust adjustment buttons, adjustment devices, etc., corresponding to the hardware device in order to adjust the hardware device. For example, the driver may adjust the angle of the seat by pulling the angle adjustment lever on the side of the seat, adjust the position of the seat by pulling the horizontal bar under the seat to move the seat forward or backward, or adjust the angle of the rearview mirror by pressing the direction adjustment button on the rearview mirror. Alternatively, the hardware device may be directly adjusted manually to change the height, angle, etc. For example, the driver may lift the target shaft of the steering wheel or lift the steering wheel itself. However, all of these adjustment solutions rely on manual adjustment by the user, and different adjustment methods may exist for different vehicle models and different hardware devices. This increases the difficulty and complexity of operation for the user and affects the user experience.
[0056] In some other adjustment solutions, adjustment controls corresponding to several hardware devices may be displayed on a central control screen, allowing the user to perform actions on the corresponding controls on the central control screen without having to adjust physical buttons. However, these adjustment solutions also rely on manual adjustment by the user. In addition, the user usually cannot complete the adjustment to the hardware device in one go through actions on the controls, and must perform actions on the controls repeatedly. This also increases the difficulty and complexity of operation for the user, affecting the user experience.
[0057] To reduce the difficulty of user operation, there are currently several adjustment solutions that can implement automatic adjustments to hardware devices in the cockpit. For example, when the driver sits in the driver's seat, the driver's seating posture is acquired, and based on the driver's seating posture, the height of the steering wheel, the angle of the rearview mirror, and the angle of the seat are automatically adjusted. However, with these adjustment solutions, if the rearview mirror and steering wheel are adjusted first, and then the seat is adjusted afterward, the user's seating posture and position may change. This can cause the height and angle of the rearview mirror and steering wheel acquired through previous adjustments to become inaccurate, potentially affecting the comfort and safety of the user while driving the vehicle.
[0058] Based on the above, embodiments of this application provide a cockpit adjustment method. Seat settings may be initially adjusted based on three-dimensional spatial position information acquired after the user is seated, to ensure that the seat height, position, angle, etc., meet the user's comfort and safety requirements while driving. After the seat settings are adjusted, the user's three-dimensional spatial information in the current seat state is reacquired. Then, the setting items of another adjustable component are further adjusted based on the user's reacquired three-dimensional spatial information to ensure that the position, angle, height, size, etc., of another adjustable component meet the user's comfort and safety requirements while driving.
[0059] In this way, the angle, position, and height of the seat are adjusted first, and the seat does not need to be readjusted when other adjustable components are subsequently adjusted. Therefore, after the user sits in the adjusted seat, the user's posture can be understood to be unchanged or only slightly changed. In this case, adjustments to other adjustable components do not affect the previously adjusted seat, and the position, angle, height, size, etc. of other adjustable components can be adjusted more precisely based on the user's three-dimensional spatial position information obtained after the seat has been adjusted. The method in the embodiment of this application can prevent the user from repeatedly performing actions or adjustments on a single component, and it can be seen that adjustments can be made more precisely to adjustable components, including the seat, in order to meet user requirements and ensure a good user experience.
[0060] The seat is the driver's seat, and the adjustable components may be understood to include one or more of the following: the steering wheel, the rearview mirror, and the imager of the head-up display.
[0061] The cockpit adjustment method provided in the embodiments of this application may be applied to a communication system. As shown in Figure 1, the communication system may include a carrier 100 and a server 200, where the carrier 100 establishes communication with the server 200. The server 200 may provide the carrier 100, while it is in operation, with relevant information, such as high-precision maps or autonomous driving schemes. Based on the information provided by the server 200, the carrier 100 may provide the user with driving routes, recommendations for gas stations, recommendations for parking lots near the destination, etc. The carrier 100 may further provide the user with autonomous driving services according to the autonomous driving schemes distributed by the server 200.
[0062] In some possible application scenarios, the carrier 100 can further obtain from the server 200 information such as the carrier 100's spatial coordinate information, size information, structural information, and model information, as well as information about components attached to the carrier 100, component models, component size information, etc. Thus, the carrier 100 can determine the user's three-dimensional spatial position information within the carrier 100 based on the relevant information of the carrier 100 and the user, and then determine the user's pose based on the user's three-dimensional spatial position information. In addition, the carrier 100 can further determine how to adjust the components to suit the user's usage requirements, such as the position, height, and angle of the components, based on the user's pose, relevant information of the components, etc.
[0063] The carrier 100 may include road transport means, water transport means, air transport means, industrial devices, agricultural devices, and entertainment devices. For example, the carrier 100 may be a vehicle. A vehicle is a vehicle in a broad sense and may be a means of transportation (e.g., commercial vehicles, passenger cars, motorcycles, flying vehicles, trains, etc.), industrial vehicles (e.g., pallet trucks, trailers, tractors, etc.), work vehicles (e.g., hydraulic excavators, bulldozers, cranes, etc.), agricultural devices (e.g., lawnmowers, harvesters, etc.), entertainment devices, toy vehicles, etc. The type of vehicle is not particularly limited in the embodiments of this application. As another example, the carrier 100 may be a means of transport such as an aircraft or a ship.
[0064] In some possible application scenarios, if the carrier 100 is a vehicle, the vehicle may include multiple control centers, processors, controllers, etc., such as a first controller, a second controller, and a third controller, as shown in Figure 2. In some other possible application scenarios, the first controller may be a smart cockpit domain controller (CDC), the third controller may be a vehicle dynamics controller (VDC), and the second controller may be a multi-domain controller (MDC), etc.
[0065] In some possible application scenarios, the first controller may be connected separately to the seat and adjustable components, and the second controller may be connected to the sensors. The vehicle cockpit may be adjusted based on the first and second controllers. The second controller may control the sensors to acquire pose information of the user in the cockpit. The first controller may acquire pose information from the second controller and, after the user is seated, acquire first three-dimensional spatial position information of the user in the cockpit based on the pose information. The first controller may further determine the user's body size information based on the first three-dimensional spatial position information and adjust the seat settings of the seat based on the body size information. After the seat settings have been adjusted, the first controller may further acquire pose information from the second controller and acquire second three-dimensional spatial position information of the user in the cockpit and adjust the component settings of the adjustable components based on the second three-dimensional spatial position information. As shown in Figure 3, the vehicle cockpit may include components such as a seat 301, a steering wheel 302, a central control screen (or smart screen) 303, a head-up display (HUD) image capture picture 304 (dashed lines indicate the position of the image capture picture), an internal cockpit rearview mirror 305, an external cockpit rearview mirror 306, an air conditioning exhaust vent 307, and a speaker 308.
[0066] From the above, it can be seen that the first controller can control and implement the functions of adjustable components of the vehicle's cockpit, such as seats, steering wheel, head-up display, rearview mirror, smart screen, sound, peripheral hardware (such as microphones and speakers), and application software. The second controller can control and implement the functions of sensors mounted on the vehicle, such as video cameras, cameras, millimeter-wave radar, and LiDAR. The third and second controllers can constitute a multi-form electric drive system within the vehicle and implement brake-by-wire, steer-by-wire, and other vehicle functions.
[0067] In addition, as shown in Figure 2, the vehicle may communicate further with a roadside unit (RSU) or a cloud device (e.g., a server) via a remote information processor (Telematics BOX, T-BOX), communication modules, etc.
[0068] In some other possible application scenarios, the first or second controller within the vehicle may, alternatively, be used separately to adjust the vehicle's cockpit.
[0069] When all components in Figure 3 can be adjusted electronically, if the adjustable components other than the driver's seat (referred to as the seat) are adjusted first, then other adjustable components will need to be readjusted after the seat is adjusted. To address this issue, the vehicle first determines the user's body size information based on the user's three-dimensional spatial position information after the user sits in the seat, and then adjusts the seat angle, position, height, etc., based on the user's body size information so that the user maintains a comfortable posture without affecting the user's safe driving. After adjusting the seat, the vehicle reacquires the user's current three-dimensional spatial information based on the seat's current angle, position, height, etc. Because the user's posture changes due to the seat adjustment, the reacquired three-dimensional spatial position information may differ from the three-dimensional spatial position information acquired before the seat adjustment. Next, the vehicle continues to adjust other adjustable components, such as the steering wheel, external cockpit rearview mirror (referred to as the rearview mirror), or HUD image picture, based on the user's newly acquired three-dimensional spatial information, to ensure that the position, angle, height, size, etc., of the other adjustable components can meet the user's comfort and safety requirements while driving. In this way, the seat angle, position, height, etc., are adjusted first, and the seat does not need to be readjusted when other adjustable components are subsequently adjusted. Therefore, after the user sits in the adjusted seat, the user's posture can be understood to be unchanged or only slightly changed. In this case, adjustments to other adjustable components do not affect the previously adjusted seat, and the position, angle, height, size, etc., of the other adjustable components can also be adjusted more precisely based on the user's three-dimensional spatial position information acquired after the seat has been adjusted.
[0070] In some possible application scenarios, a vehicle may detect whether a user is seated via sensors, etc. These sensors may include cameras located in the cockpit, pressure sensors located under the seat, etc. When the vehicle detects, via sensors, that a user is seated, it may reacquire the user's current pose information via sensors such as cameras or radar. Cameras for acquiring pose information may include infrared (IR) cameras, time-of-flight (TOF) cameras, and RGB cameras based on red-green-blue (RGB) color patterns. Radar for acquiring pose information may be millimeter-wave radar. The pose information may include images of the user's body, point cloud information of the user in the three-dimensional space of the cockpit, and radar imaging information.
[0071] At least one sensor may be located within the cockpit. For example, as shown in Figure 4, sensors may be located on the A-pillar 401 of the vehicle, on the steering pillar 402 of the steering wheel, above the dashboard 403, above the center console 404, above the interior cockpit rearview mirror 305, near the upper sunglasses case 406, and on the central control screen 303. The black dots in the figure may represent sensors.
[0072] The vehicle can determine the user's posture in the cockpit based on acquired pose information and determine the user's three-dimensional spatial position information in the cockpit based on the user's current posture. Correspondingly, after adjusting the seat, the vehicle can still acquire the user's pose information after the seat adjustment via sensors and, based on the pose information, determine the user's posture in the cockpit after the seat adjustment, the user's current three-dimensional spatial position information in the cockpit, and so on.
[0073] After adjusting the seat, the vehicle may continue to adjust one or more of the other adjustable components to implement linkage adjustments to the seat and other adjustable components. The order in which the other adjustable components are adjusted after the seat has been adjusted may include, but is not limited to, adjusting the steering wheel, or adjusting the HUD's image picture, or adjusting the rearview mirror; adjusting the steering wheel and then adjusting the HUD's image picture, or adjusting the steering wheel and then adjusting the HUD's image picture, or adjusting the HUD's image picture and then adjusting the rearview mirror, or adjusting the rearview mirror and then adjusting the steering wheel, or adjusting the steering wheel, then adjusting the HUD's image picture, and then adjusting the rearview mirror.
[0074] If, after the seat has been adjusted, further linkage adjustments are performed on two or more other adjustable components, it can be understood that the adjustable components may be adjusted sequentially or simultaneously. This is not specifically limited to the embodiments of this application.
[0075] In some possible application scenarios, after the vehicle has adjusted the adjustable components, including the seats, the user may continue to make finer manual adjustments to each adjustable component to ensure that the height, position, angle, width, etc., of the adjustable components better meet the user's comfort and safety requirements. For example, after the vehicle has adjusted the angle, position, and height of the seats, the user may manually readjust the seat angle, or after the vehicle has adjusted the angle and height of the steering wheel, the user may manually readjust the height of the steering wheel.
[0076] When the same user uses a vehicle multiple times, their body size, posture, etc., may not change significantly. Therefore, to ensure the user's driving experience, in some possible application scenarios, after adjusting the adjustable components, the vehicle can associate the current component parameters, such as position, height, angle, and width, with the current user. In this way, when the same user drives the vehicle again, the vehicle can directly adjust each adjustable component based on the component parameters associated with the user. This eliminates the process of readjusting linkages for multiple adjustable components, saving time, and also allows the position, height, angle, width, etc., of each adjustable component to suit the user's comfort and safety requirements.
[0077] In some other possible application scenarios, before driving the vehicle, the user may log in to the vehicle's management system by entering an account, scanning their face, scanning a code, etc., so that the vehicle can verify the user's identity. Upon first login, the vehicle can create an account for the current user. After linkage adjustment, the vehicle associates the adjusted component parameters with the currently logged-in user. Upon non-first login, the vehicle can retrieve stored component parameters, etc., associated with the current user.
[0078] In some possible application scenarios, some of the components shown in Figure 3 can be adjusted electronically, while some components cannot. In this case, the cockpit adjustment method in the embodiment of this application can perform linkage adjustments on the electronically adjustable components, and skip components that cannot be adjusted electronically. For example, the image capture picture of the HUD in the vehicle cannot be adjusted electronically. When the linkage adjustment process proceeds to a component, the vehicle may prompt the user to perform a manual adjustment. Once the user completes the manual adjustment or skips the adjustment step, the vehicle may continue to automatically adjust the next component.
[0079] During the implementation of the cockpit adjustment method in the embodiment of this application based on the above description, the vehicle may initially adjust the angle, position, and height of the seat based on three-dimensional spatial position information acquired after the user sits in the seat, in order to ensure that the seat height, position, and angle meet the comfort and safety requirements of the user while driving. After adjusting the seat, the vehicle reacquires the user's three-dimensional spatial information in its current state based on the seat's current angle, position, and height. Next, the vehicle continues to adjust other adjustable components based on the user's reacquired three-dimensional spatial information to ensure that the position, angle, height, and size of other adjustable components meet the comfort and safety requirements of the user while driving. In this way, the seat angle, position, and height are adjusted initially, and the seat does not need to be readjusted when other adjustable components are subsequently adjusted. Therefore, after the user sits in the adjusted seat, the user's posture can be understood to have no change or only a slight change. In this case, adjustments to another adjustable component do not affect the previously adjusted seat, and the position, angle, height, size, etc., of the other adjustable component can be more precisely adjusted based on the user's three-dimensional spatial position information obtained after the seat has been adjusted. The method in the embodiment of this application can prevent the user from repeatedly performing actions or adjustments on a single component, and it can be seen that adjustments can be made more precisely to adjustable components, including the seat, in order to meet user requirements and ensure a good user experience.
[0080] The cockpit adjustment method in this embodiment will be described below using an example in which the vehicle sequentially adjusts the seat, steering wheel, HUD image picture, and rearview mirror. As shown in Figure 5, the method may include the following S501 to S508.
[0081] S501: The vehicle detects whether the user is seated. If the user is seated, S502 is executed.
[0082] In some embodiments, the vehicle may detect whether a user is seated in a seat through sensors mounted in the vehicle's cockpit. The sensors may be cameras, pressure sensors, etc. For example, when a user sits in a seat, pressure is applied to the seat, and a pressure sensor mounted under the seat detects this pressure. In some possible application scenarios, some items or children may also be placed in the seat. Therefore, to rule out impacts from the items or children, the vehicle may determine that a user is seated in the seat when the pressure value detected by the pressure sensor is greater than or equal to a preset pressure value.
[0083] In another example, a vehicle can capture images of seats via cameras in the cockpit and determine whether a user is seated based on the content in the images. If a user is seated, the image captured by the camera will include both the seat and the user, and the vehicle can determine that the user is seated.
[0084] S502: After the user sits in the seat, the vehicle acquires the user's first three-dimensional spatial position information within the cockpit.
[0085] In some embodiments, after the user is seated, the vehicle may display first prompt information. The first prompt information is configured to remind the user to adjust their seating position so that accurate information about the user in the cockpit can be obtained. In addition, the method of displaying the first prompt information may include displaying the first prompt information or broadcasting the first prompt information.
[0086] In some possible application scenarios, the vehicle may display the first prompt information on a display device in the cockpit, such as a central control screen. For example, as shown in Figure 6, the first prompt information may be, "Stay seated, lean back, and look straight ahead." In some other possible application scenarios, the vehicle may alternatively play the first prompt information, for example, "Stay seated, lean back, and look straight ahead; the seat is being adjusted," via an audio device in the cockpit, for example.
[0087] The vehicle acquires user pose information in the cockpit after the first prompt information is displayed for a predetermined period of time. The pose information includes one or more of the user's body image, point cloud information, and radar imaging information.
[0088] In some possible application scenarios, the vehicle can acquire images of the user's body in the cockpit via cameras in the cockpit, such as infrared cameras, TOF cameras, or RGB-based cameras. Alternatively, the vehicle can continue to acquire point cloud information of the user in the three-dimensional space of the cockpit based on the body images. In some other possible application scenarios, the vehicle may alternatively acquire radar imaging information of the user in the three-dimensional space of the cockpit via millimeter-wave radar, etc. In some other possible application scenarios, the pose information acquired by the vehicle may be the user's head information, such as a head image, or point cloud information or radar imaging information of the head in three-dimensional space, or the user's upper body information, such as an upper body image, or point cloud information or radar imaging information of the upper body in three-dimensional space.
[0089] In this embodiment, since the user spends a certain amount of time adjusting their posture after receiving the first prompt information, the pose information is acquired only after the first prompt information has been displayed for a predetermined period of time. In this way, sufficient time is provided for the user to adjust their posture, ensuring that the user's posture meets the requirements of the first prompt information, or that the user's posture is standard, thus ensuring that the acquired pose information is more accurate.
[0090] After acquiring pose information, the vehicle continues to determine the user's first three-dimensional spatial position information in the cockpit's spatial coordinate system based on the pose information. It can be understood that the vehicle may determine the first three-dimensional spatial position information based on multiple types of pose information. For example, the first three-dimensional spatial position information may be determined based on human body images, point cloud information, and radar imaging information.
[0091] In some possible application scenarios, the seats in the vehicle may be pre-modeled. The seat model has corresponding three-dimensional spatial position information within the cockpit space. Subsequently, the user's first three-dimensional spatial position information in the cockpit's spatial coordinate system is determined based on pose information, current setting parameters of the seat model, etc. The seat model may be used to simulate the seat's position, angle, height, etc., in real space.
[0092] Before a user enters the cockpit, it can be understood that the cockpit seat settings are not necessarily initial parameters. For example, after a previous user has finished driving the vehicle, the previous user's configuration of the seat settings parameters may be retained, or after the vehicle's last drive has ended, the previous configuration of the seat settings parameters may be retained. In this case, the vehicle can more accurately determine the user's current three-dimensional spatial position based on the current pose information and current three-dimensional spatial position information of the seat model.
[0093] In some other possible application scenarios, the vehicle can determine the user's first three-dimensional spatial position based on pose information and human body posture algorithms, human body reconstruction algorithms, etc.
[0094] For example, if the pose information is the user's head information, the vehicle can perform head detection based on the head image acquired by the camera, as shown in Figure 7. During head detection, head pose estimation, head feature point detection, and acquisition of a personalized face model are performed separately. Next, three-dimensional spatial feature points of the user's head are acquired based on the detected two-dimensional spatial feature points and the personalized face model. Finally, the three-dimensional spatial position information of the user's head is determined based on the head pose, three-dimensional spatial feature points, etc.
[0095] If the pose information is the user's upper body information, it can be understood that the three-dimensional spatial position information of the user's upper body may be determined alternatively by the method described above. In addition, the human body posture algorithm described above is merely an example and does not limit the method for determining the user's three-dimensional spatial position information in this embodiment of the present application.
[0096] It is difficult to accurately obtain user posture, pose information, etc., based on two-dimensional information of the user in a human body image. Therefore, in this embodiment of the present application, the three-dimensional (3D) spatial position information of the user in the cockpit can be determined. The 3D spatial position information includes three-dimensional information, and the user represented by the information is three-dimensional. Subsequently, the seat and other adjustable components can be adjusted more accurately based on the three-dimensional spatial position information.
[0097] S503: The vehicle determines the user's body size information based on the user's first three-dimensional spatial position information, and adjusts the seat settings based on the body size information.
[0098] Seat settings include one or more of the following: seat angle, position, and height. User body size information may include the user's eye position, height, facial contours, weight, arm length, leg length, etc.
[0099] In some embodiments, when adjusting the seat settings of a seat, the vehicle may obtain pre-configured configuration parameters for the seat settings that match body size information. The vehicle then adjusts one or more of the seat angle, position, and height based on the pre-configured configuration parameters of the seat settings.
[0100] The pre-configured configuration parameters may be pre-set, or they may be obtained by performing constraint calculations on the user's body size information from the perspective of visual safety and spatial comfort. For example, as shown in Figure 8, after determining the first three-dimensional spatial information based on pose information, seat model, etc., the vehicle determines the user's body size information based on the first three-dimensional spatial information, performs constraint calculations regarding visual safety and spatial comfort based on the seat model and body size information such as eye position, leg length, arm length, height, etc., and obtains the pre-configured configuration parameters for seat setting items that satisfy the current user's visual safety and spatial comfort requirements.
[0101] In some possible application scenarios, the seat adjustment model may be pre-trained, the adjustment parameters for the seat setting items may be determined, and the seat setting items may be adjusted based on the seat adjustment model.
[0102] In some possible application scenarios, the vehicle can perform the aforementioned constraint calculations based on the following visual safety and spatial comfort requirements.
[0103] Spatial comfort requirements may include requirements for the seat back angle range, requirements for the human joint angle range, etc. For example, as shown in Figure 9, for a particular type of seat, according to the spatial comfort requirements, the corresponding seat back angle range may be 18° to 20°. In actual adjustment, the seat back can be adjusted to 19.5°. As another example, as shown in Figure 10, the human joint angles that affect user comfort include α1, α2, and α3 shown in Figure 10. The range of angle α1 that satisfies the spatial comfort requirements may be 20° to 30°, 5° to 34°, etc. The range of angle α2 may be 95° to 120°, 103° to 131°, 78° to 118°, etc. The range of angle α3 may be 95° to 135°, 120° to 152°, 93° to 137°, etc.
[0104] In addition, line-of-sight safety requirements may include requirements for the upper field of view and the lower field of view. For example, as shown in Figure 11, the upper field of view requirement must ensure that the user can see a traffic light and / or windshield crossbar located 12 meters away from the vehicle and 5 meters high from the driver's seat. The lower field of view requirement must ensure that the user can see within 5 meters of the ground in front of the vehicle from the driver's seat, and that the angular velocity ω ≤ 2 rad / s.
[0105] The pre-set configuration parameters, determined according to requirements such as visual safety and spatial comfort, may include seat height parameters, position parameters, and angle parameters. Seat settings are adjusted based on these pre-set configuration parameters. For example, the seat height may be increased by 10 cm, the seat moved 10 cm forward, or the seat back tilted 10° backward. After the seat is adjusted based on the pre-set configuration parameters, the seat height, position, angle, etc., can better match the user's current posture or body size and can also accommodate the user's driving habits to ensure driving safety and comfort.
[0106] S504: After adjusting the seat settings, the vehicle reacquires the user's second three-dimensional spatial position information within the cockpit.
[0107] It can be understood that after the seat is adjusted, the user's posture and other characteristics may change compared to the posture and other characteristics acquired before the adjustment. In order to adjust another adjustable component more precisely, in this embodiment of the present application, the user's three-dimensional spatial position information may be reacquired after the seat has been adjusted. In addition, in the subsequent process of adjusting another adjustable component, the component settings are further adjusted by using the reacquired three-dimensional spatial position information to ensure that the height, position, angle, and width of the other adjustable component also meet safety and comfort requirements.
[0108] Automatic adjustments performed by the vehicle on the seats may not meet the user's requirements, driving habits, etc. Therefore, in some embodiments, after adjusting the seat settings, the vehicle may display a second prompt to remind the user that they can manually adjust the seat settings. The method of displaying the second prompt may include displaying the second prompt or broadcasting the second prompt.
[0109] In some possible application scenarios, the vehicle may display a second prompt message, such as "Seat adjustment complete, you can now make fine adjustments manually," on a display device in the cockpit, such as the central control screen. In some other possible application scenarios, the vehicle may alternatively play the second prompt message, such as "Automatic seat adjustment complete, you can now continue making manual adjustments," via an audio device in the cockpit, for example.
[0110] After displaying the second prompt information, the vehicle receives the first adjustment action performed by the user on the seat setting item.
[0111] After receiving the second prompt information, the user may perform a first adjustment action on the seat setting items based on the user's requirements, driving habits, etc. The seat setting items may be understood to include one or more of angle, position, and height. The user's first adjustment action may be an action on one setting item or a linkage action on two or more setting items.
[0112] In response to the first adjustment operation, the vehicle adjusts the corresponding seat setting item and obtains the user's current second three-dimensional spatial position information within the cockpit.
[0113] If the first adjustment operation includes linkage operations for multiple setting items, the vehicle may sequentially adjust the setting items in accordance with the operation for each setting item.
[0114] The first adjustment operation may be a linkage operation for multiple setting items. Therefore, in order to avoid the vehicle starting to acquire three-dimensional spatial position information before the user has completed the operation, or to avoid the vehicle continuously waiting because it does not know whether the user's first adjustment operation has been completed, in some possible application scenarios, the vehicle may prompt the user to complete the first adjustment operation within a predetermined period by displaying second prompt information. If the vehicle receives the user's first adjustment operation within a predetermined period after the second prompt information is displayed, when the timer for the predetermined period ends, the vehicle acquires the user's current second three-dimensional spatial position information in the cockpit based on the seat that has just received the first adjustment operation. If the vehicle does not receive the user's first adjustment operation within a predetermined period after the second prompt information is displayed, it indicates that the user does not need to perform any fine adjustments to the seat. In this case, the vehicle does not respond.
[0115] In some possible application scenarios, when acquiring second three-dimensional spatial position information, the vehicle can alternatively acquire user pose information in the cockpit based on sensors or the like, and determine the user's current second three-dimensional spatial position information in the cockpit's spatial coordinate system based on the current pose information. For details, please refer to the above description of determining the first three-dimensional spatial position information. Details will not be explained again here.
[0116] S505: The vehicle adjusts the height and angle of the steering wheel based on the second three-dimensional spatial position information.
[0117] After the seat is adjusted, the user's height also changes. In this case, using the steering wheel may be uncomfortable or unsafe. Therefore, after the seat is adjusted, the height and angle of the steering wheel may be further adjusted to ensure that using the steering wheel meets safety and comfort requirements.
[0118] In some embodiments, the vehicle can first determine the user's eye position, upper body position, and arm length based on second three-dimensional spatial position information, then obtain preset configuration parameters for steering wheel settings, where the preset configuration parameters correspond to the eye position, upper body position, and arm length, and finally adjust the height and angle of the steering wheel based on the preset configuration parameters for steering wheel settings.
[0119] The pre-set configuration parameters may be pre-set, or they may be obtained by performing constraint calculations on the user's eye position, upper body position, and arm length from the perspective of visual safety and spatial comfort. For example, as shown in Figure 12, the vehicle determines the user's body size information based on second three-dimensional spatial information, and performs constraint calculations regarding visual safety and spatial comfort based on the eye position and upper limb size such as arm length and upper body position in the body size information, and obtains pre-set configuration parameters for steering wheel settings that satisfy the current user's visual safety and spatial comfort requirements.
[0120] In some possible application scenarios, alternatively, a steering wheel adjustment model may be pre-trained, and the adjustment parameters of the steering wheel settings may be determined based on the steering wheel adjustment model, and the steering wheel settings may then be adjusted.
[0121] In some possible application scenarios, the vehicle can perform the aforementioned constraint calculations based on the following visual safety and spatial comfort requirements.
[0122] The line of sight safety requirements may be determined based on the content shown in Figure 13. The line of sight safety requirements must ensure that the height of the upper edge of the steering wheel is less than or equal to the connection line 1301 between the user's eyes and the front edge of the vehicle, in order to ensure that the upper edge of the steering wheel does not obstruct the user's line of sight to the road surface. Furthermore, it must be ensured that the user can see the entire dashboard content through the hollow portion of the upper half of the steering wheel. In this case, the user's line of sight is represented by the dashed line 1302 in the figure.
[0123] In addition, spatial comfort requirements may include spatial safety requirements and grip comfort requirements. As shown in Figure 14, the spatial safety requirement is that a certain distance, for example 10-12 centimeters, must be ensured between the lower edge of the steering wheel and the user's body. If the lower edge of the steering wheel is too close to the user, the steering wheel may injure the user in the event of a vehicle collision. If the lower edge of the steering wheel is too far from the user, it will affect the user's driving control. For example, the length of the dashed line 1401 in the figure may represent the distance between the lower edge of the steering wheel and the user's body. In addition, it must be further ensured that the distance between the steering wheel and the user's chest is at least a predetermined distance, for example 25 centimeters or 30 centimeters. If the distance is less than the predetermined distance, the vehicle's airbag system will not be able to protect the user. For example, the length of the dashed line 1402 in the figure may represent the distance between the steering wheel and the user's chest.
[0124] As shown in Figure 15, the grip comfort requirements are as follows: When the user extends one hand over the top of the steering wheel in the current seated position, it must be ensured that the arm remains in a comfortable position, basically straight with only a slight bend. The user's human joint angles α5 and α6 that satisfy this comfortable state must also meet the pre-defined angle range requirements. For example, the range of α5 may be 0° to 50° or 5° to 45°, and the range of α6 may be 80° to 170°, 86° to 144°, or 77° to 155°.
[0125] The pre-set configuration parameters, determined according to requirements such as visual safety and spatial comfort, may include parameters such as steering wheel height and angle. The steering wheel settings are adjusted based on these pre-set configuration parameters. For example, as shown in Figure 16, the steering wheel height may be increased by 10 centimeters, or the steering wheel may be rotated by 10 degrees. After the steering wheel is adjusted based on the pre-set configuration parameters, the steering wheel height, angle, etc., can better match the user's current posture and satisfy the user's driving habits, ensuring driving safety and comfort.
[0126] S506: The vehicle adjusts the position and size of the HUD's image capture picture based on the second three-dimensional spatial position information.
[0127] After the seat is adjusted, the user's height also changes. In this case, the position of the HUD's image capture picture may affect the user's safe driving, or the user may not be able to comfortably view the HUD's image capture picture depending on its position. Therefore, after the seat or steering wheel is adjusted, the position and size of the HUD's image capture picture can be further adjusted to ensure that the position and size of the HUD's image capture picture meet safety and comfort requirements.
[0128] In some embodiments, the vehicle may determine the user's eye position based on second three-dimensional spatial position information, and then obtain pre-configured configuration parameters for the HUD's image capture picture that correspond to the eye position. Next, the vehicle adjusts the position and size of the HUD's image capture picture based on the pre-configured configuration parameters for the HUD's image capture picture.
[0129] The pre-configured configuration parameters may be pre-set, or they may be obtained by performing constraint calculations on the user's eye position, etc., from the perspective of line-of-sight safety and spatial comfort.
[0130] In some possible application scenarios, the vehicle can perform the aforementioned constraint calculations based on the following visual safety and spatial comfort requirements.
[0131] Eye-line safety requirements must ensure that the position of the HUD's image capture picture does not obstruct the user's forward view of the road and environment. The size of the HUD's image capture picture is determined based on the distance between the user's eyes and the HUD's image capture picture. For example, a longer distance between the eyes and the HUD's image capture picture indicates a larger HUD image capture picture size.
[0132] In addition, spatial comfort requirements may include head rotation angle comfort requirements. Specifically, when a user rotates their head to view an image captured by the HUD, it is ensured that the angle by which the user rotates their head to the left or right does not exceed the angle range specified in the comfort requirements.
[0133] The pre-set configuration parameters, determined according to requirements such as visual safety and spatial comfort, may include parameters such as the position, height, and width of the HUD's image capture picture. Based on these pre-set configuration parameters, the HUD image capture picture settings are adjusted. For example, the height of the HUD image capture picture may be increased by 10 cm, or the HUD image capture picture may be enlarged by 1.1 times. After the HUD image capture picture is adjusted based on the pre-set configuration parameters, its position, size, etc., can better match the user's current posture and meet the user's driving habits, thereby ensuring driving safety and comfort.
[0134] S507: The vehicle adjusts the angle of the rearview mirror based on the second three-dimensional spatial position information.
[0135] After the seat is adjusted, the user's height also changes. In this case, the angle of the rearview mirror may not guarantee that the user can see environmental content that meets visual safety requirements in their current posture. Therefore, after the seat is adjusted, or after the steering wheel or HUD's image capture picture is adjusted, the angle of the rearview mirror may be further adjusted to ensure that it meets visual safety requirements.
[0136] In some embodiments, the vehicle determines the user's eye position based on second three-dimensional spatial position information, determines preset configuration parameters of the rearview mirror based on the eye position, vehicle information, etc., and then adjusts the angle of the rearview mirror based on the preset configuration parameters of the rearview mirror, thereby ensuring that the captured picture seen from the rearview mirror in the user's current posture meets preset conditions and thus ensures safe driving for the user. Vehicle information includes vehicle size (e.g., length, width, height), door handle position, wheel position, vehicle spatial position information, etc.
[0137] In some possible application scenarios, since the rearview mirror is a convex mirror, the vehicle can determine the pre-set configuration parameters of the rearview mirror based on the position of the eyes, etc., according to the imaging principle of a convex mirror, and adjust the angle of the rearview mirror.
[0138] For example, a door handle is displayed in the rearview mirror. As shown in Figure 17, the user wants to see the right rear door handle in the rearview mirror, and the angle of the rearview mirror needs to be adjusted so that the user can see a virtual image of the door handle in the rearview mirror.
[0139] For the image captured by the user in the rearview mirror in the current posture to satisfy the preset conditions, this includes the image captured by the left rearview mirror satisfying the first preset condition and the image captured by the right rearview mirror satisfying the second preset condition. In some possible application scenarios, as shown in Figure 18(a), the first preset condition may include the vehicle body, the sky, and the ground each occupying a portion of the image captured. For example, the vehicle body occupies 1 / 4 of the image captured, the sky occupies 1 / 2 of the screen excluding the vehicle body in the image captured, and the ground occupies 1 / 2 of the screen excluding the vehicle body in the image captured. In some other possible application scenarios, as shown in Figure 18(b), the second preset condition may alternatively include the vehicle body, the sky, and the ground each occupying a portion of the image captured. For example, the vehicle body occupies 1 / 4 of the image captured, the sky occupies 1 / 4 of the screen excluding the vehicle body in the image captured, and the ground occupies 3 / 4 of the screen excluding the vehicle body in the image captured.
[0140] The pre-set configuration parameters, determined according to requirements such as line of sight safety, may include parameters such as the angle of the rearview mirrors. The rearview mirror settings are adjusted based on the pre-set configuration parameters. For example, the right rearview mirror is adjusted 20° toward the user, and the left rearview mirror is adjusted 10° toward the user. After the rearview mirrors are adjusted based on the pre-set configuration parameters, the angles of the rearview mirrors can better match the user's current posture and meet the user's driving habits, thereby ensuring driving safety and comfort.
[0141] In addition, it can be understood that the above-mentioned adjustments to the rearview mirrors refer to adjustments to the rearview mirrors outside the cockpit (i.e., external cockpit rearview mirrors). The external cockpit rearview mirrors include the left rearview mirror and the right rearview mirror. Note that the above-mentioned adjustments to the rearview mirrors may be for either the left or right rearview mirror, or for all rearview mirrors.
[0142] S508: The vehicle prompts the user that cockpit adjustments are complete.
[0143] In some embodiments, the means by which a vehicle indicates that cockpit adjustments are complete may include displaying prompt information or broadcasting a prompt voice. In some possible application scenarios, the vehicle may display prompt information, for example, "Cockpit adjustment complete," on the central control screen in the cockpit. In some other possible application scenarios, the vehicle may alternatively play voice prompt information, for example, "Cockpit adjustment complete, you are ready to go," through an audio device in the cockpit, etc.
[0144] From the above, it can be seen that in the cockpit adjustment method provided in this embodiment of the present application, the vehicle can first adjust the angle, position, and height of the seat based on three-dimensional spatial position information acquired after the user sits in the seat, in order to ensure that the seat height, position, angle, etc., meet the comfort and safety requirements of the user while driving. After adjusting the seat, the vehicle reacquires the user's three-dimensional spatial information in its current state based on the seat's current angle, position, and height. Next, the vehicle continues to adjust other adjustable components based on the user's reacquired three-dimensional spatial information in order to ensure that the position, angle, height, size, etc., of other adjustable components meet the comfort and safety requirements of the user while driving. In this way, the seat angle, position, height, etc., are adjusted first, and the seat does not need to be readjusted when other adjustable components are subsequently adjusted. Therefore, it can be understood that after the user sits in the adjusted seat, the user's posture remains unchanged or has only a slight change. In this case, adjustments to another adjustable component do not affect the previously adjusted seat, and the position, angle, height, size, etc., of the other adjustable component can be more precisely adjusted based on the user's three-dimensional spatial position information obtained after the seat has been adjusted. The method in this embodiment of the present application can prevent the user from repeatedly performing actions or adjustments on a single component, and it can be seen that adjustments can be made more precisely to adjustable components, including the seat, in order to meet user requirements and ensure a good user experience.
[0145] In the embodiments described above, after adjusting the seat settings, the vehicle may display a second prompt to the user to remind them to make finer-grained adjustments to the seat. Based on this, in some embodiments, after adjusting the setting items of an adjustable component other than the seat, the vehicle may alternatively display a third prompt to remind the user to manually adjust the setting items of the adjustable component.
[0146] In some possible application scenarios, after the seat has been adjusted, one other adjustable component may be adjusted independently, or linkage adjustments may be performed on multiple other adjustable components. Therefore, the vehicle may display a third prompt after adjusting only one other adjustable component, or it may display a third prompt after adjusting each adjustable component during the linkage.
[0147] For example, the sequence of adjustments to a vehicle's cockpit is seat-steering wheel. After adjusting the steering wheel, the vehicle may display prompt content, such as "Steering wheel adjustment complete, you can now make fine adjustments manually." In another example, the sequence of adjustments to a vehicle's cockpit is seat-steering wheel-rearview mirror. After adjusting the steering wheel, the vehicle may display prompt content, such as "Steering wheel adjustment complete, you can now make fine adjustments manually." After adjusting the rearview mirror, the vehicle may also display prompt content, such as "Rearview mirror adjustment complete, you can now make fine adjustments manually."
[0148] In some other possible application scenarios, the method by which the vehicle displays the third prompt information may include displaying the prompt information and / or broadcasting the prompt information. For further details, please refer to the methods for displaying the first and second prompt information in the embodiments described above. Details are again not described here.
[0149] After receiving the third prompt information, the user can perform a second adjustment action on the component settings based on their requirements, driving habits, etc. It is understood that the component settings include one or more of the following: angle, position, height, and size. The user's second adjustment action may be an action on only one setting item, or a linkage action on two or more setting items.
[0150] After displaying the third prompt information, the vehicle receives the second adjustment action performed by the user on the component setting item and adjusts the corresponding component setting item in response to the second adjustment action.
[0151] If the second adjustment operation involves linkage operations for multiple setting items, the vehicle may sequentially adjust the setting items in accordance with the operation for each setting item.
[0152] The second adjustment operation may be a linkage operation for multiple configuration items. Therefore, to avoid the vehicle continuously waiting because it does not know whether the user's second adjustment operation has been completed, in some possible application scenarios, the vehicle may prompt the user to complete the second adjustment operation within a predetermined period by displaying a third prompt. If the vehicle receives the user's second adjustment operation within the predetermined period after the third prompt is displayed, the vehicle adjusts the configuration items in response to the second adjustment operation. If the vehicle does not receive the user's second adjustment operation within the predetermined period after the third prompt is displayed, it indicates that the user does not need to perform fine adjustments to the component configuration items.
[0153] In the embodiments described above, the automatic adjustments performed by the vehicle on the adjustable components may not meet the user's requirements, driving habits, etc. Therefore, after adjusting the component settings, the vehicle may display a third prompt to remind the user that they can manually adjust the component settings of the adjustable components, thereby ensuring that the adjusted adjustable components meet the user's requirements or driving habits.
[0154] If, after a user has manually adjusted the seat and / or adjustable components, the seat setting parameters and / or component setting parameters no longer meet the user's driving safety requirements, for example, if the steering wheel is too high and obstructs the user's line of sight, it may be understood that the vehicle will not respond to the user's adjustment actions and will still retain the setting parameters acquired through the vehicle's automatic adjustments.
[0155] In practical applications, a single user may drive the vehicle multiple times. However, if linkage adjustments must be performed on the seat and other adjustable components before each drive, the efficiency of cockpit adjustments is significantly reduced. Based on this, in some embodiments, when a user drives the vehicle for the first time, the user may be prompted to adjust their posture and perform linkage adjustments on the seat and other adjustable components. The configuration parameters of the seat setting items and the component setting items of the adjustable components obtained through the adjustments are stored and associated with the current user. When the same user drives the vehicle again, the vehicle can directly obtain a set of configuration parameters corresponding to the user and directly adjust the seat and other adjustable components based on these configuration parameters. Since the position, height, angle, size, etc. of the seat and other adjustable components adjusted during the first drive satisfy the user's driving safety and driving comfort requirements, when the same user drives the vehicle again, the vehicle can directly adjust the seat and other adjustable components by using the configuration parameters of the seat setting items and component setting items obtained through the adjustments during the first drive, and as a result, the seat and other adjustable components can also satisfy the user's driving safety and driving comfort requirements.
[0156] In some possible application scenarios, when the vehicle is driven for the first time, the user can log in to a management system configured on the vehicle, and the vehicle stores user information and configuration parameters obtained through the current adjustment of seat setting items and other adjustable component setting items using the management system. In addition, after the user logs in to the management system, the vehicle can detect whether the user is seated in the seat via sensors, etc., and after the user is seated in the seat, it can start executing the cockpit adjustment method of the embodiment described above.
[0157] After the vehicle has automatically adjusted the seats and other adjustable components, the user may continue to perform manual adjustments, for example, by performing a first adjustment operation and a second adjustment operation. Thus, in some embodiments, in response to a first adjustment operation received from the user, the vehicle may store a first configuration parameter of the seat setting item obtained after the user has adjusted the seat setting item, and associate the first configuration parameter of the seat setting item with the current user. In addition, in response to a second adjustment operation received from the user, the vehicle may further store a first configuration parameter of the component setting item obtained after the user has adjusted the component setting item, and associate the first configuration parameter of the component setting item with the current user.
[0158] After the same user drives the vehicle and sits in the seat again, the vehicle retrieves the cockpit configuration parameters associated with the user, which include the first configuration parameter of the stored seat setting item and the first configuration parameter of the component setting item, and the vehicle adjusts the seat setting item and component setting item separately based on the cockpit configuration parameters. In this way, when the same user drives the vehicle again, the vehicle directly adjusts the seat and other adjustable components by using the first configuration parameters of the seat setting item and component setting item acquired through the adjustments during the initial drive, and as a result, the seat and other adjustable components can also meet the user's driving safety and driving comfort requirements.
[0159] During a user's second driving session, their physique and seating posture may change. Therefore, in some embodiments, after the seat settings are adjusted based on the cockpit configuration parameters associated with the user, the vehicle may alternatively reacquire three-dimensional spatial position information after the user has adjusted the seat settings, determine the user's current body size information based on the current three-dimensional spatial position information, and acquire a second configuration parameter for the seat settings that matches the current body size information. If the difference between the current second configuration parameter of the seat settings and the first configuration parameter of the seat settings in the cockpit configuration parameters acquired by the vehicle is large (specifically, the difference is greater than or equal to a preset difference), the vehicle can readjust the seat settings based on the current second configuration parameter of the seat settings, and as a result, the adjusted angle, height, position, etc. of the seat will meet the user's safety and comfort requirements in the current state.
[0160] After readjusting the seat settings, the vehicle continues to reacquire the user's three-dimensional spatial position information based on the adjusted seat settings and obtains the current second configuration parameter of the component settings of the adjustable components. If the degree of difference between the current second configuration parameter of a component setting and the first configuration parameter of the component setting in the cockpit configuration parameters acquired by the vehicle is large (specifically, the degree of difference is greater than or equal to a preset degree of difference), the vehicle may readjust the component setting based on the current second configuration parameter of the component setting so that the adjusted angle, height, position, size, etc. of the adjustable component meet the user's safety and comfort requirements in the current state.
[0161] In some possible application scenarios, the cockpit configuration parameters associated with the user may include corresponding first configuration parameters stored after the vehicle automatically adjusts the seat and other adjustable components during the user's first drive, or may include corresponding first configuration parameters stored by the vehicle after the user manually readjusts the seat and other adjustable components after the vehicle automatically adjusts the seat and other adjustable components during the user's first drive.
[0162] In some other possible application scenarios, the cockpit configuration parameters associated with the user may be corresponding first configuration parameters stored after the vehicle automatically adjusted the seat and other adjustable components during the user's previous driving, or they may be corresponding first configuration parameters stored by the vehicle after the user manually readjusted the seat and other adjustable components after the vehicle automatically adjusted the seat and other adjustable components during the user's previous driving.
[0163] In some possible application scenarios, the degree of difference between the first configuration parameter of a seat setting item and the current configuration parameter of a seat setting item may be expressed as the difference between the two, the absolute value of the difference between the two, the mean value between the two, etc. Similarly, the degree of difference between the first configuration parameter of a component setting item and the current configuration parameter of a component setting item may also be expressed as the difference between the two, the absolute value of the difference between the two, the mean value between the two, etc.
[0164] If the degree of difference between the second configuration parameter and the first configuration parameter is small (specifically, the degree of difference is smaller than a preset degree of difference), it can be understood that the vehicle does not need to readjust the seat configuration or another adjustable component based on the second configuration parameter.
[0165] In actual use, users often drive the vehicle. In this case, it is not necessary to adjust the cockpit frequently. Therefore, in some embodiments, when the user is not driving the vehicle for the first time, the user can choose whether or not to adjust the cockpit according to the user's requirements. For example, after logging into the vehicle management system, the user can perform a pre-configured operating mode, and the vehicle will begin performing adjustment operations in response to the pre-configured operating mode. The pre-configured operating mode may include pressing the brakes, entering voice commands, etc.
[0166] In some embodiments, the cockpit adjustment method described above allows for further adjustment of seats in the cockpit other than the driver's seat, such as the passenger seat or the rear seat.
[0167] In the embodiments described above, an example is used for illustrative purposes in which the cockpit adjustment method described above is applied to a vehicle. In some other embodiments, the cockpit adjustment method described above may be applied to a different carrier equipped with a seat and other adjustable components. The other adjustable components may include one or more of the following: a steering wheel, an imaging picture for a HUD, an external cockpit rearview mirror, an internal cockpit rearview mirror, an air conditioning system, and a central control screen.
[0168] In some solutions, multiple embodiments of this application may be combined, and the combined solution will be implemented. Optionally, some operations in the process of the embodiments of the method may be combined, and / or the order of some operations may be changed, at will. In addition, the execution order of the steps in each process is merely an example and does not constitute a limitation on the execution order of the steps. Steps may be performed in a different execution order, alternatively. The description is not intended to indicate that the execution order is the only order in which the operations are performed. Those skilled in the art can consider multiple ways of rearranging the operations described in the embodiments of this application. In addition, it should be noted that process details relating to a particular embodiment of this application may be applicable in a similar manner to other embodiments, or different embodiments may be used in combination.
[0169] In addition, some steps in the embodiment of the method may be replaced with equivalent steps. Alternatively, some steps in the embodiment of the method may be optional and may be omitted in some use scenarios. Alternatively, other possible steps may be added to the embodiment of the method.
[0170] In addition, embodiments of the method can be implemented separately or in combination.
[0171] To implement the functions described above, it is understood that a carrier, for example, a vehicle, includes corresponding hardware and / or software modules for performing the functions. Referring to the example algorithmic steps described in the embodiments disclosed herein, the application can be implemented in hardware form or in combination of hardware and computer software. Whether the functions are performed by hardware or by hardware driven by computer software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the functions described for each specific application with reference to the embodiments, but the implementation forms should not be considered to exceed the scope of this application.
[0172] In embodiments, a carrier, such as a vehicle, may be divided into functional modules based on the examples of the methods described above. For example, each functional module may be obtained through a division based on each corresponding function, or two or more functions may be integrated into a single processing module. The integrated module may be implemented in hardware form. Note that the division into modules in embodiments is an example and merely a logical functional division. Other division methods may be used in actual implementations.
[0173] One embodiment of this application provides a cockpit adjustment device. The device includes a first information acquisition module, a first adjustment module, a second information acquisition module, and a second adjustment module.
[0174] The first information acquisition module is configured to acquire the user's first three-dimensional spatial position information within the cockpit after the user has sat in the seat. For example, the relevant method step S502 in the above embodiment is performed.
[0175] The first adjustment module is configured to determine the user's body size information based on the first three-dimensional spatial position information and to adjust the seat settings of the seat based on the body size information. For example, the relevant method step S503 in the above embodiment is performed.
[0176] The second information acquisition module is configured to reacquire the user's second three-dimensional spatial position information within the cockpit after the seat setting items have been adjusted. For example, the relevant method step S504 in the above embodiment is performed.
[0177] The second adjustment module is configured to adjust the component setting items of the adjustable components based on the second three-dimensional spatial position information. For example, the relevant method steps S505, S506, and S507 in the above embodiment are performed.
[0178] In some embodiments, the cockpit adjustment device further includes an association module. The association module is configured to store a first configuration parameter of a seat setting item acquired by a first adjustment operation and to associate the first configuration parameter of the seat setting item with the user, and to store a first configuration parameter of a component setting item acquired by a second adjustment operation and to associate the first configuration parameter of the component setting item with the user. In some other embodiments, the association module is further configured to store seat setting item parameters and component setting item parameters acquired through automatic adjustment by the vehicle when the user drives the vehicle for the first time.
[0179] In some embodiments, the second adjustment module is further configured to display a third prompt after adjusting the component setting items of an adjustable component, to receive a second adjustment action performed by the user on the component setting items after the third prompt information has been displayed, and to readjust the component setting items in response to the second adjustment action.
[0180] In some embodiments, the cockpit adjustment device further includes a third adjustment module. The third adjustment module retrieves cockpit configuration parameters associated with the user after the same user sits in the seat again, and the cockpit configuration parameters include a first configuration parameter of a stored seat setting item and a first configuration parameter of a component setting item, or include a configuration parameter of a seat setting item and a configuration parameter of an adjustable component that was acquired through automatic adjustment by the vehicle when the user first drives the vehicle, and is configured to adjust the seat setting item and the component setting item separately based on the cockpit configuration parameters.
[0181] In some embodiments, the first adjustment module is further configured to adjust seat setting items and component setting items based on cockpit configuration parameters associated with the user, then obtain a second configuration parameter that matches the current body size information of the seat setting item, and if the degree of difference between the second configuration parameter of the seat setting item and the first configuration parameter of the seat setting item is greater than or equal to a preset degree of difference, then adjust the seat setting item based on the second configuration parameter of the seat setting item.
[0182] In some embodiments, the second adjustment module is further configured to adjust the seat setting item based on a second configuration parameter of the seat setting item, then obtain a second configuration parameter of a component setting item that matches the user's current second three-dimensional spatial position information, and if the difference between the second configuration parameter of the component setting item and the first configuration parameter of the component setting item is greater than or equal to a preset difference, then adjust the component setting item based on the second configuration parameter of the component setting item.
[0183] One embodiment of the present application further provides a chip. As shown in Figure 19, the chip may include one or more processors 1901, memory 1902, and a communication interface 1903.
[0184] The memory 1902 and the communication interface 1903 are coupled to the processor 1901. For example, the memory 1902 and the communication interface 1903 may be coupled to the processor 1901 via the bus 1904.
[0185] The communication interface 1903 is configured to perform data transmission with another device. The memory 1902 stores computer program code, which includes computer instructions. When the computer instructions are executed by the processor 1901, the chip becomes capable of performing the cockpit adjustment method according to the embodiments of this application.
[0186] The processor 1901 may be a processor or a controller, for example, a Central Processing Unit (CPU), a general-purpose processor, a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other programmable logic device, transistor logic device, hardware component, or any combination thereof. The processor may implement or execute various exemplary logic blocks, modules, and circuits described with reference to embodiments disclosed in this application. The processor may also be a combination of processors for implementing computing functions, for example, a combination of one or more microprocessors, or a combination of a DSP and a microprocessor.
[0187] Bus 1904 can be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, etc. Bus 1904 can be classified into address buses, data buses, control buses, etc. For ease of representation, buses are represented by a single thick line in Figure 19. However, this does not mean that only one type of bus exists.
[0188] One embodiment of this application further provides a vehicle, which includes the cockpit adjustment device of the above-described embodiment or the chip of the above-described embodiment.
[0189] One embodiment of the present application further provides another vehicle. The vehicle's cockpit includes a first controller, a second controller, sensors, a seat, and adjustable components. The adjustable components include one or more of a steering wheel, a rearview mirror, and an image-capturing picture of a head-up display. The first controller is connected separately to the seat and the adjustable components. The second controller is connected to the sensors. The first controller is connected to the second controller.
[0190] The second controller is configured to acquire user pose information in the cockpit via sensors, and the pose information includes one or more of the user's body image, point cloud information, and radar imaging information.
[0191] The first controller is configured to acquire pose information from the second controller and, after the user sits in the seat, acquire the user's first three-dimensional spatial position information within the cockpit based on the pose information.
[0192] The first controller is configured to determine the user's body size information based on first three-dimensional spatial position information and to adjust the seat settings of the seat based on the body size information, the seat settings further including one or more of the seat angle, position, and height.
[0193] The first controller is further configured to adjust seat settings, then reacquire pose information from the second controller, and reacquire the user's second three-dimensional spatial position information within the cockpit.
[0194] The first controller is configured to adjust the component settings of an adjustable component based on second three-dimensional spatial position information, the component settings further including one or more of the position, height, angle, and size of the adjustable component.
[0195] One embodiment of this application further provides a computer-readable storage medium. The computer-readable storage medium stores computer program code. When a processor executes the computer program code, the chip performs the relevant method steps in the embodiment of the method.
[0196] One embodiment of this application further provides a computer program product. When the computer program product is executed on a computer, the computer becomes capable of performing the relevant method steps in the embodiment of the method.
[0197] All chips, computer storage media, and computer program products provided in this application are configured to perform the corresponding methods described above. Therefore, for the advantages that can be achieved by the chips, computer storage media, and computer program products, please refer to the advantages of the corresponding methods described above. Further details are not provided here.
[0198] Based on the above description of the implementation configuration, those skilled in the art will clearly understand that, for the sake of convenience and simplicity, the division into functional modules described above is used merely as an illustrative example. In actual application, the above-described functions may be assigned to different functional modules and implemented according to requirements. In other words, the internal structure of the device is divided into different functional modules to implement all or some of the above-described functions.
[0199] In the various embodiments provided in this application, it should be understood that the disclosed apparatus and methods may be implemented in other ways. For example, the embodiments of the described apparatus are merely examples. For example, the division into modules or units is merely a logical functional division, and other divisions may occur during actual implementation. For example, multiple units or components may be combined or integrated into another apparatus, or some features may be ignored or not performed. In addition, the illustrated or described mutual coupling, direct coupling or communication connection may be implemented through some interfaces. Indirect coupling or communication connection between apparatus or units may be implemented electrically, mechanically or in other forms.
[0200] Units described as separate components may or may not be physically separated, and components shown as units may be one or more physical units, specifically, they may be located in one place or distributed across multiple different locations. Some or all of the units may be selected according to the actual requirements in order to achieve the objectives of the solution of the embodiment.
[0201] In addition, the functional units in the embodiments of this application may be integrated into a single processing unit, or each unit may exist physically independently, or two or more units may be integrated into a single unit. The integrated unit may be implemented in hardware form or in the form of a software functional unit.
[0202] When an integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, the integrated unit may be stored on a readable storage medium. Based on this understanding, the technical solutions, or contributing parts, or all or part of the technical solutions in essentially the embodiments of this application may be implemented in the form of a software product. The software product is stored on a storage medium and includes a number of instructions for instructing a device (which may be a single-chip microcomputer, chip, etc.) or processor to perform all or part of the steps of the method described in the embodiments of this application. The storage medium is any medium capable of storing program code, including, for example, a USB flash drive, a removable hard disk drive, read-only memory (ROM), random access memory (RAM), a magnetic disk, or a compact disk.
[0203] The above description merely outlines a specific implementation of the present application and is not intended to limit the scope of protection. Any modification or substitution within the technical scope disclosed in this application shall fall within the scope of protection. Therefore, the scope of protection of this application shall be subject to the scope of protection of the claims. [Explanation of Symbols]
[0204] 100 Carriers 200 servers 303 Central control screen 305 Interior Cockpit Rearview Mirror 306 External Cockpit Rearview Mirror 307 Exhaust vent 308 speakers 401 A-pillar 402 Steering Pillar 403 Dashboard 404 Center Console 406 Upper Sunglasses Case 1401 Dashed line 1402 Dashed line 1901 Processor 1902 memory 1903 Communication Interface 1904 Bus
Claims
1. A cockpit adjustment method, wherein the method is A step of acquiring first three-dimensional spatial position information of the user in the cockpit after the user has sat in the seat, wherein the cockpit comprises the seat and adjustable components, the adjustable components including one or more of the steering wheel, rearview mirror, and head-up display image capture pictures, A step of determining the user's body size information based on the first three-dimensional spatial position information, and adjusting the seat setting items of the seat based on the body size information, wherein the seat setting items include one or more of the angle, position, and height of the seat. The steps include: obtaining the user's second three-dimensional spatial position information within the cockpit after the aforementioned seat setting items have been adjusted; A step of adjusting the component setting items of the adjustable component based on the second three-dimensional spatial position information, wherein the component setting items include one or more of the position, height, angle, and size of the adjustable component. Methods that include...
2. The step of obtaining the first three-dimensional spatial position information of the user in the cockpit after the user has sat in the seat is as follows: A step of displaying first prompt information after the user has sat in the seat, wherein the first prompt information is used to remind the user to adjust their seating posture. The first prompt information is displayed for a predetermined period of time, and the next step is to obtain pose information of the user in the cockpit, wherein the pose information includes one or more of the user's body image, point cloud information, and radar imaging information. The steps include determining the first three-dimensional spatial position information of the user in the spatial coordinate system of the cockpit based on the pose information, and The method according to claim 1, including the method described in claim 1.
3. The step of adjusting the seat setting items of the seat based on the body size information is, The steps include obtaining pre-set configuration parameters for the aforementioned seat setting items that match the aforementioned body size information, A step of adjusting one or more of the angle, position, and height of the seat based on the pre-set configuration parameters of the seat setting item. The method according to claim 1 or 2, including the method described in claim 1 or 2.
4. The step of adjusting the component setting items of the adjustable component based on the second three-dimensional spatial position information is: The steps include determining the position of the user's eyes and upper body, as well as the length of the user's arms, based on the second three-dimensional spatial position information, A step of obtaining pre-set configuration parameters for steering wheel setting items, wherein the pre-set configuration parameters correspond to the eye position, the upper body position, and the arm length. The steps include adjusting the height and angle of the steering wheel based on the preset configuration parameters of the steering wheel setting items, and The method according to any one of claims 1 to 3, including the method described in any one of claims 1 to 3.
5. The step of adjusting the component setting items of the adjustable component based on the second three-dimensional spatial position information is: The steps include determining the position of the user's eyes based on the second three-dimensional spatial position information, The steps include obtaining pre-set configuration parameters of the image capture picture of the head-up display that corresponds to the position of the eye, A step of adjusting the position and size of the image capture picture of the head-up display based on the preset configuration parameters of the image capture picture of the head-up display. The method according to any one of claims 1 to 3, including the method described in any one of claims 1 to 3.
6. The step of adjusting the component setting items of the adjustable component based on the second three-dimensional spatial position information is: The steps include determining the position of the user's eyes based on the second three-dimensional spatial position information, The steps include determining preset configuration parameters of the rearview mirror based on the position of the eye and the size of the vehicle, The steps include adjusting the angle of the rearview mirror based on the preset configuration parameters of the rearview mirror, and The method according to any one of claims 1 to 3, including the method described in any one of claims 1 to 3.
7. The step of obtaining the user's second three-dimensional spatial position information in the cockpit after the seat setting items have been adjusted is: A step of displaying a second prompt after the seat setting items of the seat have been adjusted, wherein the second prompt is used to remind the user to adjust the seat setting items of the seat. The steps include receiving a first adjustment operation performed by the user on the seat setting item after the second prompt information is displayed, The steps include: readjusting the seat setting items in response to the first adjustment operation and obtaining the user's current second three-dimensional spatial position information within the cockpit; The method according to any one of claims 1 to 6, including
8. The aforementioned method, In response to the first adjustment operation, the steps include storing the first configuration parameters of the seat setting items obtained through the first adjustment operation, The steps of associating the first configuration parameter of the seat setting item with the user The method according to claim 7, further comprising:
9. The aforementioned method, A step of adjusting the component settings of the adjustable component, and then displaying a third prompt, wherein the third prompt is used to remind the user to adjust the component settings of the adjustable component. The steps include receiving a second adjustment operation performed by the user on the component setting item after the third prompt information is displayed, The steps include: readjusting the component setting items in response to the second adjustment operation, and storing the first configuration parameters of the component setting items obtained by the second adjustment operation; The steps of associating the first configuration parameter of the aforementioned component setting item with the user The method according to any one of claims 1 to 8, further comprising:
10. The aforementioned method, Steps include: obtaining cockpit configuration parameters associated with the user after the same user sits in the seat again, wherein the cockpit configuration parameters include the first configuration parameter of the stored seat setting item and the first configuration parameter of the component setting item; The steps include adjusting the seat setting items and the component setting items separately based on the cockpit configuration parameters. The method according to any one of claims 1 to 9, further comprising:
11. The aforementioned method, After the seat setting item and the component setting item have been adjusted based on the cockpit configuration parameters associated with the user, a second configuration parameter is obtained that matches the current body size information of the seat setting item. If the degree of difference between the second configuration parameter of the seat setting item and the first configuration parameter of the seat setting item is greater than or equal to a preset degree of difference, the seat setting item is adjusted based on the second configuration parameter of the seat setting item. The method according to claim 10, further comprising:
12. The aforementioned method, The steps include adjusting the seat setting item based on the second configuration parameter of the seat setting item, and then obtaining the second configuration parameter of the component setting item that matches the user's current second three-dimensional spatial position information, If the degree of difference between the second configuration parameter of the component setting item and the first configuration parameter of the component setting item is greater than or equal to a predetermined degree of difference, the step of adjusting the component setting item based on the second configuration parameter of the component setting item. The method according to claim 11, further comprising:
13. A cockpit adjustment device comprising a first information acquisition module, a first adjustment module, a second information acquisition module, and a second adjustment module, The first information acquisition module acquires the user's first three-dimensional spatial position information within the cockpit after the user is seated in the seat, and the cockpit comprises the seat and adjustable components, the adjustable components being configured to include one or more of the following: a steering wheel, a rearview mirror, and an image captured by a head-up display. The first adjustment module determines the user's body size information based on the first three-dimensional spatial position information, adjusts the seat setting items of the seat based on the body size information, and the seat setting items are configured to include one or more of the seat's angle, position, and height. The second information acquisition module is configured to acquire the user's second three-dimensional spatial position information within the cockpit after the seat setting items have been adjusted. The second adjustment module adjusts the component setting items of the adjustable component based on the second three-dimensional spatial position information, and the component setting items are configured to include one or more of the position, height, angle, and size of the adjustable component. Device.
14. A chip comprising memory and one or more processors, wherein the memory is coupled to the processors, the memory stores computer program code, the computer program code includes computer instructions, and when the computer instructions are executed by the processors, the chip becomes capable of performing the cockpit adjustment method according to any one of claims 1 to 12.
15. A vehicle, wherein the cockpit of the vehicle comprises a first controller, a second controller, sensors, a seat, and an adjustable component, the adjustable component comprising one or more of a steering wheel, a rearview mirror, and a head-up display image capture picture, the first controller being separately connected to the seat and the adjustable component, the second controller being connected to the sensors, and the first controller being connected to the second controller. The second controller is configured to acquire user pose information in the cockpit using the sensor, and the pose information includes one or more of the user's body image, point cloud information, and radar imaging information. The first controller is configured to acquire the pose information from the second controller and, after the user sits in the seat, to acquire the first three-dimensional spatial position information of the user in the cockpit based on the pose information. The first controller determines the user's body size information based on the first three-dimensional spatial position information, adjusts the seat setting items of the seat based on the body size information, and the seat setting items are further configured to include one or more of the angle, position, and height of the seat. The first controller is further configured to acquire the pose information from the second controller and the second three-dimensional spatial position information of the user within the cockpit after the seat setting items have been adjusted. The first controller sets the component setting items of the adjustable component based on the second three-dimensional spatial position information, and the component setting items are further configured to include one or more of the position, height, angle, and size of the adjustable component. vehicle.
16. A vehicle, wherein the vehicle is equipped with the cockpit adjustment device described in claim 13, or the chip described in claim 14.
17. A computer-readable storage medium containing computer instructions, wherein when the computer instructions are executed on a chip, the chip becomes capable of performing the cockpit adjustment method according to any one of claims 1 to 12.