A vehicle control method and related apparatus

Abstract

A vehicle control method and related apparatus are disclosed, applicable to the field of intelligent vehicles. In this application, first configuration information is defined to configure the execution conditions and execution content of a first vehicle control operation. The execution conditions of the first vehicle control operation include detecting a target user. The vehicle control device can access the vehicle's cabin information, including perception information of the target user within the cabin. Based on the first configuration information and the cabin information, the vehicle control device executes the first vehicle control operation. This application can automatically execute pre-configured vehicle control operations, and these operations are user-specific, i.e., "person recognition," eliminating the cumbersome manual control operations required by the user. This allows the target user to immediately enjoy various intelligent in-vehicle functions, greatly improving the user's driving experience and contributing to enhanced vehicle usability and safety.

Description

A vehicle control method and related device Technical Field

[0001] This application relates to the field of intelligent vehicles, and more particularly to a vehicle control method and related apparatus. Background Technology

[0002] With the development of intelligent technologies, vehicles are beginning to shift towards electrification and software definition, providing drivers with a safer and more comfortable driving experience and more intelligent functions. The concept of software-defined vehicles plays a crucial role in the field of intelligent vehicles, improving vehicle performance, safety, and user experience.

[0003] To meet users' growing demand for intelligent vehicles, more and more adjustable functions are being integrated into vehicles. These adjustable functions offer increasingly sophisticated and diverse usage methods, providing users with a technologically advanced and intelligent driving experience. However, adjusting these functions often requires complex operations, resulting in a poor user experience. There are even dangerous scenarios where drivers attempt to set functions for passengers unfamiliar with them, posing a threat to driving safety.

[0004] Summary of the Invention

[0005] This application provides a vehicle control method and related device that can perform pre-configured vehicle control operations for specific users, eliminating the tedious manual control operations for users, and enabling target users to immediately enjoy a variety of intelligent in-vehicle functions, greatly improving the comfort and safety of the vehicle.

[0006] Firstly, this application provides a vehicle control method, which can be executed by a device with computing capabilities or a component of such a device (such as a chip or module). The following description uses a vehicle control device as the executing entity of this method as an example; however, in actual implementation, the executing entity can be other names. This vehicle control method is applied to a vehicle, and the vehicle control device executing the method is located inside the vehicle or has a communication connection with the vehicle.

[0007] The vehicle control method includes: acquiring vehicle cabin information, including perception information of a target user located within the vehicle cabin; and executing a first vehicle control operation based on first configuration information and the cabin information. The first configuration information includes the execution conditions and operation content of the first vehicle control operation, and the execution conditions of the first vehicle control operation include detecting the target user.

[0008] The first vehicle control operation can be used to control the target control object, such as adjusting the target control object to a target state. The target control object has adjustable functions, such as including one or more of the following control objects: seats, doors, windows, display devices, air conditioning, lights, navigation systems, voice systems, Bluetooth, audio systems, fragrance systems, or in-vehicle applications, etc. Taking seats as an example, some vehicle seats can support the following dimensions of state adjustment: seat height, seat back angle, leg rest angle, seat fore-aft position, seat ventilation function on and off and ventilation level, seat heating on and off and heating level, massage function on and off and massage intensity adjustment.

[0009] In some schemes, the operation content of the first vehicle control operation is used to indicate the target controlled object and the target state of the target controlled object. Executing the first vehicle control operation can adjust the target controlled object to the target state. For example, the first vehicle control operation includes: adjusting the seat ventilation level to level one and opening the window by 10%. The operation content of the first vehicle control operation describes the execution action of the first vehicle control operation. Therefore, the operation content of the first vehicle control operation indicates the controlled object targeted by the first vehicle control operation and the adjustment operation on that controlled object.

[0010] In this application, first configuration information is predefined to configure the execution conditions and execution content of the first vehicle control operation. Using this first configuration information, the vehicle control device can execute the first vehicle control operation when the execution conditions are met. The execution conditions of the first vehicle control operation include detecting a target user. By utilizing the first configuration information, the first vehicle control operation can be executed when a target user is detected, thereby providing specific services to specific users, improving the vehicle's intelligence level, and meeting personalized user needs.

[0011] When implementing this vehicle control method, the vehicle control device can acquire the vehicle's cabin information and, based on the cabin information and first configuration information, enable the execution of a first vehicle control operation, allowing the relevant controlled objects to be adjusted to the corresponding state to meet the user's needs. The cabin information includes information about the vehicle's cabin, or information related to cabin control (e.g., environmental information inside and / or outside the vehicle). For example, the cabin information includes sensing information such as images, sounds, point clouds, and wireless sensing data. When a target user is present in the cabin, the cabin information includes sensing information about the target user. Based on the cabin information, the vehicle control device can determine whether the execution conditions for the first vehicle control operation are met, and if so, trigger the execution of the first vehicle control operation. In summary, this solution can automatically execute pre-configured vehicle control operations, and these operations are user-specific, i.e., "user-recognition," eliminating the tedious manual control operations for the user and allowing the target user to immediately enjoy various intelligent in-vehicle functions, greatly improving the user's driving experience.

[0012] Furthermore, in scenarios where passengers lack the ability to manually operate vehicle controls, the solution proposed in this application can automatically provide services, preventing the driver from being distracted by adjusting or instructing other passengers to adjust vehicle functions, thus improving vehicle safety.

[0013] In one possible implementation of the first aspect, the method further includes presenting a prompt message for the first configuration information. In the above implementation, the first configuration information can be presented so that the user is aware of its existence, thereby enhancing the user's driving experience. Furthermore, the configuration information is a user-level, personalized design and does not belong to the basic vehicle functions commonly understood by the public. Therefore, presenting the first configuration information to the user allows the user to learn about the personalized vehicle control operation function. For example, based on the prompt message of the presented first configuration information, the user can learn about the relevant information of the first vehicle control operation. When the first vehicle control operation is executed, the user can enjoy the intelligent functions of the vehicle with peace of mind without panic or worry, thus improving the user's driving comfort.

[0014] In another possible implementation of the first aspect, the target control object is one or more of a plurality of control objects included in the vehicle, and the control object has adjustable functions.

[0015] In another possible implementation of the first aspect, the execution conditions of the first vehicle control operation further include first environmental conditions, and the cabin information further includes environmental information used to indicate the environmental state related to the vehicle.

[0016] For example, environmental conditions include one or more of the following: event conditions, time conditions, weather conditions, lighting conditions, temperature conditions, humidity conditions, location conditions, personnel conditions in the cabin, or characteristic conditions of personnel in the cabin.

[0017] Similarly, environmental information includes one or more of the following: event information, time information, weather information, lighting information, temperature information, humidity information, condition information, location information, personnel information in the cabin, or personnel characteristic conditions in the cabin, etc.

[0018] In the above implementation, by defining the environmental conditions for executing the first vehicle control operation, the first vehicle control operation can be triggered in a specific environment, making the services provided by the first vehicle control operation more adaptable to the current environment and improving the user experience.

[0019] In another possible implementation of the first aspect, based on the first configuration information and the cabin information, a first vehicle control operation is performed, including: detecting a target user and the target user's position within the cabin based on the vehicle's cabin information; determining a first control object and a target state of the first control object based on the first configuration information and the target user's position within the cabin, wherein the first control object is a target control object and includes control objects associated with the target user's position within the cabin; and performing the first vehicle control operation based on the vehicle's cabin information and the first configuration information to adjust the first control object to the target state of the first control object.

[0020] In the above embodiments, the specific execution of the first control operation is also related to the target user's position in the vehicle. For example, the first configuration information defines the first vehicle control operation as including turning on the screen, i.e., the controlled object is the screen. However, the controlled object here includes a specific control object associated with at least a position. When the target user is detected to be in the front passenger seat, the front passenger screen is turned on; if the target user is detected to be in the left rear seat, the screen in that left rear seat is turned on. In this way, by combining the first configuration information with the user's position in the vehicle, the first control object to be controlled is determined, which can adapt to the user's different seating positions in the vehicle, and provide services tailored to the same user in different positions, significantly improving the vehicle's intelligence and enhancing the user experience.

[0021] In another possible implementation of the first aspect, a first vehicle control operation is performed based on the first configuration information and cockpit information, including: determining whether the execution conditions for the first vehicle control operation are met based on the first configuration information and cockpit information; and performing the first vehicle control operation if the execution conditions for the first vehicle control operation are met.

[0022] In another possible implementation of the first aspect, based on the first configuration information and the cabin information, a first vehicle control operation is performed, including: detecting a target user and the target user's position within the cabin based on the vehicle's cabin information; and determining whether the execution conditions for the first vehicle control operation are met based on the first configuration information and the cabin information. If the execution conditions for the first vehicle control operation are met, a first control object and a target state of the first control object are determined based on the first configuration information and the target user's position within the cabin. The first control object is a target control object, and the first control object includes control objects associated with the target user's position within the cabin. The first vehicle control operation is then performed to adjust the first control object to its target state.

[0023] In another possible implementation of the first aspect, the first configuration information corresponds to a configuration name, and the first configuration information also includes the configuration name of the first configuration information. The configuration name can be user-defined, pre-designed, or generated using relevant algorithms. For example, the configuration name could be "audio-visual mode," "rest mode," "vacation mode," "commuter mode," "personal space," etc.

[0024] By assigning corresponding configuration names to configuration information, different configuration information can be easily distinguished and used to activate the corresponding configuration information. For example, if the configuration information includes one or more configuration information entries named "Multimedia Mode," the user can simply say "Open Multimedia Mode" to activate the configuration information entry named "Multimedia Mode."

[0025] In another possible implementation of the first aspect, the first configuration information is associated with a target user, and the first vehicle control operation is used to provide services to the target user. In the above implementation, the configuration information is associated with the target user, and the vehicle control device only performs the corresponding vehicle control operation when it detects the target user associated with the configuration information. That is, when it is detected that the user associated with the configuration information is not in the cabin, the corresponding vehicle control operation will not be triggered, realizing user-identifiable, user-specific vehicle control operations and improving the user experience.

[0026] Optionally, the target user may include one or more users.

[0027] In another possible implementation of the first aspect, the execution condition of the first vehicle control operation further includes detecting a first group of users traveling together, the first group of users traveling together comprising N users, where N is an integer and N≥0. When the first user group includes at least one user, the users in the first group of users traveling together are different from the target user, and the cockpit information also includes the perception information of the users in the first group of users traveling together. In the above implementation, the configuration information also supports defining traveling users. In this case, the vehicle control device only executes the vehicle control operation when it detects the target user and detects that there are one or more traveling users around the target user (or when there are no traveling users), thus meeting the user's usage needs for the first vehicle control operation in specific situations and improving the user experience.

[0028] In another possible implementation of the first aspect, the first configuration information includes the execution conditions of the second vehicle control operation and the operation content of the second vehicle control operation. The execution conditions of the second vehicle control operation include detecting a target user and a second group of users traveling together. The second group of users traveling together includes N users, where N is an integer and N≥0. The first group of users traveling together is different from the first group of users traveling together, and the operation content of the first vehicle control operation is different from the operation content of the first vehicle control operation.

[0029] In the above implementation, the configuration information supports defining multiple sets of conditions and multiple sets of vehicle control operations corresponding to these conditions. This eliminates the need to re-activate new configuration information when some conditions change, reducing the complexity of user operations and improving the user experience. For example, taking the target user as Tuantuan, when the vehicle control device detects Tuantuan and Tuantuan's mother (a predefined accompanying user), the first vehicle control operation is executed. When Tuantuan's mother gets off the vehicle and Tuantuan rides alone, the second vehicle control operation is executed (under the execution conditions of the second vehicle control operation). In this case, no new configuration information is activated; instead, the vehicle control operation corresponding to another set of conditions is switched to.

[0030] In another possible implementation of the first aspect, before performing the first vehicle control operation based on the first configuration information and cockpit information, the method further includes: receiving an enable instruction for the first configuration information input by a user. Specifically, the enable instruction is used to instruct the first vehicle control operation to be performed if the execution conditions of the first vehicle control operation are met.

[0031] The above method supports user-manual activation (or user-triggered activation) of configuration information. By issuing an activation command, the user can trigger a check to see if the execution conditions of the vehicle control operation in the first configuration information are met, so that the first vehicle control operation is executed if the execution conditions are met. Manual activation can meet the user's personalized vehicle use needs that are actively triggered.

[0032] In another possible implementation of the first aspect, the activation command includes at least one of the following: voice command, touch screen operation command, button command, or gesture command. In the above implementation, users can use various human-computer interaction methods to input the activation command, thereby improving the convenience of activating configuration information and enhancing the user experience.

[0033] In another possible implementation of the first aspect, the first configuration information further includes first indication information. The first indication information is used to indicate that the first vehicle control operation is automatically triggered, or the first indication information is used to indicate that the first vehicle control operation is automatically triggered after a first time period following the fulfillment of the execution conditions of the first vehicle control operation.

[0034] In the above embodiments, the first configuration information can be automatically enabled. In this case, the configuration information may include indication information to automatically trigger vehicle control operations. The vehicle control device can periodically or non-periodically (e.g., conditionally triggered) check whether the execution conditions of the vehicle control operation in the first configuration information are met, so that the first vehicle control operation is executed when the execution conditions are met. Since the first vehicle control operation is executed automatically, the user's operation steps are further reduced, improving the user experience.

[0035] In another possible implementation of the first aspect, before performing the first vehicle control operation, the method further includes: presenting an execution prompt for the first vehicle control operation, receiving user confirmation of the first vehicle control operation, or determining that no user denial of the first vehicle control operation is received within a second time period. Execution confirmation confirms the instruction to perform the first vehicle control operation, while execution denial cancels or stops the instruction to perform the first vehicle control operation. Here, "user" refers to a person or program with operational capabilities, and should be understood in a broad sense; the user may be the target user or other users.

[0036] In the above embodiment, when the vehicle control device executes the first vehicle control operation, it can output an execution prompt to notify the user that the first vehicle control operation has been triggered. The user can manually confirm or manually stop the execution of the first vehicle control operation. When the vehicle control device receives the user's confirmation of the first vehicle control operation, or determines that it has not received the user's denial of the first vehicle control operation within a second time period, the first vehicle control operation is executed. In this way, the first vehicle control operation can be confirmed or canceled based on the user's input before execution, giving the user a high degree of freedom in controlling the vehicle and improving the user experience.

[0037] In another possible implementation of the first aspect, the method further includes: receiving input first definition information, generating first configuration information based on the first definition information, wherein the first definition information is used to describe the execution conditions of the first vehicle control operation and the operation content of the first vehicle control operation, and the first definition information includes instruction information of the target user.

[0038] In the above embodiments, the first configuration information can be defined by the user or other modules, i.e., externally input information. This provides a design function for providing configuration information externally, allowing users to input first-defined information based on their own needs to form the first configuration information, thereby improving the user's vehicle experience.

[0039] In another possible implementation of the first aspect, the indication information for the target user includes the user identifier of the target user, which is associated with the biometrics of the target user.

[0040] In the above implementation, the target user is a specific person. For example, the vehicle has pre-recorded the target user's facial information and recorded the nickname or identification (ID) associated with the facial information. The first definition information input by the user includes the user's nickname or ID. The vehicle can identify whether the user corresponding to that nickname or ID exists in the cabin through facial recognition.

[0041] In another possible implementation of the first aspect, the indication information for the target user includes the target user's personal characteristics, which include one or more of the following: gender, age group, clothing, mood, or activity status.

[0042] In the above implementation, the target user may not be a specific individual, but rather a group of users with certain characteristics. For example, if the target user is a lightly dressed person, the first vehicle control operation might include turning on the air conditioning, adjusting the seat heating, and turning off the seat ventilation, thus providing specific services to a particular user group. Alternatively, if the target user is a young person experiencing fatigue, the first vehicle control operation might include adjusting the ambient lighting to a warm light, reclining the seat to a specified angle, and enabling seat massage. It can be seen that by defining specific user groups, configuration information can provide targeted intelligent services to user groups with certain characteristics, enhancing the humanization and intelligence of the cabin.

[0043] In another possible implementation of the first aspect, the method further includes: presenting a first interface, the first interface including an arrangement window, conditional elements, and action elements, wherein the conditional elements are used to describe the execution conditions of the vehicle control operation, the action elements are used to describe the operation content of the vehicle control operation, and the arrangement window is used to arrange the conditional elements and action elements. Generating first configuration information based on input first definition information includes: generating the first configuration information based on the target user's instruction information and the elements arranged in the arrangement window.

[0044] The above-described implementation provides a method for inputting definition information. Users can arrange elements in a first interface to design the execution content and conditions of a first vehicle control operation. The target user associated with the first configuration information can be indicated through additional information, namely, the target user's instruction information. This instruction information can be obtained through methods such as facial recognition, voiceprint recognition, or manual selection. The first definition information received by the vehicle control device includes the elements arranged in the arrangement window and the target user's instruction information.

[0045] Due to the execution conditions and actions of the first vehicle control operation, users may make various personalized designs. Therefore, an interface is provided to allow users to design configuration information in a flat and intuitive way. The target user's instructions may specify a particular user, which can be easily and quickly selected using facial recognition, temperature detection, or manual selection. Therefore, by combining interface arrangement and target user instructions, personalized configurations can be defined more conveniently and associated with target users easily, improving the user experience.

[0046] In another possible implementation of the first aspect, the method further includes: presenting a first interface, the first interface including an arrangement window, conditional elements, and action elements, wherein the conditional elements are used to describe the execution conditions of the vehicle control operation, the action elements are used to describe the operation content of the vehicle control operation, the conditional elements include user characteristic elements, the user characteristic elements are used to describe the user's personality characteristics, and the arrangement window is used to arrange the conditional elements, user characteristic elements, and action elements. Generating first configuration information based on the input first definition information includes: generating the first configuration information based on the elements arranged in the arrangement window, wherein the elements arranged in the arrangement window include at least one user characteristic element and at least one action element, and the at least one user characteristic element is used to indicate a target user.

[0047] The above implementation provides another way to input definition information. Users can arrange elements in the first interface to design the execution content of the first vehicle control operation, the execution conditions of the first vehicle control operation, and the associated target user's characteristics. By arranging user characteristic elements, users can freely define users or user groups, improving the user experience.

[0048] In another possible implementation of the first aspect, the method further includes: generating first configuration information based on the target user's vehicle usage scenario information. The target user's vehicle usage scenario information includes the target user's instruction information, the target user's vehicle usage environment information, and the operational information of the vehicle's on-board components.

[0049] The above-described implementation provides another method for generating configuration information. Based on the target user's vehicle usage scenario information, the vehicle control device can analyze the environment in which the target user uses the vehicle and the onboard components used during vehicle use, thereby automatically generating configuration information. This allows for intelligent configuration of the execution conditions and content of vehicle control operations based on the user's driving habits, eliminating the need for manual programming by the user, lowering the barrier to personalized vehicle function configuration, further enhancing the vehicle's intelligence level, and improving the user's driving experience.

[0050] In another possible implementation of the first aspect, generating first configuration information based on the target user's vehicle usage scenario information includes: inputting the target user's vehicle usage scenario information into a first model, and generating the first configuration information through the output of the first model. Further, the first model is trained based on multiple sets of vehicle usage scenario information. In the above implementation, the vehicle control device can combine the model to analyze the target user's vehicle usage scenario information to obtain the first configuration information. The model has high computing power and can be easily deployed in a separate computing unit. Analyzing the target user's vehicle usage scenario information through the model to obtain the first configuration information can lower the application threshold for users to enjoy intelligent vehicle control operations and improve the user experience.

[0051] In another possible implementation of the first aspect, the method further includes: presenting a second interface for displaying a recommendation to activate the first configuration information, and activating the first configuration information upon receiving an input activation instruction for the first configuration information or upon not receiving an input denial activation instruction within a third time period.

[0052] In another possible implementation of the first aspect, the method further includes: receiving an input marking indication for at least one user, the marking indication indicating permission to collect vehicle scenario information of at least one user, the at least one user including a target user, or at least one including a user located in a target location area located within the vehicle's cabin.

[0053] In another possible implementation of the first aspect, after performing the first vehicle control operation, the method further includes: updating the first configuration information when it is detected that a third vehicle control operation has been performed under the execution conditions of the first vehicle control operation or the number of times the third vehicle control operation has been performed exceeds M. The execution content corresponding to the first vehicle control operation in the updated first configuration information includes performing the second vehicle control operation. Wherein, the first vehicle control operation before the update did not include the third vehicle control operation, or the first vehicle control operation before the update conflicts with the third vehicle control operation.

[0054] In another possible implementation of the first aspect, after performing the first vehicle control operation, the method further includes: determining second configuration information when it is detected that a third vehicle control operation has been performed under the triggering condition of the first vehicle control operation, or when the number of times the third vehicle control operation is performed exceeds M. The second configuration information includes the triggering condition of the third vehicle control operation and the execution content of the third operation, wherein the triggering condition of the third vehicle control operation includes the triggering condition of the first vehicle control operation. The first vehicle control operation does not include the third vehicle control operation, or the first vehicle control operation conflicts with the third vehicle control operation.

[0055] In another possible implementation of the first aspect, the method further includes: presenting a third interface for displaying recommended activation of the second configuration information, and activating the second configuration information upon receiving an input activation instruction for the second configuration information or upon not receiving an input denial activation instruction within a fourth time period.

[0056] In another possible implementation of the first aspect, the method further includes: updating the first configuration information based on an input update instruction for the first configuration information, the update instruction being used to indicate the updating of at least one of the following: the user associated with the first configuration information, the triggering condition of the first vehicle control operation, and the execution content of the first vehicle control operation.

[0057] In another possible implementation of the first aspect, multiple configuration information may be enabled simultaneously in the vehicle. When there is a conflict between the vehicle control operations corresponding to the multiple configuration information, the execution action corresponding to the vehicle control operation can be determined based on the priority of the user associated with the configuration information. The vehicle control operation associated with the configuration information of a higher-priority user will take priority and will not be interrupted by the vehicle control operation corresponding to a lower-priority user.

[0058] In another possible implementation of the first aspect, the cockpit information further includes perception information of the second user. The method further includes: determining, based on third configuration information and the cockpit information, execution conditions for performing a fourth vehicle control operation, wherein the third configuration information includes the execution conditions and operation content of the fourth vehicle control operation, and the execution conditions of the fourth vehicle control operation include detecting the second user.

[0059] When there is no conflict between the fourth vehicle control operation and the first vehicle control operation, the fourth vehicle control operation shall be executed.

[0060] The fourth vehicle control operation is executed when there is at least one sub-operation conflict between the fourth vehicle control operation and the first vehicle control operation, and the user priority of the first user is higher than the user priority of the target user.

[0061] When there is at least one sub-operation conflict between the fourth vehicle control operation and the first vehicle control operation, and the user priority of the first user is lower than the user priority of the target user, the other operations in the fourth vehicle control operation except for at least one sub-operation shall be executed.

[0062] In some scenarios, multiple configuration information may be enabled simultaneously in a vehicle. When vehicle control operations corresponding to these configuration information conflict, the priority of the user associated with each configuration information can be used to determine which vehicle control operation should take effect. Vehicle control operations associated with higher-priority users will take precedence and will not be interrupted by vehicle control operations associated with lower-priority users.

[0063] In another possible implementation of the first aspect, the method further includes: when there is at least one sub-operation conflict between the fourth vehicle control operation and the first vehicle control operation, outputting a prompt message to indicate the vehicle control operation conflict.

[0064] In another possible implementation of the first aspect, the method further includes: receiving input priority definition information, the definition information being used to define the priority of a first user or to define the priority of a target user.

[0065] In the above implementation, the priority information is predefined. For example, if the priority of user U1 is set to the highest, then if the configuration information of other users conflicts with the vehicle control operation currently enjoyed by user U1 after activation, the conflicting operation will not be executed so as not to disturb user U1's riding experience.

[0066] In another possible implementation of the first aspect, the method further includes: determining the priority of the first user and the target user based on the vehicle usage scenario information when the second user and the target user are riding together. In the above implementation, the vehicle can collect vehicle usage scenario information when multiple people are riding together, analyze which user(s)'s associated configuration information (or vehicle control operations associated with those users) are preferentially activated when riding together, thereby analyzing the user's priority.

[0067] Secondly, this application provides a vehicle control method, which can be executed by a device with computing capabilities or a component of such a device (such as a chip or module). The following description uses a vehicle control device as the executing entity of this method; however, in actual implementation, the executing entity can be other names. This vehicle control method is applied to a vehicle, and the vehicle control device executing the method is located inside the vehicle or has a communication connection with the vehicle.

[0068] The vehicle control method includes: acquiring input information and generating first configuration information based on the input information. The first configuration information includes execution conditions for a first vehicle control operation and operation content for the first vehicle control operation. The execution conditions for the first vehicle control operation include detecting a target user, and the operation content of the first vehicle control operation is used to indicate a target controlled object and its target state. The first configuration information is used to execute the first vehicle control operation when the execution conditions for the first vehicle control operation are met. Further, the method also includes: presenting prompt information related to the first configuration information.

[0069] In this application, the vehicle control device can receive input information and generate first configuration information to configure the execution conditions and execution content of a first vehicle control operation. Using this first configuration information, the vehicle control device can execute the first vehicle control operation when the execution conditions are met. The execution conditions of the first vehicle control operation include detecting a target user. By utilizing the first configuration information, the first vehicle control operation can be executed when a target user is detected, thereby providing specific services to specific users, improving the vehicle's intelligence level, and meeting personalized user needs.

[0070] Furthermore, the primary configuration information can be presented to users so they are aware of its existence, enhancing their driving experience. In addition, configuration information is a user-level, personalized design, not part of the vehicle's basic functions as commonly understood by the public. Therefore, presenting the primary configuration information allows users to understand the vehicle's personalized control functions. For example, based on the prompts in the presented primary configuration information, users can obtain relevant information for the primary vehicle control operation. When this operation is executed, users can confidently enjoy the vehicle's intelligent functions without panic or worry, thus improving user comfort.

[0071] In one possible implementation of the second aspect, the input information includes first definition information, which describes the execution conditions and operation content of the first vehicle control operation, and includes instruction information from the target user.

[0072] In another possible implementation of the second aspect, the indication information for the target user includes the user identifier of the target user, which is associated with the biometrics of the target user.

[0073] In another possible implementation of the second aspect, the indication information of the target user includes the target user's personal characteristics, which include one or more of the following: gender, age group, clothing, mood, and activity status.

[0074] In another possible implementation of the second aspect, the method further includes: presenting a first interface, the first interface including an arrangement window, condition elements, and action elements, wherein the condition elements are used to describe the execution conditions of the vehicle control operation, the action elements are used to describe the operation content of the vehicle control operation, and the arrangement window is used to arrange the condition elements and action elements. Generating first configuration information based on input first definition information includes: generating the first configuration information based on the target user's instruction information and the elements arranged in the arrangement window.

[0075] In another possible implementation of the second aspect, the method further includes: presenting a first interface, the first interface including an arrangement window, conditional elements, and action elements, wherein the conditional elements are used to describe the execution conditions of the vehicle control operation, the action elements are used to describe the operation content of the vehicle control operation, the conditional elements include user characteristic elements, the user characteristic elements are used to describe the user's personality characteristics, and the arrangement window is used to arrange the conditional elements, user characteristic elements, and action elements. Generating first configuration information based on the input first definition information includes: generating the first configuration information based on the elements arranged in the arrangement window, wherein the elements arranged in the arrangement window include at least one user characteristic element and at least one action element, and the at least one user characteristic element is used to indicate the target user.

[0076] In another possible implementation of the second aspect, the input information includes the collected vehicle usage scenario information of the target user, which includes the target user's instruction information, the target user's vehicle environment information, and the operating information of the vehicle's on-board components.

[0077] In another possible implementation of the second aspect, generating first configuration information based on input information includes: inputting the target user's vehicle usage scenario information into a first model, and generating first configuration information based on the output of the first model.

[0078] In another possible implementation of the second aspect, the method further includes: presenting a second interface for displaying recommended activation of the first configuration information; and activating the first configuration information upon receiving an input activation instruction for the first configuration information or, if no input denial activation instruction is received within a third time period.

[0079] In another possible implementation of the second aspect, the method further includes: receiving an input marking indication for at least one user, the marking indication indicating permission to collect vehicle scenario information of at least one user, the at least one user including a target user, or at least one including a user located in a target location area located within the vehicle's cabin.

[0080] In another possible implementation of the second aspect, the method further includes: updating the first configuration information based on an input update instruction for the first configuration information, wherein the update instruction is used to indicate the updating of at least one of the following: the user associated with the first configuration information, the triggering condition of the first vehicle control operation, and the execution content of the first vehicle control operation.

[0081] In another possible implementation of the second aspect, the first configuration information corresponds to a configuration name, and the first configuration information also includes the configuration name of the first configuration information.

[0082] In another possible implementation of the second aspect, the first configuration information is associated with the target user, and the first vehicle control operation is used to provide services to the target user, which includes one or more users.

[0083] In another possible implementation of the second aspect, the execution condition of the first vehicle control operation further includes detecting a first group of users traveling together, the first group of users traveling together comprising N users, where N is an integer and N≥0. If the first group of users includes at least one user, the users in the first group of users traveling together are different from the target user. Furthermore, the cockpit information also includes perception information of the users in the first group of users traveling together.

[0084] In another possible implementation of the second aspect, the first configuration information further includes the execution conditions and operation content of the second vehicle control operation. The execution conditions of the second vehicle control operation include detecting a target user and a second group of users traveling together. The second group of users traveling together includes N users, where N is an integer and N≥0. The first group of users traveling together is different from the first group of users traveling together, and the operation content of the first vehicle control operation is different from the first group of users traveling together.

[0085] Thirdly, this application provides a vehicle control device, which includes an acquisition unit, a processing unit, and an output unit. The acquisition unit is used to acquire data, such as performing the aforementioned acquisition and reception operations. The processing unit is used to process data and perform operations, such as implementing one or more of the aforementioned data processing, execution, control, determination, generation, and decision-making (e.g., judgment). The output unit is used to output information externally, such as one or more of the following: output signals, presented information, and a display interface.

[0086] The vehicle control device is used to implement the method described in the first aspect or any possible implementation of the first aspect, or to implement the method described in the second aspect or any possible implementation of the second aspect.

[0087] Fourthly, this application provides a computing device including a processor and a communication interface. The communication interface is used for outputting and / or outputting data (including instructions), and / or for receiving and / or sending data. When the processor executes program instructions in memory, it implements the method described in the first aspect or any possible embodiment of the first aspect, or implements the method described in the second aspect or any possible embodiment of the second aspect.

[0088] Fifthly, this application provides a computing device, including a processor and a memory. The memory stores a computer program, and the processor invokes the computer program to implement the method described in the first aspect or any possible implementation of the first aspect, or to implement the method described in the second aspect or any possible implementation of the second aspect.

[0089] Optionally, the computing device described in the fourth or fifth aspect above includes a chip. This chip can be a single chip or a chip system composed of multiple chips.

[0090] Alternatively, the computing device may be a computing platform.

[0091] Sixthly, this application provides an intelligent cockpit, which is applied to a vehicle, or other human-accommodating transportation or sensing device. The intelligent cockpit includes sensing devices, and also includes the vehicle control device described in the third aspect, or the computing device described in the fourth aspect, or the computing device described in the fifth aspect.

[0092] In a seventh aspect, this application provides a vehicle that includes the vehicle control device described in the third aspect, or the computing device described in the fourth aspect, or the computing device described in the fifth aspect, or the smart cockpit described in the sixth aspect.

[0093] Eighthly, this application provides a computer program product, including program instructions or executable computer program code, which, when executed by at least one processor, implements the method described in the first aspect or any possible implementation of the first aspect, or implements the method described in the second aspect or any possible implementation of the second aspect.

[0094] Ninthly, this application provides a computer-readable storage medium storing program instructions that, when executed by a processor, implement the method described in the first aspect or any possible implementation of the first aspect, or implement the method described in the second aspect or any possible implementation of the second aspect.

[0095] The beneficial effects of the solutions in aspects two through nine of this application can be found in the beneficial effects described in aspect one. Attached Figure Description

[0096] The accompanying drawings used in the description of the embodiments will be briefly introduced below.

[0097] Figure 1 is a schematic diagram of a vehicle architecture;

[0098] Figure 2 is a schematic diagram of a cockpit;

[0099] Figure 3 is a schematic diagram of vehicle usage scenarios;

[0100] Figure 4 is a schematic flowchart of a vehicle control method provided in an embodiment of this application;

[0101] Figure 5 is a schematic diagram of a user interface provided in an embodiment of this application;

[0102] Figure 6 is a schematic diagram of yet another user interface provided in an embodiment of this application;

[0103] Figure 7 is a schematic diagram of another user interface provided in an embodiment of this application;

[0104] Figure 8 is a schematic diagram of a voice broadcast scenario provided in an embodiment of this application;

[0105] Figure 9 is a schematic diagram of a scenario in which a user actively enables configuration information according to an embodiment of this application;

[0106] Figure 10 is a schematic diagram of two more user interfaces provided in the embodiments of this application;

[0107] Figure 11 is a schematic diagram of two more user interfaces provided in the embodiments of this application;

[0108] Figure 12 is a schematic diagram of another user interface provided in an embodiment of this application;

[0109] Figure 13 is a schematic diagram of another user interface provided in an embodiment of this application;

[0110] Figure 14 is a schematic flowchart of another vehicle control method provided in an embodiment of this application;

[0111] Figure 15 is a structural schematic diagram of a vehicle control device provided in an embodiment of this application;

[0112] Figure 16 is a schematic diagram of the structure of a computing device provided in an embodiment of this application. Detailed Implementation

[0113] This application can be applied to scenarios requiring human-computer interaction, such as smart vehicles, smart homes, smart showrooms, and smart security systems. For example, this application can be applied to electronic devices such as vehicles, televisions, tablets, and conference equipment.

[0114] The following uses a vehicle as an example to illustrate the devices and scenarios applied in the embodiments of this application. For ease of understanding, Figures 1, 2, and 3 are used to describe the architecture of a vehicle to which this application can be applied.

[0115] Referring to Figure 1, vehicle 100 may include a sensing system 11, a computing device 12, and peripheral devices 13. Furthermore, vehicle 100 can provide seating space for users, for example, it may include a seat or have a large accommodating space to accommodate people. Further, vehicle 100 also includes other subsystems, such as a mobility system 14, a control system 15, or a power supply (not shown in the figure). Each subsystem may include one or more components, and subsystems or components may be interconnected via wired or wireless means. Of course, the functional block diagram shown in Figure 1 is only illustrative; in actual implementation, the vehicle may include more or fewer subsystems, and the types and numbers of components included in the subsystems may also be designed differently.

[0116] The following is a description of each component of vehicle 100:

[0117] The sensing system 11 may include several sensing devices, or sensors, for sensing information about the environment surrounding or inside the vehicle. Exemplarily, the sensing system 11 may include one or more of the following sensing devices: a camera 111, a microphone 112, a radar 113, a lidar 114, a temperature sensor 115, a humidity sensor 116, a light sensor 117, a positioning system 118, an inertial measurement unit 119, a pressure sensor (not shown), a touch sensor (not shown), etc. The sensing system 11 may also include sensors for sensing the internal environment of the vehicle (e.g., an in-vehicle air quality monitor, a fuel gauge, an oil temperature gauge, etc.). Sensor data from one or more of these sensors can be used to detect the corresponding object and its corresponding characteristics (such as position, shape, orientation, speed, etc.). Some sensing devices are described below as examples.

[0118] The camera 111 is used to collect image data, including images and videos. The camera 111 may include a monocular camera, a binocular camera, a time-of-flight (TOF) camera, a camera from a driver monitoring system (DMS), or a camera from a cockpit monitoring system (CMS). Referring to Figure 2, the vehicle includes a camera 111 positioned towards the cockpit, capable of capturing images within the cockpit. Of course, the number and location of the cameras 111 can be configured according to actual needs, such as near the A-pillar on the driver's side, near the A-pillar on the passenger side, on the headrest (or backrest) of the front seats, on the front of the cockpit roof, or integrated into the central control screen.

[0119] Microphone 112 can collect sound data from the vehicle's surroundings, such as user voice or other audio input. As shown in Figure 2, microphone 112 can be located in the vehicle's steering wheel or integrated into an in-vehicle display device. For microphones 112 located within the vehicle's cabin, they can collect sound data from within the cabin. In some solutions, the sound data collected by microphone 112 can be used for voiceprint recognition to identify the user. For example, some voice control systems require a specific voiceprint from the user to function.

[0120] Radar 113 can use signals such as electromagnetic waves or sound waves to sense objects in the vehicle's surrounding environment and obtain relevant information about the objects. This relevant information may include one or more of the following: distance, angle, speed, direction of travel, reflectivity, color, texture, size, and orientation. LiDAR 114 can use light to sense objects in the vehicle's environment and obtain relevant information about them. Exemplarily, LiDAR 114 may include one or more laser sources, a laser scanner, and one or more detectors, as well as other system components (such as optical elements).

[0121] Other sensors can be found in the relevant prior art, and will not be described in detail here.

[0122] The computing device 12 is a device with computing capabilities. The computing device 12 may include hardware modules with computing capabilities and / or software modules with computing capabilities. Examples are given below based on both hardware and software implementations.

[0123] As an example of hardware implementation, computing device 12 may include at least one processor, which is a module with processing capabilities. In one implementation, the processor may be a circuit with instruction read and execute capabilities, such as a central processing unit (CPU), microprocessor, microcontroller unit (MCU), graphics processing unit (GPU), or digital signal processor (DSP). In another implementation, the processor can implement certain functions through the logical relationships of hardware circuits, which may be fixed or reconfigurable. For example, the processor may be a hardware circuit implemented as an application-specific integrated circuit (ASIC) or a programmable logic device (PLD), such as a field-programmable gate array (FPGA). In reconfigurable hardware circuits, the process of the processor loading a configuration document and configuring the hardware circuit can be understood as the process of the processor loading instructions to implement the corresponding function. Furthermore, the processor can also be a hardware circuit designed for artificial intelligence, which can be understood as an ASIC, such as a neural network processing unit (NPU), tensor processing unit (TPU), deep learning processing unit (DPU), etc. In some implementations, the computing device 12 includes at least one processor integrated as a system-on-chip (SOC), which is commonly referred to as a SOC by those skilled in the art. The SOC may include at least one processor, and when the SOC includes multiple processors, the types of processors can be different, such as including a CPU and an NPU.

[0124] For example, the computing device 12 includes, but is not limited to, a domain controller (DC), a mobile data center (MDC), an electronic control unit (ECU), and a vehicle integrated / integration unit (VIU). The DC may include a cockpit domain controller (CDC).

[0125] As an example of software implementation, computing device 12 may include software functional units. As another example of a software functional unit, computing device 12 may include one or more of the following: an executable computer program, computer code, or computer instructions, where "executable" means capable of running on a processor or computing instance. As yet another example of a software functional unit, computing device 12 may include computing instances, including virtual machines, containers, etc. A virtual machine is a computer system simulated by software, possessing complete hardware system functionality and running in an isolated environment. A container is an isolated environment obtained by packaging applications and their dependencies.

[0126] In some embodiments, some or all of the processors included in the computing device 12 may be located away from the vehicle 100 and be able to transmit information with the vehicle 100.

[0127] Peripheral device 13 is used to provide additional services to the user. In some solutions, peripheral device 13 is used for user interaction. For example, peripheral device 13 may include one or more of the following: communication device 131, screen 132, seat 133, air conditioner 134, speaker 135, fragrance 137, ambient light 138, or car refrigerator 136. Some components are described below by example:

[0128] The communication device 131 can communicate with one or more devices directly or via a communication network, including wired and wireless communication. In some embodiments, the communication device 131 has adjustable functions; for example, the Bluetooth module can support status settings such as turning it on, off, or searching for nearby devices.

[0129] In some solutions, the communication device 131, which supports wireless communication, can receive and / or transmit wireless signals. After being transmitted into the object space, the wireless signal travels through multiple transmission paths to reach the receiving device. The communication device, acting as the receiving device, can sense objects in the object space based on the wave characteristics of the received wireless signal. For example, using the basic Fresnel zone model, the communication device 131 can sense the movement of objects in space based on the waveform of the received wireless signal, thus enabling it to detect users or identify relevant user information, such as movement patterns, height, and respiratory rate. The wireless technologies used by the communication device 131 that supports wireless communication include one or more of the following: SparkLink (or NearLink), wireless local area network (WLAN), Bluetooth, Zigbee, radio frequency identification (RFID), ultra-wideband (UWB) technology, communication technologies based on long term evolution (LTE), 5th generation mobile networks (or 5th generation wireless systems, 5th-Generation, abbreviated as 5G or 5G technology), global system for mobile communications (GSM), general packet radio service (GPRS), or universal mobile telecommunications system (UMTS), etc.

[0130] Screen 132 can display information to users. Screen 132 includes one or more of the following: physical screen (such as a central control screen, passenger screen, rear screen, etc.), projection system, smart entity, or button panel. Projection system includes, for example, light field screen, head-up display (HUD), or other projection system. As shown in Figure 2, a central control screen can be installed on the vehicle's center console. The central control screen is used to display the vehicle's driving route, showcase vehicle functions, or play audio and video. In addition to the central control screen, other types of screens are also installed in the vehicle, allowing passengers in the front passenger seat, rear passengers, etc., to interact with the vehicle through the screens. This application does not strictly limit the number and placement of screens 132 in the applicable scenario. Taking the application of this application in a vehicle as an example, the placement of screen 132 can be in front of the passenger seat, on the headrest (or backrest) of the front seat, on the armrest of the seat, on the door, or on the top of the cabin.

[0131] Seat 133 is used for the occupants of vehicle 100. In some designs, seat 133 may have a variety of intelligent components, such as backrest angle adjustment components, ventilation components, seat heating components, seat audio components, seat massage components, etc.

[0132] The speaker 135 can output audio to a user inside the vehicle. For example, the speaker 135 can perform voice announcements and / or sound effect playback, such as indicating the current status of a controlled object and providing feedback on the execution of a vehicle control operation. Alternatively, the speaker can play sound effect information, such as expressing information based on the frequency of a "beep" sound. In some embodiments, the speaker 135 can also be a sound wave emitting device, for example, it can serve as the transmitter of an ultrasonic detection system (such as ultrasonic radar). Other peripheral devices 13 can be found in the descriptions in related technologies and will not be described in detail here.

[0133] In some embodiments, as shown in FIG1, the vehicle further includes various subsystems. The propulsion system 14 includes components that provide power for the movement of the vehicle 100. Exemplarily, the propulsion system 14 may include an engine 141, an energy source 142, a transmission 143, and wheels 144 (or tires). The control system 15 is a system for controlling the vehicle and its components. Exemplarily, the control system 15 may include a steering system 151, an accelerator 152, or a braking unit 153, etc.

[0134] In some embodiments, the vehicle also includes a memory that may contain instructions (e.g., program logic) that can be executed by a processor to perform various functions of the vehicle 100, including those described above. The memory may also contain additional instructions, including instructions to send data to, receive data from, interact with, and / or control one or more of the mobility system 14, sensing system 11, control system 15, and peripheral devices 13. In addition to instructions, the memory may store data such as road maps, route information, vehicle position, direction, speed, and other such vehicle data, as well as other information. This information may be used by the vehicle 100 and / or computing device 12 during operation of the vehicle in autonomous, semi-autonomous, and / or manual modes.

[0135] With the development of intelligent technology, vehicles are incorporating more and more adjustable functions. Components such as air conditioning, seats, doors and windows, lights, navigation, voice control, fragrance systems, display devices, and audio systems all have adjustable functions. Furthermore, as vehicles become more intelligent, the adjustable dimensions of in-vehicle components are increasing, and their usage is becoming more diverse. Taking vehicle 100 as an example in Figure 1, many of its peripheral devices have adjustable functions. For instance, communication device 131 may include nodes supporting StarFlash communication technology, which can be adjusted to be on or off, or to control its associated surrounding devices. Similarly, screen 132 may include multiple screens located on the center console, passenger side, driver's side, or rear seats, and these screens can have their brightness or background color adjusted. Furthermore, the seats in vehicle 100 may support the following adjustments: seat height, seat back angle, leg rest angle, seat fore-aft position, seat ventilation function on / off and ventilation level, seat heating function on / off and heating level, massage function on / off and massage intensity adjustment. For example, for vehicles that support zoned temperature control, multiple air vents will be installed at the seat position, and some or all of the air vents can be adjusted individually in terms of air volume, air temperature and air direction.

[0136] These adjustable functions offer users a technologically advanced and intelligent driving experience, but they also create technical barriers to service use. Users are forced to perform complex operations or issue numerous commands to set these functions, resulting in a poor user experience. For example, a user might issue a voice command like, "Turn on the air conditioning, adjust the fan speed to level two, set the temperature to 24 degrees Celsius and avoid airflow towards people, turn on the seat massage, recline the seat back to 100 degrees, open the passenger window 20%, open the music app to play my favorite song, set the screen brightness to 96..." This requires users to fully understand and remember the settings of each adjustable function. If a user misses an adjustment, they need to repeatedly issue the voice command. Furthermore, in some driving environments, there is a risk of the driver setting functions for passengers unfamiliar with these features, posing a threat to driving safety.

[0137] Some solutions support pre-designing adjustable functions in vehicles, allowing complex functions to be adjusted all at once. For example, car owners can design the following function combination for children: when someone is in the front passenger seat, turn on the passenger-side air conditioning and set its temperature and airflow direction; design the apps to open on the passenger-side screen and set them to play cartoons, etc., so that this function combination can be automatically activated when there is a passenger in the front passenger seat. However, this function combination is automatically executed based on events or states in the vehicle (such as "someone in the front passenger seat" mentioned above). When other users are in the front passenger seat, this function combination will still be triggered, resulting in the person currently in the front passenger seat receiving vehicle services that do not match their needs. In fact, the person currently in the front passenger seat or the driver may need to make additional adjustments to adjustable functions (such as turning off apps playing cartoons, adjusting the air conditioning temperature, closing the windows, etc.), leading to a poor user experience.

[0138] In view of this, this application provides a vehicle control method and related apparatus. In this application, configuration information is predefined in the vehicle, which configures the conditions for executing vehicle control operations and the content of the operations. The vehicle control operations are used to control objects within the vehicle, such as adjusting their state. The execution conditions for the vehicle control operations include detecting a target user. For example, referring to Figure 3, the vehicle control operations include: turning on the screen and launching application P1, reclining the seat back to 100°, and opening the seat ventilation to level two. The target user can be user U1. That is, the vehicle control operation will only be executed if user U1 is detected. Continuing with Figure 1, if all other conditions for executing this set of vehicle control operations are met, or if there are no other execution conditions for the vehicle control operation, but user U1 is not detected in the vehicle's cabin, then the vehicle control operation will not be executed. In other words, this solution can automatically execute pre-configured vehicle control operations, and these operations are targeted at a specific user, i.e., "person recognition."

[0139] In summary, this application can perform pre-configured vehicle control operations for specific users, eliminating the tedious manual control operations for users, and enabling target users to immediately enjoy a variety of intelligent in-vehicle functions, greatly improving the comfort and safety of the vehicle.

[0140] The method of this application embodiment is described below. It should be noted that the method is illustrated here using a vehicle scenario as an example. When this method is applied to other devices or systems, it can have similar effects. In this case, the method need not be called a vehicle control method; it can be called a control method or other methods. It should be understood that the names of the methods, devices, information, etc., can be designed according to the implementation situation, and this application does not strictly limit the names of things.

[0141] Please refer to Figure 4, which is a schematic flowchart of a vehicle control method provided in an embodiment of this application. Optionally, the method is applied to a vehicle, such as the vehicle 100 shown in Figure 1, and is executed by the computing device 12 in the vehicle 100 shown in Figure 1, for example. For ease of description, the following description takes the vehicle control device as the executing entity. Optionally, the vehicle control device can be replaced by the computing device 12, or the computing device 12 can include the vehicle control device.

[0142] The vehicle control method shown in Figure 4 may include one or more steps from S401 to S402. It should be understood that, for ease of description, the method is described in the order of S401 to S402, but this embodiment does not limit the order of execution, the execution time, or the number of executions of the above one or more steps. S401 to S402 are as follows:

[0143] S401: The vehicle control unit obtains information about the vehicle's cabin.

[0144] The vehicle control device is a device with computing capabilities, such as the computing device 12 shown in Figure 1. Exemplarily, the vehicle control device is a DC, such as a CDC.

[0145] The cockpit information includes information about the vehicle's cockpit, which reflects the current status of the cockpit. For example, the cockpit information includes sensory information such as images, sound, point clouds, and wireless sensing data, which can be collected by sensors installed in the vehicle (or in the vehicle's cockpit). Referring to Figure 2, a camera 111 and a microphone 112 are installed in the vehicle cockpit, which can be used to collect images and sound from within the cockpit, respectively.

[0146] In this embodiment, the cabin information includes perception information about the target user. Referring to Figure 3, when user U1 is in the cabin, the camera 111 installed in the vehicle 100 may capture an image of the target user, which can serve as perception information about the target user. Similarly, when user U1 is in the cabin, the microphone 112 installed in the vehicle 100 may capture the target user's voice, which can also serve as perception information about the target user. For example, based on the voice data captured by the microphone 112, voiceprint recognition can identify the user corresponding to the voiceprint. When the cabin information includes perception information about the target user, it can be understood that the machine has detected the presence of the target user in the cabin. Of course, due to some measurement errors or unexpected situations, the target user may not actually be present in the cabin.

[0147] In some possible implementations, cockpit information also includes information relevant to cockpit control, such as environmental information inside and / or outside the vehicle. Here, "relevant" means that this information can be used to control objects within the vehicle cockpit. For example, cockpit information includes information collected by sensing devices deployed in the cockpit, such as information collected by in-vehicle cameras (e.g., DMS, CMS), in-vehicle microphones, and in-vehicle communication devices. More exemplarily, cockpit information includes information collected by non-cockpit-related sensors, such as images of the outside of the vehicle, traffic congestion, weather information, or outside temperature, and other environmental information about the exterior and / or interior of the vehicle.

[0148] In one possible implementation, cabin information includes one or more of the following: event information, time information, weather information, lighting information, temperature information, humidity information, location information, passenger information, passenger characteristics, and congestion status. Event information indicates events detected inside or outside the vehicle, such as someone getting into the front passenger seat, someone getting into the back seat, a passenger sitting in a seat, a window being opened, a door being closed, the vehicle being charged, or the vehicle being parked. Time information includes information such as season, time of day, holidays, weekdays, daytime, nighttime, and specific time. Weather information indicates the weather (e.g., sunny, rainy, cloudy). Other information can be found in relevant literature and will not be described in detail here.

[0149] In some possible implementations, the vehicle control device acquires cockpit information in the following ways: First, the vehicle control device receives cockpit information sent (or output) by other devices or apparatuses. Second, the vehicle control device acquires data collected by sensors and generates cockpit information based on the sensor-collected data; of course, in this case, the sensor-collected data can also be directly regarded as cockpit information.

[0150] S402: The vehicle control unit performs a first vehicle control operation based on the first configuration information and the cockpit information.

[0151] A vehicle includes multiple control objects with adjustable functions used to provide services to the user. For example, a vehicle may include one or more of the following control objects: seats, doors, windows, display devices, air conditioning, lights, navigation systems, voice systems, Bluetooth, audio systems, fragrance systems, or in-vehicle applications (such as movie apps, video apps, music apps, etc.). Taking seats as an example, some vehicles' seats support adjustments in the following dimensions: seat height, seat back angle, leg rest angle, seat fore-aft position, seat ventilation function on / off and ventilation level, seat heating function on / off and heating level, massage function on / off and massage intensity adjustment.

[0152] The first vehicle control operation is used to adjust the state of a target controlled object in the vehicle. The target controlled object may include one or more of the aforementioned controlled objects. Referring to Figure 3, for example, the first vehicle control operation includes: turning on the rear screen and activating application P1, reclining the rear seats to 100°, and turning on the seat ventilation at level 2. Another example is that the first vehicle control operation includes: adjusting the seat ventilation level to level 1 and opening the windows by 10%.

[0153] The first configuration information includes the execution conditions and operation content of the first vehicle control operation. The execution conditions of the first vehicle control operation are the conditions under which the first vehicle control operation is performed. In this embodiment, the execution conditions of the first vehicle control operation include detecting a target user. The execution content of the first vehicle control operation is used to indicate the target control object and its target state; that is, performing the first vehicle control operation can adjust the target control object to the target state. For example, the first vehicle control operation includes: adjusting the seat ventilation level to level one and opening the window by 10%. The operation content of the first vehicle control operation describes the execution action of the first vehicle control operation; therefore, the operation content of the first vehicle control operation indicates the control object targeted by the first vehicle control operation and the adjustment operation on that control object.

[0154] In this embodiment, first configuration information is predefined to configure the execution conditions and execution content of the first vehicle control operation. Using this first configuration information, the vehicle control device can execute the first vehicle control operation when the execution conditions are met, allowing the relevant controlled objects to be adjusted to the corresponding state to meet the user's needs. The execution conditions of the first vehicle control operation include detecting a target user. If the cockpit information includes the target user's perception information, the vehicle control device can determine that a target user has been detected based on the cockpit information and execute the first vehicle control operation when the execution conditions are met. Thus, based on the first configuration information, specific services can be provided to a specific user (user U1 as shown in Figure 3), improving the vehicle's intelligence and meeting the personalized driving needs of the user.

[0155] In some possible implementations, when performing the first vehicle control operation, the specific content of the first vehicle control operation, i.e., the specific controlled object, is also related to the target user's seating position in the vehicle. As one possible design, the vehicle control device detects the target user and their position within the cabin based on the vehicle's cabin information. Based on first configuration information and the target user's position within the cabin, the vehicle control device determines a first controlled object and its target state. The first controlled object is a target controlled object and includes control objects associated with the target user's position within the cabin. Further, the vehicle control device performs the first vehicle control operation based on the vehicle's cabin information and the first configuration information to adjust the first controlled object to its target state. For example, the first configuration information defines the first vehicle control operation as including turning on the screen, i.e., the controlled object is the screen. However, the controlled object here includes specific control objects associated with at least a position; when the target user is detected to be in the front passenger seat, the front passenger screen is turned on; if the target user is detected to be in the rear left seat, the screen in that rear left seat is turned on. In this way, by combining the first configuration information with the user's location in the vehicle, the first control object that should be controlled can be determined. This can adapt to the user's different seating positions in the vehicle and provide targeted services for the same user in different positions, significantly improving the vehicle's intelligence and enhancing the user experience.

[0156] In some solutions, the vehicle control device may specifically perform the following operations: based on the first configuration information and cockpit information, determine whether the execution conditions for the first vehicle control operation are met. That is, based on the cockpit information, it determines whether the current situation meets the execution conditions for the first vehicle control operation. If the execution conditions for the first vehicle control operation are met, the first vehicle control operation is executed. In other solutions, determining whether the execution conditions for the first vehicle control operation are met is merely an intermediate step in the implementation process. That is, the result of determining whether the execution conditions for the first vehicle control operation are met may not be output, but rather integrated into the entire process of "executing the first vehicle control operation based on the first configuration information and cockpit information." In this case, if the first vehicle control operation is executed, it indicates that the execution conditions for the first vehicle control operation are met; otherwise, the execution conditions for the first vehicle control operation are determined not to be met.

[0157] It should be noted that the various implementation methods provided in this application can be combined without mutual exclusion. As one possible example of combination, the vehicle control device detects the target user and the target user's position within the cabin based on the vehicle's cabin information. Based on first configuration information and the cabin information, it determines whether the execution conditions for a first vehicle control operation are met. If the execution conditions for the first vehicle control operation are met, the vehicle control device determines a first controlled object and its target state based on the first configuration information and the target user's position within the cabin. The first controlled object is a target controlled object, and includes a control object associated with the target user's position within the cabin. The vehicle control device executes the first vehicle control operation to adjust the first controlled object to its target state. The above example combines the aforementioned condition judgment scheme with a design adapted to different user actions within the cabin. Various embodiments, implementation methods, possible designs, and optional solutions provided in other parts of this application can also be combined; however, each combination will not be exemplified individually.

[0158] In some possible implementations, the vehicle control device may present a prompt message for the first configuration information. This presentation may include presenting the prompt message for the first configuration information through sound, light, or electricity, such as through a display device or projection device (e.g., a light field screen). For example, the vehicle control device may present the prompt message for the first configuration information through a screen display interface. As another example, the vehicle control device may verbally announce the relevant content of the first configuration information through a speaker.

[0159] Presenting primary configuration information allows users to understand its existence or execution status, enhancing the user experience. Displaying prompts for primary configuration information enables users to access personalized vehicle control functions. For example, based on these prompts, users can learn about relevant primary vehicle control operations. During these operations, users can confidently enjoy the vehicle's intelligent features without panic or worry, thus improving user comfort.

[0160] The prompt information of the first configuration information includes information prompting at least one of the following: the name, the execution content of the first vehicle control operation, the execution conditions of the first vehicle control operation, the user associated with the first configuration information (i.e., the target user), the status of the first configuration information (e.g., enabled, or about to be enabled), or the triggering method of the first configuration information, etc. (some of which are described below). The prompt information of the first configuration information can be used to prompt at least one of the above contents.

[0161] Please refer to Figure 5, which is a schematic diagram of a user interface provided in an embodiment of this application. The vehicle control device can present the user interface 50 through a display device or a projection device. The user interface 50 includes the following: the name of the first configuration information (i.e., "audio-visual mode"), the execution conditions of the first vehicle control operation, and the execution content of the first vehicle control operation. Of course, the content shown in the user interface 50 is only an example. Among them, the execution conditions of the first vehicle control operation include detecting user U1. Here, it is exemplarily described that the first configuration information is associated with user U1. Optionally, other conditions may also be included, such as detecting someone getting into the vehicle. The execution content of the first vehicle control operation includes: turning on the rear screen, enabling application P1, reclining the rear seats to 100°, and turning on the seat ventilation at level 2.

[0162] It should be understood that the content and format presented in Figure 5 above are merely examples. In some solutions, the prompt for the first configuration information may include more or less of the first configuration information, or even other content. The following, in conjunction with Figures 6-8, introduces some possible examples of presenting the first configuration information.

[0163] As shown in Figure 6, the vehicle control device can present a user interface 50 through a display device or a projection device. The user interface 50 includes the following: the name of the first configuration information (i.e., "audio-visual mode"), the execution condition of the first vehicle control operation (user U detected), the control object involved in the first vehicle control operation (i.e., the target control object), and the status of the first configuration information (e.g., enabled). Of course, in some solutions, the user interface 50 also includes other operation controls, such as a cancel control 601 and a confirmation control (not shown in the figure), to support user control of the first configuration information. Optionally, the operation controls may also include controls such as a countdown control 602.

[0164] As shown in Figure 7, the vehicle control device can display the user interface 50 through a display device or a projection device. The text "User U1's audio-visual mode is enabled" included in the user interface 50 indicates the following: the name of the first configuration information ("audio-visual mode"), the user associated with the first configuration information ("User U1"), and the status of the first configuration information ("enabled"). Optionally, the user interface 50 shown in Figure 7 can be displayed through pop-up window 701, status bar notification, etc.

[0165] As shown in Figure 8, the vehicle control device can make a voice announcement through the speaker. The voice announcement "User U1's audio-visual mode is enabled" indicates the following: the name of the first configuration information ("audio-visual mode"), the user associated with the first configuration information ("User U1"), and the status of the first configuration information ("enabled").

[0166] In some possible implementations, the execution conditions of the first vehicle control operation also include first environmental conditions, and the cabin information further includes environmental information used to indicate the environmental state related to the vehicle. Exemplarily, environmental conditions include one or more of the following: event conditions, time conditions, weather conditions, lighting conditions, temperature conditions, humidity conditions, location conditions, passenger conditions in the cabin, or characteristic conditions of passengers in the cabin. Events include, for example, detecting someone getting into the vehicle (or someone getting into the front seat, someone getting into the back seat, etc.), detecting a door closing (or a designated door closing), detecting someone in a seat, detecting parking, detecting the vehicle being charged, etc. Time conditions include, for example, currently in a certain season, currently in a certain time period (such as lunch break, commuting time, 2 PM to 6 PM, etc.), currently on a holiday, tomorrow being a workday, currently during the day or night, etc. Weather information includes, for example, currently sunny, currently rainy, or expected to rain after a specified period, or heavy fog in the near future, etc. Lighting information includes, for example, currently poor lighting, lighting reconfiguration, or significant changes in lighting (such as exiting a tunnel), etc. Temperature conditions, such as being in a high-temperature state or a low-temperature state. Location conditions, such as the vehicle being in mountainous terrain, tunnels, highways, or urban areas. Occupant conditions in the cabin, such as the presence of a specified number of occupants, specific occupants, or occupants in specific locations within the cabin. Occupant characteristics, such as the presence of children or elderly people in the cabin.

[0167] Referring to Figure 5, the execution conditions for the first vehicle control operation also include someone boarding or disembarking. In some scenarios, a new passenger or combination of passengers may only be present in the cabin when someone boards or alights. Therefore, designing this event as an execution condition for the first vehicle control operation can prevent accidental function triggering, improve service accuracy, and enhance the user experience. In summary, defining the environmental conditions for executing the first vehicle control operation allows it to be triggered in specific environments, making the services provided by the first vehicle control operation more adaptable to the current environment and improving the user experience.

[0168] For ease of understanding, some possible designs for configuration information are described below with reference to Table 1. The following will also describe some possible implementations of this application with reference to Table 1.

[0169] Table 1 Example of configuration information

[0170] In some possible implementations, the first configuration information corresponds to a configuration name, and the first configuration information also includes the configuration name of the first configuration information. It should be noted that "correspondence" here means that one type of configuration information can have a corresponding name, but different configuration information may have the same configuration name. As shown in Table 1, both different configuration information can correspond to the name "Commuter Boarding". Optionally, the configuration name can be user-defined, pre-designed, or generated using relevant algorithms. As shown in Table 1, configuration names include, for example, "Audio-Visual Mode", "Commuter Boarding", "Parking Space", "Rest Mode", etc. Of course, the configuration names shown in Figure 1 are only examples; in specific implementations, the configuration names can be designed in other ways, such as "Vacation Mode" or "Personal Space".

[0171] In some possible implementations, the first configuration information is associated with a target user, and the first vehicle control operation is used to provide services to the target user. Optionally, the target user may include one or more users. It should be understood that the target user may be one or more, as shown in Table 1, the user associated with the configuration information corresponding to "Audio-Video Mode" is user U1. "Commuter Boarding" may correspond to two different configuration information sets, one of which may be associated with users U2 and U3. In the above implementations, associating configuration information with target users facilitates the targeted activation of specific user configuration information when the user actively enables it.

[0172] In some possible implementations, the execution condition for the first vehicle control operation further includes detecting a first group of users traveling together, the first group of users traveling together comprising N users, where N is an integer and N≥0. If the first group of users includes at least one user, the users in the first group of users traveling together are different from the target user, and the cockpit information also includes the perception information of the users in the first group of users traveling together.

[0173] Optionally, the above implementation supports special definitions, such as defining the number of users traveling together as 0, that is, N=0. In this case, the first vehicle control operation is only executed when the target user is detected traveling alone or driving alone.

[0174] In some possible implementations, the first configuration information also includes the execution conditions and operation content of the second vehicle control operation. In this case, the configuration information can include multiple sets of conditions and multiple sets of execution functions. This integrates the corresponding vehicle usage scenarios into the same configuration information, improving the design flexibility of the configuration information and enhancing the user experience. In some solutions, the first configuration information includes the execution conditions and execution content of multiple sets of vehicle control operations under multiple similar usage scenarios. Referring to Table 2, the "Rest Mode" can include the execution conditions and execution content of multiple sets of vehicle control operations. When Rest Mode is enabled, the corresponding vehicle control operation can be automatically changed according to changes in the number of people in the vehicle.

[0175] For example, the first configuration information also includes the execution conditions of the second vehicle control operation and the operation content of the second vehicle control operation. The execution conditions of the second vehicle control operation include detecting a target user and a second group of users traveling together. The second group of users traveling together includes N users, where N is an integer and N≥0. The first group of users traveling together is different from the first group of users traveling together. The operation content of the first vehicle control operation is different from the operation content of the first vehicle control operation.

[0176] Referring to Table 1, taking user U1 as an example (e.g., a child), when the vehicle control device detects both user U1 and user U2 (a predefined companion user), the following first vehicle control operation is executed: air conditioning temperature 25℃, air conditioning fan speed level 1, music off, ambient lighting off. In other words, the execution conditions for the first vehicle control operation include detecting both user U1 and user U2.

[0177] Referring to Table 1, taking user U1 as an example (e.g., a child), when the vehicle control device detects user U1 and user U3 (a predefined companion user), the following first vehicle control operation is executed: air conditioning temperature 25℃, air conditioning fan speed level 1, application P3 activated and animation C1 turned on, ambient lighting turned off. In other words, the execution conditions for this first vehicle control operation include detecting user U1 and user U2. At this time, the vehicle control operation will differ depending on the companion of user U1.

[0178] Referring to Table 1, taking user U1 as an example (e.g., a child), when the vehicle control device detects both user U1 and user U3 (a predefined companion user, different from user U2), the following first vehicle control operation is executed: air conditioning temperature 25℃, air conditioning fan speed level 1, application P3 activated and animation C1 turned on, ambient lighting turned off. In other words, the execution conditions for this first vehicle control operation include detecting both user U1 and user U2. At this time, the vehicle control operation will differ depending on the companion of user U1.

[0179] Some schemes also support defining user seats, for example, user U1 needs to sit in a specific position, and / or, companions need to sit in another specific position.

[0180] In some possible implementations, the configuration information supports manual activation by the user (or user-triggered activation). By issuing an activation command, the user can trigger a check to determine if the execution conditions for the vehicle control operation in the first configuration information are met, thus enabling the execution of the first vehicle control operation if those conditions are satisfied. That is, the vehicle control device can receive user-input activation commands for the first configuration information. Specifically, the activation command instructs the execution of the first vehicle control operation if its execution conditions are met. The activation command includes at least one of the following: voice commands, touchscreen operation commands, button commands, or gesture commands, etc.

[0181] Please refer to Figure 9. When the user issues the voice command "Open the audio-visual mode of user U1", the first configuration information can be activated. The vehicle control device can perform the first vehicle control operation based on the cockpit information and the first configuration information.

[0182] In some other possible implementations, the configuration information supports automatic activation (or condition-triggered activation), that is, the first vehicle control operation is automatically triggered when the execution conditions of the first vehicle control operation are met. As one possible design, the first configuration information also includes first indication information. The first indication information is used to indicate automatic activation of the first vehicle control operation, or it is used to indicate automatic activation of the first vehicle control operation after a first duration following the fulfillment of the execution conditions. Further, the vehicle control device may periodically or non-periodically (e.g., conditionally triggered) check whether the execution conditions of the vehicle control operation in the first configuration information are met, so that the first vehicle control operation is executed when the execution conditions are met. For example, the first duration is, for example, 10 seconds (s). That is, when the execution conditions of the first vehicle control operation are met, the first vehicle control operation will be automatically activated 10 seconds later.

[0183] In some possible implementations, when the configuration information supports multiple activation methods such as manual and automatic activation (or condition-triggered activation), the conditions involved in different activation methods can be different. Referring to Table 1, some conditions are only required to be met when condition-triggered activation is enabled. For example, the execution conditions corresponding to "Commuter Boarding" include: ① Detecting user U2, ③ Condition 1 for automatic triggering: 8-10 AM, ④ Condition 2 for automatic triggering: Navigation destination is the company. Among these, conditions ② and ③ only need to be met in automatic activation. That is, if the user issues the voice command "Enable user U2's commuter boarding mode," conditions ② and ③ do not need to be met; in this case, only detecting user U2 is required to trigger the corresponding vehicle control operation.

[0184] In some possible implementations, before executing the first vehicle control operation, the vehicle control device may display an execution prompt for the first vehicle control operation to notify the user that the first vehicle control operation has been triggered. Accordingly, the user may manually confirm or manually stop the execution of the first vehicle control operation.

[0185] Furthermore, the vehicle control device can receive confirmation from the user regarding the execution of the first vehicle control operation, or, if it determines that no denial of the execution of the first vehicle control operation is received from the user within a second time period, referring to Figure 6, taking a second time period of 10 seconds as an example, if no user clicks "cancel enable" within 10 seconds, the first vehicle control operation is executed. Execution confirmation confirms the instruction to execute the first vehicle control operation, while execution denial cancels or stops the instruction to execute the first vehicle control operation. Here, "user" refers to a person or program with operational capabilities, and should be understood in a broad sense; this user may be the target user or other users.

[0186] The content of the first configuration information and the execution process of the first vehicle control operation have been introduced above. The definition method of the first configuration information is introduced below.

[0187] Method 1: The first configuration information is generated based on user-inputted definition information. The vehicle control device can receive the input first definition information and generate first configuration information based on it. The first definition information describes the execution conditions and operation content of the first vehicle control operation, and includes the target user's instruction information.

[0188] Optionally, the target user is a specific person. The target user's information includes the target user's user identifier, which is associated with the target user's biometric characteristics. For example, the vehicle may have pre-recorded the target user's facial information and the associated nickname or identification (ID). The user's initial input includes the user's nickname or ID. The vehicle can use facial recognition to identify whether the target user corresponding to that nickname or ID exists in the cabin. As another example, the vehicle may have pre-recorded the target user's voiceprint and the associated nickname or ID. The user's initial input includes the user's nickname or ID, and the vehicle can use voiceprint recognition to identify whether the target user corresponding to that nickname or ID exists.

[0189] Alternatively, the target user may not be a specific individual, but rather a group of users with certain characteristics. The target user's information includes their characteristics, such as gender, age group, clothing, mood, or activity status. Age group examples include toddlers, children, young adults, middle-aged adults, and the elderly; clothing examples include bottoms, tops, clothing color, and thickness; mood examples include tiredness, happiness, and depression; and activity status examples include lively, quiet, and sleeping. For example, if the target user is a lightly dressed person, the first vehicle control operation includes turning on the air conditioning, adjusting the seat heating, and turning off the seat ventilation, thus providing specific services to a specific user group. As another example, if the target user is a young person in a fatigued state, the first vehicle control operation includes adjusting the ambient lighting to a warm light, reclining the seat to a specified angle, and enabling seat massage. It can be seen that by defining specific user groups, the configuration information can provide targeted intelligent services to user groups with certain characteristics, enhancing the humanization and intelligence of the cabin.

[0190] The following describes two scenarios for generating the first configuration information based on the input definition information:

[0191] Scenario 1: The first defined information includes the elements arranged in the arrangement window and the target user's instruction information. Users can arrange elements in the first interface to design the execution content and conditions of the first vehicle control operation. The target user associated with the first configuration information can be indicated through additional information, namely the target user's instruction information, which can be obtained through methods such as facial recognition, voiceprint recognition, and manual selection.

[0192] For example, the vehicle control device presents a first interface, which includes a programming window, condition elements, and action elements. The condition elements describe the execution conditions of the vehicle control operation, the action elements describe the operation content of the vehicle control operation, and the programming window is used to program the condition elements and action elements. The vehicle control device generates first configuration information based on the target user's instruction information and the elements programmed in the programming window.

[0193] It should be understood that the first interface may include one interface or multiple interfaces. As shown in Figure 10, the first interface includes a first sub-interface 1010 and a second sub-interface 1020, wherein the first sub-interface 1010 includes a condition arrangement window 1012 for arranging condition elements, and a condition display window 1011 for the condition element list. As shown in part (a) of Figure 10, the condition elements include one or more of the following categories: location, environment (here referring to the external environment of the electronic system, such as natural environments like temperature, humidity, and time), navigation, and occupants. The element categories listed here are merely examples. For example, the environment category may include elements such as time, cabin temperature, and PM2.5 concentration. Users can define specific settings for the condition elements, such as setting the time point or time range for the time element, setting the threshold or range for the cabin temperature, and setting the value or range for the PM2.5 concentration. In Figure 10, the rectangle containing "Please enter" is used to exemplarily represent an operation control that receives user input. This operation control can be designed as text input, number input, selection box, slider, etc., as needed, and can even receive voice input, gesture input, or collaborative input from other devices. There are no strict restrictions on the specific means by which the user arranges elements.

[0194] Please refer to part (b) of Figure 10. The second sub-interface 1020 includes an action orchestration window 1022 for orchestrating action elements, and an action display window 1021 for displaying the list of action elements. Action elements include one or more conditional elements such as air conditioner, car window, screen, and execution elements (e.g., countdown, loop execution, etc.). The element categories listed here are only examples. Users can edit the control objects that need to be adjusted in the action orchestration window and set their target states. The orchestration effect here is only an example.

[0195] Please refer to part (a) of Figure 11. The target user's instruction information can be obtained through methods such as facial recognition, voiceprint recognition, and manual selection. Taking manual selection as an example, please refer to part (b) of Figure 11. The user can select one or more users whose biometric features, such as facial recognition or voiceprint recognition, have been recorded as users associated with the configuration information. Alternatively, the user can choose real-time facial recognition and further select the camera to use, thereby using the camera to record and associate facial features on-site. Other user identification features, such as voiceprint recognition, can also be recorded in real-time.

[0196] Scenario 2: The first definition information includes the elements arranged in the arrangement window. The user arranges the elements in the arrangement window to design the execution content of the first vehicle control operation, the execution conditions of the first vehicle control operation, and the associated target user's personality characteristics.

[0197] For example, the vehicle control device presents a first interface, which includes an arrangement window, condition elements, and action elements. The condition elements describe the execution conditions of the vehicle control operation, and the action elements describe the operation content of the vehicle control operation. The condition elements include user characteristic elements, which describe the user's personal characteristics. The arrangement window is used to arrange the condition elements, user characteristic elements, and action elements. Based on the elements arranged in the arrangement window, the vehicle control device generates first configuration information. The elements arranged in the arrangement window include at least one user characteristic element and at least one action element, and the at least one user characteristic element is used to indicate the target user.

[0198] For information on the arrangement of conditional elements and actions, please refer to Figure 10. The arrangement of user characteristic elements can be illustrated using Figure 12 as an example. The first interface also includes a third sub-interface 120, which includes a user arrangement window 1202 for arranging user characteristic elements and a user display window 1201 for listing user elements. Action characteristic elements can be found in the aforementioned description; Figure 12 shows several possible examples, such as age group, clothing, mood, and activity status. Users can edit user characteristic elements in the action arrangement window to provide specific services to a particular user group.

[0199] Method 2: The vehicle control device generates first configuration information based on the target user's vehicle usage scenario information. This information includes the target user's instructions, the target user's driving environment information, and the operational information of the vehicle's onboard components. In other words, based on the target user's usage scenario information, the vehicle control device can analyze the environment in which the target user uses the vehicle and the onboard components used during driving, thereby automatically generating configuration information.

[0200] For example, based on user U1's vehicle usage information, it can be determined that when user U1 is commuting to work (8-10 am, from location A to location B), they usually turn on the air conditioning to 26°C, turn on the ambient lights, and turn on the fragrance. Therefore, the following configuration information can be generated: Execution conditions: The vehicle is running, the cabin detects user U1, the current time is 8-10 am, the navigation route is from location A to location B, and the execution content is: turn on the air conditioning to 26°C, turn on the ambient lights, and turn on the fragrance.

[0201] Furthermore, the vehicle control device can combine the model to analyze the target user's vehicle usage scenario information to obtain the first configuration information. For example, the vehicle control device inputs the target user's vehicle usage scenario information into a first model and generates the first configuration information based on the output of the first model. The first model can be an artificial intelligence (AI) model or a large-scale model. The AI ​​model includes, but is not limited to, machine learning models, self-learning models, deep learning models, neural networks, etc. Furthermore, when the first model is an AI model, it can be trained based on multiple sets of vehicle usage scenario information.

[0202] In some possible implementations, configuration information automatically generated based on vehicle usage scenario information can be recommended to the user for activation. As one possible implementation, the vehicle control device presents a second interface for displaying the recommended activation of the first configuration information. Further, the vehicle control device activates the first configuration information upon receiving an input activation instruction for the first configuration information or upon not receiving an input denial activation instruction within a third time period.

[0203] Please refer to Figure 13. The vehicle control device can present a second interface 130 through a display device or projection device. The second interface 130 includes prompts related to the first configuration information, such as prompts for one or more of the following: the name of the configuration information, associated user, execution conditions, and execution content. The second interface also includes text or graphic prompts, such as displaying the following text: "Based on your driving habits, the following configuration information 1 has been generated for you. Activation is recommended." The second interface 130 also includes displaying operation controls, such as a confirmation control 1301 or a cancellation control 1302. The user can click the confirmation control 1301 to indicate activation of the configuration information, or click the cancellation control 1302 to indicate denial of activation of the configuration information. Of course, the interface shown in Figure 13 is only an example. In specific implementations, various interaction methods or interfaces for user confirmation can be output in conjunction with relevant user interaction designs, which will not be listed here.

[0204] In some possible implementations, when collecting vehicle usage scenario information, data can be collected selectively for users meeting specific conditions or for users satisfying certain conditions (e.g., the front passenger). As one possible design, the vehicle control unit receives an input marking instruction for at least one user, indicating that vehicle usage scenario information for at least one user is permitted. This at least one user includes a target user, or at least one user located within a target location area, situated within the vehicle's cabin. For example, a user can input a marking instruction for the front passenger, indicating permission to collect their vehicle usage scenario information. This allows for the rapid generation of customized configuration information for one or more front passenger users, improving their user experience.

[0205] The two methods for generating configuration information described above are merely examples. In some possible implementations, the generated configuration information can be updated, either manually by the user or automatically (e.g., in the event of an operational conflict, as described below). Taking manual updating as an example, the vehicle control device updates the first configuration information based on an input update command for the first configuration information. Exemplarily, the update command is used to instruct the updating of at least one of the following: the user associated with the first configuration information, the triggering condition of the first vehicle control operation, and the execution content of the first vehicle control operation. Further exemplarily, referring to Figure 13, for configuration information generated based on vehicle usage scenario information, the user can add additional conditional elements or action elements. For example, the second interface 130 also includes an input control 1303, which can support editing conditional elements, or, the control is used to jump to the interface shown in part (a) of Figure 10 to edit conditional elements.

[0206] The process of generating configuration information has been described above. The following section introduces some possible designs after the first vehicle control operation is executed.

[0207] In some possible implementations, after the first vehicle control operation is executed, the user (who may be the target user or other users) may execute an operation that conflicts with the first vehicle control operation. The vehicle control operation can update the execution content of the first vehicle control operation in the first configuration information to adapt to the user's needs. As one possible implementation, when it is detected that a third vehicle control operation has been executed under the execution conditions of the first vehicle control operation, or the number of times the third vehicle control operation has been executed exceeds M, the vehicle control device updates the first configuration information. The execution content corresponding to the first vehicle control operation in the updated first configuration information includes the execution of the second vehicle control operation. Wherein, the first vehicle control operation before the update did not include the third vehicle control operation, or the first vehicle control operation before the update conflicted with the third vehicle control operation. Here, M can be pre-designed or pre-defined.

[0208] For example, referring to Figure 3, when the rear seat is reclined to 100°, the target user may adjust the seat to 105°. When the vehicle control device detects that the seat has been adjusted to 105° or detects that the seat has been adjusted to 105° M times, it updates the first vehicle control operation in the first configuration information and updates the target state of the rear seat to 105° in the execution content of the first vehicle control operation.

[0209] In some possible implementations, after the first vehicle control operation is executed, the user (which may be the target user or other users) may execute an operation that conflicts with the first vehicle control operation. The vehicle control operation can generate new configuration information to form a new combination of execution conditions and execution content for the vehicle control operation. As one possible implementation, when it is detected that a third vehicle control operation has been executed under the triggering conditions of the first vehicle control operation, or when the number of times the third vehicle control operation is executed exceeds M, the vehicle control device determines second configuration information. The second configuration information includes the triggering conditions of the third vehicle control operation and the execution content of the third operation. The triggering conditions of the third vehicle control operation include the triggering conditions of the first vehicle control operation. The first vehicle control operation does not include the third vehicle control operation, or the first vehicle control operation conflicts with the third vehicle control operation.

[0210] Optionally, new configuration information generated in the event of an operational conflict may be recommended to the user for activation. As one possible implementation, the vehicle control device presents a third interface for displaying the recommended activation of the second configuration information. Further, the second configuration information is activated upon receiving an input instruction to activate the second configuration information or upon not receiving an input instruction to deny activation within a fourth time period. See the foregoing for a related description.

[0211] In some scenarios, multiple configuration information may be enabled simultaneously in a vehicle. When vehicle control operations corresponding to these configuration information conflict, the priority of the user associated with each configuration information can be used to determine which vehicle control operation should take effect. Vehicle control operations associated with higher-priority users will take precedence and will not be interrupted by vehicle control operations associated with lower-priority users.

[0212] In some possible implementations, the cockpit information also includes the perception information of the second user. When the configuration information associated with the first user and the second user conflicts after activation, the conflict can be resolved based on user priority. As one possible implementation, the vehicle control device determines the execution conditions for performing a fourth vehicle control operation based on the third configuration information and the cockpit information. The third configuration information includes the execution conditions and operation content of the fourth vehicle control operation. The execution conditions of the fourth vehicle control operation include detecting the second user.

[0213] At this point, the execution of the fourth vehicle control operation may result in the following situations:

[0214] Case 1: When there is no conflict between the fourth vehicle control operation and the first vehicle control operation, execute the fourth vehicle control operation.

[0215] Case 2: If there is at least one sub-operation conflict between the fourth vehicle control operation and the first vehicle control operation, and the user priority of the first user is higher than the user priority of the target user, then the fourth vehicle control operation shall be executed.

[0216] Case 3: When there is at least one sub-operation conflict between the fourth vehicle control operation and the first vehicle control operation, and the user priority of the first user is lower than the user priority of the target user, execute the other operations in the fourth vehicle control operation except for at least one sub-operation.

[0217] Of course, the specific implementation may include more or fewer cases, and there may be other alternative designs for each case, which will not be listed here.

[0218] In some possible implementations, when there is at least one sub-operation conflict between the fourth vehicle control operation and the first vehicle control operation, the vehicle control device outputs a conflict warning message to indicate the vehicle control operation conflict. This allows the user to become aware of the operation conflict, facilitating the editing of user priorities or manual readjustment of adjustable functions.

[0219] In some possible implementations, the vehicle control device may receive input priority definition information, which is used to define the priority of a first user or the priority of a target user. In the above implementation, the priority information is predefined, for example, user U1's priority is set to the highest. In this case, if the configuration information of other users conflicts with the vehicle control operation currently enjoyed by user U1 after activation, the conflicting operation will not be executed to avoid disturbing user U1's riding experience.

[0220] In some possible implementations, the vehicle control device can determine the priority of the first user and the target user based on the vehicle usage scenario information when the second user and the target user are riding together. The vehicle can collect vehicle usage scenario information when multiple people are riding together, and analyze which user(s)'s associated configuration information (or matching the vehicle control operations associated with those users) is prioritized when riding together, thereby analyzing the user's priority.

[0221] In the embodiment shown in Figure 4, first configuration information is predefined to configure the execution conditions and execution content of the first vehicle control operation. Using this first configuration information, the vehicle control device can execute the first vehicle control operation when the execution conditions are met. The execution conditions of the first vehicle control operation include detecting a target user. By utilizing the first configuration information, the first vehicle control operation can be executed when a target user is detected, thereby providing specific services to specific users, improving the vehicle's intelligence level, and meeting personalized user needs.

[0222] Please refer to Figure 14, which is a flowchart illustrating another vehicle control method provided in an embodiment of this application. Optionally, this method is applied to a vehicle, such as the vehicle 100 shown in Figure 1, and is executed by the computing device 12 in the vehicle 100 shown in Figure 1, for example. For ease of description, the following description uses a vehicle control device as the executing entity. Optionally, the vehicle control device can be replaced by the computing device 12, or the computing device 12 can include the vehicle control device.

[0223] The vehicle control method shown in Figure 14 may include one or more steps from S1401 to S1403. It should be understood that, for ease of description, the method is described in the order of S1401 to S1403, but this embodiment does not limit the order of execution, the execution time, or the number of executions of the above one or more steps. S1401 to S1403 are as follows:

[0224] Step S1401: The vehicle control device acquires input information.

[0225] The input information can be user-inputted or vehicle-collected, used to define or analyze the information to obtain the first configuration information. Two possible implementation methods are described below:

[0226] Method 1: The input information includes first-defined information, which describes the execution conditions and operation content of the first vehicle control operation. Further, the first-defined information also includes instructions from the target user. This input can be user input or first-defined information received from other devices via a program, communication unit, etc.

[0227] Optionally, the target user is a specific person. The indication information for the target user includes the target user's user identifier, which is associated with the target user's biometric characteristics. Alternatively, the target user may not be a specific person, but rather a group of users with certain personality traits. For a related description, please refer to the definition method 1 of the first configuration information above.

[0228] The following uses user input as an example to illustrate two possible scenarios for inputting the first defined information:

[0229] Scenario 1: The first defined information includes the elements arranged in the arrangement window and the target user's instruction information. Users can arrange elements in the first interface to design the execution content and conditions of the first vehicle control operation. The target user associated with the first configuration information can be indicated through additional information, namely the target user's instruction information, which can be obtained through methods such as facial recognition, voiceprint recognition, and manual selection.

[0230] For example, the vehicle control device presents a first interface, which includes a programming window, condition elements, and action elements. The condition elements describe the execution conditions of the vehicle control operation, the action elements describe the operation content of the vehicle control operation, and the programming window is used to program the condition elements and action elements. The vehicle control device generates first configuration information based on the target user's instructions and the elements programmed in the programming window. See Figures 10 and 11 for a detailed description.

[0231] Scenario 2: The first definition information includes the elements arranged in the arrangement window. The user arranges the elements in the arrangement window to design the execution content of the first vehicle control operation, the execution conditions of the first vehicle control operation, and the associated target user's personality characteristics.

[0232] For example, the vehicle control device presents a first interface, which includes an arrangement window, condition elements, and action elements. The condition elements describe the execution conditions of the vehicle control operation, and the action elements describe the operation content of the vehicle control operation. The condition elements include user characteristic elements, which describe the user's personal characteristics. The arrangement window is used to arrange the condition elements, user characteristic elements, and action elements. Based on the elements arranged in the arrangement window, the vehicle control device generates first configuration information. The elements arranged in the arrangement window include at least one user characteristic element and at least one action element, and the at least one user characteristic element is used to indicate the target user. See Figures 10 and 12 for a detailed description.

[0233] Method 2: The input information includes the target user's vehicle usage scenario information, which includes the target user's instructions, the target user's vehicle environment information, and the vehicle's on-board component operating information.

[0234] In some possible implementations, when collecting vehicle usage scenario information, data can be collected selectively for users meeting a specific condition or for users satisfying a certain condition (e.g., the front passenger). As one possible design, the vehicle control unit receives an input tagging instruction for at least one user, indicating that vehicle usage scenario information for at least one user is permitted to be collected. This at least one user includes a target user, or at least one user located within a target location area, which is situated within the vehicle's cabin.

[0235] For a description of the aforementioned methods 1 and 2, please refer to the description of the embodiment shown in Figure 4 above.

[0236] Step S1402: The vehicle control device generates first configuration information based on the input information.

[0237] The first configuration information includes the execution conditions and operation content of the first vehicle control operation. The execution conditions include detecting a target user, and the operation content is used to indicate the target control object and its target state. The first configuration information is used to execute the first vehicle control operation when the execution conditions are met.

[0238] The following describes two implementations for generating the first configuration information, based on the two types of input information described above:

[0239] Implementation 1: The vehicle control device can receive input first definition information and generate first configuration information based on the first definition information. The first definition information is used to describe the execution conditions and operation content of the first vehicle control operation. The first definition information includes the instruction information of the target user.

[0240] Implementation 2: The vehicle control device generates first configuration information based on the target user's vehicle usage scenario information. The target user's vehicle usage scenario information includes the target user's instructions, the target user's vehicle environment information, and the operational information of the vehicle's onboard components. In other words, based on the target user's vehicle usage scenario information, the vehicle control device can analyze the environment in which the target user uses the vehicle and the onboard components used during vehicle use, thereby automatically generating configuration information.

[0241] Furthermore, the vehicle control device can combine the model to analyze the target user's vehicle usage scenario information to obtain the first configuration information.

[0242] In some possible implementations, configuration information automatically generated based on vehicle usage scenario information can be recommended to the user for activation. As one possible implementation, the vehicle control device presents a second interface for displaying the recommended activation of the first configuration information. Further, the vehicle control device activates the first configuration information upon receiving an input activation instruction for the first configuration information or upon not receiving an input denial activation instruction within a third time period.

[0243] For a detailed description of Implementation 1 and Implementation 2, please refer to the description of the embodiment shown in Figure 4 above.

[0244] In some possible implementations, the generated configuration information can be updated. This update can be manual by the user or automatic (e.g., in the event of an operational conflict, as described below). Taking manual update as an example, the vehicle control device updates the first configuration information based on an input update command for the first configuration information. Exemplarily, the update command is used to instruct the updating of at least one of the following: the user associated with the first configuration information, the triggering condition of the first vehicle control operation, and the execution content of the first vehicle control operation.

[0245] In some possible implementations, the vehicle control device may update the first configuration information based on an input update instruction for the first configuration information. The update instruction is used to indicate the update of at least one of the following information: the user associated with the first configuration information, the triggering conditions and execution content of the first vehicle control operation, the triggering method of the first configuration information, etc.

[0246] In some possible implementations, the first configuration information corresponds to a configuration name, and the first configuration information also includes the configuration name of the first configuration information.

[0247] In some possible implementations, the first configuration information is associated with a target user, and the first vehicle control operation is used to provide services to the target user. Optionally, the target user includes one or more users.

[0248] In some possible implementations, the execution condition for the first vehicle control operation further includes detecting a first group of users traveling together, the first group of users traveling together comprising N users, where N is an integer and N≥0. If the first group of users includes at least one user, the users in the first group of users traveling together are different from the target user. Furthermore, the cockpit information also includes perception information of the users in the first group of users traveling together.

[0249] In some possible implementations, the first configuration information further includes the execution conditions and operation content of the second vehicle control operation. The execution conditions of the second vehicle control operation include detecting a target user and a second group of users traveling together. The second group of users traveling together includes N users, where N is an integer and N≥0. The first group of users traveling together is different from the first group of users traveling together, and the operation content of the first vehicle control operation is different from the first group of users traveling together.

[0250] Optionally, the embodiment shown in FIG14 further includes step S1403, as follows:

[0251] Step S1403: The vehicle control device displays a prompt message with the first configuration information.

[0252] The presentation here includes displaying prompts for the first configuration information through sound, light, or electricity, such as through a display device or projection device (e.g., a light field screen). For example, the vehicle control device may display prompts for the first configuration information via a screen interface. As another example, the vehicle control device may verbally announce the relevant content of the first configuration information through a speaker.

[0253] The prompt information for the first configuration information includes information prompting at least one of the following: the name, the execution content of the first vehicle control operation, the execution conditions of the first vehicle control operation, the user associated with the first configuration information (i.e., the target user), the status of the first configuration information (e.g., enabled, or about to be enabled), or the triggering method of the first configuration information, etc. (some of these are described below). The prompt information for the first configuration information can be used to prompt at least one of the above contents. A related description can be found in the user interface shown in Figure 5.

[0254] In the embodiment shown in Figure 14, the vehicle control device can receive input information and generate first configuration information to configure the execution conditions and execution content of the first vehicle control operation. Using this first configuration information, the vehicle control device can execute the first vehicle control operation if the execution conditions are met. The execution conditions of the first vehicle control operation include detecting a target user. By utilizing the first configuration information, the first vehicle control operation can be executed when a target user is detected, thereby providing specific services to specific users, improving the vehicle's intelligence level, and meeting personalized user needs.

[0255] The foregoing has described the application scenarios and methods provided by the embodiments of this application. The apparatus of the embodiments of this application is provided below. It is understood that the various apparatuses provided in the embodiments of this application, such as interactive devices, computing devices, chips, etc., include hardware structures, software units, or combinations of hardware and software structures to perform the functions described in the above method embodiments. Those skilled in the art should readily recognize that the apparatus and modules within it can be implemented in hardware or a combination of hardware and computer software in conjunction with the various functions described in the embodiments disclosed herein. Whether a function is executed by hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different apparatus implementations in different application scenarios to implement the aforementioned method embodiments, and different implementations of the apparatus should not be considered beyond the scope of the embodiments of this application.

[0256] Several possible devices are listed below.

[0257] Please refer to Figure 15, which is a schematic diagram of a vehicle control device according to an embodiment of this application. The vehicle control device 150 may include an acquisition unit 1501 and a processing unit 1502, and optionally also includes an output unit 1503. The vehicle control device 150 may be an independent device, such as the computing device 12 shown in Figure 1, or the vehicle 100 shown in Figure 1, Figure 2, or Figure 3. Alternatively, the vehicle control device 150 may also be a software module and / or hardware module in an independent device, such as a chip in the computing device 12.

[0258] The vehicle control device 150 is used to implement the aforementioned vehicle control method, such as the vehicle control device 150 in the embodiments shown in FIG. 4 or FIG. 14. The processing unit 1502 is used to perform one or more of the aforementioned data processing, instruction execution, and other related operations such as determining, adjusting, generating, deciding, and judging. The acquisition unit 1501 is used to perform one or more of the aforementioned operations such as acquiring and receiving. Optionally, the interactive device further includes an output unit 1503, which is used to interact with the user, such as outputting prompts, presenting information, and broadcasting voice messages.

[0259] In one possible design, the vehicle control device 150 is used to implement the vehicle control method shown in Figure 4.

[0260] In one possible implementation, the acquisition unit 1501 is used to acquire vehicle cabin information, including perception information of a target user located inside the vehicle cabin. The processing unit 1502 is used to execute a first vehicle control operation based on first configuration information and the cabin information. The first configuration information includes the execution conditions and operation content of the first vehicle control operation, and the execution conditions of the first vehicle control operation include detecting the target user.

[0261] In another possible implementation, the interactive device further includes an output unit 1503, which is used to present prompts for the first configuration information.

[0262] In another possible implementation, the processing unit 1502 is used to determine whether the execution conditions for the first vehicle control operation are met based on the first configuration information and the cockpit information, and to execute the first vehicle control operation if the execution conditions for the first vehicle control operation are met.

[0263] In another possible implementation, the acquisition unit 1501 is further configured to receive an enable instruction for the first configuration information input by the user.

[0264] In another possible implementation, the interactive device further includes an output unit 1503, which is used to present an execution prompt of the first vehicle control operation, receive user confirmation of the execution of the first vehicle control operation, or determine that no user denial of the execution of the first vehicle control operation is received within a second time period.

[0265] In another possible implementation, the acquisition unit 1501 is further configured to receive input first definition information, generate first configuration information based on the first definition information, the first definition information being used to describe the execution conditions of the first vehicle control operation and the operation content of the first vehicle control operation, the first definition information including the instruction information of the target user.

[0266] In another possible implementation, the interactive device further includes an output unit 1503, which is used to present a first interface. The first interface includes an arrangement window, conditional elements, and action elements. The conditional elements describe the execution conditions of the vehicle control operation, and the action elements describe the operation content of the vehicle control operation. The arrangement window is used to arrange the conditional elements and action elements. The processing unit 1502 is also used to generate first configuration information based on the instruction information of the target user and the elements arranged in the arrangement window.

[0267] In another possible implementation, the interactive device further includes an output unit 1503, which is used to present a first interface. The first interface includes an arrangement window, conditional elements, and action elements. The conditional elements describe the execution conditions of the vehicle control operation, and the action elements describe the operation content of the vehicle control operation. The conditional elements include user characteristic elements, which describe the user's personal characteristics. The arrangement window is used to arrange the conditional elements, user characteristic elements, and action elements. The processing unit 1502 is also used to generate first configuration information based on the elements arranged in the arrangement window. The elements arranged in the arrangement window include at least one user characteristic element and at least one action element, and the at least one user characteristic element is used to indicate the target user.

[0268] In another possible implementation, the processing unit 1502 is further configured to generate first configuration information based on the target user's vehicle usage scenario information. The target user's vehicle usage scenario information includes the target user's instruction information, the target user's vehicle usage environment information, and the operating information of the vehicle's on-board components.

[0269] In another possible implementation, the processing unit 1502 is further configured to input the target user's vehicle usage scenario information into the first model, and generate first configuration information based on the output of the first model. Further, the first model is trained based on multiple sets of vehicle usage scenario information.

[0270] In another possible implementation, the interactive device further includes an output unit 1503, which is used to present a second interface for displaying a recommendation to activate the first configuration information. The first configuration information is activated upon receiving an input activation instruction for the first configuration information or upon not receiving an input denial activation instruction within a third time period.

[0271] In another possible implementation, the acquisition unit 1501 is further configured to receive an input tag indication for at least one user, the tag indication indicating permission to collect vehicle scenario information of at least one user, the at least one user including a target user, or at least one including a user located in a target location area located inside the vehicle's cabin.

[0272] In another possible implementation, the processing unit 1502 is further configured to update the first configuration information when it detects that a third vehicle control operation has been executed under the execution conditions of the first vehicle control operation, or that the number of times the third vehicle control operation has been executed exceeds M. The execution content corresponding to the first vehicle control operation in the updated first configuration information includes the execution of a second vehicle control operation. Wherein, the first vehicle control operation before the update did not include the third vehicle control operation, or the first vehicle control operation before the update conflicts with the third vehicle control operation.

[0273] In another possible implementation, the processing unit 1502 is further configured to determine second configuration information when it detects that a third vehicle control operation has been executed under the triggering condition of a first vehicle control operation, or that the number of times the third vehicle control operation has been executed exceeds M. The second configuration information includes the triggering condition of the third vehicle control operation and the execution content of the third operation. The triggering condition of the third vehicle control operation includes the triggering condition of the first vehicle control operation. The first vehicle control operation does not include the third vehicle control operation, or the first vehicle control operation conflicts with the third vehicle control operation.

[0274] In another possible implementation, the interactive device further includes an output unit 1503 for presenting a third interface for displaying recommended activation of the second configuration information, which activates the second configuration information upon receiving an input activation instruction for the second configuration information or upon not receiving an input denial activation instruction within a fourth time period.

[0275] In another possible implementation, the processing unit 1502 is further configured to update the first configuration information based on the input update instruction for the first configuration information, wherein the update instruction is configured to indicate the update of at least one of the following information: the user associated with the first configuration information, the triggering condition of the first vehicle control operation, and the execution content of the first vehicle control operation.

[0276] In another possible implementation, the cockpit information also includes the perception information of the second user. The processing unit 1502 is further configured to determine, based on the third configuration information and the cockpit information, the execution conditions for performing the fourth vehicle control operation, wherein the third configuration information includes the execution conditions and the operation content of the fourth vehicle control operation, and the execution conditions for the fourth vehicle control operation include detecting the second user.

[0277] Processing unit 1502 is also used for:

[0278] When there is no conflict between the fourth vehicle control operation and the first vehicle control operation, the fourth vehicle control operation shall be executed.

[0279] The fourth vehicle control operation is executed when there is at least one sub-operation conflict between the fourth vehicle control operation and the first vehicle control operation, and the user priority of the first user is higher than the user priority of the target user.

[0280] When there is at least one sub-operation conflict between the fourth vehicle control operation and the first vehicle control operation, and the user priority of the first user is lower than the user priority of the target user, the other operations in the fourth vehicle control operation except for at least one sub-operation shall be executed.

[0281] In another possible implementation, the interactive device further includes an output unit 1503, which is used to output a prompt message to indicate a vehicle control operation conflict when there is at least one sub-operation conflict between the fourth vehicle control operation and the first vehicle control operation.

[0282] In another possible implementation, the acquisition unit 1501 is further configured to receive input priority definition information, which is used to define the priority of a first user or to define the priority of a target user.

[0283] In another possible implementation, the processing unit 1502 is further configured to determine the priority of the first user and the target user based on the vehicle usage scenario information when the second user and the target user ride together.

[0284] The specific operations performed by the vehicle control device 150 can also be found in the embodiment shown in Figure 4.

[0285] In one possible design, the vehicle control device 150 is used to implement the vehicle control method shown in FIG14.

[0286] In one possible implementation, the acquisition unit 1501 is used to acquire input information, and the processing unit 1502 is used to generate first configuration information based on the input information.

[0287] In another possible implementation, the vehicle control device 150 further includes an output unit 1503 for presenting prompts for the first configuration information.

[0288] In another possible implementation, the vehicle control device 150 further includes an output unit 1503, which is used to present a first interface. The first interface includes a programming window, conditional elements, and action elements. The conditional elements describe the execution conditions of the vehicle control operation, and the action elements describe the operation content of the vehicle control operation. The programming window is used to program the conditional elements and action elements. The processing unit 1502 is also used to generate first configuration information based on the instruction information of the target user and the elements programmed in the programming window.

[0289] In another possible implementation, the vehicle control device further includes an output unit 1503, which is used to present a first interface. The first interface includes an arrangement window, conditional elements, and action elements. The conditional elements describe the execution conditions of the vehicle control operation, and the action elements describe the operation content of the vehicle control operation. The conditional elements include user characteristic elements, which describe the user's personal characteristics. The arrangement window is used to arrange the conditional elements, user characteristic elements, and action elements. The processing unit 1502 is also used to generate first configuration information based on the elements arranged in the arrangement window. The elements arranged in the arrangement window include at least one user characteristic element and at least one action element, and the at least one user characteristic element is used to indicate the target user.

[0290] In another possible implementation, the processing unit 1502 is further configured to generate first configuration information based on the target user's vehicle usage scenario information. The target user's vehicle usage scenario information includes the target user's instruction information, the target user's vehicle usage environment information, and the operating information of the vehicle's on-board components.

[0291] In another possible implementation, the processing unit 1502 is further configured to input the target user's vehicle usage scenario information into the first model, and generate first configuration information based on the output of the first model. Further, the first model is trained based on multiple sets of vehicle usage scenario information.

[0292] In another possible implementation, the vehicle control device further includes an output unit 1503 for presenting a second interface for displaying recommended activation of the first configuration information, which is activated upon receiving an input activation instruction for the first configuration information or upon not receiving an input denial activation instruction within a third time period.

[0293] In another possible implementation, the acquisition unit 1501 is further configured to receive an input tag indication for at least one user, the tag indication indicating permission to collect vehicle scenario information of at least one user, the at least one user including a target user, or at least one including a user located in a target location area located inside the vehicle's cabin.

[0294] In another possible implementation, the processing unit 1502 is further configured to update the first configuration information based on the input update instruction for the first configuration information, wherein the update instruction is configured to indicate the update of at least one of the following information: the user associated with the first configuration information, the triggering condition of the first vehicle control operation, and the execution content of the first vehicle control operation.

[0295] The specific operations performed by the vehicle control device 150 can also be found in the description of the embodiment shown in Figure 14.

[0296] Figure 16 shows a schematic diagram of a computing device provided in an embodiment of this application. The computing device 12 is a device with computing capabilities. This device can be a physical device, such as a controller, processor, server (e.g., rack server), host, etc., or it can be a virtual device, such as a virtual machine, container, etc. Optionally, the computing device 12 can be included in a vehicle, as shown in Figure 1.

[0297] As shown in Figure 16, the computing device 12 includes a processor 121 and a memory 122. Optionally, the computing device 12 may also include one or more of a bus 123, a communication interface 124, etc. For example, the processor 121 and the memory 122 communicate with each other via the bus 123. It should be understood that this application does not limit the number of processors and memories in the computing device 12.

[0298] Memory 122 provides storage space, which may optionally store application data, user data, operating system, and computer programs (including the aforementioned instructions 1023). Memory 122 may include volatile memory, such as random access memory (RAM). Memory 122 may also include non-volatile memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD).

[0299] Processor 121 is a module for performing calculations and may include any one or more of the following: controller (e.g., memory controller), central processing unit (CPU), graphics processing unit (GPU), microprocessor (MP), digital signal processor (DSP), coprocessor (assisting the central processing unit in completing corresponding processing and applications), application-specific integrated circuit (ASIC), microcontroller unit (MCU), virtual machine, container, etc.

[0300] The communication interface 124 is used to provide information input or output to at least one processor, such as an in-line interface, an out-line interface, etc.

[0301] And / or, the communication interface 124 can be used to receive data transmitted externally and / or transmit data externally. The communication interface 124 can be a wired link interface, including an Ethernet cable, or a wireless link interface (Wi-Fi, Bluetooth, general wireless transmission, and other wireless communication technologies, etc.). Optionally, the communication interface 124 may also include a transmitter (such as an RF transmitter, antenna, etc.) or a receiver coupled to the interface.

[0302] Bus 123 can be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. Buses can be categorized as address buses, data buses, control buses, etc. For ease of illustration, only one line is used in Figure 16, but this does not imply that there is only one bus or one type of bus. Bus 123 can include pathways for transmitting information between various components of the computing device 12 (e.g., memory 122, processor 121, communication interface 124).

[0303] In one possible implementation, memory 122 stores executable instructions, and processor 121 executes the executable instructions to implement the aforementioned vehicle control method, such as the vehicle control method in the embodiment shown in FIG4 or FIG14.

[0304] This application also provides a chip including a processor and a communication interface. The communication interface is used for outputting and / or outputting data (including instructions), and / or for receiving and / or sending data. When the processor executes program instructions in memory, the aforementioned vehicle control method, such as the vehicle control method in the embodiments shown in FIG4 or FIG14, is implemented.

[0305] As one possible example, the communication interface is used to input voice and gesture information, and the processor is used to determine the controlled object based on the voice information and adjust the state of the controlled object based on the gesture information. Optionally, the communication interface is also used to output at least some information related to various prompts.

[0306] This application provides a computer-readable storage medium storing instructions that, when executed by at least one processor, implement the aforementioned vehicle control method, such as the vehicle control method in the embodiment shown in FIG4 or FIG14.

[0307] The computer-readable storage medium can be any available medium that a computing device can store, or a data storage device such as a data center that contains one or more available media. Computer-readable storage media can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media (e.g., solid-state drives).

[0308] This application provides a computer program product including computer instructions that, when executed on at least one processor, implement the aforementioned vehicle control method, such as the vehicle control method in the embodiments shown in FIG4 or FIG14.

[0309] Optionally, the computer program product can be a software installation package or an image package. If the aforementioned method is required, the computer program product can be downloaded and executed on a computing device.

[0310] This application provides a vehicle that includes the aforementioned vehicle control device 160, or the aforementioned computing device 12, or the aforementioned chip, or the aforementioned computer storage medium, or the aforementioned computer program product deployed on the vehicle. Exemplarily, the architecture of the vehicle may be as shown in FIG1.

[0311] In addition, a few additional points need to be made regarding this application:

[0312] 1. Unless otherwise stated, “multiple” means two or more.

[0313] 2. Unless otherwise specified or in case of logical conflict, the terms and / or descriptions in different embodiments of this application are consistent and can be referenced in each other. The technical features in different embodiments can be combined to form new embodiments according to their inherent logical relationships.

[0314] III. The various numerical designations used in this application are merely for descriptive convenience and are not intended to limit the scope of protection of this application. The magnitude of the serial numbers used in this application does not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic. For example, the terms "first," "second," "third," "fourth," and other various terminology (if present) in the specification, claims, and drawings of this application are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. Such data can be interchanged where appropriate so that the embodiments described herein can be implemented in a sequence other than that illustrated or described herein.

[0315] Furthermore, any embodiment or design described in this application as "exemplary" or "for example" should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of terms such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner for ease of understanding.

[0316] IV. The terms “comprising” and “having” and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are expressly listed, but may include other steps or units that are not expressly listed or that are inherent to such process, method, product or device.

[0317] V. In this application, "for indicating" can be understood as "enabling". "Enabling" can include direct enabling and indirect enabling. When describing information for enabling A, it can include whether the information directly enables A or indirectly enables A, but it does not mean that the information necessarily carries A.

[0318] The information that enables the information is called the information to be enabled. In the specific implementation process, there are many ways to enable the information to be enabled, such as, but not limited to, directly enabling the information to be enabled, such as the information to be enabled itself or its index. It can also be indirectly enabled by enabling other information, where there is a relationship between the other information and the information to be enabled. It can also enable only a part of the information to be enabled, while the other parts are known or pre-agreed upon. For example, enabling specific information can be achieved by using a pre-agreed (e.g., protocol-defined) arrangement of various pieces of information, thereby reducing enabling overhead to some extent. Simultaneously, common parts of various pieces of information can be identified and enabled uniformly to reduce the enabling overhead caused by individually enabling the same information.

[0319] VI. In this application, "predefined" may include preconfiguration. For example, predefining certain information means that the information is calculated or received in advance before performing an action that uses the information. The "predefined" can be implemented by pre-storing corresponding codes, tables, or other means that can be used to indicate relevant information in the device (e.g., in a controller or vehicle). This application does not limit the specific implementation method.

[0320] VII. The term "storage" or "preservation" in this application can refer to storage in one or more memory devices. These memory devices can be separately configured or integrated into an encoder, decoder, processor, or communication device. Alternatively, some memory devices can be separately configured, while others can be integrated into a decoder, processor, or communication device. The type of memory can be any form of storage medium, and this is not limited.

[0321] 8. In the schematic diagrams in the accompanying drawings of this application, the dashed arrows or boxes indicate optional steps or optional modules.

[0322] 9. Unless otherwise stated, " / " indicates that the objects before and after are in an "or" relationship. For example, A / B can mean A or B. In this application, "and / or" is merely a description of the relationship between the related objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist simultaneously, and B exists alone. A and B can be singular or plural.

Claims

1. A vehicle control method, characterized in that, Applied to vehicles, the method includes: A prompt message presents the first configuration information, which includes the execution conditions of the first vehicle control operation and the operation content of the first vehicle control operation. The execution conditions of the first vehicle control operation include detecting a target user, and the operation content of the first vehicle control operation is used to indicate the target control object and the target state of the target control object. Obtain the vehicle's cabin information, which includes perception information about the target user located inside the vehicle's cabin; Based on the first configuration information and the cockpit information, a first vehicle control operation is performed to adjust the target control object to the target state.

2. The method according to claim 1, characterized in that, The execution conditions for the first vehicle control operation also include first environmental conditions, and the cockpit information also includes environmental information, which is used to indicate the environmental status related to the vehicle.

3. The method according to claim 1 or 2, characterized in that, The first vehicle control operation based on the first configuration information and the cockpit information includes: Based on the first configuration information and the cockpit information, determine whether the execution conditions of the first vehicle control operation are met; If the execution conditions of the first vehicle control operation are met, the first vehicle control operation is executed.

4. The method according to claim 1 or 2, characterized in that, The first vehicle control operation based on the first configuration information and the cockpit information includes: Based on the vehicle's cabin information, the target user and the target user's position within the cabin are detected; Based on the first configuration information and the cockpit information, determine whether the execution conditions of the first vehicle control operation are met; When the execution conditions of the first vehicle control operation are met, based on the first configuration information and the position of the target user in the cabin, the first control object and the target state of the first control object are determined. The first control object belongs to the target control object, and the first control object includes control objects associated with the position of the target user in the cabin. The first vehicle control operation is executed to adjust the first controlled object to the target state of the first controlled object.

5. The method according to any one of claims 1-4, characterized in that, The first configuration information corresponds to a configuration name, and the first configuration information also includes the configuration name of the first configuration information.

6. The method according to any one of claims 1-5, characterized in that, The first configuration information is associated with the target user, and the first vehicle control operation is used to provide services to the target user, which includes one or more users.

7. The method according to any one of claims 1-6, characterized in that, The execution conditions for the first vehicle control operation also include detecting the first group of users traveling together, the first group of users traveling together includes N users, where N is an integer and N≥0; In cases where the first user group includes at least one user, the users in the first peer user group are different from the target user; The cockpit information also includes the perception information of users in the first group of users traveling together.

8. The method according to claim 7, characterized in that, The first configuration information includes the execution conditions of the second vehicle control operation and the operation content of the second vehicle control operation. The execution conditions of the second vehicle control operation include detecting the target user and the second group of users traveling together. The second peer user group consists of N users, where N is an integer and N≥0. The first peer user group is different from the first peer user group, and the operation content of the first vehicle control operation is different from the operation content of the first vehicle control operation.

9. The method according to any one of claims 1-8, characterized in that, Before performing the first vehicle control operation based on the first configuration information and the cockpit information, the method further includes: The system receives an enable command for the first configuration information input by the user. The enable command is used to instruct the execution of the first vehicle control operation when the execution conditions of the first vehicle control operation are met.

10. The method according to claim 9, characterized in that, The execution conditions for the first vehicle control operation also include receiving an enable command for the first configuration information.

11. The method according to any one of claims 1-10, characterized in that, The first configuration information also includes first indication information, which is used to indicate that the first vehicle control operation is automatically triggered, or the first indication information is used to indicate that the first vehicle control operation is automatically triggered after a first time period following the fulfillment of the execution conditions of the first vehicle control operation.

12. The method according to any one of claims 1-11, characterized in that, Before performing the first vehicle control operation, the method further includes: The execution prompt for the first vehicle control operation is displayed; Receive confirmation from the user regarding the execution of the first vehicle control operation, or determine that no denial from the user regarding the execution of the first vehicle control operation has been received within a second time period.

13. The method according to any one of claims 1-12, characterized in that, The method further includes: Receive the initial definition information input; Based on the first definition information, the first configuration information is generated. The first definition information is used to describe the execution conditions of the first vehicle control operation and the operation content of the first vehicle control operation. The first definition information includes the instruction information of the target user.

14. The method according to claim 13, characterized in that, The indication information for the target user includes the target user's user identifier, which is associated with the target user's biometric characteristics. Alternatively, the indication information of the target user may include the target user's personal characteristics, which may include one or more of the following: gender, age group, clothing, mood, and activity status.

15. The method according to claim 13 or 14, characterized in that, The method further includes: The first interface is presented, which includes an arrangement window, condition elements and action elements. The condition elements are used to describe the execution conditions of the vehicle control operation, the action elements are used to describe the operation content of the vehicle control operation, and the arrangement window is used to arrange the condition elements and action elements. The step of generating the first configuration information based on the input first definition information includes: The first configuration information is generated based on the instructions from the target user and the elements arranged in the arrangement window.

16. The method according to claim 14 or 15, characterized in that, The method further includes: The first interface is presented, which includes an arrangement window, condition elements, and action elements. The condition elements are used to describe the execution conditions of the vehicle control operation, and the action elements are used to describe the operation content of the vehicle control operation. The condition elements include user feature elements, which are used to describe the user's personality characteristics. The arrangement window is used to arrange the condition elements, user feature elements, and action elements. The step of generating the first configuration information based on the input first definition information includes: Based on the elements arranged in the orchestration window, the first configuration information is generated. The elements arranged in the orchestration window include at least one user feature element and at least one action element. The at least one user feature element is used to indicate the target user.

17. The method according to any one of claims 1-12, characterized in that, The method further includes: Based on the target user's vehicle usage scenario information, the first configuration information is generated. The target user's vehicle usage scenario information includes the target user's instruction information, the target user's vehicle usage environment information, and the vehicle's on-board component operating information.

18. The method according to claim 17, characterized in that, The method further includes: A second interface is displayed, which is used to show the recommended activation of the first configuration information; The first configuration information is activated upon receiving an input activation instruction for the first configuration information or upon not receiving an input denial activation instruction within a third time period.

19. The method according to any one of claim 17 or 18, characterized in that, The method further includes: Receive input of a tag indication for at least one user, the tag indication being used to indicate permission to collect vehicle usage data from the at least one user. Scene information, wherein the at least one user includes the target user, or the at least one includes a user located in a target location area, the target location area being located inside the vehicle's cabin.

20. The method according to any one of claims 17-19, characterized in that, After performing the first vehicle control operation, the method further includes: When the system detects that a third vehicle control operation has been performed under the conditions that satisfy the first vehicle control operation, or that the number of times the third vehicle control operation has been performed exceeds M, the first configuration information is updated. The execution content corresponding to the first vehicle control operation in the updated first configuration information includes the execution of the second vehicle control operation. Wherein, the first vehicle control operation before the update does not include the third vehicle control operation, or the first vehicle control operation before the update conflicts with the third vehicle control operation.

21. The method according to any one of claims 17-19, characterized in that, After performing the first vehicle control operation, the method further includes: When it is detected that a third vehicle control operation has been executed under the triggering condition of the first vehicle control operation or the number of times the third vehicle control operation has been executed exceeds M, the second configuration information is determined. The second configuration information includes the triggering condition of the third vehicle control operation and the execution content of the third operation. The triggering condition of the third vehicle control operation includes the triggering condition of the first vehicle control operation. The first vehicle control operation does not include the third vehicle control operation, or the first vehicle control operation conflicts with the third vehicle control operation.

22. The method according to claim 21, characterized in that, The method further includes: A third interface is presented, which is used to display the recommended activation of the second configuration information; The second configuration information is activated upon receiving an input activation instruction for the second configuration information or upon not receiving an input denial activation instruction within a fourth time period.

23. The method according to any one of claims 1-22, characterized in that, The method further includes; Based on the input update instruction for the first configuration information, the first configuration information is updated. The update instruction is used to indicate the update of at least one of the following: the user associated with the first configuration information, the triggering condition of the first vehicle control operation, and the execution content of the first vehicle control operation.

24. A vehicle control method, characterized in that, Applied to vehicles, the method includes: Obtain input information; First configuration information is generated based on input information. The first configuration information includes the execution conditions of the first vehicle control operation and the operation content of the first vehicle control operation. The execution conditions of the first vehicle control operation include detecting a target user. The operation content of the first vehicle control operation is used to indicate the target control object and the target state of the target control object. The first configuration information is used to execute the first vehicle control operation when the execution conditions of the first vehicle control operation are met. A prompt message is displayed showing the first configuration information.

25. The method according to claim 24, characterized in that, The input information includes first definition information, which describes the execution conditions and operation content of the first vehicle control operation. The first definition information also includes the instruction information of the target user.

26. The method according to claim 25, characterized in that, The indication information for the target user includes the target user's user identifier, which is associated with the target user's biometric characteristics. Alternatively, the indication information of the target user may include the target user's personal characteristics, which may include one or more of the following: gender, age group, clothing, mood, and activity status.

27. The method according to claim 25 or 26, characterized in that, The method further includes: The first interface is presented, which includes an arrangement window, condition elements and action elements. The condition elements are used to describe the execution conditions of the vehicle control operation, the action elements are used to describe the operation content of the vehicle control operation, and the arrangement window is used to arrange the condition elements and action elements. The step of generating the first configuration information based on the input first definition information includes: The first configuration information is generated based on the instructions from the target user and the elements arranged in the arrangement window.

28. The method according to claim 25 or 26, characterized in that, The method further includes: The first interface is presented, which includes an arrangement window, condition elements, and action elements. The condition elements are used to describe the execution conditions of the vehicle control operation, and the action elements are used to describe the operation content of the vehicle control operation. The condition elements include user feature elements, which are used to describe the user's personality characteristics. The arrangement window is used to arrange the condition elements, user feature elements, and action elements. The step of generating the first configuration information based on the input first definition information includes: Based on the elements arranged in the orchestration window, the first configuration information is generated. The elements arranged in the orchestration window include at least one user feature element and at least one action element. The at least one user feature element is used to indicate the target user.

29. The method according to claim 24, characterized in that, The input information includes the vehicle usage scenario information of the target user, which includes the target user's instruction information, the target user's vehicle environment information, and the working information of the vehicle's on-board components.

30. The method according to claim 29, characterized in that, The method further includes: A second interface is displayed, which is used to show the recommended activation of the first configuration information; If an activation instruction for the first configuration information is received, or if no denial activation instruction is received within a third time period, the first configuration information is activated.

31. The method according to claim 29 or 30, characterized in that, The method further includes: The system receives an input tagging indication for at least one user, the tagging indication indicating permission to collect vehicle usage scenario information of the at least one user, the at least one user including the target user, or the at least one including a user located in a target location area located within the vehicle's cabin.

32. The method according to any one of claims 29-31, characterized in that, The method further includes; Based on the input update instruction for the first configuration information, the first configuration information is updated. The update instruction is used to indicate the update of at least one of the following: the user associated with the first configuration information, the triggering condition of the first vehicle control operation, and the execution content of the first vehicle control operation.

33. The method according to claim 32, characterized in that, The first configuration information corresponds to a configuration name, and the first configuration information also includes the configuration name of the first configuration information.

34. The method according to any one of claims 24-33, characterized in that, The first configuration information is associated with the target user, and the first vehicle control operation is used to provide services to the target user, which includes one or more users.

35. The method according to any one of claims 24-34, characterized in that, The execution conditions for the first vehicle control operation also include detecting the first group of users traveling together, the first group of users traveling together includes N users, where N is an integer and N≥0; In cases where the first user group includes at least one user, the users in the first peer user group are different from the target user; The cockpit information also includes the perception information of users in the first group of users traveling together.

36. The method according to claim 35, characterized in that, The first configuration information also includes the execution conditions of the second vehicle control operation and the operation content of the second vehicle control operation. The execution conditions of the second vehicle control operation include detecting the target user and the second group of users traveling together. The second peer user group consists of N users, where N is an integer and N≥0. The first peer user group is different from the first peer user group, and the operation content of the first vehicle control operation is different from the operation content of the first vehicle control operation.

37. A vehicle control device, characterized in that, The vehicle control device includes an acquisition unit, a processing unit, and an output unit. The vehicle control device is used to implement the method according to any one of claims 1-36.

38. A chip, characterized in that, The chip includes a processor and a communication interface, the communication interface being used for inputting and outputting information, and the processor calling a computer program to execute the method described in any one of claims 1-36.

39. A computing device, characterized in that, The computing device includes a processor and a memory, the memory being used to store a computer program, and the processor calling the computer program to perform the method according to any one of claims 1-36.

40. A vehicle, characterized in that, The vehicle includes multiple on-board components, and the vehicle further includes the vehicle control device of claim 37, or the computing device of claim 38, or the computing device of claim 39.

41. A computer storage medium, characterized in that, The computer storage medium stores a computer program, which, when executed by a processor, implements the method described in any one of claims 1-36.

Images