Vehicle control method, server and computer readable storage medium

By obtaining external perception information of the vehicle and using the preset knowledge base to determine the target function points and operating instructions, the functional conflicts that are prone to occur in multi-function vehicle management by the vehicle voice assistant are solved, and the efficiency and safety of user experience and vehicle operation are improved.

CN119724183AActive Publication Date: 2025-03-28GUANGZHOU XIAOPENG MOTORS TECH CO LTD
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
CN202411931044.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-25
Publication Date
2025-03-28
Estimated Expiration
2044-12-25

AI Technical Summary

Technical Problem

When managing and controlling multiple vehicle functions, vehicle voice assistants are prone to functional conflicts and affecting the user experience.

Method used

By obtaining the vehicle's external perception information, determining user needs, determining target functional points based on the preset knowledge base, and determining target operation instructions based on the target functional points, and issuing them to the vehicle for execution.

Benefits of technology

Effectively manage and control vehicle functions, improve driving efficiency, safety and user experience, and reduce the occurrence of functional conflicts.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119724183A_ABST
    Figure CN119724183A_ABST
Patent Text Reader

Abstract

The invention discloses a vehicle control method, a server and a computer readable storage medium. The method comprises the following steps: acquiring current vehicle external sensing information, wherein the current vehicle external sensing information comprises user sensing information and environment sensing information; and determining a user demand according to the current external perception information of the vehicle. And based on a preset knowledge base, determining a target function point according to a user demand. And determining a target operation instruction according to the target function point. And issuing the target operation instruction to the vehicle to control the vehicle to execute the target operation instruction. Thus, based on the preset knowledge base, the user demand obtained according to the current external perception information of the vehicle is processed, and the target function point for completing the user demand and the corresponding target operation instruction are determined, so that the vehicle function can be effectively controlled, and the driving efficiency, safety and user experience are improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of vehicle control technology, and in particular to a vehicle control method, a server and a computer-readable storage medium. Background Art

[0002] In the related art, the in-vehicle voice assistant is used to interact with the user to facilitate the user's operation. However, due to the surge in the number of devices on the vehicle, the in-vehicle voice assistant needs to manage and control more functions. When the in-vehicle voice assistant is reasoning about the user's voice request, it is easy to use certain functions incorrectly, causing functional conflicts and affecting the user experience. Summary of the invention

[0003] The present application provides a vehicle control method, a server and a computer-readable storage medium.

[0004] The present application provides a vehicle control method, the method comprising:

[0005] Acquiring current vehicle external perception information, wherein the current vehicle external perception information includes user perception information and environment perception information;

[0006] Determining user needs according to the current vehicle external perception information;

[0007] Based on the preset knowledge base and according to the user needs, determine the target function points;

[0008] Determining target operation instructions according to the target function point;

[0009] The target operation instruction is sent to the vehicle to control the vehicle to execute the target operation instruction.

[0010] In this way, the server obtains the current external perception information of the vehicle, which includes user perception information and environmental perception information. Next, the server determines the user needs based on the current external perception information of the vehicle. Then, based on the preset knowledge base, the server determines the target function points according to the user needs. The server then determines the target operation instructions based on the target function points. Finally, the server sends the target operation instructions to the vehicle to control the vehicle to execute the target operation instructions. In this way, based on the preset knowledge base, the user needs obtained according to the current external perception information of the vehicle are processed, and the target function points and corresponding target operation instructions used to complete the user needs are determined, so that the vehicle functions can be effectively controlled and the driving efficiency, safety and user experience can be improved.

[0011] In some implementations, determining the target function point based on the preset knowledge base and according to the user needs includes:

[0012] Based on the pre-built vehicle function point list, determining candidate function points according to the user requirements;

[0013] Based on the preset knowledge base, according to the user requirements and the candidate function points, the target function point is determined.

[0014] In this way, based on the pre-built vehicle function point list, the server determines the candidate function points according to the user's needs. Then, based on the preset knowledge base, the server determines the target function points according to the user's needs and the candidate function points. In this way, through the pre-built vehicle function point list and the preset knowledge base, the server can accurately understand and match the diverse needs of users and determine the target function points for the user's needs.

[0015] In some implementations, determining the target function point based on the preset knowledge base, according to the user requirements and the candidate function points, includes:

[0016] According to the candidate function points, current state perception information of vehicle components corresponding to the candidate function points is obtained;

[0017] Based on the preset knowledge base and according to the candidate function points, obtaining candidate function description information corresponding to the candidate function points;

[0018] The target function point is determined according to the user demand, the candidate function points, the current state perception information and the candidate function description information.

[0019] In this way, the server obtains the current state perception information of the vehicle parts corresponding to the candidate function points based on the candidate function points. Then, based on the preset knowledge base, the server obtains the candidate function description information corresponding to the candidate function points based on the candidate function points. Finally, the server determines the target function point based on the user needs, the candidate function points, the current state perception information and the candidate function description information. In this way, by integrating the current state perception information of the vehicle parts corresponding to the candidate function points and the candidate function description information, the server can accurately match the user needs, select the appropriate target function point, and avoid inappropriate function operations.

[0020] In some implementations, determining the target function point according to the user demand, the candidate function point, the current state perception information, and the candidate function description information includes:

[0021] Based on a preset function point relationship, determining the target function point from the candidate function points according to the current state perception information and the candidate function description information, the preset function point relationship including a preset priority relationship and a preset conflict relationship between the function points in the vehicle function point list;

[0022] The step of determining a target operation instruction according to the target function point includes:

[0023] The target operation instruction is determined according to the user demand and the target function point.

[0024] In this way, based on the preset function point relationship, the server determines the target function point from the candidate function points according to the current state perception information and the candidate function description information. The preset function point relationship includes the preset priority relationship and the preset conflict relationship between the function points in the vehicle function point list. Then, the server determines the target operation instruction according to the user's needs and the target function point. In this way, by considering the priority and conflict relationship between the function points, the server can intelligently select the appropriate function point and improve the accuracy and efficiency of function matching.

[0025] In some implementations, determining the target operation instruction according to the user demand and the target function point includes:

[0026] Based on a preset large language model, the target operation instruction is determined according to the user demand, the target function point and the target function description information corresponding to the target function point.

[0027] In this way, based on the preset large language model, the server determines the target operation instruction according to the user's needs, the target function point and the target function description information corresponding to the target function point. In this way, by using the preset large language model and the target function description information, the server can accurately understand the user's needs, determine the target operation instruction, reduce misunderstandings and erroneous operations, and improve the user experience.

[0028] In some embodiments, the preset knowledge base is constructed by the following steps:

[0029] Classify and process the vehicle knowledge to obtain vehicle perception information and vehicle function information, wherein the vehicle perception information includes vehicle exterior perception information and vehicle component state perception information, the vehicle exterior perception information includes environment perception information and user perception information, the user perception information includes voice requests, action behaviors and / or user information, and the user information includes user gender, user age, quantity information and / or location information in the vehicle cabin;

[0030] Determine, according to the vehicle function information, a function point and function description information corresponding to the function point, wherein the function description information includes function definition information, application scenario information, and function mutual exclusion information between sub-function points included in the function point;

[0031] Determining a function point-vehicle component relationship based on the vehicle perception information and the function point;

[0032] Determining a preset function point relationship according to the preset vehicle function relationship and the function point;

[0033] The preset knowledge base is constructed according to the function point-vehicle component relationship and the function point relationship.

[0034] In this way, the preset knowledge base is constructed by the following steps: classifying and processing vehicle knowledge to obtain vehicle perception information and vehicle function information, wherein the vehicle perception information includes vehicle external perception information and vehicle component state perception information, the vehicle external perception information includes environment perception information and user perception information, the user perception information includes voice request, action behavior and / or user information, and the user information includes user gender, user age, quantity information and / or position information in the vehicle cabin. Then, according to the vehicle function information, the function point and the function description information corresponding to the function point are determined, and the function description information includes function definition information, application scenario information and function mutual exclusion information between sub-function points included in the function point. Then, according to the vehicle perception information and the function point, the function point-vehicle component relationship is determined. Subsequently, according to the preset vehicle function relationship and the function point, the preset function point relationship is determined. Finally, the preset knowledge base is constructed according to the function point-vehicle component relationship and the function point relationship. In this way, through the above steps, a preset knowledge base can be constructed, which includes the function point-vehicle component relationship and the preset function point relationship, which can help the server understand the user's needs and provide good target operation instructions, so as to send the target operation instructions to the vehicle to complete vehicle control and process user needs, thereby improving the user experience. In addition, by collecting user perception information, the server can provide more personalized services based on the user perception information.

[0035] In some embodiments, the vehicle function relationship includes a vehicle function priority relationship and a vehicle function conflict relationship, and determining the preset function point relationship according to the preset vehicle function relationship and the function point includes:

[0036] Determining a preset priority relationship in the preset function point relationship according to the vehicle function priority relationship and the function point;

[0037] According to the vehicle function conflict relationship and the function point, a preset conflict relationship in the preset function point relationship is determined.

[0038] In this way, according to the vehicle function priority relationship and the function point, the preset priority relationship in the preset function point relationship is determined. Then, according to the vehicle function conflict relationship and the function point, the preset conflict relationship in the preset function point relationship is determined. In this way, by clarifying the relationship between the function points, the system can efficiently manage the vehicle functions while ensuring driving safety.

[0039] In certain embodiments, the method further comprises:

[0040] The numerical information and / or gear information in the vehicle perception information is rewritten to generate perception information describing the numerical information and / or the gear information.

[0041] In this way, the numerical information and / or gear information in the vehicle perception information is rewritten to generate perception information describing the numerical information and / or gear information. In this way, by rewriting the numerical information and / or gear information in the vehicle perception information, it is helpful for the server to intuitively understand the user's needs, thereby improving the user experience.

[0042] In certain embodiments, the method further comprises:

[0043] The function points that are directed to the same vehicle component and mutually exclusive are merged.

[0044] In this way, the mutually exclusive functional points for the same vehicle component are merged, which can reduce the redundancy of the same knowledge in similar functions in the preset database and reduce the memory resources consumed by the preset database.

[0045] An embodiment of the present application provides a server, which includes a processor and a memory, wherein a computer program is stored in the memory, and when the computer program is executed by the processor, the above-mentioned vehicle control method is implemented.

[0046] An embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the vehicle control method described above are implemented.

[0047] Additional aspects and advantages of the embodiments of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the embodiments of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0049] Figure 1 It is one of the flowcharts of the vehicle control method of certain embodiments of the present application;

[0050] Figure 2 is a schematic diagram of a process flow of processing external perception information of a current vehicle in certain embodiments of the present application;

[0051] Figure 3 This is a second flow chart of a vehicle control method according to certain embodiments of the present application;

[0052] Figure 4 This is a third flow chart of a vehicle control method according to certain embodiments of the present application;

[0053] Figure 5 This is a fourth flow chart of a vehicle control method according to certain embodiments of the present application;

[0054] Figure 6 This is a fifth flow chart of a vehicle control method according to certain embodiments of the present application;

[0055] Figure 7 This is the sixth flow chart of the vehicle control method of certain embodiments of the present application;

[0056] Figure 8 This is the seventh flow chart of the vehicle control method of certain embodiments of the present application;

[0057] Fig. 9 This is a flowchart of a vehicle control method according to some embodiments of the present application;

[0058] Fig.10 This is the ninth flow chart of the vehicle control method of certain embodiments of the present application. DETAILED DESCRIPTION

[0059] The embodiments of the present application are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals represent the same or similar elements or elements having the same or similar functions from beginning to end. The embodiments described below with reference to the accompanying drawings are exemplary and are only used to explain the embodiments of the present application, and cannot be understood as limiting the embodiments of the present application.

[0060] In today's automotive field, in-vehicle voice assistants have become a common technology, which greatly improves the user's operating convenience and driving experience through human-computer interaction. With the development of vehicle technology, the number of devices in vehicles is increasing, including but not limited to navigation systems, entertainment systems, air conditioning control, seat adjustment, window control, etc.

[0061] The increase in the number of devices has led to more and more functions that the in-vehicle voice assistant needs to manage and control. In this way, the in-vehicle voice assistant must have a higher level of intelligence and stronger functional coordination capabilities. However, in actual applications, when the in-vehicle voice assistant is reasoning about the user's voice request, it is easy to use certain functions incorrectly, causing functional conflicts, thus affecting the user experience. For example, when the user requests to turn on the seat heating and ventilation at the same time, if the in-vehicle voice assistant cannot correctly understand the user's intention, it may activate these two functions at the same time, causing the seat heating and ventilation to interfere with each other, thus affecting the user's comfort.

[0062] Based on the above questions, please refer to Figure 1 , the embodiment of the present application provides a vehicle control method, the method comprising:

[0063] 011: Get the current vehicle external perception information;

[0064] 012: Determine user needs based on the current vehicle external perception information;

[0065] 013: Based on the preset knowledge base and user needs, determine the target function points;

[0066] 014: Determine the target operation instructions according to the target function points;

[0067] 015: Send the target operation instruction to the vehicle to control the vehicle to execute the target operation instruction.

[0068] The embodiment of the present application also provides a server, including a memory and a processor. The vehicle control method of the embodiment of the present application can be implemented by the server of the embodiment of the present application. Specifically, a computer program is stored in the memory, and the processor is used to obtain the current vehicle external perception information. And determine the user needs based on the current vehicle external perception information. The processor is also used to determine the target function point based on the preset knowledge base and the user needs. And determine the target operation instruction based on the target function point. And send the target operation instruction to the vehicle to control the vehicle to execute the target operation instruction.

[0069] The embodiment of the present application also provides a vehicle control device. The vehicle control method of the embodiment of the present application can be implemented by the vehicle control device of the embodiment of the present application. Specifically, the vehicle control device includes an acquisition module, a determination module and a sending module. The acquisition module is used to acquire the current external perception information of the vehicle. The determination module is used to determine the user's needs based on the current external perception information of the vehicle. The determination module is also used to determine the target function point based on the preset knowledge base and the user's needs. The determination module is also used to determine the target operation instruction based on the target function point. The sending module is used to send the target operation instruction to the vehicle to control the vehicle to execute the target operation instruction.

[0070] Specifically, the current vehicle external perception information refers to the data about the vehicle's external environment and user status collected by the vehicle through its sensors and systems, including user perception information and environmental perception information. User perception information refers to the data and information about vehicle users (such as drivers and passengers) collected by the vehicle through its sensors and systems. Environmental perception information refers to the data and information about the vehicle's surroundings collected by the vehicle through its sensors, cameras and other detection equipment, including external environmental information and internal environmental information. External environmental information involves weather, light, temperature and air quality, while internal environmental information involves temperature, air quality and humidity.

[0071] User demand refers to the expectations and instructions of vehicle users regarding vehicle functions, performance or services in specific situations obtained by the server.

[0072] The preset knowledge base refers to a database that includes a large amount of structured information, which can support the decision-making and operation of the system, that is, it provides the information basis required to process user needs and determine the target operation instructions. By analyzing user needs and the vehicle's current external perception information, the server can determine the most appropriate function point from the preset knowledge base and generate corresponding operation instructions.

[0073] The target function point refers to a specific function point selected from the preset knowledge base in the vehicle intelligent system according to user needs and environmental conditions. The target function point represents the service that the user needs to perform when getting off the vehicle. For example, if the user requests the vehicle to automatically adjust the temperature, the system will determine "air conditioning adjustment: heating" as the target function point from the preset knowledge base based on the current environmental perception information (such as the temperature difference between the inside and outside of the car, and the temperature inside the car is lower). It should be noted that there may be multiple target function points, which are not limited here.

[0074] Target operation instructions refer to specific instructions generated in the vehicle intelligent system based on user needs and the current state perception information of vehicle components, according to specific function points (i.e., target function points) selected in the preset knowledge base, which can guide the vehicle to perform specific operations or services to meet user needs. For example, the user demand is "request the vehicle to automatically adjust the temperature", the target function point is "air conditioning temperature: increase temperature", and it is obtained that the air conditioning gear is 20°C and the wind speed is "2". The target operation instruction may be "temperature rises to 26°C, wind speed adjusted to: 3". It should be noted that the target operation instruction may include multiple ones, which are not limited here.

[0075] See also Figure 2 , the server obtains the current vehicle external perception information, that is, the server collects the current vehicle external perception information through the vehicle's external perception system, and the current vehicle external perception information includes user perception information and environment perception information.

[0076] Next, the server analyzes the collected current vehicle external perception information to determine the user's needs. For example, when the vehicle's external perception system detects raindrops and the main driving window is not closed, and the user voice expresses "I feel cold", the server will analyze this information and identify that the user's need is to "increase the temperature inside the car."

[0077] Then, based on the preset knowledge base, the server determines the target function point according to the user's needs. Continuing with the above example, the server determines the target function point as "the main driving window [open, close]" according to the user's needs "increase the temperature inside the car".

[0078] The server then determines the target operation instruction according to the target function point. Continuing with the above example, according to the target function point "main driving window [open, close]", the generated target operation instruction is "close the main driving window".

[0079] Finally, the server sends the target operation instruction to the vehicle to control the vehicle to execute the target operation instruction.

[0080] In summary, in the vehicle control method and server provided in the implementation manner of the present application, the server obtains the current vehicle external perception information, and the current vehicle external perception information includes user perception information and environmental perception information. Next, the server determines the user needs based on the current vehicle external perception information. Then, based on the preset knowledge base, the server determines the target function point according to the user needs. The server then determines the target operation instruction based on the target function point. Finally, the server sends the target operation instruction to the vehicle to control the vehicle to execute the target operation instruction. In this way, based on the preset knowledge base, the user needs obtained according to the current vehicle external perception information are processed, and the target function point and the corresponding target operation instruction used to complete the user needs are determined, so that the vehicle functions can be effectively controlled and the driving efficiency, safety and user experience can be improved.

[0081] See also Figure 3 In some implementations, step 013 (determining target function points based on a preset knowledge base and user needs) includes:

[0082] 0131: Based on the pre-built vehicle function point list and user requirements, determine candidate function points;

[0083] 0132: Based on the preset knowledge base, determine the target function points according to user needs and candidate function points.

[0084] In some embodiments, the determination module is further used to determine candidate function points based on a pre-built vehicle function point list and user requirements, and to determine target function points based on a preset knowledge base and user requirements and candidate function points.

[0085] In some embodiments, the processor is further configured to determine candidate function points based on a pre-built vehicle function point list and user requirements, and to determine target function points based on a preset knowledge base and user requirements and candidate function points.

[0086] Specifically, the pre-built vehicle function point list refers to an exhaustive list of all possible functions of the vehicle, which is created during the design and development phase of the vehicle intelligent system and lists in detail all the functions that the vehicle can perform, including main function points and sub-function points. When the server receives a user's request, it identifies and selects possible candidate function points based on this list. Then, combined with the current state perception information of the vehicle components corresponding to the candidate function points and the specific needs of the user, the server determines the most appropriate target function point from the candidate function points. In addition, the vehicle function point list is the basis for building a preset knowledge base, which provides a reference framework for the system's functional range.

[0087] Please refer to Figure 2 ,The server selects possible candidate function points from the pre-built vehicle function point list according to the user's needs. Continuing with the above example, according to the user's need to "increase the temperature inside the car", the candidate function points are determined as "main driving window [open, close], air conditioning temperature [heat up, cool down] and air conditioning wind speed [accelerate, slow down]".

[0088] Next, based on the preset knowledge base, the server further analyzes the relationship between the user's needs and the candidate function points, and determines the target function point that best meets the user's needs. Continuing with the above example, based on the user's need to "increase the temperature inside the car" and the candidate function points being "main driving window [open, close], air conditioning temperature [heat up, cool down] and air conditioning wind speed [accelerate, slow down]", the target function point is determined to be "main driving window [open, close]".

[0089] In this way, through the pre-built vehicle function point list and preset knowledge base, the server can accurately understand and match the diverse needs of users and determine the target function points for user needs.

[0090] See also Figure 4 In some implementations, step 0132 (determining target function points based on a preset knowledge base, user requirements and candidate function points) includes:

[0091] 01321: According to the candidate function points, obtain the current state perception information of the vehicle parts corresponding to the candidate function points;

[0092] 01322: Based on a preset knowledge base and according to the candidate function points, obtain candidate function description information corresponding to the candidate function points;

[0093] 01323: Determine the target function points based on user needs, candidate function points, current state perception information and candidate function description information.

[0094] In some embodiments, the determination module is further used to obtain the current state perception information of the vehicle parts corresponding to the candidate function points according to the candidate function points. And based on the preset knowledge base, according to the candidate function points, obtain the candidate function description information corresponding to the candidate function points. And determine the target function point according to the user needs, the candidate function points, the current state perception information and the candidate function description information.

[0095] In some embodiments, the processor is further configured to obtain, based on the candidate function points, current state perception information of vehicle components corresponding to the candidate function points. Based on a preset knowledge base, based on the candidate function points, obtain candidate function description information corresponding to the candidate function points. And determine the target function point based on user requirements, the candidate function points, the current state perception information, and the candidate function description information.

[0096] Specifically, the current status perception information of vehicle components refers to the specific working status or performance data of each vehicle component or system at a certain moment collected by the vehicle's built-in sensors and monitoring systems, including tire status: such as tire pressure, temperature, degree of wear, etc.

[0097] The candidate function description information refers to the detailed explanation and description of each candidate function point in the vehicle intelligent system. For example, for the function point "open the window", its candidate function description information may include: Definition: Lower the window glass to achieve air circulation inside and outside the car or to facilitate viewing the situation outside the car. Applicable scenario 1: Ventilation and air permeability. Positive impact: Promote air circulation in the car and improve comfort. Negative impact: Noise and wind resistance may be generated when driving at high speed, affecting the driving experience. Applicable scenario 2: View outside the car. Positive impact: Convenient to observe the situation outside the car and improve safety. Negative impact: May reduce privacy in the car. Optional operation 1: Open all. Definition: Fully lower all window glasses. Optional operation 2: Partially open. Definition: Select one or more window glasses to partially lower. Optional operation 3: Open only on the driver's side. Definition: Only lower the window glass on the driver's side.

[0098] Please refer to Figure 2 ,The server obtains the current state perception information of the corresponding vehicle components according to the candidate function points. For example, if the candidate function points include "air conditioning temperature [heating up, cooling down]", the server will obtain the current state information of the air conditioning system.

[0099] Next, the server obtains corresponding functional description information for each candidate functional point based on the preset knowledge base. These description information helps the server better understand the role and applicability of each candidate functional point.

[0100] Finally, the server integrates user needs, candidate function points, current state perception information, and candidate function description information to determine the target function point that best meets user needs.

[0101] In this way, by integrating the current state perception information of the vehicle components corresponding to the candidate function points and the candidate function description information, the server can accurately match user needs, select appropriate target function points, and avoid inappropriate function operations.

[0102] See also Figure 5 In some implementations, step 01323 (determining a target function point according to user requirements, candidate function points, current state perception information, and candidate function description information) includes:

[0103] 013231: Based on the preset function point relationship, according to the current state perception information and the candidate function description information, determine the target function point from the candidate function points;

[0104] Step 014 (determining target operation instructions according to target function points) includes:

[0105] 0141: Determine target operation instructions based on user needs and target function points.

[0106] In some embodiments, the determination module is further used to determine the target function point from the candidate function points based on the preset function point relationship, according to the current state perception information and the candidate function description information, and determine the target operation instruction according to the user demand and the target function point.

[0107] In some embodiments, the processor is further configured to determine a target function point from candidate function points based on a preset function point relationship, according to current state perception information and candidate function description information, and determine a target operation instruction according to user requirements and the target function point.

[0108] Specifically, the preset function point relationship refers to the predefined relationship between function points in the vehicle intelligent system, including priority relationship and conflict relationship, which can be set according to the functional characteristics and operating logic of the vehicle. The purpose is to ensure that the system can make reasonable decisions when executing functions, avoid conflicts between functions, and optimize the operating process.

[0109] Please refer to Figure 2, the server analyzes the priority and conflict relationship between candidate function points based on the preset function point relationship. For example, when the user demand is "want to lower the temperature", the determined candidate function points are "seat ventilation [open, close], car window [open, close], air conditioning [open, close]". Since opening the car window when turning on the air conditioner may affect the efficiency of the air conditioner, it is considered that opening the car window and turning on the air conditioner have a conflict relationship, and under the user demand of cooling down, turning on the air conditioner has a higher priority. Therefore, when analyzing whether the candidate function points are available, the server first analyzes the "air conditioning [open, close] and seat ventilation [open, close]" function points.

[0110] Next, the server combines the current state perception information and the candidate function description information to determine the target function point from the candidate function points. This process takes into account the priority and conflict relationship between function points to ensure that the selected function point not only meets user needs but can also be effectively executed under the current state of the vehicle.

[0111] Finally, the server determines the target operation instructions based on user needs and target function points.

[0112] In this way, by considering the priorities and conflict relationships between function points, the server can intelligently select appropriate function points and improve the accuracy and efficiency of function matching.

[0113] See also Figure 6 In some implementations, step 0141 (determining target operation instructions according to user requirements and target function points) includes:

[0114] 01411: Based on the preset large language model, determine the target operation instruction according to user needs, target function points and target function description information corresponding to the target function points.

[0115] In some embodiments, the determination module is used to determine the target operation instruction based on a preset large language model, according to user needs, target function points and target function description information corresponding to the target function points.

[0116] In some embodiments, the processor is further configured to determine a target operation instruction based on a preset large language model, according to user requirements, target function points, and target function description information corresponding to the target function points.

[0117] For details, please refer to Figure 2, the server first analyzes the user's needs and selects candidate function points that match the user's needs from the preset function point list. Next, based on the preset knowledge base, the server further analyzes the relationship between the user's needs and the candidate function points, and determines the target function points that best meet the user's needs. Then, the server obtains the target function description information corresponding to the target function point, which helps the server understand and execute the target function point more accurately. Finally, based on the preset large language model, the server determines the target operation instruction according to the user's needs, the target function point, and the target function description information corresponding to the target function point. Continuing with the above example, the generated target operation instruction is "Close the main driving window."

[0118] In this way, by using the preset large language model and target function description information, the server can accurately understand user needs, determine target operation instructions, reduce misunderstandings and erroneous operations, and improve user experience.

[0119] See also Figure 7 In some implementations, the preset knowledge base is constructed by the following steps:

[0120] 021: Classify and process vehicle knowledge to obtain vehicle perception information and vehicle function information;

[0121] 022: Determine function points and function description information corresponding to the function points according to the vehicle function information;

[0122] 023: Determine the relationship between function points and vehicle components based on vehicle perception information and function points;

[0123] 024: Determine a preset function point relationship according to the preset vehicle function relationship and function points;

[0124] 025: Construct a preset knowledge base based on the function point-vehicle component relationship and the function point relationship.

[0125] In some embodiments, the vehicle control device further includes a database construction module, which is used to classify vehicle knowledge to obtain vehicle perception information and vehicle function information. And according to the vehicle function information, determine the function point and the function description information corresponding to the function point. And according to the vehicle perception information and the function point, determine the function point-vehicle component relationship. The database construction module is also used to determine the preset function point relationship according to the preset vehicle function relationship and function point. And build a preset knowledge base according to the function point-vehicle component relationship and the function point relationship.

[0126] In some embodiments, the processor is further used to classify the vehicle knowledge to obtain vehicle perception information and vehicle function information. And according to the vehicle function information, determine the function point and the function description information corresponding to the function point. And according to the vehicle perception information and the function point, determine the function point-vehicle component relationship. The processor is also used to determine the preset function point relationship according to the preset vehicle function relationship and function point. And build a preset knowledge base according to the function point-vehicle component relationship and the function point relationship.

[0127] Specifically, classification processing refers to the systematic organization and classification of vehicle knowledge in the process of building a preset knowledge base, including dividing vehicle-related knowledge into vehicle perception information and vehicle function information, so as to better manage and use this information. Vehicle perception information refers to the information collected by the vehicle through various sensors and monitoring systems, including vehicle external perception information and vehicle component status perception information. Vehicle component status perception information involves the working status of each component of the vehicle, such as engine temperature, tire pressure, etc. Vehicle function information refers to the various functions that the vehicle can perform, including function points and function description information corresponding to the function points. Function description information includes function definition information, application scenario information and function mutual exclusion information. Function definition information is used to explain the specific meaning of each function point. Application scenario information is used to describe the possible application scenarios of the function point, including the positive and negative effects of the function point in each scenario. Function mutual exclusion information describes the function mutual exclusion relationship between the sub-function points included in the function point.

[0128] The location information in the vehicle cabin refers to whether there are passengers using a certain position, that is, whether there are passengers sitting in that position. The system collects the user's voice request, action behavior and user information such as gender, age, number and location through in-vehicle sensors, cameras and other devices. Subsequently, the server integrates and analyzes the collected user perception information, and based on the integrated and analyzed information, the server identifies the user's specific needs, such as adjusting the air conditioning temperature, playing specific music, etc. In this way, by collecting user perception information, the server can provide more personalized services based on the user perception information.

[0129] Function point-vehicle component relationship refers to the association between each function point and specific vehicle components in the vehicle intelligent system. For example, function point: automatic air conditioning adjustment. Related components: air conditioning system (including compressor, evaporator, temperature sensor, etc.), vehicle temperature sensor, ambient temperature sensor. Relationship description: The automatic air conditioning adjustment function requires the air conditioning system to work, and also requires temperature sensors inside and outside the vehicle to provide data to determine the temperature and wind speed of the air conditioning.

[0130] Preset function point relationships refer to the predefined relationships between different function points in the vehicle intelligent system, including the priority relationship and conflict relationship between function points, to ensure that the system can make reasonable decisions when executing functions, avoid conflicts between functions, and optimize the operation process. For example, function point relationship: automatic air conditioning adjustment and window opening. Relationship type: conflict relationship. Relationship description: When the automatic air conditioning adjustment function is running, opening the window may interfere with the effect of the air conditioning, because the open window will cause the temperature in the car to be unstable. Therefore, the system needs to make a choice between these two functions to avoid energy waste and function conflicts.

[0131] The preset knowledge base is constructed by the following steps: classifying and processing vehicle knowledge to obtain vehicle perception information and vehicle function information, wherein the vehicle perception information includes vehicle external perception information and vehicle component state perception information, the vehicle external perception information includes environment perception information and user perception information, the user perception information includes voice request, action behavior and / or user information, and the user information includes user gender, user age, quantity information and / or position information in the vehicle cabin. Then, according to the vehicle function information, the function point and the function description information corresponding to the function point are determined, and the function description information includes function definition information, application scenario information and function mutual exclusion information between sub-function points included in the function point. Then, according to the vehicle perception information and the function point, the function point-vehicle component relationship is determined. Subsequently, according to the preset vehicle function relationship and the function point, the preset function point relationship is determined. Finally, the preset knowledge base is constructed according to the function point-vehicle component relationship and the function point relationship.

[0132] In this way, through the above steps, a preset knowledge base can be constructed, which includes function point-vehicle component relationships and preset function point relationships, which can help the server understand user needs and provide good target operation instructions, so as to send the target operation instructions to the vehicle to complete vehicle control and process user needs, thereby improving user experience.

[0133] See also Figure 8 In some embodiments, the vehicle function relationship includes a vehicle function priority relationship and a vehicle function conflict relationship. Step 024 (determining a preset function point relationship according to the preset vehicle function relationship and function point) includes:

[0134] 0241: Determine a preset priority relationship in a preset function point relationship according to the vehicle function priority relationship and the function point;

[0135] 0242: Determine the preset conflict relationship in the preset function point relationship based on the vehicle function conflict relationship and function points.

[0136] In some embodiments, the database construction module is used to determine the preset priority relationship in the preset function point relationship according to the vehicle function priority relationship and the function point, and to determine the preset conflict relationship in the preset function point relationship according to the vehicle function conflict relationship and the function point.

[0137] In some embodiments, the processor is further configured to determine a preset priority relationship in a preset function point relationship according to the vehicle function priority relationship and the function point, and to determine a preset conflict relationship in a preset function point relationship according to the vehicle function conflict relationship and the function point.

[0138] Specifically, the vehicle function priority relationship refers to the predefined priority order between different functions in the vehicle intelligent system, ensuring that when multiple functions are activated at the same time or there are potential conflicts, the system can automatically decide which functions should be executed first based on the preset priorities.

[0139] Vehicle function conflict refers to the possible mutual interference or contradiction between different functions in the vehicle intelligent system. When these functions are activated at the same time, it may lead to system performance degradation, resource competition or safety risks.

[0140] First, based on the vehicle function priority relationship and function points, the importance and safety of different functions are evaluated to determine which functions should have a higher execution priority when multiple functions are activated at the same time. For example, safety functions (such as automatic emergency braking) are usually given a higher priority. After determining the priority of the function, these priority relationships need to be applied to specific function points.

[0141] Next, based on the vehicle function conflict relationships and function points, identify which functions may interfere with each other or have adverse effects when executed simultaneously. After identifying potential conflicts, these conflict relationships need to be specific to each function point.

[0142] Through these two steps, a clear function point relationship framework can be established for the vehicle intelligent system. The framework includes the priority order between function points and the potential conflicts between them, which helps the system make reasonable decisions at runtime and ensures that the operation of the vehicle meets the needs of the user while taking into account the coordination and compatibility between functions, thereby improving the accuracy and safety of the operation.

[0143] In this way, by clarifying the relationship between functional points, the system can efficiently manage vehicle functions while ensuring driving safety.

[0144] See also Fig. 9 In some embodiments, the method further comprises:

[0145] 026: Rewrite the numerical information and / or gear information in the vehicle perception information to generate perception information describing the numerical information and / or gear information.

[0146] In certain embodiments, the database construction module is used to rewrite the numerical information and / or gear information in the vehicle perception information to generate perception information describing the numerical information and / or gear information.

[0147] In some embodiments, the processor is further used to rewrite the numerical information and / or gear information in the vehicle perception information to generate perception information describing the numerical information and / or gear information.

[0148] Specifically, first, the server identifies the numerical information and gear information in the vehicle perception information, including numerical data such as vehicle speed, engine speed, fuel level, temperature, etc.

[0149] Next, the server rewrites these numerical information and gear information into more intuitive and easy-to-understand language descriptions. For example, a vehicle speed of 120 km / h is converted into "high-speed driving" and a vehicle speed of 10 km / h is converted into "slow moving" and other sensory information; an in-car temperature of 30 degrees Celsius is converted into "very hot" and an outside temperature of 38 degrees Celsius is converted into "very hot". Through the rewriting process, the server generates sensory information that describes the numerical information and gear information.

[0150] In this way, by rewriting the numerical information and / or gear information in the vehicle perception information, it helps the server to intuitively understand the user's needs, thereby improving the user experience.

[0151] See also Fig.10 In some embodiments, the method further comprises:

[0152] 027: Merge mutually exclusive functional points for the same vehicle parts.

[0153] In certain implementations, the database construction module is used to merge mutually exclusive functional points for the same vehicle component.

[0154] In certain embodiments, the processor is further configured to merge mutually exclusive functional points for the same vehicle component.

[0155] Specifically, first, the server identifies multiple function points for the same vehicle component and determines whether there is a mutually exclusive relationship between them. A mutually exclusive relationship means that these function points cannot be activated or executed at the same time. For example, for a vehicle seat, the heating and ventilation functions may be mutually exclusive in operation because it may not be appropriate or necessary to activate these two functions at the same time.

[0156] Next, the server merges the identified mutually exclusive function points. The purpose of the merger is to integrate these function points into a higher-level function point for easy management and execution. The merged function points will be able to intelligently select appropriate sub-function points to execute according to the vehicle status and user needs. For example, the main driver's window opening and main driver's window closing are merged into the main driver's window [open, close]; the passenger window opening and passenger window closing are merged into the passenger window [open, close]; the ambient light opening and ambient light closing are merged into the ambient light [open, close].

[0157] Finally, the merged function point information needs to be updated to the preset knowledge base to ensure that the system can correctly reference these merged function points in subsequent operations and decisions.

[0158] In this way, the redundancy of the same knowledge in similar functions in the preset database can be reduced, and the memory resources consumed by the preset database can be reduced.

[0159] The present application also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the vehicle control method described above are implemented.

[0160] It is understood that a computer program includes computer program code. The computer program code may be in source code form, object code form, executable file or some intermediate form. Computer readable storage media may include: any entity or device capable of carrying computer program code, recording medium, USB flash drive, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM), random access memory (RAM), and software distribution medium.

[0161] In the description of this specification, the descriptions with reference to the terms "specifically", "further", "particularly", "understandably", etc. are intended to mean that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms are not intended to refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are contradictory.

[0162] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, fragment or portion of code that includes one or more executable requests for implementing specific logical functions or steps of a process, and the scope of the preferred embodiments of the present application includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present application belong.

[0163] Although the embodiments of the present application have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations on the present application. Ordinary technicians in this field can change, modify, replace and modify the above embodiments within the scope of the present application.

Claims

1. A vehicle control method, characterized in that: The method comprises: Obtain the current vehicle external perception information; Determining user needs according to the current vehicle external perception information; Based on the preset knowledge base and according to the user needs, determine the target function points; Determining target operation instructions according to the target function point; The target operation instruction is sent to the vehicle to control the vehicle to execute the target operation instruction.

2. The vehicle control method according to claim 1, characterized in that: The step of determining the target function point based on the preset knowledge base and according to the user needs includes: Based on the pre-built vehicle function point list, determining candidate function points according to the user requirements; Based on the preset knowledge base, according to the user requirements and the candidate function points, the target function point is determined.

3. The vehicle control method according to claim 2, characterized in that: The determining the target function point based on the preset knowledge base, according to the user requirements and the candidate function points, includes: According to the candidate function points, current state perception information of vehicle components corresponding to the candidate function points is obtained; Based on the preset knowledge base and according to the candidate function points, obtaining candidate function description information corresponding to the candidate function points; The target function point is determined according to the user demand, the candidate function points, the current state perception information and the candidate function description information.

4. The vehicle control method according to claim 3, characterized in that: The determining the target function point according to the user demand, the candidate function point, the current state perception information and the candidate function description information includes: Based on a preset function point relationship, determining the target function point from the candidate function points according to the current state perception information and the candidate function description information, the preset function point relationship including a preset priority relationship and a preset conflict relationship between the function points in the vehicle function point list; The step of determining a target operation instruction according to the target function point includes: The target operation instruction is determined according to the user demand and the target function point.

5. The vehicle control method according to claim 4, characterized in that: The determining the target operation instruction according to the user demand and the target function point includes: Based on a preset large language model, the target operation instruction is determined according to the user demand, the target function point and the target function description information corresponding to the target function point.

6. The vehicle control method according to claim 1, characterized in that: The preset knowledge base is constructed by the following steps: Classify and process the vehicle knowledge to obtain vehicle perception information and vehicle function information, wherein the vehicle perception information includes vehicle exterior perception information and vehicle component state perception information, the vehicle exterior perception information includes environment perception information and user perception information, the user perception information includes voice requests, action behaviors and / or user information, and the user information includes user gender, user age, quantity information and / or location information in the vehicle cabin; Determine, according to the vehicle function information, a function point and function description information corresponding to the function point, wherein the function description information includes function definition information, application scenario information, and function mutual exclusion information between sub-function points included in the function point; Determining a function point-vehicle component relationship based on the vehicle perception information and the function point; Determining a preset function point relationship according to the preset vehicle function relationship and the function point; The preset knowledge base is constructed according to the function point-vehicle component relationship and the function point relationship.

7. The vehicle control method according to claim 6, characterized in that: The vehicle function relationship includes a vehicle function priority relationship and a vehicle function conflict relationship, and the determining of the preset function point relationship according to the preset vehicle function relationship and the function point includes: Determining a preset priority relationship in the preset function point relationship according to the vehicle function priority relationship and the function point; According to the vehicle function conflict relationship and the function point, a preset conflict relationship in the preset function point relationship is determined.

8. The vehicle control method according to claim 6, characterized in that: The method further comprises: The numerical information and / or gear information in the vehicle perception information is rewritten to generate perception information describing the numerical information and / or the gear information.

9. The vehicle control method according to claim 6, characterized in that: The method further comprises: The function points that are directed to the same vehicle component and mutually exclusive are merged.

10. A server, characterized in that: The server includes a processor and a memory, wherein a computer program is stored in the memory. When the computer program is executed by the processor, the vehicle control method according to any one of claims 1 to 9 is implemented.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the method according to any one of claims 1 to 9 are implemented.

Citation Information

Patent Citations

  • Method and device for controlling equipment based on knowledge graph

    CN114500143A

  • Voice interaction home control method and robot

    CN115240668A

  • Voice interaction method, server and computer readable storage medium

    CN117373456A

  • Intelligent voice service method and device, terminal equipment and storage medium

    CN117424960A

  • Method and device for controlling vehicle, vehicle and storage medium

    CN118082851A