Automobile user operation guidance method based on retrieval enhancement generation, computer device and storage medium

Abstract

The invention discloses an automobile user operation guidance method and device based on retrieval enhancement generation and a storage medium, and the method achieves the quick searching of operation guidance information according to the operation action of a user, and improves the user experience. Therefore, the time and energy required by a user to look up an automobile specification are reduced; secondly, as the operation instruction information stored in the operation instruction database is real, credible and standard automobile function operation instructions, it can be guaranteed that the artificial intelligence model generates real and credible operation guidance information; and thirdly, the operation guidance information generated by the artificial intelligence model is superior to standard operation instruction information stored in an operation instruction database in the aspects of readability, information transmission efficiency and the like, so that the user can understand the operation guidance information more conveniently, the frequency of using automobile functions by the user is improved, and the user experience is improved. The method is widely applied to the technical field of automobiles.

Description

Technical Field

[0001] The present invention relates to the field of automobile technology, and in particular to an automobile user operation guidance method, a computer device and a storage medium based on retrieval enhancement generation. Background Art

[0002] There are numerous functional components on a car, each of which can operate independently to achieve its function, and multiple functional components can be combined to achieve functions, so that the car has a wealth of functions that can be manipulated and used. When using a car that you are not familiar with, users with driving experience can use basic and common functions such as the accelerator pedal, brake pedal, light control, window control and seat belts skillfully based on their driving experience. However, since different cars generally have differences in functional details, and different brands and models of cars generally have exclusive customized functions, users often need to read the car's manual to skillfully use the relevant functions or even know the existence of the relevant functions.

[0003] At present, the manuals provided with cars are usually paper or electronic materials, with low information transmission efficiency. In addition, in order to ensure the integrity of the information, the manuals usually record a lot of information such as the use of components such as the accelerator pedal and the brake pedal, while the information on the use of customized functions that users may want to know more about is scattered everywhere, further reducing the efficiency of information transmission. Car users usually need to spend a lot of time and energy to learn how to use a certain function of the car, and may even give up because it takes too long, resulting in a low utilization rate of this car function and a waste of car performance. Summary of the invention

[0004] In view of the technical problems that the current automobile manuals have low information transmission efficiency, resulting in waste of automobile performance, etc., the purpose of the present invention is to provide a method, device and storage medium for automobile user operation guidance based on retrieval enhancement generation.

[0005] In one aspect, an embodiment of the present invention includes a method for automobile user operation guidance based on retrieval enhancement generation, and the method for automobile user operation guidance based on retrieval enhancement generation includes the following steps:

[0006] Detecting operation action information of a user of the first automobile;

[0007] In response to the operation action information, performing retrieval enhancement generation to obtain operation guidance information;

[0008] According to the operation guidance information, operation guidance is performed.

[0009] Further, the performing retrieval enhancement generation in response to the operation action information to obtain the operation guide information includes:

[0010] Run a retrieval-augmented generation system; the retrieval-augmented generation system includes an operation instruction database and an artificial intelligence model; the operation instruction database includes operation instruction information for a first vehicle.

[0011] Query the operation instruction database according to the operation action information to obtain the operation instruction information.

[0012] Input the operation instruction information into the artificial intelligence model for processing to obtain the operation guidance information.

[0013] Further, the artificial intelligence model is a large language model; the step of inputting the operation instruction information into the artificial intelligence model for processing to obtain the operation guidance information includes:

[0014] Use the operation instruction information as a prompt and input it into the artificial intelligence model for text generation.

[0015] Obtain the generated text output by the artificial intelligence model as the operation guidance information.

[0016] Further, the step of running the retrieval-augmented generation system includes:

[0017] Deploy the artificial intelligence model locally on the first vehicle.

[0018] Deploy the operation instruction database locally on the first vehicle or on a server.

[0019] Update the data in the operation instruction database.

[0020] Further, the step of updating the data in the operation instruction database includes:

[0021] Obtain first operation instruction update data provided by an automobile manufacturer.

[0022] Update the operation instruction database with the first operation instruction update data.

[0023] Further, the step of updating the data in the operation instruction database includes:

[0024] Obtain first operation instruction update data provided by an automobile manufacturer.

[0025] Obtain second operation instruction update data provided by a second vehicle; the second vehicle is a vehicle within the same range as the first vehicle, and the second operation instruction update data corresponds to the same vehicle function as the first operation instruction update data.

[0026] Use the first operation instruction update data and the second operation instruction update data to perform a preliminary update on the operation instruction database;

[0027] Set that when the preliminarily updated operation instruction database is queried, it outputs the first operation instruction information corresponding to the first operation instruction update data, or the second operation instruction information corresponding to the second operation instruction update data;

[0028] Respectively obtain the first execution times of the operation guidance information corresponding to the first operation instruction information and the second execution times of the operation guidance information corresponding to the second operation instruction information;

[0029] When the first execution times are greater than the second execution times, perform a final update on the operation instruction database with the first operation instruction update data;

[0030] When the second execution times are greater than the first execution times, perform a final update on the operation instruction database with the second operation instruction update data.

[0031] Further, the performing operation guidance according to the operation guidance information includes:

[0032] Detect the completion degree of the operation action information;

[0033] When the completion degree is less than the threshold, output the operation guidance information;

[0034] When the completion degree is greater than or equal to the threshold, score the operation action information according to the operation guidance information.

[0035] Further, the detecting the completion degree of the operation action information includes:

[0036] When the operation action information does not trigger the operation of the corresponding first automotive functional component within the preset time, determine that the completion degree is less than the threshold;

[0037] When the operation action information triggers the operation of the corresponding first automotive functional component within the preset time, determine that the completion degree is greater than or equal to the threshold.

[0038] On the other hand, an embodiment of the present invention further includes a computer device, including a memory and a processor, the memory is used to store at least one program, and the processor is used to load at least one program to execute the method for generating automotive user operation guidance based on retrieval enhancement in the embodiment.

[0039] On the other hand, an embodiment of the present invention further includes a computer-readable storage medium storing a program executable by a processor, and the program executable by the processor is used to execute the method for guiding the operation of a vehicle user based on retrieval enhancement in the embodiment when executed by the processor.

[0040] The beneficial effects of the present invention are as follows: In the method for guiding the operation of a vehicle user based on retrieval enhancement in the embodiment, firstly, according to the operation actions of the user, the operation guidance information can be quickly found, thereby reducing the time and effort that the user needs to spend consulting the vehicle manual; secondly, since the operation description information stored in the operation description database is the real, credible and standardized operation description of the vehicle function, it can ensure that the artificial intelligence model generates real and credible operation guidance information; thirdly, the operation guidance information generated by the artificial intelligence model is often superior to the standardized operation description information stored in the operation description database in terms of readability and information transmission efficiency, etc., so it is more convenient for the user to understand, which is beneficial to increasing the frequency of the user using the vehicle function and reducing the idle and waste of the vehicle performance. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 is a schematic diagram of the principle of the method for guiding the operation of a vehicle user based on retrieval enhancement in the embodiment;

[0042] Figure 2 is a schematic diagram of the steps of the method for guiding the operation of a vehicle user based on retrieval enhancement in the embodiment. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0043] In this embodiment, the method for guiding the operation of a vehicle user based on retrieval enhancement can be applied to Figure 1 the vehicle system shown. Referring to Figure 1 , the vehicle system includes a local server, a Retrieval-augmented Generation (RAG) system, and a visual and voice interaction system. Among them, the retrieval enhancement generation system includes an operation description database and an artificial intelligence model.

[0044] In this embodiment, taking a specific vehicle (the first vehicle) equipped with Figure 1 the vehicle system shown as an example for description. The user of the first vehicle can specifically be the driver or passenger of the first vehicle.

[0045] In this embodiment, referring to Figure 2 , the method for guiding the operation of a vehicle user based on retrieval enhancement includes the following steps:

[0046] S1. Detect the operation action information of the user of the first vehicle;

[0047] S2. Perform retrieval enhancement generation in response to the operation action information to obtain operation guidance information;

[0048] S3. Provide operation guidance according to the operation guidance information.

[0049] Step S1 is executed by the visual and voice interaction system. The visual and voice interaction system can perform human-computer interaction through visual and voice means. For example, the visual and voice interaction system can take pictures of the user of the first vehicle to obtain videos or images of the user of the first vehicle, and perform action recognition on the videos or images to identify actions in the form of body movements, head movements, or facial expressions made by the user of the first vehicle; the visual and voice interaction system can record the speech of the user of the first vehicle to obtain the speaking voice of the user of the first vehicle, so as to identify actions in the form of speech spoken by the user of the first vehicle.

[0050] When the user of the first vehicle needs to use a certain function on the first vehicle, without having to query the instruction manual of the first vehicle in advance, the user can directly actually perform or attempt to perform an action to use this function, and this action is detected by the visual and voice interaction system to generate operation action information. The operation action information can specifically be a time series, representing information such as the action type and amplitude made by the user of the first vehicle at each moment.

[0051] For example, when the user of the first vehicle needs to use the music playback function of the first vehicle, the user of the first vehicle can actually click or attempt to click the music playback button set on the first vehicle, and the body movement made by the user of the first vehicle will be detected by the visual and voice interaction system, thereby generating operation action information describing the body movement (such as the positions of joints and other nodes at each moment).

[0052] In step S2, referring to Figure 1 , the visual and voice interaction system sends the operation action information to the local server, and the local server calls the retrieval enhancement generation system to perform retrieval enhancement generation according to the operation action information, thereby obtaining operation guidance information. Among them, the operation guidance information is the operation guidance for the user of the first vehicle to use the music playback function of the first vehicle.

[0053] In this embodiment, when performing step S2, that is, performing retrieval enhancement generation in response to the operation action information to obtain operation guidance information, the following steps can be specifically executed:

[0054] S201. Run the retrieval enhancement generation system;

[0055] S202. Query the operation instruction database according to the operation action information to obtain operation instruction information;

[0056] S203. Input the operation instruction information into the artificial intelligence model for processing to obtain operation guidance information.

[0057] The retrieval-augmented generation system running in step S201 includes Figure 1 the operation instruction database and the artificial intelligence model as shown. Among them, the operation instruction database includes the operation instruction information of the first vehicle. Among them, the operation instruction information specifically includes the function details of the first vehicle, and the operation actions that the user specifically needs to perform in order to use these function details, etc. For example, the format of the data stored in the operation instruction database is shown in Table 1.

[0058] Table 1

[0059] Functional details Actions to be performed Music playback Click the music play button / Make a right swipe gesture / Say the voice command "Play music" Increase the music playback volume Click the volume increase button / Make an upward swipe gesture / Say the voice command "Increase volume" …… ……

[0060] In step S202, according to the operation action information, it is possible to determine what operation actions the user of the first vehicle has performed, so as to query the corresponding operation actions and function details in the operation instruction database to form operation instruction information.

[0061] For example, if the user of the first vehicle makes the action of "clicking the music play button" (either try to click, for example, just put the finger on the music play button without actually clicking, or actually complete the click), then performing step S202 will be able to detect the action of "clicking the music play button" and the function detail of "music play", so as to form operation instruction information.

[0062] Specifically, referring to Figure 1 , the data queried from the operation instruction database is sent to the local server in the form of Chunk. After processing such as multi-way recall and re-ranking by the local server, operation instruction information is generated.

[0063] In step S203, referring to Figure 1 , the operation instruction database inputs the queried operation instruction information into the artificial intelligence model for processing to obtain operation guidance information.

[0064] In this embodiment, the artificial intelligence model in the retrieval-augmented generation system can be a trained large language model. The artificial intelligence model can generate information for guiding the user to perform corresponding or related function details based on the operation instruction information, that is, operation guidance information. Specifically, the operation instruction information queried from the operation instruction database can be used as a prompt word and input into the artificial intelligence model for text generation to obtain the generated text output by the artificial intelligence model as the operation guidance information.

[0065] For example, when the operation instruction information with the function item being "Music Playback" and the operation action to be performed being "Click the music play button" (attempt to click) is input into the artificial intelligence model, the artificial intelligence model can output operation guidance information with the content "Do you want to use the music playback function? You can directly click the music play button", so as to guide the user to use the corresponding function of "Music Playback"; the artificial intelligence model can also output operation guidance information with the content "You can also click the volume up button, or make a swiping-up gesture, or say the voice 'Increase volume', so as to increase the music playback volume".

[0066] In this embodiment, the artificial intelligence model in the retrieval augmented generation system can be locally deployed in the first vehicle, and the operation instruction database in the retrieval augmented generation system can also be deployed locally in the first vehicle. In this way, the operation action information, operation instruction information, etc. of the users of the first vehicle can all be processed locally in the first vehicle without uploading to external devices such as servers, thus effectively protecting privacy and security.

[0067] In this embodiment, the operation instruction database in the retrieval augmented generation system can also be deployed on the servers of automobile manufacturers (including automobile production manufacturers and after-sales service manufacturers, etc.), which is beneficial for automobile manufacturers to maintain the operation instruction information stored in the operation instruction database.

[0068] The working principle of the retrieval augmented generation executed in step S2 itself is to reduce the inaccurate or fictional content (commonly known as "hallucination") generated by the artificial intelligence model based on the error patterns in the training data by retrieving external knowledge bases or real-time data, so as to facilitate the generated content to be based on real and verifiable information. And by applying the retrieval augmented generation in step S2, the operation instruction database storing the operation instruction information is used as the external knowledge base of the artificial intelligence model, and the operation instruction database is used to reduce the "hallucination" of the artificial intelligence model, guiding the artificial intelligence model to generate operation guidance information related to the operation instruction information.

[0069] Therefore, in this embodiment, the operation instruction information of the content specifications compiled by the official or authoritative parties can be stored in the operation instruction database, which can realize the quick association and search of the operation instruction information, and use the performance of semantic text generation and conversion of the artificial intelligence model to convert the operation instruction information into easy-to-understand operation guidance information. On the one hand, it realizes the quick search for operation guidance information according to the user's operation actions, thus reducing the time and effort that the user needs to spend consulting the car instruction manual; on the other hand, since the operation instruction information stored in the operation instruction database is the real, credible and standardized operation instructions of the car functions, it can ensure that the artificial intelligence model generates real and credible operation guidance information; on the third hand, the operation guidance information generated by the artificial intelligence model is often superior to the standardized operation instruction information stored in the operation instruction database in terms of readability and information transmission efficiency, so it is more convenient for users to understand, which is conducive to increasing the frequency of users using car functions and reducing the idle and waste of car performance.

[0070] In this embodiment, when performing step S3, that is, the step of performing operation guidance according to the operation guidance information, the following steps can be specifically executed:

[0071] S301. Detect the completion degree of the operation action information;

[0072] S302. When the completion degree is less than the threshold, output the operation guidance information;

[0073] S303. When the completion degree is greater than or equal to the threshold, score the operation action information according to the operation guidance information.

[0074] In step S301, the completion degree of the operation action information can be judged by whether the operation action information actually triggers the operation of the car functional components.

[0075] For example, if the user of the first car makes the action of "clicking the music play button", a preset duration (such as 5s) can be set. If it is detected that within the preset duration, the action of "clicking the music play button" actually triggers the operation of the first car functional component (audio-visual entertainment system) to realize the music play function, then it is determined that the completion degree of the operation action information is greater than or equal to the threshold (completed); if it is detected that after the preset duration, the action of "clicking the music play button" does not trigger the operation of the first car functional component (audio-visual entertainment system) to realize the music play function, then it is determined that the completion degree of the operation action information is less than the threshold (not completed).

[0076] When the completion degree of the operation action information is less than the threshold value, for example, when the action of "clicking the music play button" made by the user of the first vehicle does not actually trigger the operation of the audio-visual entertainment system to play music, step S302 is selected for execution. In step S302, the local server can call the visual and voice interaction system to output operation guidance information in the form of vision (display) or voice (speaker), etc., so as to guide the user to perform a standardized operation action according to the operation guidance information, and thus use the music play function of the first vehicle.

[0077] When the completion degree of the operation action information is greater than or equal to the threshold value, for example, when the action of "clicking the music play button" made by the user of the first vehicle has actually triggered the operation of the audio-visual entertainment system to play music, step S303 is selected for execution. In step S303, since the user of the first vehicle has actually completed the trigger of music play, there is no need to output operation guidance information to guide the user to operate the music play. At this time, the operation guidance information is equivalent to the standardized operation of the music play function of the first vehicle, and the local server can score the operation action information according to the operation guidance information.

[0078] Specifically, the operation guidance information and the operation action information are in the form of time series respectively. Therefore, the local server can calculate the similarity between the two time series of the operation guidance information and the operation action information, and use the similarity as the score for the operation action information. When the score is lower than the score threshold, the local server can determine that the deviation between the operation action information actually made by the user and the standardized operation guidance information is too large, and thus determine that the user's operation action is incorrect. The local server can call the visual and voice interaction system to output an alarm to guide the user to perform a standardized operation.

[0079] In this embodiment, the operation instruction database in the retrieval enhanced generation system can also be updated with data. Specifically, the following steps can be executed:

[0080] S20101A. Obtain the first operation instruction update data provided by the vehicle manufacturer;

[0081] S20102A. Update the operation instruction database with the first operation instruction update data.

[0082] Steps S20101A - S20102A are the first execution method for updating the operation instruction database with data.

[0083] In step S20101A, the automobile manufacturer edits the first operation instruction update data. The first operation instruction update data can be an addition to, deletion of, or modification of the data stored in the operation instruction database. For example, specifically, the first operation instruction update data can be, based on the data shown in Table 1, adding operation instruction information with a function item of "switching songs". In step S20102A, an addition of operation instruction information is performed on the operation instruction database according to the first operation instruction update data, so as to update the operation instruction database. The operation instruction database updated by executing steps S20101A - S20102A is shown in Table 2.

[0084] Table 2

[0085]

[0086]

[0087] By executing steps S20101A - S20102A, dynamic update of the operation instruction database can be achieved.

[0088] In this embodiment, when updating the data in the operation instruction database in the retrieval enhancement generation system, the following steps can also be executed:

[0089] S20101B. Obtain the first operation instruction update data provided by the automobile manufacturer;

[0090] S20102B. Obtain the second operation instruction update data provided by the second automobile;

[0091] S20103B. Initially update the operation instruction database with the first operation instruction update data and the second operation instruction update data;

[0092] S20104B. Set that when the initially updated operation instruction database is queried, the first operation instruction information corresponding to the first operation instruction update data or the second operation instruction information corresponding to the second operation instruction update data is output;

[0093] S20105B. Respectively obtain the first execution times of the operation guide information corresponding to the first operation instruction information and the second execution times of the operation guide information corresponding to the second operation instruction information;

[0094] S20106B. When the first execution times are greater than the second execution times, finally update the operation instruction database with the first operation instruction update data;

[0095] S20107B. When the second execution times are greater than the first execution times, finally update the operation instruction database with the second operation instruction update data.

[0096] Steps S20101B - S20107B are the second execution method for data update of the operation instruction database.

[0097] Step S20101B is the same as S20101A.

[0098] In step S20102B, the local server of the first vehicle can call the communication module installed on the first vehicle to search for vehicles within the same range as the first vehicle, that is, the second vehicle.

[0099] Specifically, the second vehicle being within the same range as the first vehicle can refer to being within the same geographical area range (such as a certain city), the Internet area range connected by the communication module (such as a certain car enthusiasts' technical exchange group), the same time range (such as the production or sales time period of the vehicle), or a range divided by the vehicle manufacturer, etc. (such as production or sales batches, car clubs, etc.). There can be multiple second vehicles.

[0100] In step S20102B, each second vehicle can upload second operation instruction update data to the server. The second operation instruction update data, like the first operation instruction update data, can add, delete, or modify the data stored in the operation instruction database. The second operation instruction update data in this embodiment corresponds to the same vehicle functions as the first operation instruction update data. For example, if the first operation instruction update data obtained in step S20101B is, specifically, on the basis of the data shown in Table 1, adding an operation instruction information with a function sub - item of "switch songs", then each of the second operation instruction update data obtained in step S20102B also corresponds to the function sub - item of "switch songs", but the specific content of the "operation actions to be performed" is different from the first operation instruction update data.

[0101] In step S20103B, the first operation instruction update data obtained in step S20101B and the second operation instruction update data obtained in step S20102B are respectively used to perform a preliminary update on the operation instruction database. Preliminary update means a temporary and roll - backable update. For example, by executing step S20103B and using the first operation instruction update data obtained in step S20101B to perform a preliminary update on the operation instruction database, an updated operation instruction database as shown in Table 2 can also be obtained.

[0102] Based on the same principle, by executing step S20103B and using one of the second operation instruction update data obtained in step S20102B to perform a preliminary update on the operation instruction database, an updated operation instruction database as shown in Table 3 can be obtained.

[0103] Table 3

[0104] Functional details Actions to be performed Music playback Click the music play button / Make a right swipe gesture / Say the voice command "Play music" Increase the music playback volume Click the volume increase button / Make an upward swipe gesture / Say the voice command "Increase volume" Switch songs Click the switch button / Make a repeated gesture of releasing the thumb and index finger / Say the voice command "Play a different song" …… ……

[0105] In this embodiment, by performing steps S20101B - S20103B, it is possible to have at least two versions of the updated operation instruction database. One version is shown in Table 2 and the second version is shown in Table 3. The difference between Table 2 and Table 3 lies in the operation action information for the function sub - item "switch songs", and the corresponding operation actions to be performed are different.

[0106] In step S20104B, the preliminarily updated operation instruction database is set so that when step S202 is executed, if the operation action information corresponds to the function sub - item "switch songs", that is, there are multiple versions of the "operation actions to be performed", then the operation instruction database can randomly output the first operation instruction information corresponding to the first operation instruction update data, that is, output "click the switch button / make a downward - right swipe gesture / say the voice of'switch songs'" in the first version shown in Table 2, or output "click the switch button / make a gesture of repeatedly releasing the thumb and index finger / say the voice of 'change a song'" in the second version shown in Table 3.

[0107] By performing step S20104B, when step S203 is executed, the content of the operation guidance information output by the artificial intelligence model can randomly become "click the switch button / make a downward - right swipe gesture / say the voice of'switch songs'" or "click the switch button / make a gesture of repeatedly releasing the thumb and index finger / say the voice of 'change a song'". In the case of executing step S203 multiple times, both of the above - mentioned two contents of the operation guidance information output by the artificial intelligence model will appear multiple times respectively.

[0108] In this case, step S20105B is executed to obtain the first execution count of the operation guidance information corresponding to the first operation instruction information, that is, the number of times the user of the first vehicle actually makes the operation action of "click the switch button / make a downward - right swipe gesture / say the voice of'switch songs'", and the second execution count of the operation guidance information corresponding to the second operation instruction information, that is, the number of times the user of the first vehicle actually makes the operation action of "click the switch button / make a gesture of repeatedly releasing the thumb and index finger / say the voice of 'change a song'".

[0109] In steps S20106B - S20107B, compare the relative magnitudes of the first execution count and the second execution count. If the first execution count is greater than the second execution count, then execute step S20106B to perform a final update on the operation instruction database with the first operation instruction, for example, the operation instruction database of the first version shown in Table 2 can be retained, and the operation instruction database of the second version shown in Table 3 can be deleted; if the second execution count is greater than the first execution count, then execute step S20107B to perform a final update on the operation instruction database with the second operation instruction, for example, the operation instruction database of the second version shown in Table 3 can be retained, and the operation instruction database of the first version shown in Table 2 can be deleted; if the first execution count is equal to the second execution count, then the user of the first vehicle can set which version of the operation instruction database to retain and delete, or perform random retention and deletion.

[0110] In this embodiment, the principle of executing steps S20101B - S20107B is as follows: The first operation instruction update data obtained in step S20101B is an operation guide edited officially, while the second operation instruction update data obtained in step S20102B is an operation guide edited by the user of the second vehicle who is also a user. The first operation instruction update data is relatively more normative, while the second operation instruction update data is relatively more convenient and user - friendly; by executing steps S20103B - S20104B, multiple versions of the operation instruction database can be provided for the user of the first vehicle to try out. By executing steps S20105B - S20107B, the tendency of the user towards each version can be compared through the first execution count and the second execution count, so as to select the version preferred by the user of the first vehicle for final update. Therefore, by executing steps S20101B - S20107B, greater selectivity and usage flexibility can be provided for the user of the first vehicle, enhancing the usage experience.

[0111] A computer program for implementing the method for generating a vehicle user operation guide based on retrieval enhancement in this embodiment can be written. The computer program can be written into a computer device or a storage medium. When the computer program is read and run, the method for generating a vehicle user operation guide based on retrieval enhancement in this embodiment is executed, thereby achieving the same technical effects as the method for generating a vehicle user operation guide based on retrieval enhancement in the embodiment.

[0112] It should be noted that, unless otherwise specified, when a feature is referred to as "fixed" or "connected" to another feature, it can be directly fixed or connected to the other feature, or indirectly fixed or connected to the other feature. In addition, the descriptions such as upper, lower, left, and right used in this disclosure are only relative to the mutual positional relationship of the components of this disclosure in the drawings. The singular forms of "a", "an", and "the" used in this disclosure are also intended to include the plural forms, unless the context clearly indicates otherwise. In addition, unless otherwise defined, all technical and scientific terms used in this embodiment have the same meaning as commonly understood by those skilled in the art of this technology. The terms used in the specification of this embodiment are only for describing specific embodiments and are not intended to limit the present invention. The term "and / or" used in this embodiment includes any and all combinations of one or more of the related listed items.

[0113] It should be understood that although the terms first, second, third, etc. may be used in this disclosure to describe various elements, these elements should not be limited to these terms. These terms are only used to distinguish elements of the same type from each other. For example, without departing from the scope of this disclosure, the first element may also be referred to as the second element, and similarly, the second element may also be referred to as the first element. The use of any and all examples or exemplary language ("for example", "such as", etc.) provided in this embodiment is only intended to better illustrate the embodiments of the present invention and will not impose a limitation on the scope of the present invention unless otherwise required.

[0114] It should be recognized that the embodiments of the present invention can be implemented or carried out by computer hardware, a combination of hardware and software, or by computer instructions stored in a non-transitory computer-readable memory. The method can be implemented in a computer program using standard programming techniques - including a non-transitory computer-readable storage medium configured with the computer program, where the storage medium so configured causes the computer to operate in a specific and predefined manner - according to the methods and drawings described in the specific embodiments. Each program can be implemented in a high-level procedural or object-oriented programming language to communicate with the computer system. However, if desired, the program can be implemented in assembly or machine language. In any case, the language can be a compiled or interpreted language. In addition, for this purpose, the program can run on a dedicated integrated circuit programmed for this purpose.

[0115] In addition, the operations of the processes described in this embodiment may be performed in any suitable order, unless this embodiment otherwise indicates or is clearly inconsistent with the context in other detectable ways. The processes described in this embodiment (or variations and / or combinations thereof) may be executed under the control of one or more computer systems configured with executable instructions and may be implemented as code (e.g., executable instructions, one or more computer programs, or one or more applications) executed commonly on one or more processors, by hardware, or a combination thereof. A computer program includes a plurality of instructions executable by one or more processors.

[0116] Furthermore, the method may be implemented in any type of computing platform operably connected, including but not limited to personal computers, minicomputers, mainframes, workstations, network or distributed computing environments, separate or integrated computer platforms, or communicating with charged particle tools or other imaging devices, etc. Aspects of the present invention may be implemented in machine-readable code stored on a non-transitory storage medium or device, whether removable or integrated into the computing platform, such as a hard disk, optical read and / or write storage medium, RAM, ROM, etc., such that it is readable by a programmable computer and, when the storage medium or device is read by the computer, can be used to configure and operate the computer to execute the processes described herein. In addition, the machine-readable code, or portions thereof, may be transmitted via a wired or wireless network. When such media include instructions or programs that implement the above steps in combination with a microprocessor or other data processor, the invention of this embodiment includes these and other different types of non-transitory computer-readable storage media. When programmed according to the methods and techniques of the present invention, the present invention also includes the computer itself.

[0117] The computer program can be applied to the input data to perform the functions of this embodiment, thereby converting the input data to generate output data stored in non-volatile memory. The output information can also be applied to one or more output devices such as a display. In a preferred embodiment of the present invention, the converted data represents physical and tangible objects, including specific visual depictions of physical and tangible objects generated on the display.

[0118] The above are only the preferred embodiments of the present invention. The present invention is not limited to the above-described embodiments. As long as it achieves the technical effects of the present invention by the same means, any modifications, equivalent replacements, improvements, etc., made within the spirit and principles of the present invention shall be included within the scope of protection of the present invention. Within the scope of protection of the present invention, its technical solutions and / or implementation manners may have various different modifications and variations.

Claims

1. A method for automobile user operation guidance based on retrieval enhancement generation, characterized in that: The automobile user operation guidance method based on retrieval enhancement generation includes: Detecting operation action information of a user of the first automobile; In response to the operation action information, performing retrieval enhancement generation to obtain operation guidance information; According to the operation guidance information, operation guidance is performed.

2. The method for automobile user operation guidance based on retrieval enhancement generation according to claim 1 is characterized in that: The step of performing search enhancement generation in response to the operation action information to obtain operation guide information includes: Running a search enhancement generation system; the search enhancement generation system includes an operation instruction database and an artificial intelligence model; the operation instruction database includes operation instruction information for the first automobile; According to the operation action information, query the operation instruction database to obtain the operation instruction information; The operation instruction information is input into the artificial intelligence model for processing to obtain the operation guidance information.

3. The method for automobile user operation guidance based on retrieval enhancement generation according to claim 2 is characterized in that: The artificial intelligence model is a large language model; the step of inputting the operation instruction information into the artificial intelligence model for processing to obtain the operation guide information includes: Using the operation instruction information as a prompt word, inputting it into the artificial intelligence model to generate text; The generated text output by the artificial intelligence model is obtained as the operation guidance information.

4. The method for automobile user operation guidance based on retrieval enhancement generation according to claim 2 is characterized in that: The operation search enhancement generation system comprises: Deploy the artificial intelligence model locally in the first car; Deploy the operation instruction database locally in the first vehicle or on a server; The operation instruction database is updated.

5. The method for automobile user operation guidance based on retrieval enhancement generation according to claim 4 is characterized in that: The updating of data in the operation instruction database comprises: Obtain the first operating instructions update data provided by the automobile manufacturer; The operation instruction database is updated with the first operation instruction update data.

6. The method for automobile user operation guidance based on retrieval enhancement generation according to claim 4 is characterized in that: The updating of data in the operation instruction database comprises: Obtain the first operating instructions update data provided by the automobile manufacturer; Acquire second operation instruction update data provided by a second car; the second car is a car located in the same range as the first car, and the second operation instruction update data and the first operation instruction update data correspond to the same car function; Preliminarily updating the operation instruction database using the first operation instruction update data and the second operation instruction update data; Setting the initially updated operation instruction database to output first operation instruction information corresponding to the first operation instruction update data, or second operation instruction information corresponding to the second operation instruction update data, when being queried; Respectively obtaining a first execution count of the operation guidance information corresponding to the first operation description information and a second execution count of the operation guidance information corresponding to the second operation description information; When the first execution number is greater than the second execution number, the operation instruction database is finally updated with the first operation instruction update data; When the second execution number is greater than the first execution number, the operation instruction database is finally updated with the second operation instruction update data.

7. The method for automobile user operation guidance based on search enhancement generation according to any one of claims 1 to 6, characterized in that: The providing operation guidance according to the operation guidance information includes: Detecting the completion degree of the operation action information; When the degree of completion is less than a threshold, outputting the operation guidance information; When the degree of completion is greater than or equal to a threshold, the operation action information is scored according to the operation guidance information.

8. The method for automobile user operation guidance based on retrieval enhancement generation according to claim 7 is characterized in that: The detecting the completion degree of the operation action information includes: When the operation action information does not trigger the operation of the corresponding first automobile functional component within the preset time period, determining that the completion degree is less than a threshold; When the operation action information triggers the operation of the corresponding first automobile functional component within a preset time period, it is determined that the completion degree is greater than or equal to a threshold.

9. A computer device, characterized in that: It includes a memory and a processor, the memory is used to store at least one program, and the processor is used to load at least one program to execute the automobile user operation guidance method based on retrieval enhancement generation as described in any one of claims 1-8.

10. A computer-readable storage medium storing a program executable by a processor, characterized in that: The program executable by the processor is used to execute the automobile user operation guidance method based on retrieval enhancement generation as described in any one of claims 1-8 when executed by the processor.

Images