Operation guiding method for equipment operation and related product thereof

Abstract

The invention provides an operation guiding method for equipment operation and a related product thereof, and the method comprises the steps: responding to a function learning request of a target user for a target function of target equipment, and obtaining at least one operation step related to the target function; controlling the target equipment to execute first guide operation corresponding to each operation step so as to enable the target equipment to complete a target function; the first guiding operation comprises the steps of outputting first information used for prompting operation steps and prompting second information through an operation object associated with the operation steps in the target equipment, so that the target user operates the operation object under the guiding of the first information and the second information to complete the operation steps. By outputting the first information, the user can clearly complete the operation steps required to be executed by the target function, and by prompting the second information, the user can intuitively find the operation object required to be operated by executing the operation steps in the target equipment, so that the learning effect of the equipment function can be improved.

Description

Technical Field

[0001] This application relates to the field of equipment operation technology, specifically to an operation guidance method for equipment operation and related products. Background Technology

[0002] As vehicle functions continue to evolve, users' need to learn about these functions has increased significantly. Currently, although vehicle manufacturers provide vehicle owner manuals as a learning tool, these manuals are generally presented in the form of web pages, text, or long videos. When users learn a particular function, they need to read or watch the owner manual on their own. This lack of guidance leads to low learning efficiency and a high risk of misoperation, ultimately resulting in poor learning outcomes for vehicle functions. Summary of the Invention

[0003] The main objective of this application is to propose an operation guidance method for device operation and related products, aiming to improve the learning effect of device functions.

[0004] This application provides an operation guidance method for device operation, applied to a target device, comprising: responding to a function learning request from a target user for a target function of the target device, obtaining at least one operation step associated with the target function; controlling the target device to execute a first guidance operation corresponding to each of the operation steps, so that the target device completes the target function; the first guidance operation includes: outputting first information for prompting the operation steps, and prompting second information through an operation object associated with the operation steps in the target device, so that the target user operates the operation object under the guidance of the first information and the second information to complete the operation steps.

[0005] In one embodiment, the at least one operation step includes a first operation step and a second operation step, wherein the second operation step is the next operation step after the first operation step; controlling the target device to execute the first guidance operation corresponding to each of the operation steps includes: obtaining the operation result of the first operation step; in response to the operation result indicating that the operation object associated with the first operation step has been successfully operated, outputting first information for prompting the second operation step; and prompting the second information through the operation object associated with the second operation step in the target device.

[0006] In one embodiment, after obtaining the operation result of the first operation step, the method further includes: in response to the operation result indicating that the operation object associated with the first operation step failed to operate successfully, controlling the target device to execute a second guidance operation corresponding to the first operation step; the second guidance operation includes: outputting the reason why the first operation object failed to operate successfully; and / or re-outputting the first information for prompting the first operation step, and prompting the second information through the operation object associated with the first operation step in the target device; or, outputting the first information for prompting the third operation step, and prompting the second information through the operation object associated with the third operation step in the target device; the third operation step is an alternative operation step to the first operation step.

[0007] In one embodiment, the step of obtaining at least one operation step associated with the target function in response to a target user's function learning request for a target function of a target device includes: sending the function learning request to a server in response to the target user's function learning request for a target function of the target device; the function learning request instructing the server to determine at least one operation step associated with the target function based on a configured user manual; and receiving the at least one operation step sent by the server based on the function learning request.

[0008] In one embodiment, the at least one operation step includes a first operation step and a second operation step, wherein the second operation step is the next operation step after the first operation step; receiving the at least one operation step sent by the server based on the function learning request includes: after receiving the first operation step sent by the server, sending the operation result of the first operation step to the server; and receiving the second operation step sent by the server in response to the operation result indicating that the operation object associated with the first operation step has successfully operated.

[0009] In one embodiment, the step of obtaining at least one operation step associated with the target function in response to a target user's function learning request for a target function of a target device includes: in response to the function learning request, using a large speech model to identify the function learning intent corresponding to the function learning request; and determining at least one operation step associated with the target function based on the function learning intent and the device information of the target device.

[0010] In one embodiment, determining at least one operation step associated with the target function based on the function learning intention and the device information of the target device includes: inputting the function learning intention and the device information of the target device into a preset knowledge graph, and querying the preset knowledge graph to obtain the at least one operation step; and / or Before determining at least one operation step associated with the target function based on the function learning intention and the device information of the target device, the method further includes: obtaining the function learning preference information of the target user; determining at least one operation step associated with the target function based on the function learning intention and the device information of the target device includes: determining the at least one operation step based on the function learning intention, the device information of the target device, and the function learning preference information of the target user.

[0011] In one embodiment, before obtaining at least one operation step associated with the target function in response to a target user's function learning request for a target function of a target device, the method further includes: outputting recommended learning information for the target function based on a user profile corresponding to the target user; determining the target user's function learning request for the target function in response to a function learning input corresponding to the recommended learning information; and after controlling the target device to execute a first guiding operation corresponding to each of the operation steps to enable the target device to complete the target function, the method further includes: obtaining operation status data corresponding to the target function; the operation status data indicating whether the at least one operation step associated with the target function has been successfully completed; and updating the user profile corresponding to the target user based on the operation status data.

[0012] In one embodiment, the step of prompting the second information through an operation object associated with the operation step in the target device includes at least one of the following: when the operation object includes a physical control, adjusting the display parameters of the backlight of the physical control; when the operation object includes a target settings interface associated with the operation step, controlling the display screen of the target device to display the target settings interface; when the operation object includes a touch area in the display screen of the target device associated with the operation step, controlling the display parameters of the touch area to change.

[0013] This application also provides an electronic device, which includes a memory and a processor. The memory stores a computer program, and the processor executes the computer program to implement the above-described operation guidance method.

[0014] This application also provides a computer-readable storage medium storing a computer program that, when executed by a processor, implements the above-described operation guidance method.

[0015] This application provides an operation guidance method for device operation and related products. In response to a target user's request for function learning of a target device's target function, the method acquires at least one operation step associated with the target function; and controls the target device to execute a first guidance operation corresponding to each operation step, so that the target device completes the target function. The first guidance operation includes: outputting first information to prompt the operation steps, and prompting second information through an operation object associated with the operation steps in the target device. This allows the target user to operate the operation object under the guidance of the first and second information to complete the operation steps. Thus, a dual guidance system of operation steps and operation objects is formed on the user side, enabling the user to not only clearly understand the operation steps required to complete the target function, but also intuitively find the operation object required to perform the operation steps in the target device. This improves function learning efficiency and effectively avoids misoperation, thereby enhancing the learning effect of the device function. Attached Figure Description

[0016] Figure 1 This is a flowchart illustrating the operation guidance method for device operation provided in the embodiments of this application.

[0017] Figure 2 This is a schematic diagram illustrating the effect of the operation guide provided in the embodiments of this application.

[0018] Figure 3 This is a flowchart illustrating the process of determining the target operation path provided in an embodiment of this application.

[0019] Figure 4 This is a schematic diagram of the architecture of the operation guidance system for device operation provided in the embodiments of this application.

[0020] Figure 5 This is a schematic diagram illustrating the specific process of the operation guidance method for device operation provided in the embodiments of this application.

[0021] Figure 6 This is another specific flowchart illustrating the operation guidance method for device operation provided in the embodiments of this application.

[0022] Figure 7 This is a schematic diagram of the operation guidance device for device operation provided in the embodiments of this application.

[0023] Figure 8 This is a schematic diagram of the structure of the electronic device provided in the embodiments of this application. Detailed Implementation

[0024] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.

[0025] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such use of data can be interchanged where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the digit " / " generally indicates that the preceding and following objects are in an "or" relationship.

[0026] The operation guidance method for device operation provided in this application will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0027] Please see Figure 1 This application provides an operation guidance method for device operation, applied to a target device, comprising: Step S101: In response to the target user's function learning request for the target function of the target device, obtain at least one operation step associated with the target function; Optionally, the target device can be any vehicle, ship, or aircraft, or any mobile terminal device such as a mobile phone or tablet. Optionally, the target user can be any user who needs to learn the functions of the target device.

[0028] In practice, the above-mentioned function learning request can be determined by detecting the function learning input of the target user for the target function of the target device; optionally, the function learning input can be the operation of the user actively searching for the target function in the target device and triggering the learning entry of the function, or it can be the triggering operation performed by the user accepting the target function actively recommended for learning by the target device.

[0029] Next, in response to the above function learning request, at least one operation step associated with the target function can be determined using the configured user manual. For details, please refer to the relevant description below, which will not be described here. Alternatively, at least one operation step associated with the target function can be determined using a preset knowledge graph. For details, please refer to the relevant description below, which will not be described here.

[0030] Step S102: Control the target device to execute the first guidance operation corresponding to each operation step so that the target device can complete the target function; the first guidance operation includes: outputting first information to prompt the operation steps, and prompting second information through the operation object associated with the operation steps in the target device, so that the target user can operate the operation object under the guidance of the first information and the second information to complete the operation steps.

[0031] Optionally, the first information may include the specific operation content of the operation steps, such as the name, location, and operation method of the operation object associated with the operation steps. In actual implementation, the first information can be output in at least one form, such as text display or voice broadcast. The second information may be information generated by the operation object associated with the operation steps in the target device, used to physically display the location of the operation object in the target device. In actual implementation, the second information can be prompted according to the type of operation object. For specific implementation, please refer to the relevant description below, which will not be described here.

[0032] If there is only one operation step associated with the target function, the first guiding operation corresponding to that operation step can be output directly; if there are multiple operation steps associated with the target function, the first guiding operation corresponding to each operation step can be output sequentially according to the execution order of each operation step.

[0033] This application embodiment, in response to a target user's function learning request for a target function of a target device, obtains at least one operation step associated with the target function; and controls the target device to execute a first guidance operation corresponding to each operation step, so that the target device completes the target function; the first guidance operation includes: outputting first information to prompt the operation steps, and prompting second information through the operation object associated with the operation steps in the target device, so that the target user operates the operation object under the guidance of the first and second information to complete the operation steps. In this way, a dual guidance of operation steps and operation objects is formed on the user side, so that the user can not only clearly understand the operation steps required to complete the target function, but also intuitively find the operation object required to perform the operation steps in the target device, which can improve the function learning efficiency and effectively avoid misoperation, thereby improving the learning effect of device function.

[0034] In one embodiment, the output in step S102 above is used to prompt first information about the operation steps, including: Display the first information on the target device's screen, and / or read the first information aloud.

[0035] In practice, the first information can be displayed on the target device's screen in at least one of the following forms: image, text, or animation; alternatively, it can be read aloud in the form of voice. This allows the user to clearly understand the operational steps required to complete the target function, thereby improving the efficiency of function learning. Optionally, text-to-speech (TTS) technology can be used to convert pre-set text information used to prompt operational steps into voice information for playback, thus outputting the first information.

[0036] Taking the target function as vehicle seat height adjustment as an example, the first information used to prompt the operation steps associated with this function may include Figure 2 The text description shown reads "Press here to adjust seat height," and includes a dynamic arrow indicating the press location, as well as the "P" and circle markings indicating the press location.

[0037] In one embodiment, before prompting for the second information through the operation object associated with the operation step in the target device in step S102, the operation guidance method provided in this application embodiment further includes: The second piece of information is determined based on the type of the object being operated on.

[0038] Optionally, the type of the operation object may include at least one of the following: physical control class, settings interface class, and touch area class; in actual implementation, the second information can be obtained by querying the correspondence between the preset object type and the prompt information based on the type of the operation object.

[0039] Optionally, for physical control types, the second information corresponding to this type can be the differentiated display information of the physical control backlight; for settings interface types, the second information corresponding to this type can be the visual presentation information of the settings interface; for touch area types, the second information corresponding to this type can be the differentiated display information of the touch area.

[0040] This application embodiment determines the second information based on the type of the operation object, which can improve the adaptability of the second information to the operation object. Under the guidance of the second information, the user can intuitively find the operation object associated with the operation steps in the target device, which can improve the efficiency of function learning and effectively avoid misoperation, thereby improving the learning effect of device function.

[0041] In one embodiment, the prompting of the second information through the operation object associated with the operation step in step S102 above includes at least one of the following: When the operation object includes physical controls, adjust the display parameters of the backlight of the physical controls; When the object of operation includes a target setting interface associated with the operation steps, the target device's display screen is controlled to show the target setting interface. When the target object includes a touch area on the display screen of the target device that is associated with the operation steps, the display parameters of the touch area are controlled to change.

[0042] In practical implementation, when the object being manipulated includes a physical control, the display parameters of the physical control's backlight can be adjusted to produce at least one differentiated display effect, such as flashing, highlighting, or color changing. This allows for the display of secondary information about the physical control's location on the target device. Optionally, the physical control may include at least one of a physical button or a physical knob.

[0043] In practical implementation, when the object of operation includes a target setting interface associated with the operation steps, the target setting interface can be displayed on the target device's screen, allowing for automatic visual presentation of the target setting interface. This provides a second piece of information indicating the location of the target setting interface within the target device. Optionally, the target setting interface may include at least one of a parameter configuration interface and a mode selection interface.

[0044] In practical implementation, when the operation object includes a touch area on the display screen of the target device associated with the operation steps, the display parameters of the touch area can be controlled to produce at least one differentiated display effect, such as flashing, highlighting, or color changing. This allows for the display of a second piece of information—the location of the touch area on the target device—to be displayed. Optionally, the touch area may include at least one of the following: a virtual button area, a slider area, or a function icon area displayed on the screen.

[0045] This application embodiment, by adjusting the display parameters of the backlight of a physical control when the object of operation includes that physical control, can quickly highlight the physical location of the physical control to be operated, reducing the threshold for users to find and operate the physical control; by controlling the display screen of the target device to display the target setting interface when the object of operation includes that target setting interface associated with the operation steps, the automatic triggering display of the target setting interface can be realized, avoiding invalid interface jumps for users in multi-level menus; by controlling the display parameters of the touch area associated with the operation steps on the display screen of the target device when the object of operation includes that touch area, the spatial boundary of the touch area to be operated can be clearly defined, which can improve the operation efficiency of the touch area and reduce the probability of misoperation, thereby improving the device's function learning effect.

[0046] Optionally, the above-mentioned at least one operation step includes a first operation step and a second operation step, wherein the second operation step is the next operation step after the first operation step. In one embodiment, the control target device in step S102 performs a first guidance operation corresponding to each operation step, including: Obtain the result of the first operation step; In response to an operation result indicating that the operation object associated with the first operation step has been successfully operated, the system outputs first information to prompt the second operation step, and prompts the second information through the operation object associated with the second operation step in the target device.

[0047] In practice, the result of the first operation step can be determined based on the actual operation state of the operation object associated with the first operation step. If the actual operation state matches the target operation state, the result of the first operation step can be determined as a successful operation of the operation object associated with the first operation step. Conversely, if the actual operation state does not match the target operation state, the result of the first operation step can be determined as a failed operation of the operation object associated with the first operation step.

[0048] Optionally, the target operation state can be a pre-defined operation state that the operation object needs to meet if the operation object is successfully operated. For example, if the operation object is a physical button, its target operation state can be that the physical button is effectively pressed and the mechanical contact is activated; if the operation object is a slider touch area, its target operation state can be that the touch point completes a sliding action in a specified direction within the slider area, and the parameter value reaches a preset threshold after sliding; if the operation object is a target settings interface, its target operation state can be that a preset configuration action is completed, and the configuration parameters meet the configuration requirements.

[0049] Taking the vehicle seat height adjustment function as an example, the associated operation steps may include: Step 1, clicking the "My Vehicle" icon on the central control screen; Step 2, dragging the seat height adjustment button on the page displayed on the central control screen. If the "My Vehicle" icon associated with Step 1 is detected to have been effectively touched, it can be determined that the operation of the "My Vehicle" icon associated with Step 1 has been successful. The vehicle speaker can then play a voice prompt stating "drag the seat height adjustment button on the page displayed on the central control screen." Simultaneously, the central control screen can be controlled to display the seat height adjustment interface, and the touch area corresponding to the seat height adjustment button on that interface can be highlighted.

[0050] This application embodiment achieves progressive and precise guidance for multiple operation steps associated with a target function by obtaining the operation result of the first operation step, responding to the operation result indicating that the operation object associated with the first operation step has been successfully operated, outputting first information to prompt the second operation step, and prompting the second information through the operation object associated with the second operation step in the target device. This improves the effectiveness of guiding multiple operation steps associated with the target function and thus enhances the learning effect of the device function.

[0051] In one embodiment, after obtaining the operation result of the first operation step, the operation guidance method provided in this application further includes: In response to an operation result indicating that the operation object associated with the first operation step was not successfully operated, the target device is controlled to execute a second guiding operation corresponding to the first operation step. Optionally, the second guiding operation includes: Output the reason why the first operation failed; and / or The system re-outputs the first information used to prompt the first operation step, and prompts the second information through the operation object associated with the first operation step in the target device; or, it outputs the first information used to prompt the third operation step, and prompts the second information through the operation object associated with the third operation step in the target device; the third operation step is an alternative operation step to the first operation step.

[0052] In practice, when the operation result indicates that the operation object associated with the first operation step failed to operate successfully, the reason for the failure can be analyzed based on the actual operation status of the operation object associated with the first operation step and the actual execution status of the first guiding operation corresponding to the first operation step. Then, based on the analyzed reason, the target device can be controlled to execute the second guiding operation corresponding to the first operation step to explain to the user the reason for the failure of the operation object associated with the first operation step, and / or to guide the target user to repeat the operation of the operation object associated with the first operation step, or to guide the target user to operate the operation object associated with an alternative operation step to the first operation step.

[0053] In actual implementation, in response to a mismatch between the actual execution state and the target execution state, but a match between the actual operation state and the target operation state, the reason why the operation object associated with the first operation step failed to operate is determined to be that the target device failed to execute the first guiding operation corresponding to the first operation step. In this case, the target device can be controlled to output the reason why the first operation object failed to operate, and re-output the first information used to prompt the first operation step, and prompt the second information through the operation object associated with the first operation step in the target device.

[0054] In response to a mismatch between the actual execution state and the target execution state, but a mismatch between the actual operation state and the target operation state, the reason for the unsuccessful operation of the operation object associated with the first operation step is determined to be that the target user failed to operate the operation object associated with the first operation step under the guidance of the first and second information. In this case, the target device can be controlled to output the reason for the unsuccessful operation of the first operation object, and re-output the first information used to prompt the first operation step, as well as prompt the second information through the operation object associated with the first operation step in the target device. If the target user still fails to operate the operation object associated with the first operation step after re-outputting the first and second information, the target device can be controlled to output the first information used to prompt the alternative operation step (i.e., the third operation step) of the first operation step, and prompt the second information through the operation object associated with the third operation step in the target device.

[0055] Optionally, the aforementioned target execution state can be a pre-defined execution state that the target device needs to meet when it successfully executes the first guidance operation corresponding to the first operation step. For example, when the second information is highlighted in the touch area A of the target device's display screen, and the first information is output via voice broadcast controlled by the electronic control unit B in the target device, if the execution state of the electronic control unit B indicates that it has successfully controlled the speaker to play the first information, and the display state of the touch area A is highlighted, then it can be determined that the target device has successfully executed the first guidance operation corresponding to the first operation step; that is, the actual execution state of the first guidance operation corresponding to the first operation step matches the target execution state.

[0056] This application embodiment, in response to the unsuccessful operation of the operation object associated with the first operation step, controls the target device to execute a second guided operation corresponding to the first operation step. The second guided operation may include an explanation of the reason for the unsuccessful operation, re-guide the target user to execute the first operation step, or guide the target user to execute an alternative operation step of the first operation step, forming an active and multi-level error correction and guidance mechanism. This can significantly improve the effectiveness of guiding each operation step associated with the target function, thereby improving the learning effect of the device function.

[0057] Optionally, in step S101 above: in response to a target user's function learning request for a target function of a target device, at least one operation step associated with the target function can be obtained. This can be achieved by the target device responding to the function learning request and using the user manual stored on the target device to determine at least one operation step associated with the target function; or by the server responding to the function learning request sent by the target device and using the user manual stored on the server to send at least one operation step associated with the target function to the target device.

[0058] In one embodiment, step S101 above: in response to a target user's function learning request for a target function of a target device, obtaining at least one operational step associated with the target function, including: In response to a target user's request for learning the target function of the target device, a function learning request is sent to the server; the function learning request is used to instruct the server to determine at least one operation step associated with the target function based on the configured user manual. Receive at least one operation step sent by the server based on the function learning request.

[0059] In practice, when a target device receives a function learning request from a target user for a specific function of the target device, it can send the request to the server. Upon receiving the function learning request, the server can query the user manual based on the request to obtain at least one operational step associated with the target function; then, the server can send this at least one operational step associated with the target function to the target device.

[0060] This application embodiment, in response to a target user's function learning request for a target device's target function, delegates the matching and acquisition of operation steps associated with the target function to the server, which can reduce the local storage and computing burden of the target device and improve the efficiency of acquiring operation steps associated with the target function; in addition, relying on the server, the user manual can be maintained and updated in real time, thereby ensuring the accuracy of the operation steps acquired using the user manual.

[0061] Optionally, at least one operation step includes a first operation step and a second operation step, wherein the second operation step is the next operation step after the first operation step. In one embodiment, the at least one operation step sent by the receiving server based on the functional learning request includes: After receiving the first operation step sent by the server, send the operation result of the first operation step to the server; The server receives a response indicating that the operation object associated with the first operation step has successfully performed the second operation step.

[0062] In practice, the server sends at least one operation step associated with the target function to the target device. Alternatively, the server can send all operation steps associated with the target function to the target device at once, and the target device executes each operation step in sequence based on the execution order and the operation result of each operation step.

[0063] Alternatively, the server can send each operation step to the target device in the order of execution, and the prerequisite for the server to send the second operation step is that it receives information from the target device that the operation object associated with the first operation step has been successfully operated.

[0064] In this embodiment, the execution results of each operation step are fed back to the server in real time by the target device. The server then sends the next operation step to the target device based on the successful operation of the operation object associated with the previous operation step. This achieves closed-loop control of the functional learning process, which can improve the guidance efficiency of each operation step and ensure the guidance reliability of each operation step, thereby improving the learning effect of the device function.

[0065] In one embodiment, step S101 above: in response to a target user's function learning request for a target function of a target device, obtaining at least one operational step associated with the target function, including: In response to a function learning request, the large speech model is used to identify the function learning intent corresponding to the function learning request. Based on the functional learning intent and the device information of the target device, determine at least one operational step associated with the target function.

[0066] In actual implementation, when the target device receives a function learning request, it can input the function learning request into the large language model. The large language model can perform semantic parsing on the function learning request, and then, based on the intent classification system pre-aligned by the large speech model, the parsed semantic elements can be mapped into structured function learning intents.

[0067] In practice, the functional learning intent and the target device's device information can be input into a preset knowledge graph. The preset knowledge graph can then be used to retrieve at least one operational step associated with the target function. For details on this implementation, please refer to the relevant descriptions below; it will not be described here. Alternatively, at least one operational step associated with the target function can be determined based on the functional learning intent, the target device's device information, and the user's functional learning preferences. For details on this implementation, please refer to the relevant descriptions below; it will not be described here.

[0068] This application embodiment utilizes a large language model to accurately identify the function learning intent corresponding to the function learning request, and combines the device information of the target device to dynamically determine the operation steps associated with the target function. This can significantly improve the accuracy and scenario adaptability of determining the operation steps associated with the target function, thereby improving the learning effect of the device function.

[0069] In one embodiment, determining at least one operational step associated with the target function based on the functional learning intent and the device information of the target device includes: Input the functional learning intent and the device information of the target device into a preset knowledge graph, and retrieve at least one operation step from the preset knowledge graph.

[0070] Optionally, the device information of the target device may include at least one of the target device's model, configuration, and operating status. The preset knowledge graph may be a semantic network built based on the user manual and centered on device functions. It may store a first correspondence between the device function learning intention and the preset device operating status, and a second correspondence between the device function learning intention, device model and configuration, and operation steps.

[0071] In actual implementation, the target user's learning intent for the target function and the device information of the target device can be input into a preset knowledge graph. The preset knowledge graph can use the learning intent of the target function to query the first correspondence mentioned above and obtain the preset device operating status corresponding to the target function. Then, the preset knowledge graph can compare the operating status of the target device with the preset device operating status corresponding to the target function to determine whether there is a conflict between the two. For example, if the preset device operating status corresponding to function A is that the vehicle is in a parked state or the vehicle speed is less than the preset speed, and the vehicle is currently in a high-speed state, then the vehicle's operating status conflicts with the preset device operating status corresponding to function A. In this case, a prompt message indicating that learning function A is not allowed and the reason can be output.

[0072] If there is no conflict between the state of the target device and the preset device operating state corresponding to the target function, the preset knowledge graph can use the functional learning intent for the target function, the model and configuration of the target device to query the above-mentioned second correspondence and obtain at least one operation step associated with the target function.

[0073] This application embodiment achieves structured knowledge-driven operation step query by inputting the accurately identified function learning intent and device information into a preset knowledge graph. This not only ensures a high degree of matching between the obtained operation steps, function learning intent and device information, but also intelligently derives complete, reasonable operation steps that conform to the constraints of device information through the association relationships in the preset knowledge graph, thereby improving the learning effect of device functions.

[0074] In one embodiment, before determining at least one operational step associated with the target function based on the functional learning intent and the device information of the target device, the operation guidance method provided in this application further includes: Obtain the target user's functional learning preference information; the functional learning preference information is used to characterize the target user's operational preferences in historical functional learning.

[0075] The above-mentioned determination of at least one operational step associated with the target function based on the functional learning intent and the device information of the target device may further include: Based on the functional learning intent, the device information of the target device, and the functional learning preference information of the target user, at least one operation step is determined.

[0076] In actual implementation, before determining at least one operation step associated with the target function based on the function learning intent and the device information of the target device, the original operation log of the target user in the historical function learning can be extracted. Then, feature extraction and analysis can be performed on the operation data in the original operation log to obtain the function learning preference information of the target user.

[0077] Next, the corresponding operation sequence template can be retrieved from the standard operation sequence library using the function learning intent for the target function and the device information of the target device. Optionally, the standard operation sequence library can be built based on the user manual, and the operation sequence template can include at least one operation node and optional operation steps for each operation node. Then, the operation sequence template can be adjusted using the function learning preference information of the target user, such as reducing the number of operation nodes, selecting operation steps for each operation node that match the function learning preferences of the target user, etc., to obtain the target operation sequence associated with the target function, and the operation steps in the target operation sequence can be identified as the operation steps associated with the target function.

[0078] Alternatively, the functional learning intent for the target function, the device information of the target device, and the user's functional learning preference information can be input into a preset knowledge graph, and at least one operation step associated with the target function can be obtained by querying and matching in the preset knowledge graph.

[0079] Optionally, the above-mentioned functional learning preference information can be represented as a vector; the above-mentioned operational preferences can be used to characterize the target user's learning difficulty preferences in historical functional learning, such as the target user's fixed tendency or selection preference for the difficulty dimensions of learning content, such as complexity, pace of advancement, and depth of knowledge.

[0080] Please see Figure 3 It can obtain the target user's original operation logs in historical function learning, and perform feature extraction and transformation on the data in the original operation logs through feature engineering to obtain the user's function learning preference vector; then, the function learning intention for the target function, the device information of the target device, and the function learning preference information of the target user can be input into a preset knowledge graph. The preset knowledge graph can first determine multiple operation paths that match the function learning intention for the target function and the device information of the target device; optionally, each operation path includes at least one operation step and its execution order.

[0081] Then, the pre-defined knowledge graph can be used to match and calculate the target user's functional learning preferences with multiple operation paths using methods such as cosine similarity and Euclidean distance. Based on the matching calculation results, a suitable target operation path can be selected from multiple operation paths. Finally, the operation steps in the target operation path can be determined as the operation steps associated with the target function. Optionally, the target operation path can be the shortest operation path suitable for the target user, or it can be an operation path consisting of operation steps that the target user needs to review.

[0082] This application embodiment obtains the target user's functional learning preference information, and determines at least one operation step associated with the target function based on the functional learning intention, the device information of the target device, and the target user's functional learning preference information. This makes the final operation step not only compatible with the device information of the target device, but also compatible with the target user's functional learning preference, thereby reducing the learning trial and error cost of the target user and improving the learning effect of the device function.

[0083] In one embodiment, before step S101: obtaining at least one operation step associated with the target function in response to a target user's function learning request for a target function of the target device, the operation guidance method provided in this application embodiment further includes: Based on the user profile corresponding to the target user, output recommended learning information for the target function; In response to functional learning input corresponding to recommended learning information, determine the target user's functional learning request for the target function.

[0084] Optionally, the user profile corresponding to the target user can be the user profile of the target user themselves, or it can be the user profile of users of the same type. A user profile can be understood as a labeled description of a user's learning level of different types of device functions. For example, if a user successfully learns the intelligent driving function of a vehicle multiple times, the user profile can be labeled as "intelligent driving expert".

[0085] In practice, based on the user profile of the target user, information can be output to recommend target functions that match the user profile. For example, if user A's user profile has the tag "Intelligent Driving Expert", then user A can be recommended to learn intelligent driving-related functions. Alternatively, based on the user profiles of similar users, information can be output to recommend target functions that match the user type. For example, if user A is female and there are many female users with the tag "Intelligent Driving Expert", then user A can be recommended to learn intelligent driving-related functions.

[0086] Next, by continuously monitoring user interaction behaviors related to the recommended learning information, we can listen for the functional learning input corresponding to the recommended learning information. If we detect that the target user has explicitly accepted the recommendation, we can confirm that the functional learning input corresponding to the recommended learning information has been successfully detected. Then, based on the target user's functional learning input and combined with a structured functional learning request template, we generate a functional learning request for the target user regarding the target function.

[0087] This application embodiment outputs recommended learning information for the target function based on the user profile corresponding to the target user, and determines the target user's function learning request for the target function in response to the function learning input corresponding to the recommended learning information. This realizes a mechanism of function learning recommendation driven by user profile, which enables accurate matching between device function learning and user profile, and can improve the learning effect of device function.

[0088] In one embodiment, after the target device executes the first guidance operation corresponding to each operation step in step S102 above, so that the target device completes the target function, the operation guidance method provided in this application embodiment further includes: Obtain the operation status data corresponding to the target function; the operation status data is used to indicate whether at least one operation step associated with the target function has been successfully completed; Update the user profile corresponding to the target user based on the operation status data.

[0089] Optionally, the operation status data corresponding to the target function may include the operation status data of the operation objects associated with the above-mentioned at least one operation step.

[0090] In actual implementation, when the operation object includes physical controls, the operation status data can include operation information such as pressing and rotating of physical controls; when the operation object includes a target setting interface associated with the operation steps, the operation status data can include configuration action data and configuration parameters of the target setting interface; when the operation object includes a touch area on the display screen of the target device associated with the operation steps, the operation status data can include touch operation information of the touch area.

[0091] The user profile can update the "learned target function" tag to the target user's profile if the operation status data indicates that at least one operation step associated with the target function has been successfully completed; alternatively, the user profile can update the "to be familiarized with target function" tag to the target user's profile if the operation status data indicates that any operation step associated with the target function has not been successfully completed.

[0092] This application embodiment is based on obtaining the operation status data corresponding to the target function, and updating the user profile corresponding to the target user according to the operation status data. This can make the device function recommended for learning based on the user profile continuously match the user's real learning needs. In this way, the accuracy of function learning recommendation can be continuously improved through iterative updates of the user profile, thereby improving the learning effect of device function.

[0093] Optionally, the server can be a cloud platform, and the target device can be a vehicle. In one embodiment, the operation guidance method for device operation provided in this application can be applied to, for example... Figure 4 The illustrated device operation guidance system may include a cloud platform and a vehicle terminal (referred to as the vehicle terminal). The cloud platform may include a cloud control center and a Large Language Model (LLM) engine module; the vehicle terminal may include an execution and feedback module, a status detection and feedback unit, a user interaction module, and an information presentation and entity interaction guidance unit.

[0094] Optionally, the user interaction module can receive function learning input from the target user for the target function of the vehicle, and send the function learning input of the target function to the execution and feedback module. In actual implementation, the user interaction module may include at least one of the following: an in-vehicle microphone, a touch screen, and a multi-function steering wheel. The function learning input may be in the form of at least one of voice, text, touch, or physical button operation.

[0095] The execution and feedback module can respond to the function learning input sent by the user interaction module, determine the function learning request of the target user for the target function, and send the function learning request to the LLM engine module.

[0096] The LLM engine module can respond to the function learning request sent by the execution and feedback module, and use a large speech model to identify the function learning intent corresponding to the function learning request. Then, the LLM engine module can input the function learning intent, as well as vehicle information such as vehicle model, configuration, and status, into a preset knowledge graph, and retrieve a structured sequence of operation steps from the preset knowledge graph. Then, the LLM engine module can send the sequence of operation steps to the cloud control center. The sequence of operation steps can include at least one operation step associated with the target function.

[0097] The cloud control center can be used to send the sequence of operation steps sent by the LLM engine module, and send the i-th operation step associated with the target function and its guidance information to the execution and feedback module according to the execution order of each operation step; Next, the execution and feedback module can control the information presentation and physical interaction guidance unit in the vehicle associated with the guidance information of the i-th operation step to output the first information for prompting the i-th operation step and the second information for physically displaying the location of the operation object associated with the i-th operation step, based on the i-th operation step and its guidance information sent by the cloud control center, so as to guide the target user to operate the corresponding operation object to complete the i-th operation step. The status monitoring and feedback unit can monitor the status data of the operation object associated with the i-th operation step in real time under the guidance of the first and second information, and can feed back the status data of the i-th operation to the cloud control center through the execution and feedback module. The cloud control center can determine the operation result of the i-th operation step based on the operation status data fed back by the execution and feedback module; and if the operation result of the i-th operation step indicates that the operation object associated with the i-th operation step has been successfully operated, it can send the i+1-th operation step associated with the target function and its guidance information to the execution and feedback module, and repeat the above process until all operation steps associated with the target function are successfully completed.

[0098] The cloud control center can also send the j-th operation step associated with the target function and its guidance information to the execution and feedback module if the operation result of the i-th operation step indicates that the operation object associated with the i-th operation step has failed. This allows the execution and feedback module to guide the target user to repeat the i-th operation step or perform an alternative operation step. Optionally, the j-th operation step and the i-th operation step can be the same operation step, or the j-th operation step can be an alternative operation step to the i-th operation step.

[0099] This application embodiment, through the interaction between the user, the vehicle, and the cloud, enables various operation steps associated with target functions of the vehicle. The object requiring user operation is visually displayed on the vehicle using methods such as highlighting, breathing lights, or flashing specific colors, while simultaneously providing voice / text prompts for the user to perform the operation steps and feedback on the operation results. This forms a closed loop of guidance, operation, and feedback, allowing users to obtain an immersive training experience, thus significantly improving the efficiency and accuracy of users learning vehicle functions. The device operation guidance method provided in this application embodiment can be applied to scenarios such as intelligent vehicle function education, after-sales training, and the launch of new over-the-air (OTA) functions.

[0100] like Figure 5 As shown in one specific embodiment, the operation guidance method for device operation provided in this application may further include the following steps: Step A: User voice / text input; Users can send function learning input for the target function to the vehicle via the in-vehicle microphone or in-vehicle screen; Step B: Cloud-based LLM interprets intent; The cloud-based LLM engine interprets the user's functional learning intent based on the functional learning input sent from the vehicle. If the user's function learning intent is not parsed successfully, the vehicle terminal can be instructed to prompt the user to re-enter the information. If the user's functional learning intent is successfully parsed, then proceed to step C: generate a structured sequence of operation steps; the cloud-based LLM engine can generate a structured sequence of operation steps based on the functional learning intent, as well as vehicle information such as vehicle model, configuration, and status; Step D: Cloud Control Center Signs & Issues; The cloud control center can securely sign the generated sequence of operation steps and then issue it to the vehicle. Step E: The vehicle receives and verifies the signature; After receiving the sequence of operation steps, the vehicle can verify the signature it carries. If the signature verification fails, an error can be reported to the cloud, and a request can be made to resend the operation step sequence from the cloud. If the signature verification passes, proceed to step F: entity interaction guidance; the vehicle can execute the guidance operation corresponding to the i-th operation step by controlling the flashing of control buttons, interface jump, voice prompts, etc., according to the execution order of each operation step in the operation step sequence. Step G: The user performs the operation; the user can perform the i-th operation step on the vehicle based on the prompts of the guided operation corresponding to the i-th operation step; Step H: Monitor operation status data; the vehicle terminal can monitor the operation status data of the i-th operation step in real time; Determine whether the i-th operation step was executed successfully; the cloud can determine whether the i-th operation step was successful based on the operation status data of the i-th operation step. If the i-th operation step is not executed successfully, the vehicle can be instructed to prompt the user to re-enter the information and return to step A.

[0101] If the i-th operation step is executed successfully, then step I can be executed: the cloud determines whether it is the last step; the cloud can determine whether the i-th operation step is the last operation step associated with the target function; If the i-th operation step is the last operation step, then execute step K: complete the tutorial and update the user profile; the cloud can update the user profile and instruct the vehicle to output a prompt indicating that the tutorial is completed; completing the tutorial can be used to indicate that the user has completed all operations associated with the target function and all operations have been successfully performed. If the i-th operation step is the last operation step, then execute step L: proceed to the next instruction; in this step, the cloud can instruct the vehicle to guide the user to execute the next operation step; after receiving the instruction from the cloud, the vehicle can update i to i+1 and return to execute step F.

[0102] It is worth mentioning that, to further ensure the security of the operation steps associated with the target function, before executing step F, the vehicle can determine whether the vehicle's operating state matches the preset vehicle operating state corresponding to the target function. If they match, step F can be executed; if they do not match, a prompt message indicating that learning the target function is not allowed and the reason therefor can be output. For example, if the preset vehicle operating state corresponding to the vehicle's entertainment function is a non-high-speed driving state, and the vehicle detects that the vehicle is in a high-speed driving state, then learning the vehicle's entertainment function is not allowed.

[0103] like Figure 6 As shown, in another specific embodiment, the operation guidance method for device operation provided in this application may further include the following steps: Step A: Vehicle-side voice input; Users can send function learning input for the target function to the vehicle via the vehicle's microphone. Step B: Front-end DSP noise reduction, AEC, and dereverberation; The vehicle can perform digital signal processing (DSP) on the user's voice input and improve the clarity of the voice through techniques such as acoustic echo cancellation (AEC), noise reduction, and dereverberation. Step C: Lightweight ASR 220M model; The vehicle can use a lightweight Automatic Speech Recognition (ASR) 220M model to recognize the speech processed in Step B and obtain the speech recognition result; Determine if the confidence level is ≥0.85; If the confidence level of the speech recognition result is less than 0.85, the vehicle terminal can prompt the user to re-enter the information and return to step A. If the confidence score of the speech recognition result is ≥0.85, then proceed to step D: Rule-in-Loop Large Language Model (Rule-in-Loop LLM) intent normalization; the cloud can use Rule-in-Loop LLM to perform intent normalization processing on the speech recognition result obtained in step C to identify the user's functional learning intent; Step E: Generate a quadruple Q; The cloud can combine the user's functional learning intent identified in step D with vehicle information such as vehicle model, configuration, and status to obtain the quadruple Q; Determine if there is a conflict with the knowledge graph; this step can determine whether the information in the quad Q conflicts with the preset knowledge graph. If there is a conflict, the cloud can instruct the vehicle to prompt the user to re-enter the information and return to step A. If there is no conflict, proceed to step F: State-consistent hashing pre-simulates the zero-hop action chain; the cloud can use the state-consistent hashing algorithm to pre-simulate the zero-hop operation action chain based on the quadruple Q generated in step E, and generate the first operation step sequence associated with the target function. Step G: Fill coordinates + CAN_ID into the vehicle model template library; the cloud can retrieve the corresponding operation control coordinate information and CAN bus identifier (CAN_ID) from the vehicle model template library according to the vehicle model; and can use the information retrieved from the vehicle model template library to fill the first operation step sequence generated in step F to obtain a structured second operation step sequence; Step H: Send the MQTT to the vehicle; The cloud can send the generated second operation step sequence to the vehicle via the Message Queuing Telemetry Transport (MQTT) protocol; Step 1: Vehicle-side HSM signature verification; The vehicle-side can verify the signature of the second operation step sequence through the Hardware Security Module (HSM); Determine whether the signature verification is successful; If the verification fails, the vehicle can report an error to the cloud and request the cloud to resend the operation step sequence; If the signature verification is successful, proceed to step J: execute hardware actions in sequence; the vehicle terminal can execute hardware actions such as button flashing, interface switching, and voice prompts in the order of execution of each operation step in the second operation step sequence. Step J: Determine if the status confirmation is successful; In this step, the cloud can determine whether the execution status data of each operation step meets the status data requirements for successful execution of the operation step. If the execution status data of each execution step meets the requirements, the status is confirmed to be successful; if the execution status data of any execution step does not meet the requirements, the status is confirmed to be unsuccessful. If the status passes, proceed to step K: complete this lesson and update the user profile; the cloud can instruct the vehicle to output a prompt message indicating that the target function lesson has been completed and update the user profile. If the status fails, proceed to step L: cloud-based error correction and retry; the cloud can instruct the vehicle to output an explanation to the user for the reason why the operation step was not successfully executed, guide the user to re-execute the operation step in the vehicle, or guide the user to perform an alternative operation for the operation step in the vehicle.

[0104] Please see Figure 7 This application also provides an operation guidance device 700 for device operation, applied to the aforementioned target device, which can implement the aforementioned operation guidance method. The device 700 may include an acquisition module 701 and a control module 702.

[0105] The acquisition module 701 can be used to acquire at least one operation step associated with the target function in response to a target user's function learning request for the target function of the target device. The control module 702 can be used to control the target device to perform the first guidance operation corresponding to each operation step, so that the target device can complete the target function; the first guidance operation may include: outputting first information to prompt the operation steps, and prompting second information through the operation object associated with the operation steps in the target device, so that the target user can operate the operation object under the guidance of the first information and the second information to complete the operation steps.

[0106] The operation guidance device provided in this application embodiment can realize the operation guidance method for the above-mentioned device operation or the various steps of the operation guidance method embodiment for the above-mentioned device operation, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0107] This application also provides an electronic device, including a processor and a memory. The memory stores a program or instructions that can run on the processor. When the program or instructions are executed by the processor, they can implement the operation guidance method for the above-described device operation or the various steps of the operation guidance method embodiments for the above-described device operation, and can achieve the same technical effect. To avoid repetition, they will not be described again here.

[0108] Figure 8 To illustrate the hardware structure of the electronic device according to the embodiments of this application, the electronic device includes: The processor 801 can be implemented using a general-purpose central processing unit (CPU), microprocessor, application specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of this application. The memory 802 can be implemented as a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 802 can store the operating system and other applications. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 802, and the processor 801 calls the operation boot method for executing the device operation of the embodiments of this application. The 803 input / output interface is used to implement information input and output. The communication interface 804 is used to enable communication and interaction between this electronic device and other devices. Communication can be achieved through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WIFI, Bluetooth, etc.). Bus 805 transmits information between various components of an electronic device (e.g., processor 801, memory 802, input / output interface 803, and communication interface 804); The processor 801, memory 802, input / output interface 803, and communication interface 804 are connected to each other within the electronic device via bus 805.

[0109] The electronic device provided in this application embodiment can implement the operation guidance method for the above-described device operation or the various steps of the operation guidance method embodiment for the above-described device operation, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0110] This application also provides a computer-readable storage medium storing a program or instructions that, when executed by a processor, implement the operation guidance method for the above-described device operation or the various steps of the operation guidance method embodiment for the above-described device operation, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0111] The processor is the processor in the electronic device described in the above embodiments. The computer-readable storage medium includes computer-readable storage media such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.

[0112] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface and the processor are coupled. The processor is used to run programs or instructions to implement the operation guidance method for the above-described device operation or the various steps of the operation guidance method embodiment for the above-described device operation, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0113] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.

[0114] This application provides a computer program product stored in a storage medium. The program product is executed by at least one processor to implement the operation guidance method for device operation described above or the various steps of the operation guidance method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.

[0115] This application also provides a vehicle including the aforementioned electronic device. The vehicle can implement the operation guidance method or the various steps of the operation guidance method embodiments described above through the electronic device, and achieve the same technical effects. To avoid repetition, further details are omitted here.

[0116] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not delete other identical elements present in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

[0117] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.

[0118] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.

Claims

1. A method for guiding the operation of equipment, characterized in that, Applied to target devices, including: In response to a target user's request to learn a target function of a target device, at least one operation step associated with the target function is obtained; The target device is controlled to execute a first guidance operation corresponding to each of the operation steps, so that the target device completes the target function; the first guidance operation includes: outputting first information to prompt the operation steps, and prompting second information through the operation object associated with the operation steps in the target device, so that the target user operates the operation object under the guidance of the first information and the second information to complete the operation steps.

2. The operation guidance method as described in claim 1, characterized in that, The at least one operation step includes a first operation step and a second operation step, wherein the second operation step is the next operation step after the first operation step. The first guiding operation corresponding to each of the operation steps, which controls the target device to perform, includes: Obtain the operation result of the first operation step; In response to the operation result indicating that the operation object associated with the first operation step has been successfully operated, first information is output to prompt the second operation step, and second information is prompted through the operation object associated with the second operation step in the target device.

3. The operation guidance method as described in claim 2, characterized in that, After obtaining the operation result of the first operation step, the method further includes: In response to the operation result indicating that the operation object associated with the first operation step failed to operate successfully, the target device is controlled to execute a second guidance operation corresponding to the first operation step; the second guidance operation includes: Output the reason why the first operation failed; and / or The system may re-output the first information used to prompt the first operation step, and provide the second information through the operation object associated with the first operation step in the target device; or, output the first information used to prompt the third operation step, and provide the second information through the operation object associated with the third operation step in the target device; wherein the third operation step is an alternative operation step to the first operation step.

4. The operation guidance method as described in claim 1, characterized in that, The step of responding to a target user's function learning request for a target function of a target device and obtaining at least one operational step associated with the target function includes: In response to the target user's function learning request for the target device, the function learning request is sent to the server; the function learning request is used to instruct the server to determine at least one operation step associated with the target function based on the configured user manual; Receive at least one operation step sent by the server based on the function learning request.

5. The operation guidance method as described in claim 4, characterized in that, The at least one operation step includes a first operation step and a second operation step, wherein the second operation step is the next operation step after the first operation step. The step of receiving at least one operation sent by the server based on the function learning request includes: After receiving the first operation step sent by the server, send the operation result of the first operation step to the server; The server receives a response indicating that the operation result indicates that the operation object associated with the first operation step has successfully performed the second operation step.

6. The operation guidance method as described in claim 1, characterized in that, The step of responding to a target user's function learning request for a target function of a target device and obtaining at least one operational step associated with the target function includes: In response to the function learning request, the function learning intent corresponding to the function learning request is identified using a large speech model; Based on the learning intent of the function and the device information of the target device, at least one operation step associated with the target function is determined.

7. The operation guidance method according to claim 6, characterized in that, The step of determining at least one operation step associated with the target function based on the function learning intention and the device information of the target device includes: inputting the function learning intention and the device information of the target device into a preset knowledge graph, and querying the preset knowledge graph to obtain the at least one operation step; and / or Before determining at least one operation step associated with the target function based on the function learning intention and the device information of the target device, the method further includes: obtaining the function learning preference information of the target user; determining at least one operation step associated with the target function based on the function learning intention and the device information of the target device includes: determining the at least one operation step based on the function learning intention, the device information of the target device, and the function learning preference information of the target user.

8. The operation guidance method as described in claim 1, characterized in that, Before obtaining at least one operational step associated with the target function in response to a target user's function learning request for a target function of a target device, the method further includes: Based on the user profile corresponding to the target user, output recommended learning information for the target function; In response to the functional learning input corresponding to the recommended learning information, determine the functional learning request of the target user for the target function; After controlling the target device to execute the first guiding operation corresponding to each of the operation steps, so that the target device completes the target function, the method further includes: Obtain operation status data corresponding to the target function; the operation status data is used to indicate whether the at least one operation step associated with the target function has been successfully completed; Update the user profile corresponding to the target user based on the operation status data.

9. The operation guidance method according to any one of claims 1-8, characterized in that, The step of providing second information through the operation object associated with the operation step in the target device includes at least one of the following: When the operation object includes a physical control, adjust the display parameters of the backlight of the physical control; When the operation object includes a target setting interface associated with the operation steps, the display screen of the target device is controlled to display the target setting interface. When the operation object includes a touch area on the display screen of the target device that is associated with the operation step, the display parameters of the touch area are controlled to change.

10. An electronic device, characterized in that, The electronic device includes a memory and a processor, the memory storing a computer program, and the processor executing the computer program to implement the operation guidance method as described in any one of claims 1 to 9.

11. A computer-readable storage medium storing a computer program, characterized in that, When the computer program is executed by the processor, it implements the operation guidance method as described in any one of claims 1 to 9.

Images