Method and apparatus for processing information based on interaction instruction in interactive product

By acquiring and parsing users' interactive video intent information in interactive products, and providing interactive tutorial videos when matching fails, the inefficiency caused by converting gesture interaction commands into text or voice is solved, thereby improving human-computer interaction efficiency and user interaction capabilities.

CN116501917BActive Publication Date: 2026-04-21SHENZHEN RENMA INTERACTIVE TECH CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
SHENZHEN RENMA INTERACTIVE TECH CO LTD
Filing Date
2023-04-27
Publication Date
2026-04-21

AI Technical Summary

Technical Problem

In existing technologies, users who need gesture interaction need to convert gesture interaction commands into text or voice before interacting, resulting in low efficiency of human-computer interaction.

Method used

By acquiring user-input interactive videos and parsing intent information during the interaction between the terminal device and the server, outputting prompts to receive confirmation or denial instructions, and playing interactive teaching videos until the intent information matches the plot nodes, the teaching and correction of interactive instructions are realized.

Benefits of technology

It improves the efficiency of human-computer interaction, helps users learn and consolidate their knowledge of interactive commands, and enhances their interactive command capabilities and logical thinking abilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116501917B_ABST
    Figure CN116501917B_ABST
Patent Text Reader

Abstract

This application discloses an information processing method and apparatus based on interactive commands in an interactive product. Using the method of this application, when the first intent information corresponding to the first interactive video input by the current user does not match the node identifier of at least one candidate plot node, a first prompt message is output to receive a confirmation or denial command input for the first intent information, thus confirming whether the first intent information is correct. This helps improve the user's logical thinking and language expression abilities. When a denial command is received for the first intent information, a second prompt message including the trigger identifier of each of the at least one candidate plot node is output, thereby entering the interactive video teaching process to output the corresponding interactive teaching video to the user. This allows the user to learn and consolidate operational knowledge of interactive commands during the interaction process, which helps improve the user's interactive ability, learning ability, and proactive thinking ability.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This application relates to the field of general data processing technology in the Internet industry, and in particular to an information processing method and apparatus based on interactive instructions in an interactive product. Background Technology

[0002] As applications evolve, more and more apps can perform interactive tasks. For example, users can experience interactive novels in reading apps or interactive games in gaming apps. Currently, users typically interact with apps using voice or text input. However, for users with specific interaction needs, such as those requiring gesture interaction, the gesture commands must first be converted into text or voice before interaction can occur, leading to lower human-computer interaction efficiency. Summary of the Invention

[0003] This invention provides an information processing method and apparatus based on interactive commands in interactive products, which can improve the efficiency of human-computer interaction.

[0004] In a first aspect, embodiments of this application provide an information processing method based on interactive instructions in an interactive product, applied to a terminal device of an interactive product service system. The interactive product service system includes a server and a terminal device, which are communicatively connected. The method includes: the terminal device interacting with the server to obtain a first interactive video input by the currently active user during the output of plot content corresponding to the current plot node, and obtaining first intent information corresponding to the first interactive video; when the first intent information does not match the node identifier of at least one candidate plot node, outputting first prompt information; the first prompt information is used to receive a confirmation instruction or a denial instruction input for the first intent information; the candidate plot node is the next plot node of the current plot node. Upon receiving a denial instruction for the first intent information input, a second prompt message is output; the second prompt message includes a trigger identifier for each candidate plot node in at least one candidate plot node; upon receiving a trigger instruction for the trigger identifier of the first candidate plot node input, the system responds to the trigger instruction by displaying and playing a second interactive video; the second interactive video is an interactive tutorial video corresponding to the first candidate plot node; at least one candidate plot node includes the first candidate plot node; after the second interactive video finishes playing, a third interactive video input by the currently using object is obtained, and the second intent information corresponding to the third interactive video is obtained; when the second intent information matches the node identifier of the first candidate plot node, the plot content corresponding to the first candidate plot node is output.

[0005] As can be seen, when the first intent information corresponding to the first interactive video obtained by the terminal device is incorrect, the interactive teaching process can be initiated by outputting second prompt information including the trigger identifier of each candidate plot node in at least one candidate plot node. Upon receiving a trigger command input for the trigger identifier of the first candidate plot node, the interactive teaching video corresponding to the first candidate plot node (i.e., the second interactive video) is displayed and played. After the second interactive video finishes playing, the second intent information corresponding to the third interactive video re-entered by the current user is obtained. When the second intent information matches the node identifier of the first candidate plot node, the plot content corresponding to the first candidate plot node is output. This allows the terminal device to teach interactive commands through the interactive video teaching process when it obtains incorrect first intent information, avoiding repeated acquisition of incorrect intent information that would prevent effective interaction. This improves the efficiency of human-computer interaction and helps users learn and consolidate their operational knowledge of interactive commands, as well as enhance their interactive command capabilities.

[0006] In one implementation, when the second intent information does not match the node identifier of the first candidate plot node, but the second intent information matches the node identifier of the second candidate plot node, a third prompt message is output; the third prompt message is used to receive a confirmation instruction or a denial instruction input for the second candidate plot node; at least one candidate plot node includes the second candidate plot node; when a confirmation instruction input for the second candidate plot node is received, the plot content corresponding to the second candidate plot node is output.

[0007] As can be seen, after the interactive video teaching process, if the re-acquired intent information (second intent information) does not match the node identifier of the candidate plot node (first candidate plot node) corresponding to the interactive teaching video, but matches the node identifier of other candidate plot nodes (second candidate plot nodes), the terminal device can output a third prompt message to receive a confirmation or denial instruction for the input of the second candidate plot node, so as to confirm with the user whether to jump to the plot content corresponding to the second candidate plot node, thereby improving the efficiency of human-computer interaction, enhancing interactivity, and thus helping to improve the user's proactive thinking ability.

[0008] In one implementation, upon receiving a denial instruction for the second candidate plot node, a fourth prompt message is output; the fourth prompt message is used to prompt for re-entry of the interactive video.

[0009] It is evident that when a denial instruction is received for the second candidate plot node, that is, when the user confirms that they will not jump to the plot content corresponding to the second candidate plot node, the terminal device can enter the process of re-entering the interactive video by outputting a fourth prompt message to prompt the user to re-enter the interactive video. This allows for more intelligent interaction with the user, improves the efficiency of human-computer interaction, and helps to enhance the user's logical thinking ability.

[0010] In one implementation, when the second intent information does not match the node identifier of the first candidate plot node, and the second intent information does not match the node identifier of the second candidate plot node, a fifth prompt message is output; the fifth prompt message is used to prompt the user to re-enter the interactive video.

[0011] As can be seen, when the node identifier of the reacquired intent information (second intent information) does not match the node identifier of the candidate plot node (first candidate plot node) corresponding to the interactive teaching video, and also does not match the node identifier of other candidate plot nodes (second candidate plot nodes), the terminal device can enter the process of re-entering the interactive video by outputting the fifth prompt information to prompt the user to re-enter the interactive video. This allows for more intelligent interaction with the user, improves the efficiency of human-computer interaction, and helps to improve the user's logical thinking ability.

[0012] In one implementation, upon receiving a confirmation instruction for the input of the first intent information, a sixth prompt message is output; the sixth prompt message is used to prompt for re-entry of the interactive video; upon receiving the fourth interactive video input by the currently used object, and when the third intent information corresponding to the obtained fourth interactive video matches the node identifier of the third candidate plot node, the plot content corresponding to the third candidate plot node is output; at least one candidate plot node includes the third candidate plot node.

[0013] It is evident that when the first intent information corresponding to the first interactive video is correct, the terminal device can output a sixth prompt message to prompt the user to re-enter the interactive video, thereby entering the process of re-entering the interactive video. This allows the device to obtain the third intent information corresponding to the re-entered fourth interactive video. When the third intent information matches the node identifier of the third candidate plot node, the device can input the plot content corresponding to the third candidate plot node, thereby enhancing interactivity, improving human-computer interaction efficiency, and helping to improve the user's interactive command capabilities and comprehension.

[0014] In one implementation, when the first intent information cannot be obtained, a fourth candidate plot node is determined from at least one candidate plot node based on the target interaction information included in the first interactive video; the interactive information included in the interactive video corresponding to the fourth candidate plot node has the highest matching degree with the target interaction information; based on the fourth candidate plot node, a seventh prompt message is output; the seventh prompt message is used to receive a confirmation instruction or a denial instruction input for the fourth candidate plot node; when a confirmation instruction input for the fourth candidate plot node is received, the plot content corresponding to the fourth candidate plot node is output.

[0015] It is evident that when the first intent information corresponding to the first interactive video cannot be obtained, the terminal device can determine the reference plot node (fourth candidate plot node) with the highest matching degree with the target interactive information from at least one candidate plot node through the target interactive information included in the first interactive video. This allows the terminal device to output a seventh prompt message for receiving a confirmation or denial instruction for the fourth candidate plot node, in order to confirm with the user whether to jump to the plot content corresponding to the fourth candidate plot node. This facilitates more intelligent interaction with the user, improves the efficiency of human-computer interaction, and helps to enhance the user's proactive thinking ability and imagination.

[0016] In one implementation, upon receiving a denial instruction for the fourth candidate plot node, an eighth prompt message is output; the eighth prompt message includes the trigger identifier of each candidate plot node.

[0017] It is evident that when a denial instruction is received for the reference plot node (the fourth candidate plot node), i.e., when the user confirms that they will not jump to the plot content corresponding to the fourth candidate plot node, the terminal device can output an eighth prompt message including the trigger identifier of each candidate plot node to enter the interactive video teaching process. This allows for interactive instruction teaching based on the candidate plot nodes triggered by the user, enabling the user to learn and consolidate their operational knowledge of interactive instructions during the interaction process. This helps improve the user's interactive instruction ability and logical thinking ability, and is beneficial to improving the efficiency of human-computer interaction.

[0018] In one implementation, when the first intent information matches the node identifier of the first candidate plot node among at least one candidate plot node, the plot content corresponding to the first candidate plot node is output.

[0019] It is evident that when the first intent information obtained by the terminal device matches the node identifier of the first candidate plot node, that is, when the user wants to jump to the plot content corresponding to the first candidate plot node, the terminal device can output the plot content corresponding to the first candidate plot node, thereby improving the efficiency of human-computer interaction and thus helping to improve the user's interactive command ability and logical thinking ability.

[0020] Secondly, embodiments of this application provide an information processing device based on interactive instructions in an interactive product, including:

[0021] The acquisition module is used to acquire the first interactive video input by the currently used object and the first intent information corresponding to the first interactive video during the process of outputting the plot content corresponding to the current plot node.

[0022] The processing module is configured to output a first prompt message when the first intent information does not match the node identifier of at least one candidate plot node; the first prompt message is used to receive a confirmation instruction or a denial instruction input for the first intent information; the candidate plot node is the next plot node of the current plot node; and is also configured to output a second prompt message when a denial instruction input for the first intent information is received; the second prompt message includes the trigger identifier of each candidate plot node among the at least one candidate plot node.

[0023] The display module is used to respond to the trigger command and display and play the second interactive video when it receives the trigger identifier input for the first candidate plot node; the second interactive video is an interactive teaching video corresponding to the first candidate plot node; at least one candidate plot node includes the first candidate plot node;

[0024] The acquisition module is also used to acquire the third interactive video input by the currently using object after the second interactive video has finished playing, and to acquire the second intent information corresponding to the third interactive video;

[0025] The processing module is also used to output the plot content corresponding to the first candidate plot node when the second intent information matches the node identifier of the first candidate plot node.

[0026] Thirdly, embodiments of this application provide a computer device, including a memory and a processor. The memory stores a computer program, and when the computer program is executed by the processor, the processor performs an information processing method based on interactive instructions in an interactive product provided in embodiments of this application.

[0027] Fourthly, embodiments of this application provide a computer storage medium storing a computer program, which includes program instructions. When executed by a processor, the program instructions perform the information processing method based on interactive instructions in the interactive product provided in embodiments of this application.

[0028] Fifthly, embodiments of this application provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. When the computer instructions are executed by the processor of a computer device, they execute the information processing method based on interactive instructions in the interactive product provided in embodiments of this application. Attached Figure Description

[0029] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0030] Figure 1 This is an architecture diagram of an information processing system based on interactive instructions in an interactive product, provided in an embodiment of this application.

[0031] Figure 2 This is a flowchart illustrating an information processing method based on interactive instructions in an interactive product, as provided in an embodiment of this application.

[0032] Figure 3A This is a schematic diagram of a terminal device desktop provided in an embodiment of this application;

[0033] Figure 3B This is a schematic diagram of application B provided in an embodiment of this application;

[0034] Figure 3C This is a schematic diagram illustrating how the plot content corresponding to the current plot node is output, as provided in an embodiment of this application.

[0035] Figure 3D This is a schematic diagram illustrating another way to output the plot content corresponding to the current plot node, provided in an embodiment of this application.

[0036] Figure 3E This is a schematic diagram illustrating another way of outputting the plot content corresponding to the current plot node, provided in an embodiment of this application.

[0037] Figure 3F This is a schematic diagram illustrating the output of a first prompt message according to an embodiment of this application;

[0038] Figure 3G This is a schematic diagram illustrating the output of a second prompt message according to an embodiment of this application;

[0039] Figure 3H This is a schematic diagram illustrating another method for outputting the second prompt message provided in an embodiment of this application;

[0040] Figure 3I This is a schematic diagram of a user inputting a trigger command for a trigger identifier of a first candidate plot node, provided in an embodiment of this application;

[0041] Figure 3J This is a schematic diagram illustrating the display and playback of a second interactive video provided in an embodiment of this application;

[0042] Figure 4 This is a flowchart illustrating another interactive product information processing method based on interactive instructions provided in this application embodiment;

[0043] Figure 5 This is a flowchart illustrating another interactive product information processing method based on interactive instructions provided in this application embodiment;

[0044] Figure 6 This is a flowchart illustrating another information processing method based on interactive instructions in an interactive product provided in this application embodiment;

[0045] Figure 7 This is a schematic diagram of the structure of an information processing device based on interactive instructions in an interactive product provided in an embodiment of this application;

[0046] Figure 8 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. Detailed Implementation

[0047] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of this application.

[0048] This application provides an information processing method based on interactive commands in interactive products, which can improve the efficiency of human-computer interaction. The information processing method based on interactive commands in interactive products provided in this application can be implemented based on one or more artificial intelligence technologies.

[0049] Artificial intelligence (AI) is the theory, methods, technology, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that attempts to understand the essence of intelligence and produce a new kind of intelligent machine that can react in a way similar to human intelligence. AI studies the design principles and implementation methods of various intelligent machines, enabling them to possess the functions of perception, reasoning, and decision-making.

[0050] Artificial intelligence (AI) is a comprehensive discipline encompassing a wide range of fields, including both hardware and software technologies. Fundamental AI technologies generally include sensors, dedicated AI chips, cloud computing, distributed storage, big data processing, operating / interactive systems, and mechatronics. AI software technologies primarily include computer vision, speech processing, natural language processing, and machine learning / deep learning.

[0051] Machine Learning (ML) is a multidisciplinary field involving probability theory, statistics, approximation theory, convex analysis, and algorithm complexity theory. It specifically studies how computers can simulate or implement human learning behavior to acquire new knowledge or skills and reorganize existing knowledge structures to continuously improve their performance. Machine learning is the core of artificial intelligence and the fundamental way to endow computers with intelligence; its applications span all areas of artificial intelligence. Machine learning and deep learning typically include techniques such as artificial neural networks, belief networks, reinforcement learning, transfer learning, and inductive learning.

[0052] With the research and advancement of artificial intelligence (AI) technology, AI is being studied and applied in various fields, such as smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, autonomous driving, drones, robots, smart healthcare, and smart customer service. It is believed that with the development of technology, AI will be applied in more fields and play an increasingly important role.

[0053] In feasible embodiments, the information processing method based on interactive commands in the interactive product provided in this application can also be implemented based on cloud technology. Specifically, it may involve one or more of cloud technologies, such as cloud storage, cloud computing, and cloud database. For example, it may retrieve the plot content corresponding to the current plot node from the cloud database, or match the first intent information with the node identifier of at least one candidate plot node through cloud computing, or store at least one candidate plot node through cloud storage.

[0054] Please see Figure 1 This is an architecture diagram of an information processing system based on interactive commands in an interactive product, provided in an embodiment of this application. The information processing system based on interactive commands in this interactive product may include a terminal device 101 and a server 102. Figure 1 The number of terminal devices and servers shown is for illustrative purposes only and does not constitute a limitation on this application. For example, in actual applications, more than two servers may be included.

[0055] The terminal device 101 can be a terminal device with information processing and data processing functions based on interactive commands, as in interactive products. This terminal device can be implemented in various forms. For example, the terminal device can be a smartphone, a smart wearable device (such as a smartwatch), a tablet computer, a laptop computer, a desktop computer, a smart voice interaction device, a smart home appliance, an in-vehicle terminal, and so on. The embodiments of this application do not limit the specific technology or device form used in the terminal device.

[0056] Server 102 can be a server that provides services to terminal device 101. Server 102 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms, etc.

[0057] In this embodiment, server 102 can be used to store node identifiers of at least one candidate plot node, plot content corresponding to at least one candidate plot node, first prompt information, second prompt information, and second interactive video, etc., so as to transmit the above data to terminal device 101 when terminal device 101 obtains the first interactive video input by the currently used object. It should be noted that... Figure 1 The example described uses the storage of at least one candidate plot node's node identifier, the plot content corresponding to at least one candidate plot node, the first prompt information, the second prompt information, and the second interactive video on server 102 as an example, which does not limit this application. Optionally, the node identifier of at least one candidate plot node and the plot content corresponding to at least one candidate plot node can be stored on one server, while the first prompt information, the second prompt information, and the second interactive video can be stored on another server. This application does not impose any restrictions on this.

[0058] The following provides a detailed description of the information processing method based on interactive instructions in an interactive product according to embodiments of this application. This information processing method based on interactive instructions in an interactive product can be executed by an information processing device based on interactive instructions within the interactive product. This information processing device based on interactive instructions in an interactive product can be a terminal device or a device integrated into the terminal device, such as a processor or chip. This application embodiment uses the execution of the information processing method based on interactive instructions in an interactive product by a terminal device as an example for illustration.

[0059] Please see Figure 2 , Figure 2This is a flowchart illustrating an information processing method based on interactive commands in an interactive product, as provided in an embodiment of this application. The information processing method based on interactive commands in this interactive product includes the following steps:

[0060] S201, during the process of outputting the plot content corresponding to the current plot node, obtain the first interactive video input by the current user and obtain the first intent information corresponding to the first interactive video.

[0061] The current plot node can be any plot node in any interactive product. This interactive product can be an interactive story, interactive novel, or interactive game, etc., and this application does not limit it. Optionally, the interactive product can also be called an interactive work, interactive project, interactive task, etc., which does not constitute a limitation on this application. In this embodiment of the application, an interactive novel is used as an example for illustration, which does not constitute a limitation on this application.

[0062] In other words, the interactive novel in this application embodiment can not only play or display corresponding plot content to users through terminal devices, but also interact with users through terminal devices. The interactive novel can be a novel that users click on after entering a novel reading application. Optionally, the interactive novel can be a novel that a user is reading for the first time, i.e., a novel that the terminal device opens and outputs corresponding plot content for the first time; alternatively, the interactive novel can also be a novel that a user is reading before, i.e., a novel that the terminal device opens and outputs corresponding plot content for the first time, and this application does not impose any restrictions on this.

[0063] For example, taking a smartwatch as the terminal device, such as Figure 3A As shown, a user can initiate a click command on an application (such as application B) for reading novels on the desktop of a terminal device. The terminal device can then receive and respond to this click command, opening application B. Figure 3B As shown, users can initiate a click command on an interactive novel (such as novel D) in application B. The terminal device can receive and respond to the click command, and output the plot content corresponding to the current plot node of novel D.

[0064] It should be noted that if this is the user's first time reading the interactive novel (such as novel D mentioned above), the plot content corresponding to the current plot node in novel D can be the plot content corresponding to the first plot node in novel D. The plot content corresponding to the first plot node can be the table of contents of novel D, or it can be the first paragraph of the first chapter of the main text of novel D; this application does not impose any restrictions on this. Optionally, if this is not the user's first time reading novel D, the plot content corresponding to the current plot node in novel D can be the plot content corresponding to the plot node from the user's previous reading of novel D; this application does not impose any restrictions on this.

[0065] The terminal device can output the plot content corresponding to the current plot node through voice, text, video, or other multimedia, and this application does not limit this. For example, such as... Figure 3C As shown, Figure 3C Taking a smartwatch as an example, this diagram illustrates how the plot content corresponding to the current plot node is output in the form of voice; for example... Figure 3D As shown, Figure 3D Taking a smartphone as an example, this diagram illustrates how the plot content corresponding to the current plot node is output in text form; for example... Figure 3E As shown, Figure 3E Taking a tablet computer as an example, this diagram illustrates how the plot content corresponding to the current plot node is output in video format. It should be noted that... Figure 3C , Figure 3D and Figure 3E For illustrative purposes only, it is understood that when the terminal device is a smartwatch, the plot content corresponding to the current plot node can also be output in the form of video, and this application does not impose any restrictions on this.

[0066] The first interactive video can be an interactive video of the current user responding to prompts in the plot content corresponding to the current plot node. Optionally, the interactive video can include voice interactive video, gesture interactive video, or body interactive video, etc. It is understood that, taking gesture interactive video as an example, the interactive video can be a simple hand gesture, such as gesturing numbers with fingers; optionally, the interactive video can also be sign language video, such as gesturing a sentence, etc., and this application does not impose any limitations on this. It should be noted that the following description uses gesture interactive video as an example and does not impose any limitations on this application.

[0067] For example, during the output of the plot content corresponding to the current plot node, the terminal device can output a prompt message (such as prompt message 1) to prompt the current user to input an interactive video, thereby indicating the next plot node to jump to; correspondingly, the current user can respond to prompt message 1 and input the first interactive video. It is understood that the terminal device can output the prompt message to prompt the current user to input an interactive video in the form of voice, text, video, or interactive animation, and this application does not limit this.

[0068] In one implementation, the terminal device can obtain first intent information from the first interactive video, and match the obtained first intent information with the node identifiers of at least one candidate plot node. Based on the matching status of the first intent information with the node identifiers of at least one candidate plot node, the device can then execute the subsequent method steps of the present application embodiment.

[0069] The first intent information can be the meaning corresponding to the first interactive video. For example, assuming the meaning corresponding to the first interactive video is "apple," the terminal device can obtain the first intent information of "apple" from the first interactive video. Candidate plot nodes can be the next plot node after the current plot node. It is understood that the current plot node can correspond to one or more candidate plot nodes, and this application does not impose any restrictions on this.

[0070] The node identifier of a candidate plot node can be the identification information corresponding to that candidate plot node. This identification information can be characters or text, and this application does not impose any restrictions on this. For example, the terminal device can use the keyword corresponding to the candidate plot node as the node identifier of that candidate plot node. For example, assuming that the plot content corresponding to candidate plot node 1 is "choose to plant an apple tree" and the plot content corresponding to candidate plot node 2 is "choose to plant a pear tree," that is, "apple tree" and "pear tree" can be the keywords of the two candidate plot nodes respectively, then the terminal device can use "apple tree" as the identification information of candidate plot node 1 and "pear tree" as the identification information of candidate plot node 2. Optionally, the node identifier of a candidate plot node can also be called the jump condition of the candidate plot node, and this application does not impose any restrictions on this.

[0071] In another implementation, the terminal device may not be able to obtain the first intent information from the first interactive video. In this case, the terminal device can determine the fourth candidate plot node from at least one candidate plot node based on the target interactive information included in the first interactive video, and output the seventh prompt information for receiving the input confirmation or denial instruction for the fourth candidate plot node based on the fourth candidate plot node.

[0072] In other words, when the terminal device determines the fourth candidate plot node based on the target interaction information included in the first interactive video, it can output a seventh prompt message to indicate whether the current user should jump to the plot content corresponding to the fourth candidate plot node, i.e., whether to output the plot content corresponding to the fourth candidate plot node. Specifically, for content related to the terminal device's inability to obtain intent information (such as the first intent information mentioned above), please refer to the detailed description below, which will not be repeated here.

[0073] S202, when the first intent information does not match the node identifier of at least one candidate plot node, output the first prompt information.

[0074] The first prompt message can be any form of prompt message output by the terminal device (text, voice, or interactive animation, etc.), and can be used to receive confirmation or denial instructions for the input of the first intent information. For example, the first prompt message can be "Is the first intent information correct?", and this application does not limit this.

[0075] like Figure 3F As shown, Figure 3F Taking a tablet computer as an example, a schematic diagram illustrating the output of the first prompt message by the terminal device is shown. It should be noted that... Figure 3F The example shown is of the first prompt message in text form displayed in the dialog box of the interactive character, and does not constitute a limitation on this application. Optionally, when the terminal device outputs the first prompt message in text form through the interactive character, it may also output the first prompt message in voice form, and this application does not impose any restrictions on this.

[0076] It is understandable that if the first intent information does not match the node identifier of any candidate plot node among at least one candidate plot node, it indicates that the first intent information obtained by the terminal device from the first interactive video may be incorrect. In this case, the terminal device can output the first prompt information to confirm with the current user whether the first intent information is correct.

[0077] Optionally, when the first intent information matches the node identifier of the first candidate plot node among at least one candidate plot node, the terminal device may output the plot content corresponding to the first candidate plot node. The at least one candidate plot node may include the first candidate plot node, which can be any one of the at least one candidate plot node. Optionally, the first candidate plot node and the aforementioned fourth candidate plot node may be the same plot node or different plot nodes; this application does not impose any restrictions on this.

[0078] It is understandable that when the first intent information matches the node identifier of the first candidate plot node among at least one candidate plot node, it means that the terminal device has obtained the first candidate plot node that matches the first intent information corresponding to the first interactive video, and the terminal device can output the plot content corresponding to the first candidate plot node.

[0079] It should be noted that when the first intent information matches the node identifier of the first candidate plot node among at least one candidate plot node, the terminal device can directly jump to the first candidate plot node, that is, output the plot content corresponding to the first candidate plot node. At this time, it can be said that the current user can interact with the terminal device through interactive commands, so that the user can learn and consolidate the knowledge of interactive commands during the interaction process, which is conducive to improving the user's ability to interact through interactive commands.

[0080] For example, suppose the current plot node corresponds to two candidate plot nodes, where the node identifier of candidate plot node 1 is "apple tree" and the node identifier of candidate plot node 2 is "pear tree". If the intent information (i.e., the first intent information) obtained by the terminal device from the first interactive video is "mango tree", then the terminal device can determine that the first intent information does not match the node identifiers of the two candidate plot nodes. Optionally, if the intent information (i.e., the first intent information) obtained by the terminal device from the first interactive video is "apple tree", it means that the first intent information matches the node identifier of candidate plot node 1, then the terminal device can output the plot content corresponding to candidate plot node 1.

[0081] S203, upon receiving a denial instruction for the first intent information input, outputs a second prompt message.

[0082] The second prompt information may include a trigger identifier for each candidate plot node among at least one candidate plot node. Optionally, the second prompt information and the aforementioned eighth prompt information may be the same prompt information or different prompt information; this application does not impose any restrictions on this.

[0083] It should be noted that when the terminal device receives a denial instruction for the input of the first intent information, it means that the current user has confirmed that the first intent information is incorrect. The terminal device can then output a second prompt message that includes the trigger identifier of each of the at least one candidate plot node to display each selectable plot node to the user. This allows the user to select the plot node they wish to jump to in the subsequent process, thereby improving the user's comprehension, imagination and proactive thinking ability.

[0084] For example, suppose the current plot node corresponds to two candidate plot nodes, where the node identifier of candidate plot node 1 is "apple tree" and the node identifier of candidate plot node 2 is "pear tree", and the first intent information obtained by the terminal device from the first interactive video is "mango tree"; if the terminal device receives a denial instruction for the first intent information "mango tree", indicating that the first intent information "mango tree" obtained from the first interactive video is incorrect, the terminal device can output a prompt message (i.e., a second prompt message) including the trigger identifier of each candidate plot node in at least one of the candidate plot nodes.

[0085] For example, such as Figure 3G As shown, Figure 3G Taking a tablet computer as an example, a schematic diagram illustrating the output of a second prompt message by the terminal device is shown. Figure 3GIt is understood that the terminal device can list the relevant content of each candidate plot node in text form, such as listing the node identifier of each candidate plot node, or listing the plot content corresponding to each candidate plot node. This application does not impose any restrictions on this.

[0086] Optionally, when the terminal device's display screen is small, i.e., when the display screen may not be large enough to list all the relevant content of the candidate plot nodes, the terminal device can hide the candidate plot nodes that cannot be listed. Users can access the hidden candidate plot nodes by swiping. Figure 3H As shown, Figure 3H Taking a smartwatch as an example, a schematic diagram illustrating the output of a second prompt message by the terminal device is shown. Wherein, Figure 3H The terminal device lists the relevant content of each candidate plot node in the form of video, and this application does not impose any restrictions on this.

[0087] In one implementation, upon receiving a confirmation command for the first intent input, the terminal device may output a sixth prompt message. This sixth prompt message prompts the user to re-enter the interactive video.

[0088] It should be noted that when the terminal device receives a confirmation instruction for the input of the first intent information, it means that the current user has confirmed that the first intent information is correct. In other words, although the terminal device has obtained the first intent information corresponding to the correct first interactive video, it cannot confirm the candidate plot node that matches the first intent information from the node identifier of at least one candidate plot node. Therefore, the terminal device can consider the input first interactive video to be incorrect and output a sixth prompt message to prompt the user to re-enter the interactive video.

[0089] For example, suppose the current plot node corresponds to two candidate plot nodes, where candidate plot node 1 is identified as "apple tree" and candidate plot node 2 is identified as "pear tree", and the intent information (i.e. the first intent information) obtained by the terminal device from the first interactive video is "mango tree"; if the terminal device receives a confirmation instruction for the first intent information "mango tree", it means that the first intent information "mango tree" obtained from the first interactive video is correct, and the terminal device can output a prompt message (i.e. the sixth prompt message) to prompt the user to re-enter the interactive video.

[0090] It should be noted that when the terminal device outputs a prompt message (such as the sixth prompt message mentioned above) to encourage re-entry of the interactive video, the terminal device can enter the process of re-entering the interactive video. For a detailed description of this re-entry process, please refer to the following description; it will not be repeated here.

[0091] S204, upon receiving a trigger command input for the trigger identifier of the first candidate plot node, respond to the trigger command and display and play the second interactive video.

[0092] The second interactive video can be an interactive tutorial video corresponding to the first candidate plot node. In other words, the intent information corresponding to the second interactive video can match the node identifier of the first candidate plot node. It is understood that the second interactive video can be an interactive tutorial video output by the terminal device; that is, the second interactive video has a different output target than the aforementioned first and fourth interactive videos, as well as the third interactive video mentioned below.

[0093] For example, such as Figure 3I As shown, with Figure 3G Taking the output of a second prompt message to the terminal device as an example, Figure 3I An illustrative diagram illustrates a user inputting a trigger command for the trigger identifier of a first candidate plot node. Further, as... Figure 3J As shown, Figure 3J An exemplary diagram is shown of a terminal device displaying and playing a second interactive video.

[0094] S205, after the second interactive video finishes playing, obtain the third interactive video input by the currently using object, and obtain the second intent information corresponding to the third interactive video.

[0095] The third interactive video can be an interactive video that the current user can input again. That is, after the current user has watched the instructional interactive video (i.e., the second interactive video), the current user can input the third interactive video based on the instructional interactive video. It is understood that this third interactive video can be different from the aforementioned first interactive video, and this application does not impose any restrictions on this.

[0096] It should be noted that when the terminal device outputs a prompt message including the trigger identifier of each candidate plot node in at least one candidate plot node, such as when the terminal device outputs the aforementioned second prompt message, the terminal device can enter the interactive video teaching process. For details regarding the terminal device entering the interactive video teaching process, please refer to the detailed description below; this application will not repeat it here.

[0097] It is understandable that when the terminal device receives the third interactive video input by the current user, the terminal device can obtain the second intent information corresponding to the third interactive video and match the second intent information with the node identifier of at least one candidate plot node in order to further determine whether the next plot node that the current user wants to jump to can be determined based on the second intent information.

[0098] S206, when the second intent information matches the node identifier of the first candidate plot node, output the plot content corresponding to the first candidate plot node.

[0099] The terminal device outputs the plot content corresponding to the candidate plot node, which may be the text content, the audio content, or the video content corresponding to the candidate plot node. This application does not limit this.

[0100] It is understandable that when the second intent information matches the node identifier of the first candidate plot node, it means that after the terminal device outputs the second interactive video for teaching, the user can correctly complete the input of the interactive video corresponding to the first candidate plot node by watching the second interactive video, thereby achieving the purpose of interactive video teaching. In turn, the user can learn and consolidate the operation knowledge of interactive commands during the interaction process, which is conducive to cultivating the user's self-learning ability.

[0101] Optionally, if the second intent information does not match the node identifier of the first candidate plot node, the terminal device can determine whether the second intent information matches the node identifiers of other candidate plot nodes. It should be noted that the following two situations may exist:

[0102] Scenario 1: When the second intent information does not match the node identifier of the second candidate plot node, the terminal device may output a fifth prompt message to encourage re-entry of the interactive video. Here, at least one candidate plot node may include a second candidate plot node, which can be any plot node other than the first candidate plot node among at least one candidate plot node; that is, the second candidate plot node and the aforementioned first candidate plot node can be different candidate plot nodes.

[0103] Optionally, the fifth prompt message may be the same as or different from the aforementioned sixth prompt message; this application does not impose any restrictions on this. It is understood that when the terminal device outputs a prompt message to re-enter the interactive video, such as the aforementioned fifth prompt message, the terminal device can enter the operation process of re-entering the interactive video. It should be noted that the operation process of re-entering the interactive video can be found in the detailed description above, and will not be repeated here.

[0104] Scenario 2: When the second intent information matches the node identifier of the second candidate plot node, the terminal device can output a third prompt message. This third prompt message can be used to receive a confirmation or denial command input to the second candidate plot node. In other words, the third prompt message can be used to confirm with the current user whether the second candidate plot node matching the second intent information is correct; that is, the third prompt message can be used to confirm whether to jump to the plot content corresponding to the second candidate plot node.

[0105] Understandably, when the second intent information matches the node identifier of the second candidate plot node, that is, when the second intent information does not match the node identifier of the first candidate plot node corresponding to the second interactive video, it indicates that the third interactive video input by the current user does not match the second interactive video. In this case, the terminal device can output a third prompt message to confirm with the current user whether to jump to the plot content corresponding to the second candidate plot node, so as to avoid errors.

[0106] Optionally, the current user can receive and respond to the third prompt message by inputting a confirmation command, i.e., confirming the jump to the plot content corresponding to the second candidate plot node. Correspondingly, the terminal device can output the plot content corresponding to the second candidate plot node upon receiving the confirmation command input for that node.

[0107] Optionally, the current user can receive and respond to the third prompt by inputting a denial command, thus denying the jump to the plot content corresponding to the second candidate plot node. Correspondingly, when the terminal device receives the denial command input for the second candidate plot node, it can output a fourth prompt to encourage re-entry of the interactive video.

[0108] It should be noted that when the terminal device outputs a prompt message to re-enter the interactive video, such as the fourth prompt message mentioned above, the terminal device can enter the operation process of re-entering the interactive video. Specifically, the operation process of re-entering the interactive video can be found in the detailed description above, and will not be repeated here.

[0109] In this embodiment, the terminal device, by acquiring a first interactive video and the first intent information corresponding to the first interactive video, can output a first prompt message for receiving a confirmation or denial instruction input for the first intent information when the first intent information does not match the node identifier of at least one candidate plot node. Upon receiving a denial instruction input for the first intent information, it outputs a second prompt message including the trigger identifier of each of the at least one candidate plot node to enter the interactive teaching process. Upon receiving a trigger instruction input for the trigger identifier of the first candidate plot node, it displays and plays the interactive teaching video corresponding to the first candidate plot node, i.e., the second interactive video. After the second interactive video finishes playing, it acquires a third interactive video input by the currently active user and the second intent information corresponding to the third interactive video. Then, when the second intent information matches the node identifier of the first candidate plot node, it outputs the plot content corresponding to the first candidate plot node. This method can improve the efficiency of human-computer interaction and is beneficial for enhancing users' self-learning ability, interactive ability, proactive thinking ability, and logical thinking ability.

[0110] Please see Figure 4 , Figure 4 This is a flowchart illustrating an information processing method based on interactive commands in an interactive product, as provided in an embodiment of this application. The information processing method based on interactive commands in this interactive product includes the following steps:

[0111] S401, output a second prompt message including a trigger identifier for each candidate plot node in at least one candidate plot node.

[0112] S402, upon receiving a trigger command input for the trigger identifier of the first candidate plot node, responds to the trigger command and displays and plays the second interactive video.

[0113] S403, after the second interactive video finishes playing, obtain the third interactive video input by the currently using object, and obtain the second intent information corresponding to the third interactive video.

[0114] S404, determine whether the second intent information matches the node identifier of the first candidate plot node. If the second intent information matches the node identifier of the first candidate plot node, execute S405. If the second intent information does not match the node identifier of the first candidate plot node, execute S406.

[0115] S405, outputs the plot content corresponding to the first candidate plot node.

[0116] S406, determine whether the second intent information matches the node identifier of the second candidate plot node. If the second intent information matches the node identifier of the second candidate plot node, execute S407. If the second intent information does not match the node identifier of the second candidate plot node, execute S411.

[0117] S407, outputs a third prompt message for receiving a confirmation or denial command for the second candidate story node.

[0118] S408, determine whether a confirmation command has been received for the input of the second candidate plot node. If a confirmation command has been received for the input of the second candidate plot node, execute S409. If a denial command has been received for the input of the second candidate plot node, execute S410.

[0119] S409, output the plot content corresponding to the second candidate plot node.

[0120] S410, outputs the fourth prompt message prompting for re-entry of the interactive video.

[0121] S411, output the fifth prompt message prompting you to re-enter the interactive video.

[0122] It should be noted that the relevant content of S401-S411 above can be found in the aforementioned... Figure 2 The detailed descriptions in the corresponding embodiments are not repeated here.

[0123] In this embodiment, the terminal device can enter an interactive teaching process by outputting a second prompt message including a trigger identifier for each of the at least one candidate plot node. Upon receiving a trigger command input for the trigger identifier of the first candidate plot node, it displays and plays the interactive teaching video corresponding to the first candidate plot node, i.e., the second interactive video. After the second interactive video finishes playing, it obtains the third interactive video input by the currently active user, as well as the second intent information corresponding to the third interactive video. Then, when the second intent information matches the node identifier of the first candidate plot node, it outputs the plot content corresponding to the first candidate plot node. This improves human-computer interaction efficiency and helps users learn and consolidate operational knowledge of interactive commands during the interaction process, thereby enhancing their interactive capabilities.

[0124] Please see Figure 5 , Figure 5 This is a flowchart illustrating an information processing method based on interactive commands in an interactive product, as provided in an embodiment of this application. The information processing method based on interactive commands in this interactive product includes the following steps:

[0125] S501, outputs the sixth prompt message prompting for re-entry of the interactive video.

[0126] It should be noted that this application embodiment uses the output of the sixth prompt message as an example to describe in detail the specific process of entering the re-entry interactive video, and does not constitute a limitation on this application. Optionally, in this application embodiment, the terminal device can enter the process of re-entering the interactive video through any prompt message for re-entering the interactive video, such as the fourth prompt message, the fifth prompt message, etc., and this application does not impose any restrictions on this.

[0127] S502, receive the fourth interactive video input from the currently used object.

[0128] Furthermore, when the current user receives the sixth prompt from the terminal device, they can respond to the sixth prompt and re-enter the fourth interactive video; correspondingly, the terminal device can receive the fourth interactive video entered by the current user. This fourth interactive video can be an interactive video re-entered by the current user for the plot content corresponding to the current plot node. It is understood that this fourth interactive video can be different from the aforementioned first interactive video, and this application does not impose any restrictions on this.

[0129] S503, obtain the third intent information corresponding to the fourth interactive video.

[0130] It is understandable that when the terminal device receives the re-entered fourth interactive video, the terminal device can obtain the third intent information corresponding to the fourth interactive video, and match the third intent information with the node identifier of at least one candidate plot node, so as to further determine whether the next plot node that the current user wants to jump to can be determined based on the third intent information.

[0131] It should be noted that the embodiments in this application are illustrated using the example of the terminal device being able to obtain the third intent information corresponding to the fourth interactive video, and do not constitute a limitation on this application. Optionally, the terminal device may also be unable to obtain the third intent information corresponding to the fourth interactive video. If the terminal device is unable to obtain the third intent information corresponding to the fourth interactive video, the terminal device can determine a reference candidate plot node from at least one candidate plot node based on the target interaction information included in the fourth interactive video. For relevant details, please refer to the detailed description below, which will not be repeated here.

[0132] S504, determine whether the third intent information matches the node identifier of the third candidate plot node. If the third intent information matches the node identifier of the third candidate plot node, execute S505. If the third intent information does not match the node identifier of the third candidate plot node, execute S506.

[0133] S505, outputs the plot content corresponding to the third candidate plot node.

[0134] Wherein, at least one candidate plot node includes a third candidate plot node, which can be any one of the at least one candidate plot node. Optionally, the third candidate plot node and the aforementioned first candidate plot node can be the same candidate plot node or different candidate plot nodes, and this application does not impose any restrictions on this.

[0135] For example, suppose the current plot node corresponds to two candidate plot nodes, where the node identifier of candidate plot node 1 is "apple tree" and the node identifier of candidate plot node 2 is "pear tree"; if the intent information (i.e. the third intent information) obtained by the terminal device from the fourth interactive video is "apple tree", that is, the third intent information "apple tree" matches the node identifier of candidate plot node 1, then the terminal device can output the plot content corresponding to candidate plot node 1.

[0136] S506, output a prompt message asking for re-entry of the interactive video. Optionally, this prompt message asking for re-entry of the interactive video may be referred to as the ninth prompt message. Optionally, the ninth prompt message and the aforementioned sixth prompt message may be the same prompt message or different prompt messages; this application does not impose any restrictions on this.

[0137] For example, suppose the current plot node corresponds to two candidate plot nodes, where the node identifier of candidate plot node 1 is "apple tree" and the node identifier of candidate plot node 2 is "pear tree"; if the intent information (i.e. the third intent information) obtained by the terminal device from the fourth interactive video is "lemon tree", that is, the third intent information "lemon tree" does not match the node identifiers of the two candidate plot nodes, then the terminal device can output a prompt message (i.e. the ninth prompt message) to prompt the user to re-enter the interactive video.

[0138] Understandably, terminal devices can be set to preset the number of times interactive videos can be re-entered. This allows the device to exit the interactive video re-entry process after reaching the preset number of re-entry attempts, thereby avoiding an infinite loop in the interactive video re-entry process, which would waste the terminal device's energy and negatively impact the user experience.

[0139] Optionally, the terminal device can determine the preset number of times to re-enter the interactive video based on the user's patience level. For example, if the user exits the application after re-entering the interactive video three times, the terminal device can set the number of re-entries to no more than three. Optionally, the terminal device can also determine the preset number of re-entries in other ways, which are not limited in this application.

[0140] It should be noted that when the number of times the interactive video is re-entered exceeds the preset number, that is, when the terminal device exits the re-enter interactive video operation process, the terminal device can determine the next step after exiting the re-enter interactive video operation process by referring to the opposite method steps of entering the re-enter interactive video operation process.

[0141] The method steps for entering the re-entry interactive video operation process are the method steps corresponding to triggering the re-entry interactive video operation process. For example, suppose that when the terminal device receives a confirmation instruction for the first intent information input, the terminal device outputs a sixth prompt message to prompt for re-entry of the interactive video. That is, when the terminal device receives the confirmation instruction for the first intent information input, it triggers the method steps corresponding to the re-entry interactive video operation process.

[0142] It is understandable that the method steps that lead to the re-entry interactive video operation process are the method steps corresponding to the opposite situation that triggers the re-entry interactive video operation process. For example, suppose that when the terminal device receives a confirmation instruction for the first intention information input, it triggers the method steps corresponding to the re-entry interactive video operation process; then, the terminal device receiving a denial instruction for the first intention information input can be the method steps that lead to the re-entry interactive video operation process.

[0143] For example, suppose that when the terminal device receives a confirmation instruction for the input of the first intent information, it triggers the method steps corresponding to the re-entry interactive video operation process, and the number of re-entry interactive video operations exceeds a preset number; at this time, the terminal device can determine the next step after exiting the re-entry interactive video operation process based on the method steps when the terminal device receives a denial instruction for the input of the first intent information. For example, the terminal device can confirm that when the terminal device receives a denial instruction for the input of the first intent information, it can output a second prompt message including the trigger identifier of each of the at least one candidate plot node, that is, "outputting a second prompt message including the trigger identifier of each of the at least one candidate plot node" can be the next step after exiting the re-entry interactive video operation process.

[0144] It should be noted that the method for determining the next step after exiting and re-entering the interactive video is only for illustrative purposes and does not impose any limitations on this application.

[0145] In this embodiment, the terminal device can enter the process of re-entering the interactive video by outputting a sixth prompt message prompting the user to re-enter the interactive video. This allows it to re-receive the fourth interactive video input from the currently used user and obtain the third intent information corresponding to the fourth interactive video. The third intent information is then matched with the node identifier of at least one candidate plot node. When the third intent information matches the node identifier of the third candidate plot node, the plot content corresponding to the third candidate plot node is output. This improves the efficiency of human-computer interaction and helps users enhance their logical thinking ability, comprehension, and imagination during the interaction process.

[0146] Please see Figure 6 , Figure 6 This is a flowchart illustrating an information processing method based on interactive commands in an interactive product, as provided in an embodiment of this application. The information processing method based on interactive commands in this interactive product includes the following steps:

[0147] S601, in the process of outputting the plot content corresponding to the current plot node, obtain the first interactive video input by the current user.

[0148] S602, determine whether the first intent information corresponding to the first interactive video can be obtained. If the terminal device can obtain the first intent information from the first interactive video, then execute S603. If the terminal device cannot obtain the first intent information from the first interactive video, then execute S609.

[0149] S603, determine whether the first intent information matches the node identifier of the first candidate plot node. If the first intent information matches the node identifier of the first candidate plot node among at least one candidate plot node, execute S604. If the first intent information does not match the node identifier of at least one candidate plot node, execute S605.

[0150] S604, outputs the plot content corresponding to the first candidate plot node.

[0151] S605, outputs a first prompt message for receiving a confirmation or denial instruction input in response to the first intent information.

[0152] S606, determine whether a confirmation instruction for the first intent information input has been received. If a confirmation instruction for the first intent information input is received, execute S607. If a denial instruction for the first intent information input is received, execute S608.

[0153] S607 outputs the sixth prompt message, prompting the user to re-enter the interactive video. It can be understood that when the terminal device outputs this sixth prompt message, the process of re-entering the interactive video can begin.

[0154] S608, output a second prompt message including a trigger identifier for each of at least one candidate plot node. It is understood that when the terminal device outputs this second prompt message, the interactive video tutorial process can begin.

[0155] It should be noted that the relevant content of S601-S608 above can be found in the aforementioned... Figures 2-5 The detailed descriptions in the corresponding embodiments are not repeated here.

[0156] S609, based on the target interaction information included in the first interactive video, determine a fourth candidate plot node from at least one candidate plot node.

[0157] Among them, the interactive video corresponding to the fourth candidate plot node has the highest matching degree between the interactive information and the target interactive information. This fourth candidate plot node can be any one of the at least one candidate plot node. Optionally, taking a gesture interaction video as an example, the interactive information included in this video can be gesture interaction information, and the target interactive information can be the target gesture interaction information included in the first interactive video. That is, if the terminal device cannot obtain the first intent information from the first interactive video, the terminal device can determine the fourth candidate plot node from at least one candidate plot node based on the target gesture interaction information included in the first interactive video.

[0158] For example, suppose the target gesture interaction information included in the first interactive video contains 5 gestures, and the gesture interaction information included in the interactive video corresponding to the fourth candidate plot node also contains 5 gestures. If 4 gestures in the target gesture interaction information included in the first interactive video match 4 gestures in the gesture interaction information included in the interactive video corresponding to the fourth candidate plot node, and the target gesture interaction information included in the first interactive video matches less than 4 gestures in the gesture interaction information included in the interactive videos corresponding to other candidate plot nodes, then the terminal device can determine the candidate plot node with the highest matching degree with the target gesture interaction information from at least one candidate plot node, namely the aforementioned fourth candidate plot node.

[0159] It should be noted that if the user incorrectly inputs the first interactive video, such as entering the second of the four gestures incorrectly, the terminal device may not be able to obtain the first intent information from the first interactive video. In this case, the terminal device can determine the fourth candidate plot node based on the target gesture interaction information included in the first interactive video, thereby executing the subsequent method steps of this application embodiment. This application uses gesture interaction video as an example for illustration and does not constitute a limitation on this application.

[0160] Optionally, if the first intent information corresponding to the first interactive video input by the current user is intent information outside the intent information database corresponding to the current interactive product, that is, if the first intent information is intent information not involved in the current interactive product, the terminal device may not be able to obtain the first intent information from the first interactive video. For example, taking the current interactive product as an interactive novel, assuming the current interactive novel is the fairy tale "The Little Mermaid," that is, the intent information database corresponding to the current interactive novel may not contain intent information such as "archaeology." In this case, if the first intent information corresponding to the first interactive video input by the current user is "archaeology," the terminal device may not be able to obtain the first intent information from the first interactive video.

[0161] S610, based on the fourth candidate plot node, outputs a seventh prompt message for receiving a confirmation or denial command input for the fourth candidate plot node.

[0162] Furthermore, the terminal device can output a seventh prompt message based on the fourth candidate plot node. This seventh prompt message is used to receive confirmation or denial commands input for the fourth candidate plot node. In other words, when the terminal device determines the fourth candidate plot node based on the target interaction information included in the first interactive video, it can output the seventh prompt message to indicate whether the current user wants to jump to the plot content corresponding to the fourth candidate plot node, i.e., whether to output the plot content corresponding to the fourth candidate plot node.

[0163] Understandably, when the terminal device cannot obtain the first intent information from the first interactive video, the fourth candidate plot node can be a reference plot node determined by the terminal device from at least one candidate plot node. Therefore, after determining the reference plot node, the terminal device can output prompt information to the current user to confirm whether the reference plot node is the plot node that the current user wants to enter, thereby more intelligently judging the user's intent and improving the user's logical thinking ability, language expression ability, and interactive command learning ability while enhancing interactivity.

[0164] S611, determine whether a confirmation command has been received for the input of the fourth candidate plot node. If a confirmation command has been received for the input of the fourth candidate plot node, execute S612. If a denial command has been received for the input of the fourth candidate plot node, execute S613.

[0165] S612, outputs the plot content corresponding to the fourth candidate plot node.

[0166] Understandably, when the user enters a confirmation command for the fourth candidate plot node, that is, when the user confirms that they can jump to the plot content corresponding to the fourth candidate plot node, the terminal device can output the plot content corresponding to the fourth candidate plot node.

[0167] S613, outputs the eighth hint message including the trigger identifier of each candidate plot node.

[0168] It is understandable that when the user inputs a denial command for the fourth candidate plot node, that is, the user does not want to jump to the plot content corresponding to the fourth candidate plot node, the terminal device fails to determine the next plot node that the user wants to jump to based on the target interaction information included in the first interactive video.

[0169] If the terminal device cannot obtain the first intent information from the first interactive video, and cannot determine the current user's desired jump to the next candidate plot node based on the target interactive information included in the first interactive video, the terminal device can output an eighth prompt message to provide the user with the trigger identifier of each candidate plot node included in the eighth prompt message for the current user to select.

[0170] It should be noted that the terminal device outputs the eighth prompt message to display the trigger identifier of each candidate plot node, thereby showing the current user the various candidate plot nodes to choose from. This allows the terminal device to enter the interactive video tutorial process. When the current user inputs a trigger command for a candidate plot node (e.g., the target plot node), the terminal device can guide the user through the interactive video tutorial process corresponding to the target plot node. The specific interactive video tutorial process can be found in the detailed description above, and will not be repeated here.

[0171] In this embodiment, the terminal device acquires a first interactive video input by the user while outputting the plot content corresponding to the current plot node. When the first intention information corresponding to the first interactive video cannot be acquired, the terminal device can determine a fourth candidate plot node with the highest matching degree with the target interactive information from at least one candidate plot node based on the target interactive information included in the first interactive video. Based on the fourth candidate plot node, the terminal device can output a seventh prompt message for receiving a confirmation or denial instruction for inputting a confirmation instruction or denial instruction for the fourth candidate plot node. When a confirmation instruction for inputting a confirmation instruction for the fourth candidate plot node is received, the terminal device can output the plot content corresponding to the fourth candidate plot node, so as to interact with the user more intelligently, which is conducive to improving the efficiency of human-computer interaction and helping to improve the user's proactive thinking ability.

[0172] Furthermore, in the specific embodiments of this application, data related to the current plot node, the first interactive video, the first intent information, the second intent information, and the target interactive information, as well as the data used in the information processing method based on interactive instructions in the interactive product, are all authorized by the user. When the above embodiments of this application are applied to specific products or technologies, the data used must obtain user permission or consent, and the collection, use, and processing of related data must comply with relevant laws, regulations, and standards.

[0173] For further details, please see Figure 7 , Figure 7 This is a schematic diagram of the structure of an information processing device based on interactive instructions in an interactive product provided in an embodiment of this application. Figure 7 As shown, the information processing device 700 based on interactive commands in interactive products can be applied to the above-mentioned... Figure 1 The terminal device in the corresponding embodiment. Specifically, the information processing device 700 based on interactive instructions in the interactive product can be a computer program (including program code) running on the terminal device. For example, the information processing device 700 based on interactive instructions in the interactive product is an application software; the information processing device 700 based on interactive instructions in the interactive product can be used to execute... Figures 2-6 The corresponding steps in the method provided in the corresponding embodiment.

[0174] The information processing device 700 based on interactive instructions in an interactive product may include: an acquisition unit 701, a processing unit 702, and a display unit 703.

[0175] The acquisition unit 701 is used to acquire the first interactive video input by the currently used object and acquire the first intent information corresponding to the first interactive video during the process of outputting the plot content corresponding to the current plot node.

[0176] The processing unit 702 is configured to output a first prompt message when the first intent information does not match the node identifier of at least one candidate plot node; the first prompt message is used to receive a confirmation instruction or a denial instruction input for the first intent information; the candidate plot node is the next plot node of the current plot node; and is also configured to output a second prompt message when a denial instruction input for the first intent information is received; the second prompt message includes the trigger identifier of each candidate plot node among the at least one candidate plot node.

[0177] Display unit 703 is configured to respond to a trigger instruction inputting a trigger identifier for a first candidate plot node, and display and play a second interactive video; the second interactive video is an interactive tutorial video corresponding to the first candidate plot node; at least one candidate plot node includes the first candidate plot node;

[0178] The acquisition unit 701 is also used to acquire the third interactive video input by the currently used object after the second interactive video has finished playing, and to acquire the second intent information corresponding to the third interactive video.

[0179] The processing unit 702 is also used to output the plot content corresponding to the first candidate plot node when the second intent information matches the node identifier of the first candidate plot node.

[0180] In one implementation, the processing unit 702 is further configured to output third prompt information when the second intent information does not match the node identifier of the first candidate plot node, and the second intent information matches the node identifier of the second candidate plot node; the third prompt information is used to receive a confirmation instruction or a denial instruction input for the second candidate plot node; at least one candidate plot node includes the second candidate plot node; and when a confirmation instruction is received for the second candidate plot node, the plot content corresponding to the second candidate plot node is output.

[0181] In one implementation, the processing unit 702 is further configured to output a fourth prompt message when receiving a denial instruction input for the second candidate plot node; the fourth prompt message is used to prompt for re-entry of the interactive video.

[0182] In one implementation, the processing unit 702 is further configured to output a fifth prompt message when the second intent information does not match the node identifier of the first candidate plot node and the second intent information does not match the node identifier of the second candidate plot node; the fifth prompt message is used to prompt the user to re-enter the interactive video.

[0183] In one implementation, the processing unit 702 is further configured to output a sixth prompt message when receiving a confirmation instruction for the input of the first intent information; the sixth prompt message is used to prompt for re-entry of the interactive video; when receiving the fourth interactive video input by the currently used object, and the third intent information corresponding to the obtained fourth interactive video matches the node identifier of the third candidate plot node, the processing unit 702 is configured to output the plot content corresponding to the third candidate plot node; at least one candidate plot node includes the third candidate plot node.

[0184] In one implementation, the processing unit 702 is further configured to, when the first intent information cannot be obtained, determine a fourth candidate plot node from at least one candidate plot node based on the target interaction information included in the first interactive video; the interactive information included in the interactive video corresponding to the fourth candidate plot node has the highest matching degree with the target interaction information; output a seventh prompt message based on the fourth candidate plot node; the seventh prompt message is used to receive a confirmation instruction or a denial instruction input for the fourth candidate plot node; and when a confirmation instruction input for the fourth candidate plot node is received, output the plot content corresponding to the fourth candidate plot node.

[0185] In one implementation, the processing unit 702 is further configured to output an eighth prompt message when a denial instruction is received for the fourth candidate plot node; the eighth prompt message includes a trigger identifier for each candidate plot node.

[0186] In one implementation, the processing unit 702 is further configured to output the plot content corresponding to the first candidate plot node when the first intent information matches the node identifier of the first candidate plot node among at least one candidate plot node.

[0187] According to the embodiments of this application, Figure 7 In the interactive product shown, the various units in the information processing device based on interactive instructions can be individually or entirely merged into one or more other units, or some of the units can be further divided into multiple functionally smaller units. This achieves the same operation without affecting the technical effects of the embodiments of this application. The above-mentioned units are based on logical function division. In practical applications, the function of one unit can also be implemented by multiple units, or the function of multiple units can be implemented by one unit. In other embodiments of this application, the information processing device based on interactive instructions in the interactive product may also include other units. In practical applications, these functions can also be implemented with the assistance of other units, and can be implemented collaboratively by multiple units.

[0188] According to embodiments of this application, the following can be achieved by running on a general-purpose computing device, such as a computer, which includes processing elements and storage elements such as a central processing unit (CPU), random access memory (RAM), and read-only memory (ROM), a device capable of performing operations such as... Figures 2-6 The computer program (including program code) for each step involved in the corresponding method shown, to construct such... Figure 7 The interactive product shown includes an information processing apparatus based on interactive instructions, and a method for implementing such information processing in the interactive product according to the embodiments of this application. The computer program described above can be recorded on, for example, a computer storage medium, loaded onto the aforementioned computing device via the computer storage medium, and run therein.

[0189] Further, please see Figure 8 , Figure 8 This is a schematic diagram of the structure of a computer device provided in an embodiment of this application. This computer device 800 can also be used to implement the functions of a blockchain node in the above method embodiments. For example... Figure 8 As shown, the computer device 800 may include at least: a processor 801, a communication interface 802, and a computer storage medium 803. The processor 801, communication interface 802, and computer storage medium 803 may be connected via a bus or other means.

[0190] Computer storage medium 803 can be stored in memory 804 of computer device 800. This computer storage medium 803 is used to store computer programs, which include program instructions. The processor 801 is used to execute the program instructions stored in the computer storage medium 803. The processor 801 (or CPU (Central Processing Unit)) is the computing and control core of computer device 800, suitable for implementing one or more instructions, specifically suitable for loading and executing:

[0191] During the process of outputting the plot content corresponding to the current plot node, the first interactive video input by the current user is obtained, and the first intent information corresponding to the first interactive video is obtained;

[0192] When the first intent information does not match the node identifier of at least one candidate plot node, a first prompt information is output; the first prompt information is used to receive a confirmation instruction or a denial instruction input for the first intent information; the candidate plot node is the next plot node of the current plot node; it is also used to output a second prompt information when a denial instruction input for the first intent information is received; the second prompt information includes the trigger identifier of each candidate plot node in at least one candidate plot node.

[0193] Upon receiving a trigger command input for the trigger identifier of the first candidate plot node, the system responds to the trigger command by displaying and playing the second interactive video; the second interactive video is an interactive tutorial video corresponding to the first candidate plot node; at least one candidate plot node includes the first candidate plot node;

[0194] After the second interactive video finishes playing, obtain the third interactive video input by the currently using object, and obtain the second intent information corresponding to the third interactive video;

[0195] When the second intent information matches the node identifier of the first candidate plot node, output the plot content corresponding to the first candidate plot node.

[0196] In one implementation, the processor 801 is further configured to output third prompt information when the second intent information does not match the node identifier of the first candidate plot node, and the second intent information matches the node identifier of the second candidate plot node; the third prompt information is used to receive a confirmation instruction or a denial instruction input for the second candidate plot node; at least one candidate plot node includes the second candidate plot node; and when a confirmation instruction is received for the second candidate plot node, the processor outputs the plot content corresponding to the second candidate plot node.

[0197] In one implementation, the processor 801 is further configured to output a fourth prompt message upon receiving a denial instruction for input to a second candidate plot node; the fourth prompt message is used to prompt for re-entry of the interactive video.

[0198] In one implementation, the processor 801 is further configured to output a fifth prompt message when the second intent information does not match the node identifier of the first candidate plot node and the second intent information does not match the node identifier of the second candidate plot node; the fifth prompt message is used to prompt the user to re-enter the interactive video.

[0199] In one implementation, the processor 801 is further configured to output a sixth prompt message when receiving a confirmation instruction for the input of the first intent information; the sixth prompt message is used to prompt for re-entry of the interactive video; when receiving the fourth interactive video input by the currently used object, and the third intent information corresponding to the acquired fourth interactive video matches the node identifier of the third candidate plot node, the processor outputs the plot content corresponding to the third candidate plot node; at least one candidate plot node includes the third candidate plot node.

[0200] In one implementation, the processor 801 is further configured to, when the first intent information cannot be obtained, determine a fourth candidate plot node from at least one candidate plot node based on the target interaction information included in the first interactive video; the interactive information included in the interactive video corresponding to the fourth candidate plot node has the highest matching degree with the target interaction information; output a seventh prompt message based on the fourth candidate plot node; the seventh prompt message is used to receive a confirmation instruction or a denial instruction input for the fourth candidate plot node; and when a confirmation instruction input for the fourth candidate plot node is received, output the plot content corresponding to the fourth candidate plot node.

[0201] In one implementation, the processor 801 is further configured to output an eighth prompt message upon receiving a denial instruction input for a fourth candidate plot node; the eighth prompt message includes a trigger identifier for each candidate plot node.

[0202] In one implementation, the processor 801 is further configured to output the plot content corresponding to the first candidate plot node when the first intent information matches the node identifier of the first candidate plot node among at least one candidate plot node.

[0203] It should be understood that the computer device 800 described in the embodiments of this application can execute the foregoing text. Figures 2-6 The description of the information processing method based on interactive instructions in the corresponding embodiments can also be performed as described above. Figure 7 The information processing device 700 based on interactive commands in the interactive product will not be described in detail here. Furthermore, the beneficial effects of using the same method will also not be described in detail.

[0204] Furthermore, it should be noted that this application embodiment also provides a computer storage medium, which stores a computer program executed by the information processing device 700 based on interactive instructions in the interactive product mentioned above. The computer program includes program instructions, and when the processor executes the program instructions, it can execute the aforementioned... Figures 2-6 The description of the information processing method based on interactive instructions in the corresponding embodiments is already provided and will not be repeated here. Furthermore, the beneficial effects of using the same method will also not be repeated. For technical details not disclosed in the embodiments of the computer storage medium involved in this application, please refer to the description of the method embodiments of this application. As an example, program instructions can be deployed and executed on a single computer device, or on multiple computer devices located in one location, or on multiple computer devices distributed across multiple locations and interconnected via a communication network. Multiple computer devices distributed across multiple locations and interconnected via a communication network can be combined to form a blockchain network.

[0205] According to one aspect of this application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the aforementioned... Figures 2-6 The methods described in the corresponding embodiments are therefore not repeated here.

[0206] Those skilled in the art will recognize that the units and steps of the various examples described in conjunction with the embodiments disclosed in this application can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0207] In the above embodiments, implementation can be achieved, in whole or in part, through software, hardware, firmware, or any combination thereof. When implemented in software, it can be implemented, in whole or in part, as a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present invention are generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in or transmitted through a computer storage medium. The computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.). The computer storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0208] The above description is merely a specific embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this invention should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.

Claims

1. An information processing method based on interactive commands in an interactive product, characterized in that, A terminal device applied in an interactive product service system, the interactive product service system including a server and the terminal device, the server being communicatively connected to the terminal device; the method includes: The terminal device interacts with the server to obtain the first interactive video input by the currently using user and the first intent information corresponding to the first interactive video during the process of outputting the plot content corresponding to the current plot node. When the first intent information does not match the node identifier of at least one candidate plot node, a first prompt message is output; the first prompt message is used to receive a confirmation instruction or a denial instruction input in response to the first intent information; the candidate plot node is the next plot node of the current plot node; Upon receiving a denial instruction in response to the first intent information input, a second prompt message is output; the second prompt message includes the trigger identifier of each candidate plot node among the at least one candidate plot node; Upon receiving a trigger command input for a trigger identifier of a first candidate plot node, the system responds to the trigger command by displaying and playing a second interactive video; the second interactive video is an interactive tutorial video corresponding to the first candidate plot node; the at least one candidate plot node includes the first candidate plot node. After the second interactive video finishes playing, the third interactive video input by the currently using object is obtained, and the second intent information corresponding to the third interactive video is obtained; When the second intent information matches the node identifier of the first candidate plot node, the plot content corresponding to the first candidate plot node is output; When the first intent information cannot be obtained, a fourth candidate plot node is determined from the at least one candidate plot node based on the target interaction information included in the first interactive video; the interactive information included in the interactive video corresponding to the fourth candidate plot node has the highest matching degree with the target interaction information, the first interactive video is a gesture interaction video, the target interaction information is the target gesture interaction information included in the first interactive video, and the highest matching degree means that the number of gestures matched between the target gesture interaction information and the gesture interaction information included in the interactive video corresponding to the fourth candidate plot node is greater than the number of gestures matched between the target gesture interaction information and the gesture interaction information included in the interactive videos corresponding to other candidate plot nodes; Based on the fourth candidate plot node, a seventh prompt message is output; the seventh prompt message is used to receive a confirmation or denial instruction input for the fourth candidate plot node; Upon receiving a confirmation command for the fourth candidate plot node, the plot content corresponding to the fourth candidate plot node is output.

2. The method according to claim 1, characterized in that, The method further includes: When the second intent information does not match the node identifier of the first candidate plot node, but the second intent information matches the node identifier of the second candidate plot node, a third prompt message is output; the third prompt message is used to receive a confirmation command or a denial command input to the second candidate plot node; the at least one candidate plot node includes the second candidate plot node; Upon receiving a confirmation command for the second candidate plot node, the plot content corresponding to the second candidate plot node is output.

3. The method according to claim 2, characterized in that, The method further includes: Upon receiving a denial instruction for the second candidate plot node, a fourth prompt message is output; the fourth prompt message is used to prompt the user to re-enter the interactive video.

4. The method according to claim 1, characterized in that, The method further includes: When the second intent information does not match the node identifier of the first candidate plot node, and the second intent information does not match the node identifier of the second candidate plot node, a fifth prompt message is output; the fifth prompt message is used to prompt the user to re-enter the interactive video.

5. The method according to claim 1, characterized in that, The method further includes: Upon receiving a confirmation instruction for the first intent information input, a sixth prompt message is output; the sixth prompt message is used to prompt for re-entry of the interactive video. When the fourth interactive video input by the currently used object is received, and the third intent information corresponding to the fourth interactive video matches the node identifier of the third candidate plot node, the plot content corresponding to the third candidate plot node is output; the at least one candidate plot node includes the third candidate plot node.

6. The method according to claim 1, characterized in that, The method further includes: Upon receiving a denial command input for the fourth candidate plot node, an eighth prompt message is output; the eighth prompt message includes the trigger identifier of each candidate plot node.

7. The method according to claim 1, characterized in that, The method further includes: When the first intent information matches the node identifier of the first candidate plot node among the at least one candidate plot node, the plot content corresponding to the first candidate plot node is output.

8. An information processing device based on interactive commands in an interactive product, characterized in that, include: The acquisition module is used to acquire the first interactive video input by the currently used object and acquire the first intent information corresponding to the first interactive video during the process of outputting the plot content corresponding to the current plot node. The processing module is used to output a first prompt message when the first intent information does not match the node identifier of at least one candidate plot node; The first prompt information is used to receive a confirmation or denial instruction in response to the first intent information input; the candidate plot node is the next plot node after the current plot node; It is also used to output a second prompt message when a denial instruction is received in response to the first intent information input; the second prompt message includes a trigger identifier for each of the at least one candidate plot node; The display module is configured to respond to a trigger instruction inputting a trigger identifier for a first candidate plot node by displaying and playing a second interactive video; the second interactive video is an interactive tutorial video corresponding to the first candidate plot node; the at least one candidate plot node includes the first candidate plot node; The acquisition module is further configured to acquire the third interactive video input by the currently using object after the second interactive video has finished playing, and acquire the second intent information corresponding to the third interactive video; The processing module is further configured to output the plot content corresponding to the first candidate plot node when the second intent information matches the node identifier of the first candidate plot node; The processing module is further configured to, when the first intent information cannot be obtained, determine a fourth candidate plot node from the at least one candidate plot node based on the target interaction information included in the first interactive video; the interactive video corresponding to the fourth candidate plot node has the highest matching degree with the target interaction information, the first interactive video is a gesture interaction video, the target interaction information is the target gesture interaction information included in the first interactive video, and the highest matching degree means that the number of gestures matched between the target gesture interaction information and the gesture interaction information included in the interactive video corresponding to the fourth candidate plot node is greater than the number of gestures matched between the target gesture interaction information and the gesture interaction information included in the interactive videos corresponding to other candidate plot nodes; as well as, Based on the fourth candidate plot node, output the seventh prompt message; The seventh prompt message is used to receive a confirmation or denial instruction input for the fourth candidate plot node; as well as, Upon receiving a confirmation command for the fourth candidate plot node, the plot content corresponding to the fourth candidate plot node is output.

9. A computer device, characterized in that, It includes a processor and a memory, the memory storing a computer program that, when executed by the processor, causes the processor to perform the steps of the method according to any one of claims 1-8.

10. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, the computer program including program instructions that, when executed by a processor, cause a computer device having the processor to perform the steps of the method according to any one of claims 1-7.

11. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, is used to load and perform the method as described in any one of claims 1-7.

Citation Information

Patent Citations

  • Video interaction method and device, equipment, storage medium and software product

    CN114615555A