Interaction method and device, terminal and storage medium

By automatically identifying and executing interactive information in the interactive interface, the problem of low interaction efficiency in the prior art is solved, and an interaction method that simplifies operations and improves efficiency is realized.

CN118939163AActive Publication Date: 2024-11-12BEIJING DAJIA INTERNET INFORMATION TECH CO LTD
View PDF 8 Cites 0 Cited by

Patent Information

Application Number
CN202410940443.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-12
Publication Date
2024-11-12
Estimated Expiration
2044-07-12

AI Technical Summary

Technical Problem

In the existing interaction methods, the interaction between the user and the artificial intelligence assistant is low, and the user needs to manually understand and execute the steps indicated by text messages, resulting in cumbersome operations.

Method used

Using an interactive interface based on multimedia resources, by obtaining and identifying interactive information, the interaction target and operation information are automatically determined, and the target function operations are directly executed to simplify the interaction process.

Benefits of technology

It improves human-computer interaction efficiency, shortens the operation path of target functions, realizes automated operations, and improves user experience.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118939163A_ABST
    Figure CN118939163A_ABST
Patent Text Reader

Abstract

The invention provides an interaction method and device, a terminal and a storage medium, and belongs to the technical field of computers. According to the interaction method, for first interaction information in an interaction interface of multimedia resources, if it is detected that an interaction target of the first interaction information is a target object, it is indicated that an interaction appeal exists in the first interaction information, and then the first interaction information is automatically operated according to operation information indicated by the first interaction information; and operating the target function indicated by the first interaction information to realize interaction. According to the method, the target function can be automatically operated according to the first interaction information, the operation path of the target function is shortened, and the man-machine interaction efficiency is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to an interaction method, device, terminal and storage medium. Background Art

[0002] With the development of computer technology, the ways of interaction between users and applications are becoming more and more diverse. By interacting with applications, users can set the functions of applications, make the terminal display the content requested by users, or provide emotional feedback to users.

[0003] At present, one interaction method is that the application provides an artificial intelligence assistant, and in the comment interface of the application, the user and the artificial intelligence assistant interact by sending text messages to each other. Taking the setting of the application function through this interaction method as an example, in the comment interface of the application, the user sends a text message to the artificial intelligence assistant to indicate that he wants to enable a certain function of the application. Based on the text message sent by the user, the artificial intelligence assistant also replies to the user through a text message on how to enable the function, and the user then manually enables the corresponding function based on the enabling method.

[0004] In the above method, after the user receives the text message sent by the artificial intelligence assistant, he or she needs to understand the text message and then execute the steps indicated by the text message before the above operations can be realized. The interaction process is relatively cumbersome and the human-computer interaction efficiency is low. Summary of the invention

[0005] The embodiments of the present disclosure provide an interaction method, device, terminal and storage medium for improving interaction efficiency. The technical solution is as follows.

[0006] In a first aspect, an interaction method is provided, which includes: based on an interaction interface of the multimedia resource, obtaining first interaction information for a multimedia resource; if the interaction target of the first interaction information is a target object, determining a target function corresponding to the first interaction information and operation information for the target function based on the first interaction information; and performing an interaction operation based on the target function and the operation information.

[0007] The interactive method provided by the embodiment of the present disclosure, for the first interactive information in the interactive interface of the multimedia resource, if it is detected that the interactive target of the first interactive information is the target object, it indicates that there is an interactive demand in the first interactive information, and then automatically operates the target function indicated by the first interactive information according to the operation information indicated by the first interactive information to achieve interaction. The method can automatically operate the target function according to the first interactive information, shorten the operation path of the target function, and improve the efficiency of human-computer interaction.

[0008] In some embodiments, the above-mentioned interaction method further includes: identifying constituent elements of the first interaction information, and if the first interaction information includes a target word or a target symbol, determining the interaction target of the first interaction information as a target object.

[0009] In some embodiments, the above-mentioned interaction method also includes: performing emotion recognition on the first interaction information to obtain an emotion recognition result, and if the emotion recognition result is a target result, determining the interaction target of the first interaction information as a target object.

[0010] In some embodiments, the target result is a result opposite to the emotion tag of the multimedia resource.

[0011] In some embodiments, the above-mentioned determining the target function corresponding to the first interaction information and the operation information for the target function based on the first interaction information includes: based on the emotion recognition result, taking the reply function as the target function, and taking the emotion recognition result as the operation information of the target function.

[0012] In some embodiments, the above interaction method further includes: identifying constituent elements of the first interaction information, and if the first interaction information includes a function keyword, determining that the interaction target of the first interaction information is a target object, and the function keyword indicates a target function.

[0013] In some embodiments, the above-mentioned determination of the target function corresponding to the first interaction information and the operation information for the target function based on the first interaction information includes: taking the function indicated by the function keyword in the first interaction information as the target function, and taking the part of the first interaction information associated with the function keyword as the operation information of the target function.

[0014] In some embodiments, the above-mentioned determining the target function corresponding to the first interaction information and the operation information for the target function based on the first interaction information includes: determining the target function corresponding to the first interaction information based on the first interaction information; displaying at least one operation control corresponding to the target function based on the target function; and in response to a triggering operation on any one operation control of at least one operation control, determining the operation information corresponding to any one operation control as the operation information for the target function.

[0015] In some embodiments, the target function is a first multimedia playback function, the operation information indicates an enable operation, and the interactive operation based on the target function and the operation information includes: displaying an interactive interface after enabling the first multimedia playback function.

[0016] In some embodiments, the target function is a second multimedia playback function, the operation information indicates a setting target for the second multimedia playback function, and the interactive operation based on the target function and the operation information includes: displaying an interactive interface after adjusting the second multimedia playback function to the setting target.

[0017] In some embodiments, the target function is a storage function, the operation information indicates the content to be stored, and the interactive operation performed based on the target function and the operation information includes: obtaining the content to be stored through the storage function; and storing the content to be stored.

[0018] In some embodiments, the above-mentioned interaction method further includes: displaying the content to be stored in the interaction interface.

[0019] In some embodiments, the above-mentioned interaction method further includes: displaying the content to be stored in a comment window of the interaction interface, the comment window being used to post comments; and sending the content to be stored in the interaction interface in response to a sending operation on the content to be stored.

[0020] In some embodiments, the target function is a search function, the operation information indicates the search content indicated by the first interaction information, and the interactive operation performed based on the target function and the operation information includes: searching for the search content indicated by the first interaction information through the search function; and displaying the search results in the interactive interface.

[0021] In some embodiments, the above-mentioned displaying the search results in the interactive interface includes: displaying a jump control in the interactive interface; and displaying the search results in response to a triggering operation on the jump control.

[0022] In some embodiments, the target function is a reply function, the operation information indicates an emotion recognition result of the first interaction information, and the interactive operation performed based on the target function and the operation information includes: displaying an animation associated with the emotion recognition result in the interactive interface through the reply function based on the emotion recognition result.

[0023] In some embodiments, the above method further includes: displaying information indicating that the interactive operation is completed in the interactive interface.

[0024] In some embodiments, the above-mentioned display of information indicating that the interactive operation is completed in the interactive interface includes: displaying second interactive information in the interactive interface, the second interactive information is a reply of the target object to the first interactive information, and the second interactive information indicates that the interactive operation is completed.

[0025] In a second aspect, an interactive device is provided, which includes: an information acquisition module, configured to execute an interactive interface based on a multimedia resource, and obtain first interactive information for the multimedia resource; a function determination module, configured to execute if the interactive target of the first interactive information is a target object, then based on the first interactive information, determine the target function corresponding to the first interactive information and the operation information for the target function; an operation module, configured to execute an interactive operation based on the target function and the operation information.

[0026] In a third aspect, a terminal is provided, comprising a processor and a memory, wherein the memory is used to store at least one computer program, and the at least one computer program is loaded and executed by the processor to implement the operations performed by the interaction method provided in the above-mentioned first aspect or various optional implementations of the first aspect.

[0027] In a fourth aspect, a computer-readable storage medium is provided, wherein at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor to implement the operations performed by the interactive method provided in the above-mentioned first aspect or various optional implementations of the first aspect.

[0028] In a fifth aspect, a computer program product or a computer program is provided, which includes at least one program segment, and the at least one program segment is stored in a computer-readable storage medium. The processor of the terminal reads the at least one program segment from the computer-readable storage medium, and the processor executes the at least one program segment, so that the terminal performs the operations performed by the interaction method provided in the above-mentioned first aspect or various optional implementations of the first aspect.

[0029] Based on the implementations provided in the above aspects, the present disclosure can be further combined to provide more implementations. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0031] Figure 1 is a schematic diagram of an implementation environment of an interactive method provided by an embodiment of the present disclosure;

[0032] Figure 2 is a flow chart of an interaction method provided by an embodiment of the present disclosure;

[0033] Figure 3 is an example diagram of an interactive interface provided by an embodiment of the present disclosure;

[0034] Figure 4 is a flow chart of another interactive method provided by an embodiment of the present disclosure;

[0035] Figure 5 is an example diagram of an input window provided by an embodiment of the present disclosure;

[0036] Figure 6 is an example diagram of comment information display provided by an embodiment of the present disclosure;

[0037] Figure 7 This is an example diagram of a bullet screen information display provided by an embodiment of the present disclosure;

[0038] Figure 8 is a flow chart of another interactive method provided by an embodiment of the present disclosure;

[0039] Fig. 9 is an example diagram of replying to first interaction information provided by an embodiment of the present disclosure;

[0040] Fig.10 This is an example diagram of a setting interface of a comment shielding function provided by an embodiment of the present disclosure;

[0041] Fig.11 is an example diagram of an adjustment window provided by an embodiment of the present disclosure;

[0042] Fig.12 is another example diagram of barrage information display provided by an embodiment of the present disclosure;

[0043] Fig.13 is a flow chart of another interactive method provided by an embodiment of the present disclosure;

[0044] Fig.14 is a storage progress display example diagram provided by an embodiment of the present disclosure;

[0045] Fig.15 is another example diagram of replying to first interaction information provided by an embodiment of the present disclosure;

[0046] Fig.16 is another example diagram of replying to the first interaction information provided by an embodiment of the present disclosure;

[0047] Fig.17 is an example diagram of another input window provided by an embodiment of the present disclosure;

[0048] Fig.18 is another example diagram of replying to the first interaction information provided by an embodiment of the present disclosure;

[0049] Fig.19 is an example diagram of a picture selection control provided by an embodiment of the present disclosure;

[0050] Fig. 20 is a flow chart of another interactive method provided by an embodiment of the present disclosure;

[0051] Fig.21 is another example diagram of replying to the first interaction information provided by an embodiment of the present disclosure;

[0052] Fig. 22 is another example diagram of replying to the first interaction information provided by an embodiment of the present disclosure;

[0053] Fig.23 is an example diagram of a search control provided by an embodiment of the present disclosure;

[0054] Fig.24 is a flow chart of another interactive method provided by an embodiment of the present disclosure;

[0055] Fig.25 is an example diagram of an animation display provided by an embodiment of the present disclosure;

[0056] Fig.26 is an example diagram of an emotion level option provided by an embodiment of the present disclosure;

[0057] Fig. 27 is another example diagram of animation display provided by an embodiment of the present disclosure;

[0058] Fig.28 is a structural block diagram of an interactive device provided by an embodiment of the present disclosure;

[0059] Fig.29 It is a structural diagram of a terminal provided by an embodiment of the present disclosure. DETAILED DESCRIPTION

[0060] In order to make the objectives, technical solutions and advantages of the present disclosure more clear, the embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings.

[0061] In the present disclosure, the terms "first", "second", etc. are used to distinguish identical items or similar items with substantially identical effects and functions. It should be understood that there is no logical or temporal dependency between the "first", "second", and "nth", nor are there any limitations on quantity and execution order.

[0062] In the present disclosure, the term "at least one" means one or more, and the term "plurality" means two or more.

[0063] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with the relevant laws, regulations and standards of relevant countries and regions. For example, the interactive information involved in this disclosure is obtained with full authorization.

[0064] Figure 1 is a schematic diagram of an implementation environment of an interactive method provided by an embodiment of the present disclosure, such as Figure 1 As shown, the implementation environment includes a terminal 101 and a server 102, and the terminal 101 and the server 102 are connected via a wireless network or a wired network. Figure 1 In the example, the number of terminals and servers is only an example. For example, the number of terminals and servers can be multiple, and the embodiments of the present disclosure are not limited to this.

[0065] The terminal 101 is a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, an intelligent voice interaction device, a smart home appliance, a vehicle-mounted terminal, etc., but is not limited thereto. The server 102 is an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN (Content Delivery Network), big data and artificial intelligence platforms.

[0066] In some embodiments, an application is installed and run on the terminal 101, and the application has an interactive function, which can be a social application, a multimedia resource playback application, or a conference application, etc. Through this application, users can realize functions such as posting comments or publishing bullet screens. During the interaction process, the terminal 101 obtains the interactive information through the application, identifies the interactive information, and replies to the interactive information according to the recognition result, or performs the operation indicated by the recognition result. In other embodiments, the server 102 is used to provide background services for the application. During the interaction process, the terminal 101 obtains the interactive information through the application, sends the interactive information to the server 102, and the server 102 processes the interactive information received from the terminal 101, adjusts the service to the terminal 101 according to the processing result, or replies to the terminal 101 according to the processing result.

[0067] Figure 2 is a flow chart of an interactive method provided by an embodiment of the present disclosure, such as Figure 2As shown, the method includes the following steps.

[0068] 201. A terminal obtains first interaction information for a multimedia resource based on an interaction interface of the multimedia resource.

[0069] The multimedia resource is a video, audio, or graphic, etc., which is not limited in the embodiments of the present disclosure. The interactive interface of the multimedia resource is used to display the information published for the multimedia resource. The displayed information is comment information or bullet screen information. Correspondingly, the interactive interface is the comment interface of the multimedia resource or the multimedia resource playback interface with the bullet screen display function turned on. This is not limited in the embodiments of the present disclosure. Take the interactive interface as an example, the comment interface of the multimedia resource. Figure 3 is an example diagram of an interactive interface provided by an embodiment of the present disclosure, such as Figure 3 As shown, the interactive interface displays a multimedia resource playback area 301, a comment area 302 and an input box 303. Among them, the multimedia resource playback area 301 is used to display multimedia resources, the comment area 302 is used to display information received by the terminal and information sent by the terminal, and the input box 303 is used to obtain information to be sent. The first interactive information is information sent by the terminal through the interactive interface. The display form of the first interactive information is related to the interactive interface. For example, if the interactive interface is a comment interface for multimedia resources, the first interactive information is displayed in the interactive interface in the form of comments. If the interactive interface is a multimedia resource playback interface with a bullet screen display function turned on, the first interactive information is displayed in the interactive interface in the form of bullet screen. The content of the first interactive information can be any content that complies with the provisions of the interactive interface. For example, the content of the first interactive information indicates adjusting the playback of multimedia resources, adjusting the display of the interactive interface, or saving the multimedia resources being played. The content of the first interactive information can also be the user's emotional expression or demand expression. The emotional expression reflects the user's emotions. For example, the emotional expression "I am very happy today" reflects that the user's emotions are relatively positive. The demand expression indicates the user's needs. For example, the demand expression "Help me appreciate this author" indicates that the user's need is to appreciate the author. Of course, the content of the first interactive information may also be other content, which is not limited in the embodiment of the present disclosure.

[0070] In the embodiment of the present disclosure, in the interactive interface of the multimedia resource, the terminal obtains the sent information as the first interactive information for the multimedia resource in response to the operation of sending the information.

[0071] 202. If the interaction target of the first interaction information is a target object, the terminal determines, based on the first interaction information, a target function corresponding to the first interaction information and operation information for the target function.

[0072] Among them, the interaction target of the first interaction information refers to the interaction object of the first interaction information. The types of interaction objects include multiple types, such as information interaction objects, intelligent assistants provided by the interaction interface, publishers of multimedia resources, and accounts associated with the account currently playing multimedia resources (friend accounts or follow-up accounts, etc.), etc., and the embodiments of the present disclosure do not limit this. The target object is a pre-set interaction object and can belong to any of the above interaction object types. The target functions include multiple functions, such as multimedia resource playback functions, storage functions, search functions, and reply functions. Multimedia resource playback functions are functions related to the playback mode or playback content of multimedia resources, such as bullet screen functions, automatic continuous playback functions, small window playback functions, double-speed playback functions, dark background display functions, screen clearing functions, mute functions, watch later functions, bullet screen operation speed adjustment functions, multimedia resource playback speed adjustment functions, font size adjustment functions, multimedia resource recommendation functions, and comment shielding functions. The storage function is a function for storing specified content, such as multimedia resource download functions, text extraction functions, screenshot functions, and screenshot comment functions. The search function is a function for searching related content, such as the search function for related multimedia resources, the search function for related terms, and the search function for related products or orders, etc. The reply function is a function for replying to information sent by a sending operation, such as providing emotional feedback to information sent by a sending operation and conducting a conversation based on information sent by a sending operation, etc. The operation information for the target function indicates the operation to be performed on the target function. For example, the operation information can be an operation verb such as turn on, turn off, increase, decrease, speed up, slow down, etc., and can also be prompt information such as content to be stored, content to be searched, content to be blocked, and emotion recognition results of information, which is not limited in the embodiments of the present disclosure.

[0073] In some embodiments, the terminal performs regular matching on the first interactive information according to the target object. If the result of the regular matching indicates that the first interactive information includes the target object, the interactive target of the first interactive information is the target object, and the terminal identifies the first interactive information to determine the target function corresponding to the first interactive information and the operation information for the target function from the first interactive information. Among them, the process of the terminal identifying the first interactive information can be that the terminal performs word segmentation processing on the first interactive information to obtain multiple texts corresponding to multiple first interactive information. The terminal matches the multiple texts with the texts in the function text library respectively, takes the function indicated by the matching result as the target function corresponding to the first interactive information, matches the multiple texts with the texts in the operation text library respectively, and takes the operation information indicated by the matching result as the operation information for the target function. Among them, the function text library includes texts corresponding to multiple functions, and the operation text library includes texts corresponding to multiple operations.

[0074] 203. The terminal performs an interactive operation based on the target function and the operation information.

[0075] In the embodiment of the present disclosure, the terminal performs the operation indicated by the operation information on the target function according to the operation information to realize the interactive operation. For example, if the target function is the bullet screen function and the operation information is to turn on, the terminal turns on the bullet screen function in the interactive interface.

[0076] The interactive method provided by the embodiment of the present disclosure, for the first interactive information in the interactive interface of the multimedia resource, if it is detected that the interactive target of the first interactive information is the target object, it indicates that there is an interactive demand in the first interactive information, and then automatically operates the target function indicated by the first interactive information according to the operation information indicated by the first interactive information to achieve interaction. The method can automatically operate the target function according to the first interactive information, shorten the operation path of the target function, and improve the efficiency of human-computer interaction.

[0077] Through the above Figure 2 The interactive method shown in the figure can realize various interactive operations in the interactive interface of multimedia resources, for example, Figure 2 The interactive method shown in the figure opens or closes a specified multimedia playback function in the interactive interface, sets the multimedia playback function in the interactive interface, stores the specified content in the interactive interface, displays the searched related content in the interactive interface, and replies to the information in the interactive interface. Figure 2 The interactive method shown is used to illustrate the process of implementing the above-mentioned multiple interactive operations.

[0078] Taking the example of enabling the bullet screen function in the comment interface of a multimedia resource, the process of enabling or disabling the specified multimedia resource playback function in the interactive interface through the above-mentioned interactive method is explained. Figure 4 is a flow chart of an interactive method provided by an embodiment of the present disclosure, such as Figure 4 As shown, the method includes the following steps.

[0079] 401. The terminal displays a comment interface for multimedia resources.

[0080] Among them, the comment interface of multimedia resources is as mentioned above Figure 3 The interface shown is used to display the comments received by the terminal and the comments sent by the terminal on the multimedia resources. For example, the comment interface is a comment area for a short video, and the comment area is used to display the comments on the short video.

[0081] In the disclosed embodiment, the terminal displays a comment control in the playback interface of the multimedia resource, and displays a comment interface of the multimedia resource in response to a trigger operation on the comment control.

[0082] 402. The terminal obtains information to be sent in response to an input operation on the comment interface.

[0083] In the present disclosure, Figure 3 As shown, an input box is displayed in the comment interface. In response to a trigger operation on the input box, the terminal displays an input window in the comment interface. In response to an input operation on the input window, the information input by the input operation is obtained as information to be sent. Figure 5 As shown, an input box 502 and a keyboard area 503 are displayed in the input window 501. The input box 502 is used to display information input by an input operation, and the keyboard area 503 is used to receive an input operation.

[0084] 403. In response to the sending operation of the information to be sent, the terminal obtains the information to be sent as first interaction information for the multimedia resource.

[0085] The sending operation is triggered by the sending control in the above input window. Figure 5 As shown in control 504 in .

[0086] In the embodiment of the present disclosure, in response to a trigger operation on a send control, the terminal displays the information to be sent corresponding to the trigger operation in the comment interface, and obtains the sent information as the first interactive information for the multimedia resource. Displaying the information to be sent corresponding to the send trigger operation in the comment interface means: displaying the information to be sent in the form of a comment in the comment interface, such as Figure 6 The information 601 is displayed in the form of comments in the comment interface.

[0087] The above steps 401 to 403 are a possible implementation method for obtaining the first interactive information for multimedia resources based on the interactive interface of multimedia resources. This implementation method obtains the information sent on the interactive interface as the first interactive information, can respond to the information sent by the user in real time, and improve the timeliness of the interaction.

[0088] 404. The terminal identifies the constituent elements of the first interaction information. If the first interaction information includes an interaction request for an intelligent assistant, it is determined that the interaction target of the first interaction information is the intelligent assistant.

[0089] The above-mentioned smart assistant is also the target object in the embodiment of the present disclosure. Among them, the constituent elements of the first interactive information indicate the content contained in the first interactive information. For example, if the first interactive information is "@XXX, turn on the barrage function", the constituent elements of the first interactive information are "@", "X", "X", ..., "function", "ability". The constituent elements of the first interactive information include at least one of symbol elements, word elements, and digital elements, etc., which are not limited in the embodiment of the present disclosure. The interactive request to the smart assistant consists of a preset symbol and the name of the smart assistant. For example, the preset symbol is "@" and the name of the smart assistant is "XXX", then the interactive request to the smart assistant is "@XXX". Of course, the interactive request to the smart assistant may also only include the name of the smart assistant, which is not limited in the embodiment of the present disclosure. In some embodiments, if the first interactive information includes preset words, preset symbols or function keywords, etc., the terminal can also determine that the interactive target of the first interactive information is a smart assistant, which is not limited in the embodiment of the present disclosure. Among them, the function keyword is related to the function and can be the name of the function, etc., which is not limited in the embodiment of the present disclosure.

[0090] In the disclosed embodiment, the terminal identifies the constituent elements of the first interactive information by means of regular matching, so as to identify the interactive request for the intelligent assistant from the first interactive information. If the interactive request for the intelligent assistant is identified, the interactive target of the first interactive information is determined to be the intelligent assistant. The process of identifying the interactive request from the first interactive information includes at least one round of identification process, and each round of identification process includes at least one identification. In the first identification process of the first round of identification, the terminal matches the first character in the first interactive information with the first character in the interactive request. If the character is different from the first character in the interactive request, the terminal matches the next character in the first interactive information with the first character in the interactive request for the next identification. If the character is the same as the first character in the interactive request, the terminal matches the next character in the first interactive information with the next character in the interactive request for the next identification, and so on for the subsequent identification processes of the first round of identification. During one recognition process of the first round of recognition, if the character corresponding to the recognition in the first interaction information is different from the character corresponding to the recognition in the interaction request, the terminal performs a second round of recognition process, that is, the terminal starts from the second character of the first interaction information and re-executes the process of identifying the interaction request from the first interaction information, and so on for subsequent recognition processes.

[0091] The above process is illustrated by taking the terminal performing regular matching on the first interactive information as a whole as an example, which can ensure that the interactive request is not missed during the recognition process. In some embodiments, the terminal performs word segmentation on the first interactive information to obtain multiple texts corresponding to the first interactive information. For each text, the terminal performs regular matching on the text to identify the constituent elements of the first interactive information. If there is a text that includes an interactive request for an intelligent assistant, it is determined that the interactive target of the first interactive information is the intelligent assistant. This process performs regular matching after word segmentation on the first interactive information, which can improve the recognition efficiency of the first interactive information.

[0092] This step 404 is a possible implementation method in which the terminal identifies the constituent elements of the first interaction information. If the first interaction information includes a target word or a target symbol, then determining that the interaction target of the first interaction information is a target object. By determining the interaction target of the first interaction information, the pertinence of the interaction can be improved, the sense of interaction can be enhanced, and the user experience can be optimized. In some embodiments, if the first interaction information does not include an interaction request for an intelligent assistant, it means that the interaction target of the first interaction information is not an intelligent assistant, and the terminal can choose not to execute subsequent steps.

[0093] It should be noted that step 404 is an optional step. In some embodiments, the terminal can identify the constituent elements of the first interaction information through the following step 405. If the first interaction information includes a function keyword, the interaction target of the first interaction information is determined to be the target object. The function keyword indicates the target function. This possible implementation method can effectively reduce the interaction steps and improve the interaction efficiency.

[0094] 405. The terminal performs semantic recognition on the first interaction information to obtain a semantic recognition result of the first interaction information.

[0095] The semantic recognition result of the first interaction information includes the target function corresponding to the first interaction information and the operation information for the target function. There are multiple ways for the terminal to perform semantic recognition on the first interaction information to obtain the semantic recognition result. The following describes the multiple semantic recognition ways respectively.

[0096] In some embodiments, the terminal performs word segmentation processing on the first interactive information to obtain multiple texts corresponding to the first interactive information, and obtains the semantic recognition result of the first interactive information by performing semantic recognition on the multiple texts. The process of semantic recognition of the multiple texts includes two steps. The first step includes: for each text, the terminal matches the text with each text in the first functional text library. If there is a text identical to the text in the first functional text library, the terminal uses the function indicated by the identical text as the target function corresponding to the first interactive information. The second step includes: for each text, the terminal matches the text with each text in the first operation text library. If there is a text identical to the text in the first operation text library, the terminal uses the operation information indicated by the identical text as the operation information for the above target function. The terminal can execute the first step first and then the second step, or can execute the second step first and then the first step. The embodiment of the present disclosure does not limit the execution order of the above two steps. This process not only identifies the target function corresponding to the first interactive information, but also identifies the operation information of the target function, which can improve the accuracy of the acquired semantic recognition result. In some embodiments, the matching process in the above two steps is the same as the process of identifying the constituent elements of the first interactive information in the above step 403, and the embodiments of the present disclosure will not be repeated here.

[0097] In some embodiments, after the terminal obtains the target function corresponding to the first interaction information through the above-mentioned first step, the text located at the specified position in the above-mentioned multiple texts is used as the operation information of the target function. For example, after the terminal recognizes the text corresponding to the target function corresponding to the first interaction information, the text adjacent to the text corresponding to the target function is used as the operation information of the target function. This process is a possible implementation method in which the terminal uses the function indicated by the function keyword in the first interaction information as the target function and uses the part of the first interaction information associated with the function keyword as the operation information of the target function. For the first interaction information with a relatively simple structure, the efficiency of semantic recognition through this method is relatively high.

[0098] In some embodiments, the terminal can also process the first interactive information through a semantic recognition model and output a semantic recognition result of the first interactive information. The semantic recognition model is a pre-trained model that can output the semantics corresponding to the information based on the input information.

[0099] 406. If the semantic recognition result of the first interaction information indicates to enable the barrage function, the terminal enables the barrage function in the comment interface.

[0100] In the embodiment of the present disclosure, in the semantic recognition result, if the target function corresponding to the first interactive information is the bullet screen function, and the operation information for the target function is turned on, the semantic recognition result indicates turning on the bullet screen function, and the terminal turns on the bullet screen function in the comment interface. Figure 6 As shown, multiple bullet comments are scrolled above the interactive interface.

[0101] The above process is a possible implementation method for the terminal to perform interactive operations based on the target function and operation information. This possible implementation method is to display the comment interface after the barrage function is turned on, so that the user does not need to perform additional operations to turn on the barrage function, thereby improving the efficiency of human-computer interaction.

[0102] 407. The terminal displays the first reply information of the intelligent assistant to the first interaction information in the comment interface, and the first reply information indicates that the barrage function has been turned on.

[0103] In the embodiment of the present disclosure, the terminal displays the first reply information of the intelligent assistant to the first interactive information on the comment interface, such as Figure 6 As shown, the intelligent assistant reply information 602 is displayed below the information 601. Among them, there are multiple ways to obtain the first reply information. One way to obtain is: the terminal splices the first interactive information and the operation result corresponding to the first interactive information, processes the spliced ​​content through the large language model, and outputs the first reply information to the first interactive information. The large language model is a pre-trained model that can output a reply to the information based on the input information, thereby realizing a dialogue. One way to obtain is: the terminal obtains a text that matches the target function and the operation result of the target function from the first reply text library based on the operation result of the target function corresponding to the first interactive information, and uses the text as the first reply information. The first reply text library includes replies for different operation results of different functions. Another way to obtain is: the terminal fills the target function corresponding to the first interactive information and the operation result for the target function into a pre-prepared reply template, and uses the filled reply template as the first reply information, which is not limited in the embodiment of the present disclosure.

[0104] The above process is a possible implementation method for displaying information on the completion of an interactive operation in an interactive interface. In this possible implementation method, the terminal displays the second interactive information in the interactive interface, and the second interactive information is the target object's reply to the first interactive information, indicating that the interactive operation is completed, which can improve the sense of interaction and optimize the user experience. It should be noted that this step is an optional step, and the terminal can choose whether to display the intelligent assistant's reply to the first interactive information in the comment interface.

[0105] The interactive method provided by the embodiment of the present disclosure, for the first interactive information in the interactive interface of the multimedia resource, if it is detected that the interactive target of the first interactive information is the target object, it indicates that there is an interactive demand in the first interactive information, and then automatically operates the target function indicated by the first interactive information according to the operation information indicated by the first interactive information to achieve interaction. This method can automatically operate the target function according to the first interactive information, shorten the operation path of the target function, and improve the efficiency of human-computer interaction. The above process can automatically turn on the barrage function only by sending the first interactive information, which greatly shortens the operation path of the barrage function and improves the efficiency of human-computer interaction.

[0106] Above Figure 4 The interactive method shown is described by taking the target function as the bullet screen function and the operation information as the opening operation as an example. In some embodiments, the target function is a first multimedia playback function such as the automatic continuous broadcast function, the small window playback function, the double speed playback function, the dark background display function, the screen clearing function, the mute function, or the watch later function, and the corresponding operation information is an opening operation or a closing operation, etc. In other embodiments, the target function is a first multimedia playback function such as the bullet screen font size adjustment function, the comment font size adjustment function, or the copywriting font size adjustment function, and the corresponding operation information is an increase operation or a decrease operation, etc. In some other embodiments, the target function is a first multimedia playback function such as the bullet screen scrolling speed adjustment function or the multimedia resource playback speed adjustment function, and the corresponding operation information is an increase operation or a decrease operation, etc. In some other embodiments, the target function is a comment shielding function, and the corresponding operation information is shielding comments with specified characters, which is not limited in the embodiments of the present disclosure.

[0107] In addition, the above Figure 4 The interactive method shown is described by taking the comment interface of a multimedia resource as an example. In some embodiments, the interactive method is applied to a multimedia resource playback interface with the bullet screen display function turned on. The first interactive information and the intelligent assistant's reply to the first interactive information are displayed in the multimedia resource playback interface in the form of bullet screen. Figure 7 As shown, bullet screen 701 is the first interactive information, and bullet screen 702 is the reply of the intelligent assistant to the first interactive information. Alternatively, the terminal displays a reminder control 703 in the multimedia resource playback interface, and the reminder control indicates that the interactive operation has been completed.

[0108] Taking setting a comment shielding function in a comment interface of a multimedia resource as an example, the process of setting a specified multimedia resource playback function in an interactive interface through the interactive method provided by an embodiment of the present disclosure is described. Figure 8 is a flow chart of an interactive method provided by an embodiment of the present disclosure, such as Figure 8 As shown, the method includes the following steps.

[0109] 801. The terminal displays a comment interface for multimedia resources.

[0110] 802. The terminal obtains information to be sent in response to an input operation on the comment interface.

[0111] 803. In response to the sending operation of the information to be sent, the terminal obtains the information to be sent as first interaction information for the multimedia resource.

[0112] 804. The terminal identifies constituent elements of the first interaction information. If the first interaction information includes an interaction request for an intelligent assistant, it is determined that the interaction target of the first interaction information is the intelligent assistant.

[0113] The above steps 801 to 804 are similar to the above steps 401 to 404, and will not be described in detail in this embodiment of the present disclosure.

[0114] 805. The terminal performs semantic recognition on the first interaction information to obtain a semantic recognition result of the first interaction information.

[0115] In the embodiment of the present disclosure, the terminal performs word segmentation processing on the first interactive information to obtain multiple texts corresponding to the first interactive information, and obtains the semantic recognition results of the first interactive information by performing semantic recognition on the multiple texts. The process of performing semantic recognition on the multiple texts includes: for each text, the terminal matches the text with each text in the second functional text library, and if there is a text identical to the text in the second functional text library, the terminal uses the function indicated by the identical text as the target function corresponding to the first interactive information. Among them, the second functional text library and the above-mentioned first functional text library can be the same text library or different text libraries, and the embodiment of the present disclosure does not limit this.

[0116] This process is a possible implementation method for the terminal to determine the target function corresponding to the first interaction information based on the first interaction information. This possible implementation method only identifies the target function corresponding to the first interaction information. When the operation information indicated by the first interaction information is vague, it can avoid invalid identification of the operation information and improve the interaction efficiency. In some embodiments, the terminal can also perform semantic recognition on the first interaction information according to the semantic recognition method shown in 405 above. If the operation information in the first interaction information is difficult to identify, resulting in the semantic recognition result not including the operation information corresponding to the above function, the terminal executes subsequent steps.

[0117] 806. If the semantic recognition result of the first interaction information indicates a comment blocking function, the terminal displays the second reply information of the intelligent assistant to the first interaction information in the comment interface, and the second reply information includes a setting entry for the comment blocking function.

[0118] Among them, the comment blocking function is to prevent comments containing blocked words from being displayed in the comment interface.

[0119] In an embodiment of the present disclosure, if the semantic recognition result of the first interactive information indicates a comment blocking function, the target function is the comment blocking function, and the terminal displays the second reply information of the intelligent assistant to the first interactive information in the form of a comment in the comment interface. The method for obtaining the second reply information is the same as the method for obtaining the first reply information in the above step 407, and the present embodiment of the present disclosure will not elaborate on this. Fig. 9 is an example diagram of replying to the first interaction information provided by an embodiment of the present disclosure, such as Fig. 9 As shown, information 901 is the first interaction information, information 902 is the second reply information of the intelligent assistant to the first interaction information, and in information 902, control 903 is the setting entry for the comment blocking function.

[0120] This process is a possible implementation method in which the terminal displays at least one operation control corresponding to the target function based on the target function. In this possible implementation method, the target function is the comment shielding function, and the operation control is the setting entry of the comment shielding function. Through the setting entry, the user can independently set the comment shielding function, thereby improving the degree of freedom of human-computer interaction and optimizing the user experience.

[0121] 807. In response to the triggering operation on the setting entry for the comment shielding function, the terminal displays a setting interface for the comment shielding function.

[0122] Fig.10 is an example diagram of a setting interface of a comment shielding function provided by an embodiment of the present disclosure, such as Fig.10 As shown, the setting interface displays a shielding word input box 1001, the number of shielding words added / the total number of shielding words that can be added 1002, the added shielding words 1003 and the return control 1004. Through the shielding word input box 1001, the terminal can obtain the newly added shielding word.

[0123] 808. The terminal obtains a shielding word corresponding to the comment shielding function in response to a setting operation on the setting interface of the comment shielding function.

[0124] Among them, the setting operation of the setting interface of the comment shielding function includes at least one of the operations of adding shielding words, deleting shielding words and modifying shielding words.

[0125] In the disclosed embodiment, the terminal adjusts the blocked words corresponding to the comment blocking function in response to the setting operation of the setting interface of the comment blocking function, and obtains the keywords corresponding to the adjusted comment blocking function, that is, the setting target of the comment blocking function.

[0126] The above steps 807 to 808 are a possible implementation method in which the terminal determines the operation information corresponding to any operation control as the operation information corresponding to the target function in response to the trigger operation of any operation control in at least one operation control. In this possible implementation method, the operation control is the setting entry of the comment shielding function, and the operation information corresponding to the operation control is the operation information corresponding to the setting operation of the setting interface of the comment shielding function. In some embodiments, the operation control displayed in the reply is the setting control of the comment shielding function. The terminal obtains the comment shielding words by setting the setting control without jumping to the setting interface, thereby improving the efficiency of human-computer interaction.

[0127] 809. The terminal displays the comments that do not contain the blocked words corresponding to the comment blocking function in the comment interface.

[0128] In the disclosed embodiment, after the terminal returns to the comment interface from the setting interface of the comment shielding function, the terminal displays in the comment interface the comments filtered according to the shielding words corresponding to the comment shielding function, that is, the comments that do not contain the shielding words corresponding to the comment shielding function. This process is a possible implementation method of the terminal displaying the interactive interface after adjusting the second multimedia playback function to the setting target. In this possible implementation method, the second multimedia playback function is the comment shielding function, and the operation information is the setting target for the second multimedia playback function, and the setting target is the shielding words corresponding to the comment shielding function.

[0129] The interactive method provided by the embodiment of the present disclosure, for the first interactive information in the interactive interface of the multimedia resource, if it is detected that the interactive target of the first interactive information is the target object, it indicates that there is an interactive demand in the first interactive information, and then automatically operates the target function indicated by the first interactive information according to the operation information indicated by the first interactive information to achieve interaction. This method can automatically operate the target function according to the first interactive information, shorten the operation path of the target function, and improve the efficiency of human-computer interaction. By sending the first interactive information, the above process can directly jump to the setting interface of the target function through the setting entry in the reply to the first interactive information, so as to set the target function, effectively improving the efficiency of human-computer interaction.

[0130] Above Figure 8 The interactive method shown is described by taking the target function as the comment shielding function and the operation information as the shielded words corresponding to the comment shielding function as an example. In some embodiments, the target function is the multimedia resource recommendation function. According to the target function, the terminal displays the adjustment entry of the intelligent assistant reply multimedia resource recommendation function in the comment interface. In response to the triggering operation of the adjustment entry, the terminal displays the adjustment window of the multimedia resource recommendation function in the comment interface. The adjustment window is as shown in FIG. Fig.11As shown, the adjustment window 1101 displays labels 1102 corresponding to multiple content types and a display control 1103 for labels corresponding to more content types. The display control 1103 is used to trigger the display of more labels in the adjustment window 1101. The terminal obtains the setting target, that is, the user's content preference for multimedia resources in response to the selection operation of the label in the adjustment window. The terminal adjusts the multimedia resources recommended to the user subsequently according to the user's content preference for multimedia resources. In some embodiments, the terminal can also adjust the multimedia resources recommended to the user subsequently according to the semantics of the first interactive information, and then display the intelligent assistant's reply to the adjusted information and the adjustment entrance of the multimedia resource recommendation function in the comment interface, which not only enables the user to set the target function by publishing the first interactive information, but also provides the user with an additional setting channel, thereby improving the user's experience.

[0131] In some embodiments, the target function is a preset activity, and the terminal displays an activity entry of the preset activity in the comment interface according to the preset activity. In response to a trigger operation on the activity entry, the terminal jumps to an activity interface corresponding to the preset activity.

[0132] In addition, the above Figure 8 The interactive method shown is described by taking the comment interface of a multimedia resource as an example. In some embodiments, the interactive method is applied to the multimedia resource playback interface with the bullet screen display function turned on. The terminal displays the operation controls corresponding to the target function in the reply bullet screen, such as Fig.12 As shown, barrage 1201 is the intelligent assistant's reply to the first interactive information. In barrage 1201, control 1202 is the operation control corresponding to the target function.

[0133] Taking a request to take a screenshot of a multimedia resource in a comment interface of a multimedia resource as an example, the process of storing designated content in the interactive interface through the interactive method provided by an embodiment of the present disclosure is described. Fig.13 is a flow chart of an interactive method provided by an embodiment of the present disclosure, such as Fig.13 As shown, the method includes the following steps.

[0134] 1301. The terminal displays a comment interface for multimedia resources.

[0135] 1302. The terminal obtains information to be sent in response to an input operation on the comment interface.

[0136] 1303. In response to the sending operation of the information to be sent, the terminal obtains the information to be sent as first interaction information for the multimedia resource.

[0137] 1304. The terminal identifies constituent elements of the first interaction information. If the first interaction information includes an interaction request for an intelligent assistant, it is determined that the interaction target of the first interaction information is the intelligent assistant.

[0138] The above steps 1301 to 1304 are similar to the above steps 401 to 404, and will not be described in detail in this embodiment of the present disclosure.

[0139] 1305. The terminal performs semantic recognition on the first interaction information to obtain a semantic recognition result of the first interaction information.

[0140] This process is the same as the above step 405, and will not be described in detail in this embodiment of the present disclosure.

[0141] 1306. If the semantic recognition result of the first interaction information indicates that a screenshot of the multimedia resource is taken at the first time point, the terminal obtains a picture of the multimedia resource at the first time point.

[0142] The first time point is the time point at which the playback process of the multimedia resource arrives. For example, the first time point is 00:35, indicating the 35th second of the multimedia resource.

[0143] In an embodiment of the present disclosure, if the semantic recognition result of the first interactive information indicates that the target function corresponding to the first interactive information is a screenshot function, and the operation information corresponding to the screenshot function indicates a first time point, then the semantic recognition result indicates that a screenshot of the multimedia resource is taken at the first time point. At the first time point in the multimedia resource playback process, the terminal takes a screenshot of the multimedia resource to obtain a picture of the multimedia resource at the first time point. In some embodiments, the terminal stores the picture obtained by the screenshot locally. This process is a possible implementation method in which the terminal obtains the content to be stored through the storage function and stores the content to be stored.

[0144] In some embodiments, if the semantic recognition result of the first interaction information indicates that a screenshot of the multimedia resource is taken at the first time point, the terminal obtains a video frame image of the multimedia resource at the first time point. In this way, the user can obtain the image of the multimedia resource at the first time point without waiting for the playback process of the multimedia resource to reach the first time point, which can improve the efficiency of human-computer interaction.

[0145] In some embodiments, when the terminal stores the image of the multimedia resource at the first time point, the storage progress is displayed in the comment interface. Fig.14 As shown, in the multimedia resource playback area, the progress display control 1401 shows that the storage progress is 28%. The progress display control 1401 also displays a cancel control 1402. In response to the triggering operation of the cancel control 1402, the terminal cancels the storage of the content indicated by the first interaction information.

[0146] 1307. The terminal displays the third reply information of the intelligent assistant to the first interaction information in the comment interface, where the third reply information includes the picture of the multimedia resource at the first time point.

[0147] In the embodiment of the present disclosure, the terminal displays the third reply information of the intelligent assistant to the first interactive information in the comment interface in the form of a comment. The third reply information includes pictures and text information of the multimedia resource at the first time point. The method for obtaining the text information is the same as the method for obtaining the first reply information in the above step 407, and the present embodiment of the disclosure will not be repeated here. Fig.15 is an example diagram of replying to the first interaction information provided by an embodiment of the present disclosure, such as Fig.15 As shown, information 1501 is the first interactive information, information 1502 is the third reply information of the intelligent assistant to the first interactive information, and in information 1502, picture 1503 is a picture of the multimedia resource at the first time point. It should be noted that this step is an optional step, and the terminal can choose whether to display the picture of the multimedia resource at the first time point in the comment interface.

[0148] The interactive method provided by the embodiment of the present disclosure, for the first interactive information in the interactive interface of the multimedia resource, if it is detected that the interactive target of the first interactive information is the target object, it indicates that there is an interactive demand in the first interactive information, and then automatically operates the target function indicated by the first interactive information according to the operation information indicated by the first interactive information to achieve interaction. This method can automatically operate the target function according to the first interactive information, shorten the operation path of the target function, and improve the efficiency of human-computer interaction. The above process issues a storage instruction in the form of sending the first interactive information, which not only provides a new triggering method for the storage function, but also improves the accuracy of the screenshot image for the screenshot function, thereby optimizing the user experience.

[0149] Above Fig.13 The interactive method shown is described by taking the target function as the screenshot function and the operation information as the time point of the screenshot as an example. In some embodiments, the target function is other storage functions, such as the screenshot comment function. In the corresponding process, after the terminal stores the screenshot image, the smart object replies to the first interactive information in the comment interface, and also displays the image control, in which the screenshot image is displayed. Fig.16 As shown, information 1601 is the first interactive information, information 1602 is the text information that the smart object replies to the first interactive information, and control 1603 is an image control, in which a screenshot image 1604 is displayed. In response to the triggering operation on the image control, the terminal displays a comment window in the comment interface, in which the screenshot image is displayed, and the comment window is used to post comments. Fig.17As shown, window 1701 is an input window, and a screenshot image 1702 is displayed in window 1701. In response to the sending operation of the image, the terminal sends the image in the comment interface. For example, window 1701 also displays a send control 1703, and in response to the triggering operation of the send control 1703, the terminal sends the image in the form of a comment in the comment interface. For another example, the target function corresponding to the first interactive information is a text description extraction function of a multimedia resource. After the terminal obtains the text description, it displays the intelligent assistant's reply to the text description of the first interactive information, such as Fig.18 As shown, in the comment interface, information 1801 is the first interactive information, and information 1802 is the text description of the multimedia resource. For another example, the target function corresponding to the first interactive information is the storage function of multiple pictures in the multimedia resource, then the terminal displays a picture selection control in the comment interface, and the picture selection control displays multiple pictures and a storage control. Fig.19 As shown, a plurality of pictures 1902 and a storage control 1903 are displayed in the picture selection control 1901. In response to the selection operation of the picture, the terminal displays that the picture is selected, and in response to the triggering operation of the storage control, stores the selected picture.

[0150] In addition, the above Fig.13 The interactive method shown is explained by taking the comment interface of multimedia resources as an example. In some embodiments, the above-mentioned interactive method is applied to the multimedia resource playback interface with the bullet screen display function turned on, which is not limited in the embodiments of the present disclosure.

[0151] Taking requesting to search for related content in a comment interface of a multimedia resource as an example, the process of displaying the searched related content in an interactive interface through the interactive method provided by an embodiment of the present disclosure is described. Fig. 20 is a flow chart of an interactive method provided by an embodiment of the present disclosure, such as Fig. 20 As shown, the method includes the following steps.

[0152] 2001. The terminal displays a comment interface for multimedia resources.

[0153] 2002. The terminal obtains information to be sent in response to an input operation on the comment interface.

[0154] 2003. In response to the sending operation of the information to be sent, the terminal obtains the information to be sent as first interaction information for the multimedia resource.

[0155] 2004. The terminal identifies constituent elements of the first interaction information. If the first interaction information includes an interaction request for an intelligent assistant, it is determined that the interaction target of the first interaction information is the intelligent assistant.

[0156] The above steps 2001 to 2004 are similar to the above steps 401 to 404, and will not be described in detail in this embodiment of the present disclosure.

[0157] 2005. The terminal performs semantic recognition on the first interaction information to obtain a semantic recognition result of the first interaction information.

[0158] This process is the same as the above step 405, and will not be described in detail in this embodiment of the present disclosure.

[0159] 2006. If the semantic recognition result of the first interactive information indicates to search for a related collection of multimedia resources, the terminal searches for the related collection of multimedia resources according to the semantic recognition result of the first interactive information to obtain search results.

[0160] Among them, the related collection of multimedia resources is a video collection or a picture collection related to the multimedia resources, etc., which is not limited in the embodiments of the present disclosure.

[0161] In an embodiment of the present disclosure, if the semantic recognition result of the first interactive information indicates that the target function corresponding to the first interactive information is a search function, and the operation information corresponding to the search function indicates a related collection of multimedia resources, then the semantic recognition result indicates searching for a related collection of multimedia resources. The terminal uses the text description of the multimedia resource as a search term to search, and uses the collection obtained by the search as a related collection of multimedia resources to obtain search results. During the search process, for each collection, the terminal calculates the similarity between the text description of the collection and the search term, and uses the collection with a similarity greater than or equal to a similarity threshold as a related collection of multimedia resources.

[0162] 2007. The terminal displays the fourth reply information of the intelligent assistant to the first interactive information in the comment interface, and the fourth reply information includes the search results.

[0163] In the embodiment of the present disclosure, the terminal displays the fourth reply information of the intelligent assistant to the first interactive information in the comment interface in the form of a comment. The fourth reply information includes search results and text information. The method for obtaining the text information is the same as the method for obtaining the first reply information in the above step 407, and the embodiment of the present disclosure will not be repeated here. Fig.21 is an example diagram of replying to the first interaction information provided by an embodiment of the present disclosure, such as Fig.21 As shown, information 2101 is the first interaction information, and information 2102 is the fourth reply information of the intelligent assistant to the first interaction information. Information 2102 displays multiple collections 2103 obtained by the search, and the multiple collections 2103 are displayed in information 2102 in order of similarity from large to small.

[0164] In some embodiments, the fourth reply message also includes a jump control, such as Fig.21As shown in the control 2104. In response to the triggering operation of the jump control, the terminal jumps from the comment interface to the search page and displays the search results in the search page.

[0165] The interactive method provided by the embodiment of the present disclosure, for the first interactive information in the interactive interface of the multimedia resource, if it is detected that the interactive target of the first interactive information is the target object, it indicates that there is an interactive demand in the first interactive information, and then automatically operates the target function indicated by the first interactive information according to the operation information indicated by the first interactive information to achieve interaction. This method can automatically operate the target function according to the first interactive information, shorten the operation path of the target function, and improve the efficiency of human-computer interaction. By sending the first interactive information, the above process can directly view the search results for related content in the reply to the first interactive information, which not only enriches the content displayed on the interactive interface, but also saves the user from having to jump to other search interfaces to search for related content, thereby improving the efficiency of human-computer interaction.

[0166] Above Fig. 20 The interactive method shown is described by taking the search for related collections as an example. In some embodiments, the target function corresponding to the first interactive information is a search function for the follow-up of an event, knowledge or interesting terms, etc., which is not limited in the embodiments of the present disclosure. In some embodiments, the first interactive information indicates a search for a product or an order. Taking the first interactive information indicating a search for an order as an example, Fig. 22 As shown, after searching for the order, the terminal displays the intelligent assistant's reply 2201 to the first interaction information in the form of a comment in the comment interface, and the content of the reply includes a text description of the order progress and a jump link 2202 to the order page. In response to the triggering operation of the jump link, the terminal displays the corresponding order page.

[0167] In addition, the above Fig. 20 The interactive method shown is described by taking the comment interface of a multimedia resource as an example. In some embodiments, the interactive method is applied to a multimedia resource playback interface with a bullet screen display function turned on. After the terminal obtains the search results, a search control is displayed in the multimedia resource playback interface, and the search results are displayed in the search control. The search control is as follows: Fig.23 As shown in the control 2301 in the figure, the control 2301 displays the search results 2302.

[0168] Taking replying to information containing specified emotions in a comment interface of a multimedia resource as an example, the process of replying to information in an interactive interface through the interactive method provided by an embodiment of the present disclosure is explained. Fig.24 is a flow chart of an interactive method provided by an embodiment of the present disclosure, such as Fig.24 As shown, the method includes the following steps.

[0169] 2401. The terminal displays a comment interface for multimedia resources.

[0170] 2402. The terminal obtains information to be sent in response to an input operation on the comment interface.

[0171] 2403. In response to the sending operation of the information to be sent, the terminal obtains the information to be sent as first interaction information for the multimedia resource.

[0172] The above steps 2401 to 2403 are similar to the above steps 401 to 403, and will not be repeated herein in this embodiment of the present disclosure.

[0173] 2404. The terminal performs emotion recognition on the first interaction information to obtain an emotion recognition result of the first interaction information.

[0174] There are multiple ways to perform emotion recognition on the first interactive information, and the multiple emotion recognition methods are described below respectively.

[0175] In some embodiments, the terminal performs word segmentation processing on the first interaction information to obtain multiple texts corresponding to the first interaction information. For each text, the terminal matches the text with each text in the emotional text library. If there is a text identical to the text in the emotional text library, the terminal uses the identical text as the emotion recognition result of the first interaction information. The emotional text library includes texts corresponding to multiple emotions.

[0176] In some embodiments, the terminal processes the first interaction information through an emotion recognition model and outputs an emotion recognition result of the first interaction information. The emotion recognition model is a pre-trained model that can output the emotion contained in the information based on the input information.

[0177] After obtaining the emotion recognition result of the first interaction information, the terminal can use the reply function as the target function and the emotion recognition result as the operation information of the target function.

[0178] 2405. If the emotion recognition result of the first interaction information is a target result, the terminal displays an animation associated with the emotion recognition result in the comment interface based on the emotion recognition result.

[0179] The target result is a pre-set result, for example, the target recognition result is a result opposite to the emotion tag of the multimedia resource. The emotion tag of the multimedia resource may be a pre-set tag, such as a tag set by the publisher of the multimedia resource. The emotion tag of the multimedia resource may also be a tag obtained by real-time recognition, which is not limited in the embodiments of the present disclosure. The animation associated with the emotion recognition result may be a pre-set animation, or an animation generated in real time according to the emotion recognition result, which is not limited in the embodiments of the present disclosure.

[0180] In the embodiment of the present disclosure, if the emotion recognition result of the first interaction information is the target result, the terminal determines that the interaction target of the first interaction information is the intelligent assistant, and displays an animation associated with the emotion recognition result in the comment interface according to the emotion recognition result of the first interaction information to adjust the user's emotion. Fig.25 As shown, the first interactive information is "I am a little sad today", and the terminal displays a love animation in the comment interface. The above process is a possible implementation method for the terminal to display an animation associated with the emotion recognition result in the interactive interface through the reply function based on the emotion recognition result.

[0181] In some embodiments, the terminal displays multiple emotion level options in the form of comments in the comment interface based on the emotion recognition result of the first interaction information, and different emotion level options correspond to different emotion intensities. Fig.26 As shown, the comment interface displays multiple emotion level options 2601. In response to a trigger operation on any emotion level option, the terminal displays an animation corresponding to the emotion level option in the comment interface.

[0182] The interactive method provided by the embodiment of the present disclosure, for the first interactive information in the interactive interface of the multimedia resource, if it is detected that the interactive target of the first interactive information is the target object, it indicates that there is an interactive demand in the first interactive information, and then automatically operates the target function indicated by the first interactive information according to the operation information indicated by the first interactive information to achieve interaction. The method can automatically operate the target function according to the first interactive information, shorten the operation path of the target function, and improve the efficiency of human-computer interaction. The above process can automatically identify the emotions contained in the first interactive information, and give corresponding emotional feedback in the form of animation, which can improve the effectiveness of the interaction and improve the user experience.

[0183] Above Fig.24 The interactive method shown is described by taking the emotion recognition result of the first interactive information as an example that the emotion label of the multimedia resource is opposite. In some embodiments, the emotion recognition result of the first interactive information indicates that the publisher of the multimedia resource is appreciated. Fig. 27 As shown, the terminal displays an animation of falling flowers in the comment interface, and the publisher's avatar and preset dialogue are displayed in the center of the animation.

[0184] In addition, the above Fig.24 The interaction method shown is explained using the comment interface of a multimedia resource as an example. In some embodiments, the above-mentioned interaction method is applied to a multimedia resource playback interface with a barrage display function turned on. After the terminal obtains the emotion recognition result, the animation corresponding to the emotion recognition result is displayed in the multimedia resource playback interface.

[0185] Fig.28 is a structural block diagram of an interactive device provided according to an embodiment of the present disclosure. The device is used to execute the steps of the above-mentioned interactive method. Fig.28 , the interactive device includes the following modules.

[0186] The information acquisition module 2801 is configured to execute an interactive interface based on a multimedia resource and acquire first interactive information for the multimedia resource;

[0187] The function determination module 2802 is configured to determine, if the interaction target of the first interaction information is a target object, a target function corresponding to the first interaction information and operation information for the target function based on the first interaction information;

[0188] The operation module 2803 is configured to perform an interactive operation based on the target function and the operation information.

[0189] In some embodiments, the above-mentioned interaction device further includes:

[0190] The first recognition module is configured to perform recognition on the constituent elements of the first interaction information, and if the first interaction information includes the target word or the target symbol, determine that the interaction target of the first interaction information is the target object.

[0191] In some embodiments, the above-mentioned interaction device further includes:

[0192] The second recognition module is configured to perform emotion recognition on the first interaction information to obtain an emotion recognition result. If the emotion recognition result is a target result, the interaction target of the first interaction information is determined to be a target object.

[0193] In some embodiments, the target result is a result that is the opposite of the sentiment tag of the multimedia resource.

[0194] In some embodiments, the second identification module is configured to execute:

[0195] Based on the emotion recognition results, the reply function is used as the target function, and the emotion recognition results are used as the operation information of the target function.

[0196] In some embodiments, the above-mentioned interaction device further includes:

[0197] The third identification module is configured to identify the constituent elements of the first interaction information, and if the first interaction information includes a function keyword, determine that the interaction target of the first interaction information is the target object, and the function keyword indicates the target function.

[0198] In some embodiments, the third identification module is configured to execute:

[0199] The function indicated by the function keyword in the first interaction information is used as the target function, and the part of the first interaction information associated with the function keyword is used as the operation information of the target function.

[0200] In some embodiments, the function determination module 2802 is configured to execute:

[0201] Based on the first interaction information, determining a target function corresponding to the first interaction information;

[0202] Based on the target function, display at least one operation control corresponding to the target function;

[0203] In response to a triggering operation on any one of the at least one operation controls, operation information corresponding to any one of the operation controls is determined as operation information for a target function.

[0204] In some embodiments, the target function is a first multimedia playback function, the operation information indicates a start operation, and the operation module 2803 is configured to execute:

[0205] The interactive interface after the first multimedia playback function is enabled is displayed.

[0206] In some embodiments, the target function is a second multimedia playback function, the operation information indicates a setting target for the second multimedia playback function, and the operation module 2803 is configured to execute:

[0207] The interactive interface after adjusting the second multimedia playback function to the set target is displayed.

[0208] In some embodiments, the target function is a storage function, the operation information indicates the content to be stored, and the operation module 2803 is configured to execute:

[0209] Obtain the content to be stored through the storage function;

[0210] The content to be stored is stored.

[0211] In some embodiments, the operation module 2803 is further configured to execute:

[0212] The content to be stored is displayed in the interactive interface.

[0213] In some embodiments, the operation module 2803 is further configured to execute:

[0214] The content to be stored is displayed in the comment window of the interactive interface, and the comment window is used to post comments;

[0215] In response to a sending operation on the content to be stored, the content to be stored is sent in the interactive interface.

[0216] In some embodiments, the target function is a search function, the operation information indicates the search content indicated by the first interaction information, and the operation module 2803 includes:

[0217] A search unit, configured to perform a search on the search content indicated by the first interaction information through a search function;

[0218] The display unit is configured to display the search results in the interactive interface.

[0219] In some embodiments, the display unit is configured to perform:

[0220] Display jump controls in the interactive interface;

[0221] In response to the triggering operation of the jump control, the search results are displayed.

[0222] In some embodiments, the target function is a reply function, the operation information indicates the emotion recognition result of the first interaction information, and the operation module 2803 is configured to execute:

[0223] Through the reply function, based on the emotion recognition results, animations associated with the emotion recognition results are displayed in the interactive interface.

[0224] In some embodiments, the above-mentioned interaction device further includes:

[0225] The display module is configured to be executed in the interactive interface and display information on the completion of the interactive operation.

[0226] In some embodiments, the display module is configured to execute:

[0227] In the interaction interface, second interaction information is displayed, the second interaction information is the target object's reply to the first interaction information, and the second interaction information indicates that the interaction operation is completed.

[0228] It should be noted that: when the device provided in the above embodiment interacts, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiment belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0229] Fig.29It is a schematic diagram of the structure of a terminal provided by an embodiment of the present disclosure. The terminal 2900 may have relatively large differences due to different configurations or performances, and may include one or more CPUs (Central Processing Units, processors) 2901 and one or more memories 2902, wherein the memory 2902 stores at least one computer program, and the at least one computer program is loaded and executed by the processor 2901 to implement the interaction methods provided by the above-mentioned various method embodiments. Of course, the terminal may also have components such as a wired or wireless network interface, a keyboard, and an input and output interface for input and output. The terminal may also include other components for implementing device functions, which will not be repeated here.

[0230] The embodiment of the present disclosure also provides a computer-readable storage medium, in which at least one computer program is stored, and the at least one computer program is loaded and executed by the processor of the terminal to implement the operation performed by the terminal in the interaction method of the above embodiment. For example, the computer-readable storage medium can be ROM (Read-Only Memory), RAM (Random Access Memory), CD-ROM (Compact Disc Read-Only Me mory), magnetic tape, floppy disk and optical data storage device, etc.

[0231] In some embodiments, the computer program involved in the embodiments of the present disclosure may be deployed and executed on one terminal, or on multiple terminals located at one location, or on multiple terminals distributed at multiple locations and interconnected by a communication network. Multiple terminals distributed at multiple locations and interconnected by a communication network may constitute a blockchain system.

[0232] The embodiment of the present disclosure also provides a computer program product or a computer program, which includes at least one program segment, and the at least one program segment is stored in a computer-readable storage medium. The processor of the terminal reads the at least one program segment from the computer-readable storage medium, and the processor executes the at least one program segment, so that the terminal executes the interaction method provided in the above various optional implementations.

[0233] A person skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware or by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, and the above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0234] The above description is only an optional embodiment of the present disclosure and is not intended to limit the present disclosure. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present disclosure shall be included in the protection scope of the present disclosure.

Claims

1. An interactive method, characterized in that: The method comprises: Based on the interactive interface of the multimedia resource, obtaining first interactive information for the multimedia resource; If the interaction target of the first interaction information is a target object, determining, based on the first interaction information, a target function corresponding to the first interaction information and operation information for the target function; Based on the target function and the operation information, an interactive operation is performed.

2. The interactive method according to claim 1, characterized in that: The method further comprises: The constituent elements of the first interactive information are identified, and if the first interactive information includes a target word or a target symbol, the interactive target of the first interactive information is determined to be a target object.

3. The interactive method according to claim 1, characterized in that: The method further comprises: Emotion recognition is performed on the first interaction information to obtain an emotion recognition result. If the emotion recognition result is a target result, the interaction target of the first interaction information is determined to be a target object.

4. The interactive method according to claim 3, characterized in that: The target result is a result opposite to the emotion label of the multimedia resource.

5. The interactive method according to claim 3, characterized in that: The determining, based on the first interaction information, a target function corresponding to the first interaction information and operation information for the target function includes: Based on the emotion recognition result, a reply function is used as the target function, and the emotion recognition result is used as operation information of the target function.

6. The interactive method according to claim 1, characterized in that: The method further comprises: The constituent elements of the first interaction information are identified, and if the first interaction information includes a function keyword, an interaction target of the first interaction information is determined to be a target object, and the function keyword indicates the target function.

7. The interactive method according to claim 6, characterized in that: The determining, based on the first interaction information, a target function corresponding to the first interaction information and operation information for the target function includes: The function indicated by the function keyword in the first interaction information is used as the target function, and the part of the first interaction information associated with the function keyword is used as operation information of the target function.

8. The interactive method according to claim 1, characterized in that: The determining, based on the first interaction information, a target function corresponding to the first interaction information and operation information for the target function includes: Determining, based on the first interaction information, a target function corresponding to the first interaction information; Based on the target function, display at least one operation control corresponding to the target function; In response to a triggering operation on any one of the at least one operation controls, the operation information corresponding to the any one operation control is determined as the operation information for the target function.

9. The interactive method according to claim 1, characterized in that: The target function is a first multimedia playback function, the operation information indicates a start operation, and the performing of the interactive operation based on the target function and the operation information includes: The interactive interface after enabling the first multimedia playback function is displayed.

10. The interactive method according to claim 1, characterized in that: The target function is a second multimedia playback function, the operation information indicates a setting target for the second multimedia playback function, and the performing the interactive operation based on the target function and the operation information includes: An interactive interface after adjusting the second multimedia playback function to the set target is displayed.

11. The interactive method according to claim 1, characterized in that: The target function is a storage function, the operation information indicates content to be stored, and the performing of the interactive operation based on the target function and the operation information includes: Obtaining the content to be stored through the storage function; The content to be stored is stored.

12. The interactive method according to claim 11, characterized in that: The method further comprises: The content to be stored is displayed in the interactive interface.

13. The interactive method according to claim 11, characterized in that: The method further comprises: Displaying the content to be stored in a comment window of the interactive interface, wherein the comment window is used to post comments; In response to an operation of sending the content to be stored, the content to be stored is sent in the interactive interface.

14. The interactive method according to claim 1, characterized in that: The target function is a search function, the operation information indicates the search content indicated by the first interaction information, and the performing the interaction operation based on the target function and the operation information includes: Searching, by using the search function, for the search content indicated by the first interaction information; The search results are displayed in the interactive interface.

15. The interactive method according to claim 14, characterized in that: Displaying search results in the interactive interface includes: Displaying a jump control in the interactive interface; In response to a triggering operation on the jump control, the search results are displayed.

16. The interactive method according to claim 1, characterized in that: The target function is a reply function, the operation information indicates an emotion recognition result of the first interaction information, and the performing the interaction operation based on the target function and the operation information includes: Through the reply function, based on the emotion recognition result, an animation associated with the emotion recognition result is displayed in the interactive interface.

17. The interactive method according to claim 1, characterized in that: The method further comprises: In the interactive interface, information indicating that the interactive operation is completed is displayed.

18. The interactive method according to claim 17, characterized in that: In the interactive interface, the information showing that the interactive operation is completed includes: In the interaction interface, second interaction information is displayed, where the second interaction information is a reply of the target object to the first interaction information, and the second interaction information indicates that the interaction operation is completed.

19. An interactive device, characterized in that: The device comprises: An information acquisition module is configured to execute an interactive interface based on a multimedia resource and acquire first interactive information for the multimedia resource; a function determination module, configured to determine, if the interaction target of the first interaction information is a target object, a target function corresponding to the first interaction information and operation information for the target function based on the first interaction information; The operation module is configured to perform an interactive operation based on the target function and the operation information.

20. A terminal, characterized in that: The terminal comprises a processor and a memory, wherein the memory is used to store at least one computer program, and the at least one computer program is loaded by the processor to execute the method according to any one of claims 1 to 18.

21. A computer-readable storage medium, characterized in that: The computer-readable storage medium is used to store at least one computer program, and the at least one computer program is used to execute the method according to any one of claims 1 to 18.

22. A computer program product comprising a computer program, characterized in that When the computer program is executed by a processor, the method according to any one of claims 1 to 18 is implemented.

Citation Information

Patent Citations

  • Intelligent interaction method and device and storage medium

    CN107832286A

  • Information search processing method and device, equipment, storage medium and program product

    CN113987221A

  • Resource recommendation method and device, computer equipment and medium

    CN113987326A

  • Smart home interaction method and device based on Internet of Things

    CN114743554A

  • Interactive information processing method and device, electronic equipment and storage medium

    CN116820306A