Interaction method, apparatus, terminal and storage medium
By automatically identifying and executing interactive information in the interactive interface of multimedia resources, the problem of cumbersome interaction processes in existing technologies is solved, and efficient human-computer interaction is achieved.
Patent Information
- Application Number
- CN202410940443.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-12
- Publication Date
- 2026-01-23
- Estimated Expiration
- 2044-07-12
AI Technical Summary
In existing technologies, the interaction process between users and applications is cumbersome and the efficiency of human-computer interaction is low, especially when setting up functions through text messages, which requires users to manually perform multiple steps.
By obtaining the first interactive information from the interactive interface of multimedia resources, the system automatically identifies the interactive target and operation information, and directly executes the operation of the target function, thus shortening the operation path.
It improves the efficiency of human-computer interaction, simplifies the user operation process, and enables users to quickly complete the operation of the target function by automatically recognizing and executing interactive information.
Smart Images

Figure CN118939163B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present disclosure relates to the technical field of computer, and particularly relates to an interaction method and device, a terminal and a storage medium. BACKGROUND
[0002] With the development of computer technology, the ways of interaction between users and applications are more and more diversified. Through the interaction between users and applications, users can realize operations such as setting the functions of the applications, making the terminal display the content required by the users to display, or providing emotional feedback to the users.
[0003] At present, one interaction method is to provide an artificial intelligence assistant in an application. In a comment interface of the application, users and the artificial intelligence assistant realize interaction by exchanging text messages. Taking the setting of the functions of the application as an example, in the comment interface of the application, the user sends a text message to the artificial intelligence assistant to indicate that the user wants to start a certain function of the application. The artificial intelligence assistant replies to the user by a text message according to the text message sent by the user, and the user manually starts the corresponding function according to the starting mode.
[0004] In the above method, after the user receives the text message sent by the artificial intelligence assistant, the user understands the text message, and then realizes the above operations after executing the steps indicated by the text message. The interaction process is relatively cumbersome, and the human-computer interaction efficiency is relatively low. SUMMARY
[0005] The embodiments of the present disclosure provide an interaction method, device, terminal and storage medium, which are used for improving the interaction efficiency. The technical solutions are as follows.
[0006] In a first aspect, an interaction method is provided. The method comprises: obtaining first interaction information for a multimedia resource based on an interaction interface of the multimedia resource; if an interaction target of the first interaction information is a target object, determining a target function corresponding to the first interaction information and operation information for the target function based on the first interaction information; and performing an interaction operation based on the target function and the operation information.
[0007] The interaction method provided by the embodiments of the present disclosure can automatically operate the target function according to the first interaction information if it is detected that the interaction target of the first interaction information in the interaction interface of the multimedia resource is the target object, which indicates that there is an interaction demand in the first interaction information, and then the target function indicated by the first interaction information is operated according to the operation information indicated by the first interaction information to realize the interaction. The method can automatically operate the target function according to the first interaction information, shorten the operation path of the target function, and improve the human-computer interaction efficiency.
[0008] In some embodiments, the interaction method further includes: identifying the component elements of the first interaction information, and determining that the interaction target of the first interaction information is the target object if the first interaction information includes a target word or a target symbol.
[0009] In some embodiments, the interaction method further includes: performing sentiment recognition on the first interaction information to obtain a sentiment recognition result, and determining that the interaction target of the first interaction information is the target object if the sentiment recognition result is a target result.
[0010] In some embodiments, the target result is a result opposite to a sentiment label of the multimedia resource.
[0011] In some embodiments, the determining, based on the first interaction information, of the target function corresponding to the first interaction information and operation information for the target function includes: based on the sentiment recognition result, taking a reply function as the target function and taking the sentiment recognition result as the operation information for the target function.
[0012] In some embodiments, the interaction method further includes: identifying the component elements of the first interaction information, and determining that the interaction target of the first interaction information is the target object if the first interaction information includes a function keyword, the function keyword indicating the target function.
[0013] In some embodiments, the determining, based on the first interaction information, of the target function corresponding to the first interaction information and operation information for the target function includes: taking a function indicated by a function keyword in the first interaction information as the target function, and taking a part of the first interaction information associated with the function keyword as the operation information for the target function.
[0014] In some embodiments, the determining, based on the first interaction information, of the target function corresponding to the first interaction information and operation information for the target function includes: determining, based on the first interaction information, the target function corresponding to the first interaction information; displaying at least one operation control corresponding to the target function based on the target function; and determining, in response to a triggering operation on any operation control of the at least one operation control, operation information corresponding to the any operation control as the operation information for the target function.
[0015] In some embodiments, the target function is a first multimedia playing function, and the operation information indicates an opening operation, and the performing, based on the target function and the operation information, of the interaction operation includes: displaying an interaction interface after the first multimedia playing function is opened.
[0016] In some embodiments, the target function is a second multimedia playing function, the operation information indicates a setting target for the second multimedia playing function, and the executing the interactive operation based on the target function and the operation information includes displaying an interactive interface in which the second multimedia playing function is adjusted to the setting target.
[0017] In some embodiments, the target function is a storage function, and the operation information indicates content to be stored. The executing the interactive operation based on the target function and the operation information includes obtaining the content to be stored by using the storage function and storing the content to be stored.
[0018] In some embodiments, the method further includes displaying the content to be stored in the interactive interface.
[0019] In some embodiments, the method further includes displaying the content to be stored in a comment window of the interactive interface, and the comment window is used to publish a comment. In response to a sending operation on the content to be stored, the content to be stored is sent in the interactive interface.
[0020] In some embodiments, the target function is a search function, and the operation information indicates search content indicated by the first interactive information. The executing the interactive operation based on the target function and the operation information includes searching the search content indicated by the first interactive information by using the search function and displaying a search result in the interactive interface.
[0021] In some embodiments, the displaying the search result in the interactive interface includes displaying a jump control in the interactive interface, and in response to a triggering operation on the jump control, the search result is displayed.
[0022] In some embodiments, the target function is a reply function, and the operation information indicates a sentiment recognition result of the first interactive information. The executing the interactive operation based on the target function and the operation information includes displaying an animation associated with the sentiment recognition result in the interactive interface by using the reply function based on the sentiment recognition result.
[0023] In some embodiments, the method further includes displaying information that the interactive operation is completed in the interactive interface.
[0024] In some embodiments, the displaying the information that the interactive operation is completed in the interactive interface includes displaying second interactive information in the interactive interface, the second interactive information is a reply of a target object to the first interactive information, and the second interactive information indicates that the interactive operation is completed.
[0025] In a second aspect, an interaction device is provided, which includes: an information obtaining module configured to execute a multimedia resource based interaction interface, and obtain first interaction information for the multimedia resource; a function determining module configured to, if an interaction target of the first interaction information is a target object, determine a target function corresponding to the first interaction information and operation information for the target function based on the first interaction information; and an operation module configured to execute an interaction operation based on the target function and the operation information.
[0026] In a third aspect, a terminal is provided, which includes a processor and a memory, the memory being configured to store at least one piece of computer program, the at least one piece of computer program being loaded and executed by the processor to implement the operations performed by the interaction method provided in the first aspect or various optional implementation manners of the first aspect.
[0027] In a fourth aspect, a computer readable storage medium is provided, which stores at least one piece of computer program, the at least one piece of computer program being loaded and executed by a processor to implement the operations performed by the interaction method provided in the first aspect or various optional implementation manners of the first aspect.
[0028] In a fifth aspect, a computer program product or computer program is provided, which includes at least one piece of program stored in a computer readable storage medium, a processor of a terminal reads the at least one piece of program from the computer readable storage medium, and the processor executes the at least one piece of program to enable the terminal to perform the operations performed by the interaction method provided in the first aspect or various optional implementation manners of the first aspect.
[0029] On the basis of the implementation manners provided in the above aspects, the present disclosure can be further combined to provide more implementation manners. BRIEF DESCRIPTION OF DRAWINGS
[0030] In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present disclosure, and other drawings can be obtained by those skilled in the art without creative effort based on these drawings.
[0031] Figure 1 is a schematic diagram of an implementation environment of an interaction method provided by an embodiment of the present disclosure;
[0032] Figure 2 is a flowchart of an interaction method provided by an embodiment of the present disclosure;
[0033] Figure 3 is an example diagram of an interactive interface provided by an embodiment of the present disclosure;
[0034] Figure 4 is a flowchart of another interactive method provided by an embodiment of the present disclosure;
[0035] Figure 5 is an example diagram of an input window provided by an embodiment of the present disclosure;
[0036] Figure 6 is an example diagram of comment information display provided by an embodiment of the present disclosure;
[0037] Figure 7 is an example diagram of barrage information display provided by an embodiment of the present disclosure;
[0038] Figure 8 is a flowchart of another interactive method provided by an embodiment of the present disclosure;
[0039] Figure 9 is an example diagram of replying to first interactive information provided by an embodiment of the present disclosure;
[0040] Figure 10 is an example diagram of a setting interface of a comment shielding function provided by an embodiment of the present disclosure;
[0041] Figure 11 is an example diagram of an adjustment window provided by an embodiment of the present disclosure;
[0042] Figure 12 is an example diagram of another barrage information display provided by an embodiment of the present disclosure;
[0043] Figure 13 is a flowchart of another interactive method provided by an embodiment of the present disclosure;
[0044] Figure 14 is an example diagram of storage progress display provided by an embodiment of the present disclosure;
[0045] Figure 15 is an example diagram of replying to first interactive information provided by an embodiment of the present disclosure;
[0046] Figure 16 is an example diagram of replying to first interactive information provided by an embodiment of the present disclosure;
[0047] Figure 17 is an example diagram of another input window provided by an embodiment of the present disclosure;
[0048] Figure 18 is an example diagram of replying to first interactive information provided by an embodiment of the present disclosure;
[0049] Figure 19 FIG. 1 is an example diagram of a picture selection control provided by an embodiment of the present disclosure;
[0050] Figure 20 FIG. 2 is a flowchart of another interaction method provided by an embodiment of the present disclosure;
[0051] Figure 21 FIG. 3 is an example diagram of replying to first interaction information provided by an embodiment of the present disclosure;
[0052] Figure 22 FIG. 4 is an example diagram of replying to first interaction information provided by an embodiment of the present disclosure;
[0053] Figure 23 FIG. 5 is an example diagram of a search control provided by an embodiment of the present disclosure;
[0054] Figure 24 FIG. 6 is a flowchart of another interaction method provided by an embodiment of the present disclosure;
[0055] Figure 25 FIG. 7 is an example diagram of animation display provided by an embodiment of the present disclosure;
[0056] Figure 26 FIG. 8 is an example diagram of an emotion level option provided by an embodiment of the present disclosure;
[0057] Figure 27 FIG. 9 is an example diagram of another animation display provided by an embodiment of the present disclosure;
[0058] Figure 28 FIG. 10 is a structural block diagram of an interaction device provided by an embodiment of the present disclosure;
[0059] Figure 29 FIG. 11 is a structural schematic diagram of a terminal provided by an embodiment of the present disclosure. DETAILED DESCRIPTION
[0060] In order to make the purpose, technical solutions and advantages of the present disclosure clearer, the embodiments of the present disclosure will be further described in detail below with reference to the drawings.
[0061] In the present disclosure, the terms "first", "second", and the like are used to distinguish the same items or similar items with basically the same function and action, and it should be understood that there is no logical or time sequence dependency between "first", "second", and "nth", and the number and execution order are not limited.
[0062] In the present disclosure, the term "at least one" means one or more, and the meaning of "multiple" is two or more.
[0063] It should be noted that the information (including but not limited to user device information, user personal information, etc.), data (including but not limited to data for analysis, stored data, displayed data, etc.) and signals involved in the present disclosure are all authorized by the user or fully authorized by all parties, and the collection, use and processing of related data need to comply with relevant laws, regulations and standards of relevant countries and regions. For example, the interaction information involved in the present disclosure is obtained under full authorization.
[0064] Figure 1 is an implementation environment schematic diagram of an interaction method provided by an embodiment of the present disclosure, as shown in Figure 1 The implementation environment includes a terminal 101 and a server 102, and the terminal 101 and the server 102 are connected through a wireless network or a wired network. Figure 1 In the embodiment, the number of terminals and servers is only an example, for example, the number of terminals and servers can be multiple, and the embodiment of the present disclosure does not limit this.
[0065] The terminal 101 is a smart phone, a tablet computer, a notebook computer, a desktop computer, a smart speaker, a smart watch, a smart voice interaction device, a smart home appliance, a vehicle-mounted terminal, etc., but is not limited thereto. The server 102 is an independent physical server, and can also be a server cluster or a distributed system composed of multiple physical servers, and can also be a cloud server providing cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN (Content Delivery Network), big data and artificial intelligence platforms, and other basic cloud computing services.
[0066] In some embodiments, an application program is installed and run on the terminal 101, the application program has an interaction function, and can be a social application program, a multimedia resource playing application program or a conference application program, etc. The user can realize the functions of publishing comments or publishing bullet screens through the application program, and in the interaction process, the terminal 101 obtains interaction information through the application program, identifies the interaction information, replies to the interaction information according to the identification result, or performs the operation indicated by the identification result. In other embodiments, the server 102 is used to provide background services for the application program, and in the interaction process, the terminal 101 obtains interaction information through the application program, sends the interaction information to the server 102, the server 102 processes the interaction information received from the terminal 101, adjusts the services for the terminal 101 according to the processing result, or replies to the terminal 101 according to the processing result.
[0067] Figure 2 is a flowchart of an interaction method provided by an embodiment of the present disclosure, as shown in Figure 2As shown, the method comprises the following steps.
[0068] 201. The terminal acquires first interaction information for the multimedia resource based on an interaction interface of the multimedia resource.
[0069] The multimedia resource is a video, an audio or a text image, and the embodiments of the present disclosure do not make a limitation in this regard. The interaction interface of the multimedia resource is used to display information published for the multimedia resource, and the displayed information is comment information or a barrage information. Accordingly, the interaction interface is a comment interface of the multimedia resource or a multimedia resource playing interface with a barrage display function, and the embodiments of the present disclosure do not make a limitation in this regard. Taking the interaction interface as the comment interface of the multimedia resource as an example, Figure 3 is an example diagram of an interaction interface provided by the embodiments of the present disclosure, as Figure 3 As shown, the interaction interface displays a multimedia resource playing area 301, a comment area 302 and an input box 303. The multimedia resource playing area 301 is used to display the multimedia resource, the comment area 302 is used to display information received by the terminal and information sent by the terminal, and the input box 303 is used to acquire information to be sent. The first interaction information is information sent by the terminal through the interaction interface. The display form of the first interaction information is related to the interaction interface. For example, the interaction interface is a comment interface of the multimedia resource, and the first interaction information is displayed in the form of a comment in the interaction interface. The interaction interface is a multimedia resource playing interface with a barrage display function, and the first interaction information is displayed in the form of a barrage in the interaction interface. The content of the first interaction information can be any content conforming to the regulation of the interaction interface. For example, the content of the first interaction information indicates to adjust the playing of the multimedia resource, to adjust the display of the interaction interface or to save the multimedia resource being played. The content of the first interaction information can also be an emotional expression or a demand expression of the user. The emotional expression reflects the emotion of the user. For example, the emotional expression "I am very happy today" reflects that the emotion of the user is relatively positive. The demand expression indicates the demand of the user. For example, the demand expression "help me to appreciate this author" indicates that the demand of the user is to appreciate the author. Of course, the content of the first interaction information can also be other content, and the embodiments of the present disclosure do not make a limitation in this regard.
[0070] In the embodiments of the present disclosure, in the interaction interface of the multimedia resource, the terminal acquires the sent information as the first interaction information for the multimedia resource in response to the sending operation of the information.
[0071] 202. If the interaction target of the first interaction information is a target object, the terminal determines a target function corresponding to the first interaction information and operation information for the target function based on the first interaction information.
[0072] The interaction target of the first interaction information refers to an interaction object of the first interaction information. The type of the interaction object includes multiple types, such as an information interaction object, an intelligent assistant provided by an interaction interface, a publisher of a multimedia resource, and an account (a friend account or a follow account, etc.) associated with an account currently playing the multimedia resource, and the like. The present embodiment of the present disclosure does not limit this. The target object is a pre-set interaction object, which can belong to any of the above interaction object types. The target function includes multiple functions, such as a multimedia resource playing function, a storage function, a search function, and a reply function, and the like. The multimedia resource playing function is a function related to the playing mode or playing content of the multimedia resource, such as a barrage function, an automatic continuous playing function, a small window playing function, a speed playing function, a display dark background function, a screen clearing function, a mute function, a watch later function, a barrage running speed adjusting function, a multimedia resource playing speed adjusting function, a font size adjusting function, a multimedia resource recommendation function, and a comment shielding function, and the like. The storage function is a function of storing specified content, such as a multimedia resource downloading function, a script extracting function, a screenshot function, and a screenshot comment function, and the like. The search function is a function of searching for related content, such as a related multimedia resource search function, a related keyword search function, and a related commodity or order search function, and the like. The reply function is a function of replying to the information sent by the sending operation, such as emotional feedback to the information sent by the sending operation and a dialogue based on the information sent by the sending operation, and the like. The operation information for the target function indicates an operation to be performed on the target function. For example, the operation information can be an operation verb such as turning on, turning off, turning up, turning down, turning fast, turning slow, and the like. It can also be a prompt information such as content to be stored, content to be searched, content to be shielded, and an emotional recognition result of the information, and the like. The present embodiment of the present disclosure does not limit this.
[0073] In some embodiments, the terminal performs regular matching on the first interaction information according to the target object. If the result of the regular matching indicates that the first interaction information includes the target object, the interaction target of the first interaction information is the target object. The terminal identifies the first interaction information to determine the target function corresponding to the first interaction information and the operation information for the target function from the first interaction information. The process of identifying the first interaction information by the terminal can be a word segmentation process of the first interaction information, to obtain a plurality of texts corresponding to the first interaction information. The terminal matches the plurality of texts with texts in a function text library respectively, and takes the function indicated by the matching result as the target function corresponding to the first interaction information. The terminal matches the plurality of texts with texts in an operation text library respectively, and takes the operation information indicated by the matching result as the operation information for the target function. The function text library includes texts corresponding to multiple functions, and the operation text library includes texts corresponding to multiple operations.
[0074] 203、The terminal performs an interaction operation based on the target function and the operation information.
[0075] In the embodiments of the present disclosure, the terminal performs an operation indicated by the operation information on the target function according to the operation information, so as to realize the interactive operation. For example, the target function is a barrage function, and the operation information is to start, and the terminal starts the barrage function in the interactive interface.
[0076] The interactive method provided by the embodiments of the present disclosure can detect that the interactive target of the first interactive information in the interactive interface of the multimedia resource is a target object, which indicates that there is an interactive appeal in the first interactive information, and then automatically perform an operation on a target function indicated by the first interactive information according to operation information indicated by the first interactive information, so as to realize the interaction. The method can automatically perform an operation on the target function according to the first interactive information, shorten the operation path of the target function, and improve the human-computer interaction efficiency.
[0077] Through the above Figure 2 The terminal can realize various interactive operations in the interactive interface of the multimedia resource through the interactive method shown in Figure 2 For example, the interactive method shown in Figure 2 The processes of realizing the above various interactive operations through the interactive method shown in
[0078] For example, the process of starting or closing a specified multimedia resource playing function in the interactive interface through the above interactive method is described by taking starting a barrage function in a comment interface of a multimedia resource as an example. Figure 4 is a flowchart of an interactive method provided by the embodiments of the present disclosure, as shown in Figure 4 The method includes the following steps.
[0079] 401. The terminal displays a comment interface of a multimedia resource.
[0080] The comment interface of the multimedia resource is as shown in the above Figure 3 The comment interface is used to display comments received by the terminal for the multimedia resource and comments sent by the terminal for the multimedia resource. For example, the comment interface is a comment area of a certain short video, and the comment area is used to display comments for the short video.
[0081] In the embodiments of the present disclosure, the terminal displays a comment control in a playing interface of a multimedia resource, and displays a comment interface of the multimedia resource in response to a trigger operation on the comment control.
[0082] 402、the terminal acquires the information to be sent in response to the input operation on the comment interface.
[0083] In the embodiments of the present disclosure, as shown in Figure 3 The comment interface displays an input box, and the terminal displays an input window in the comment interface in response to a triggering operation on the input box, and acquires the information input by the input operation on the input window as the information to be sent. As shown in Figure 5 The input window 501 displays an input box 502 and a keyboard area 503, the input box 502 is used to display the information input by the input operation, and the keyboard area 503 is used to receive the input operation.
[0084] 403、the terminal acquires the first interaction information for the multimedia resource in response to a sending operation on the information to be sent.
[0085] The sending operation is triggered by a sending control in the input window, as shown by the control 504 in Figure 5 .
[0086] In the embodiments of the present disclosure, the terminal displays the information to be sent corresponding to the triggering operation of the sending control in the comment interface, and acquires the sent information as the first interaction information for the multimedia resource. The display of the information to be sent corresponding to the triggering operation of the sending control in the comment interface means that the information to be sent is displayed in the form of a comment in the comment interface, for example, the information 601 is displayed in the form of a comment in the comment interface as shown in Figure 6 .
[0087] The steps 401 to 403 above are a possible implementation of the terminal acquiring the first interaction information for the multimedia resource based on the interaction interface of the multimedia resource. The implementation acquires the information sent on the interaction interface as the first interaction information, can respond to the information sent by the user in real time, and improves the timeliness of the interaction.
[0088] 404、the terminal identifies the constituent elements of the first interaction information, and if the first interaction information includes an interaction request for the intelligent assistant, determines that the interaction target of the first interaction information is the intelligent assistant.
[0089] The intelligent assistant is also the target object in the embodiments of the present disclosure. The constituent elements of the first interaction information indicate the content contained in the first interaction information. For example, the first interaction information is "@XXX, turn on the bullet screen function", and the constituent elements of the first interaction information are "@", "X", "X",..., "gong", and "neng". The constituent elements of the first interaction information include at least one of a symbol element, a word element, and a number element, and the embodiments of the present disclosure do not limit this. The interaction request for the intelligent assistant is composed of a preset symbol and the name of the intelligent assistant. For example, the preset symbol is "@", and the name of the intelligent assistant is "XXX", and the interaction request for the intelligent assistant is "@XXX". Of course, the interaction request for the intelligent assistant can only include the name of the intelligent assistant, and the embodiments of the present disclosure do not limit this. In some embodiments, if the first interaction information includes a preset word, a preset symbol, or a function keyword, the terminal can also determine that the interaction target of the first interaction information is the intelligent assistant, and the embodiments of the present disclosure do not limit this. The function keyword is related to a function, and can be the name of the function, and the embodiments of the present disclosure do not limit this.
[0090] In the embodiments of the present disclosure, the terminal identifies the constituent elements of the first interaction information by a regular matching method to identify the interaction request for the intelligent assistant from the first interaction information. If the interaction request for the intelligent assistant is identified, it is determined that the interaction target of the first interaction information is the intelligent assistant. The process of identifying the interaction request from the first interaction information includes at least one round of identification process, and each round of identification process includes at least one identification. In the first identification process of the first round of identification, the terminal matches the first character in the first interaction information with the first character in the interaction request. If the character is different from the first character in the interaction request, the terminal matches the next character in the first interaction information with the first character in the interaction request to perform the next identification. If the character is the same as the first character in the interaction request, the terminal matches the next character in the first interaction information with the next character in the interaction request to perform the next identification. The subsequent identification processes of the first round of identification are performed in this way. In one identification process of the first round of identification, if the character corresponding to the identification in the first interaction information is different from the character corresponding to the identification in the interaction request, the terminal performs the second round of identification process, that is, the terminal starts from the second character in the first interaction information, and re-executes the process of identifying the interaction request from the first interaction information. The subsequent identification processes are performed in this way.
[0091] The above process is described by taking the terminal performing regular matching on the first interaction information as an example, and can ensure that no interaction request is missed in the identification process. In some embodiments, the terminal performs word segmentation on the first interaction information to obtain a plurality of texts corresponding to the first interaction information. For each text, the terminal performs regular matching on the text to identify the constituent elements of the first interaction information. If there is a text including an interaction request to the intelligent assistant, it is determined that the interaction target of the first interaction information is the intelligent assistant. This process of performing regular matching after word segmentation on the first interaction information can improve the identification efficiency of the first interaction information.
[0092] This step 404 is the terminal identifying the constituent elements of the first interaction information, and if the first interaction information includes a target word or a target symbol, it is determined that the interaction target of the first interaction information is a possible implementation of the target object. By determining the interaction target of the first interaction information, the interaction can be more targeted, the interaction can be more realistic, and the user experience can be optimized. In some embodiments, if the first interaction information does not include an interaction request to the intelligent assistant, it indicates that the interaction target of the first interaction information is not the intelligent assistant, and the terminal can choose not to perform the subsequent steps.
[0093] It should be noted that this step 404 is an optional step, and in some embodiments, the terminal can identify the constituent elements of the first interaction information by the following step 405, and if the first interaction information includes a function keyword, it is determined that the interaction target of the first interaction information is the target object. The function keyword indicates the target function, and this possible implementation can effectively reduce the interaction steps and improve the interaction efficiency.
[0094] 405. The terminal performs semantic recognition on the first interaction information to obtain a semantic recognition result of the first interaction information.
[0095] The semantic recognition result of the first interaction information includes the target function corresponding to the first interaction information and the operation information for the target function. There are multiple ways for the terminal to perform semantic recognition on the first interaction information to obtain the semantic recognition result, and the multiple semantic recognition ways are described below.
[0096] In some embodiments, the terminal performs word segmentation on the first interaction information to obtain a plurality of texts corresponding to the first interaction information, and performs semantic recognition on the plurality of texts to obtain a semantic recognition result of the first interaction information. The process of performing semantic recognition on the plurality of texts includes two steps. The first step includes: for each text, the terminal matches the text with each text in the first function text library, and if there is a same text in the first function text library, the terminal takes the function indicated by the same text as the target function corresponding to the first interaction information. The second step includes: for each text, the terminal matches the text with each text in the first operation text library, and if there is a same text in the first operation text library, the terminal takes the operation information indicated by the same text as the operation information for the target function. The terminal can first perform the first step and then perform the second step, or first perform the second step and then perform the first step. The execution order of the two steps is not limited in the embodiments of the present disclosure. The process not only identifies the target function corresponding to the first interaction information, but also identifies the operation information of the target function, which can improve the accuracy of the obtained semantic recognition result. In some embodiments, the matching process in the two steps is the same as the process of identifying the constituent elements of the first interaction information in step 403, which will not be described here again.
[0097] In some embodiments, after the terminal obtains the target function corresponding to the first interaction information through the first step, the terminal takes the text at a specified position in the plurality of texts as the operation information of the target function. For example, after the terminal identifies the text corresponding to the target function of the first interaction information, the terminal takes the text adjacent to the text corresponding to the target function as the operation information of the target function. This process is a possible implementation of the terminal taking the function indicated by the function keyword in the first interaction information as the target function and taking the part associated with the function keyword in the first interaction information as the operation information of the target function. For the first interaction information with a relatively simple structure, the efficiency of semantic recognition through this way is relatively high.
[0098] In some embodiments, the terminal can also process the first interaction information through a semantic recognition model to output a semantic recognition result of the first interaction information. The semantic recognition model is a pre-trained model that can output the semantics corresponding to the input information according to the input information.
[0099] 406、If the semantic recognition result of the first interaction information indicates to turn on the barrage function, the terminal turns on the barrage function in the comment interface.
[0100] In the semantic recognition result, if the target function corresponding to the first interaction information is the barrage function, and the operation information for the target function is to start, the semantic recognition result indicates to start the barrage function, and the terminal starts the barrage function in the comment interface. As shown in Figure 6
[0101] The above process is one possible implementation of the terminal performing an interaction operation based on a target function and operation information. This possible implementation displays the comment interface after starting the barrage function, without requiring the user to perform additional operations to start the barrage function, thereby improving human-computer interaction efficiency.
[0102] 407. The terminal displays first reply information of the intelligent assistant to the first interaction information in the comment interface, and the first reply information indicates that the barrage function has been started.
[0103] In the present embodiment of the disclosure, the terminal displays the first reply information of the intelligent assistant to the first interaction information in the comment interface, as shown in Figure 6
[0104] The above process is one possible implementation of displaying information of an interaction operation execution completion in an interaction interface. In this possible implementation, the terminal displays the second interaction information in the interaction interface, and the second interaction information is a reply of a target object to the first interaction information, indicating that the interaction operation execution is completed, which can improve the interactive feeling and optimize the user experience. It should be noted that this step is optional, and the terminal can choose whether to display the reply of the intelligent assistant to the first interaction information in the comment interface.
[0105] The interaction method provided in the embodiments of the present disclosure can automatically operate the target function according to the operation information indicated by the first interaction information, shorten the operation path of the target function, and improve the human-computer interaction efficiency. The above process can automatically start the bullet screen function by sending the first interaction information, greatly shortens the operation path of the bullet screen function, and improves the human-computer interaction efficiency.
[0106] The above Figure 4 The interaction method shown in the above
[0107] In addition, the above Figure 4 The interaction method shown in the above Figure 7 The bullet screen 701 is the first interaction information, and the bullet screen 702 is the reply of the intelligent assistant to the first interaction information. Alternatively, the terminal displays a reminder control 703 in the multimedia resource playing interface, and the reminder control displays that the interaction operation has been completed.
[0108] For example, the comment shielding function is set in the comment interface of the multimedia resource, and the process of setting the specified multimedia resource playing function in the interaction interface by the interaction method provided in the embodiments of the present disclosure is described. Figure 8 is a flowchart of an interaction method provided in the embodiments of the present disclosure, as shown in the above Figure 8 The method comprises the following steps.
[0109] 801、The terminal displays a comment interface of the multimedia resource.
[0110] 802、The terminal acquires to-be-sent information in response to an input operation on the comment interface.
[0111] 803、The terminal acquires the to-be-sent information as first interaction information for the multimedia resource in response to a sending operation on the to-be-sent information.
[0112] 804、The terminal identifies a constituent element of the first interaction information, and determines that an interaction target of the first interaction information is the intelligent assistant if the first interaction information includes an interaction request for the intelligent assistant.
[0113] The steps 801 to 804 are the same as the steps 401 to 404, and thus are not described herein.
[0114] 805、The terminal performs semantic recognition on the first interaction information to obtain a semantic recognition result of the first interaction information.
[0115] In the embodiment of the disclosure, the terminal performs word segmentation processing on the first interaction information to obtain a plurality of texts corresponding to the first interaction information, and performs semantic recognition on the plurality of texts to obtain the semantic recognition result of the first interaction information. The process of performing semantic recognition on the plurality of texts includes: for each text, the terminal matches the text with each text in a second function text library, and if there is a same text as the text in the second function text library, the terminal takes a function indicated by the same text as a target function corresponding to the first interaction information. The second function text library and the first function text library described above can be the same text library or different text libraries, and the embodiment of the disclosure does not limit this.
[0116] This process is a possible implementation manner of determining the target function corresponding to the first interaction information based on the first interaction information. This possible implementation manner only identifies the target function corresponding to the first interaction information, and in the case that the operation information indicated by the first interaction information is relatively ambiguous, invalid identification of the operation information can be avoided, and the interaction efficiency is improved. In some embodiments, the terminal can also perform semantic recognition on the first interaction information according to the semantic recognition method shown in 405, and if the operation information in the first interaction information is difficult to identify, resulting in that the semantic recognition result does not include the operation information corresponding to the function, the terminal performs the subsequent steps.
[0117] 806、If the semantic recognition result of the first interaction information indicates a comment shielding function, the terminal displays second reply information of the intelligent assistant to the first interaction information in the comment interface, and the second reply information includes a setting entry for the comment shielding function.
[0118] The comment shielding function is to hide the comment with the shielding word in the comment interface.
[0119] In the embodiment of the present disclosure, if the semantic recognition result of the first interaction information indicates the comment shielding function, the target function is the comment shielding function, and the terminal displays the second reply information of the smart assistant to the first interaction information in the form of a comment in the comment interface. The second reply information is obtained in the same way as the first reply information in step 407, and the embodiment of the present disclosure will not be repeated here. Figure 9 is an example diagram provided by the embodiment of the present disclosure for replying to the first interaction information, as shown in Figure 9 The information 901 is the first interaction information, the information 902 is the second reply information of the smart assistant to the first interaction information, and the control 903 in the information 902 is a setting entry for the comment shielding function.
[0120] The process is a possible implementation of the terminal displaying at least one operation control corresponding to the target function based on the target function. In this possible implementation, the target function is the comment shielding function, and the operation control is a setting entry for the comment shielding function. Through the setting entry, the user can independently set the comment shielding function, thereby improving the degree of freedom of human-computer interaction and optimizing the user experience.
[0121] 807、The terminal displays the setting interface of the comment shielding function in response to the triggering operation on the setting entry for the comment shielding function.
[0122] Figure 10 is an example diagram of a setting interface of the comment shielding function provided by the embodiment of the present disclosure, as shown in Figure 10 The setting interface displays an input box 1001 of the shielding word, the number of added shielding words / total number of addable shielding words 1002, the added shielding words 1003, and a return control 1004. Through the input box 1001 of the shielding word, the terminal can obtain the newly added shielding word.
[0123] 808、The terminal obtains the shielding word corresponding to the comment shielding function in response to the setting operation on the setting interface of the comment shielding function.
[0124] The setting operation on the setting interface of the comment shielding function includes at least one of the adding operation of the shielding word, the deleting operation of the shielding word, and the modifying operation of the shielding word.
[0125] In the embodiment of the present disclosure, the terminal adjusts the shielding word corresponding to the comment shielding function in response to the setting operation on the setting interface of the comment shielding function, obtains the adjusted keyword corresponding to the comment shielding function, and sets the target of the comment shielding function.
[0126] The steps 807-808 are a possible implementation manner in which the terminal determines the operation information corresponding to any operation control as the operation information corresponding to the target function in response to the triggering operation on any operation control in the at least one operation control. In the possible implementation manner, the operation control is the setting entry of the comment shielding function, and the operation information corresponding to the operation control is the operation information corresponding to the setting operation of the setting interface of the comment shielding function. In some embodiments, the operation control displayed in the reply is the setting control of the comment shielding function, and the terminal obtains the comment shielding word through the setting operation on the setting control, without jumping to the setting interface, thereby improving the human-computer interaction efficiency.
[0127] 809. The terminal displays, in the comment interface, a comment that does not contain the shielding word corresponding to the comment shielding function.
[0128] In the embodiments of the present disclosure, after the terminal returns to the comment interface from the setting interface of the comment shielding function, the terminal displays, in the comment interface, a comment filtered according to the shielding word corresponding to the comment shielding function, that is, a comment that does not contain the shielding word corresponding to the comment shielding function. This process is a possible implementation manner of displaying the interaction interface in which the second multimedia playback function is adjusted as the setting target. In the possible implementation manner, the second multimedia playback function is the comment shielding function, the operation information is the setting target for the second multimedia playback function, and the setting target is the shielding word corresponding to the comment shielding function.
[0129] The interaction method provided in the embodiments of the present disclosure can automatically operate the target function according to the first interaction information, shorten the operation path of the target function, and improve the human-computer interaction efficiency. The above process can directly jump to the setting interface of the target function through the setting entry in the reply to the first interaction information, thereby setting the target function, and effectively improving the human-computer interaction efficiency.
[0130] The above Figure 8 The interaction method is described by taking the target function as the comment shielding function and the operation information as the shielding word corresponding to the comment shielding function. In some embodiments, the target function is a multimedia resource recommendation function, and the terminal displays, in the comment interface, an adjustment entry of the intelligent assistant reply to the multimedia resource recommendation function according to the target function. The terminal displays, in the comment interface, an adjustment window of the multimedia resource recommendation function in response to the triggering operation on the adjustment entry. The adjustment window is as shown in FIG. 8B. Figure 11As shown, a plurality of content type corresponding labels 1102 and a display control 1103 of a label corresponding to more content types are displayed in the adjustment window 1101. The display control 1103 is used to trigger the display of more labels in the adjustment window 1101. The terminal acquires the setting target, i.e., the content preference of the user for the multimedia resource, in response to the selection operation of the label in the adjustment window. The terminal adjusts the multimedia resource recommended to the user subsequently according to the content preference of the user for the multimedia resource. In some embodiments, the terminal can also adjust the multimedia resource recommended to the user subsequently according to the semantics of the first interaction information, and then display the adjusted information and the adjustment entrance of the multimedia resource recommendation function of the intelligent assistant reply in the comment interface. Not only does the user achieve the setting of the target function by publishing the first interaction information, but also provides an additional setting channel for the user, thereby improving the user experience.
[0131] In some embodiments, the target function is a preset activity, and the terminal displays an activity entrance of the preset activity in the comment interface according to the preset activity. The terminal jumps to an activity interface corresponding to the preset activity in response to the triggering operation of the activity entrance.
[0132] In addition, the above Figure 8 The interaction method shown is described by taking the comment interface of the multimedia resource as an example. In some embodiments, the above interaction method is applied in the multimedia resource playing interface in which the bullet screen display function is opened, and the terminal displays the operation control corresponding to the target function in the reply bullet screen, such as Figure 12 As shown, the bullet screen 1201 is the reply of the intelligent assistant to the first interaction information, and the control 1202 in the bullet screen 1201 is the operation control corresponding to the target function.
[0133] Taking the request for taking a screenshot of the multimedia resource in the comment interface of the multimedia resource as an example, the process of storing the specified content in the interaction interface by the interaction method provided by the embodiments of the present disclosure is described. Figure 13 is a flowchart of an interaction method provided by the embodiments of the present disclosure, as shown in Figure 13 The method includes the following steps.
[0134] 1301. The terminal displays a comment interface of a multimedia resource.
[0135] 1302. The terminal acquires to-be-sent information in response to an input operation on the comment interface.
[0136] 1303. The terminal acquires the to-be-sent information as first interaction information for the multimedia resource in response to a sending operation on the to-be-sent information.
[0137] 1304、the terminal identifies the constituent elements of the first interaction information, and if the first interaction information includes an interaction request for the intelligent assistant, determines that the interaction target of the first interaction information is the intelligent assistant.
[0138] The steps 1301 to 1304 are the same as the steps 401 to 404, and the embodiments of the present disclosure will not be described here again.
[0139] 1305、the terminal performs semantic recognition on the first interaction information, and obtains a semantic recognition result of the first interaction information.
[0140] The process is the same as the step 405, and the embodiments of the present disclosure will not be described here again.
[0141] 1306、if the semantic recognition result of the first interaction information indicates that the first interaction information corresponds to a screenshot function, and operation information corresponding to the screenshot function indicates the first time point, the terminal obtains a picture of the multimedia resource at the first time point.
[0142] The first time point is a time point at which the playing process of the multimedia resource reaches, for example, the first time point is 00:35, indicating the 35th second of the multimedia resource.
[0143] In the embodiments of the present disclosure, if the semantic recognition result of the first interaction information indicates that the target function corresponding to the first interaction information is a screenshot function, and operation information corresponding to the screenshot function indicates the first time point, the semantic recognition result indicates that the multimedia resource is screenshot at the first time point. At the first time point in the playing process of the multimedia resource, the terminal screenshots the multimedia resource to obtain a picture of the multimedia resource at the first time point. In some embodiments, the terminal stores the picture obtained by the screenshot to the local. The process is one possible implementation of the terminal obtaining the content to be stored by the storage function and storing the content to be stored.
[0144] In some embodiments, if the semantic recognition result of the first interaction information indicates that the multimedia resource is screenshot at the first time point, the terminal obtains a video frame picture of the multimedia resource at the first time point. In this way, the user does not need to wait for the playing process of the multimedia resource to reach the first time point to obtain the picture of the multimedia resource at the first time point, which can improve the efficiency of human-computer interaction.
[0145] In some embodiments, when the terminal stores the picture of the multimedia resource at the first time point, the storage progress is displayed in the comment interface. As shown in Figure 14 The progress display control 1401 in the playing area of the multimedia resource displays the storage progress as 28%. The cancel control 1402 is also displayed in the progress display control 1401, and the terminal cancels the storage of the content indicated by the first interaction information in response to the triggering operation on the cancel control 1402.
[0146] 1307、The terminal displays the third reply information of the intelligent assistant to the first interaction information in the comment interface, and the third reply information includes a picture of the multimedia resource at the first time point.
[0147] In the embodiment of the present disclosure, the terminal displays the third reply information of the intelligent assistant to the first interaction information in the comment interface in the form of a comment, and the third reply information includes a picture of the multimedia resource at the first time point and text information. The manner of obtaining the text information is the same as the manner of obtaining the first reply information in step 407, and the embodiment of the present disclosure will not be described here. Figure 15 is an example diagram provided by the embodiment of the present disclosure for replying to the first interaction information, as shown in Figure 15 Information 1501 is the first interaction information, and information 1502 is the third reply information of the intelligent assistant to the first interaction information. In information 1502, picture 1503 is a picture of the multimedia resource at the first time point. It should be noted that this step is an optional step, and the terminal can choose whether to display the picture of the multimedia resource at the first time point in the comment interface.
[0148] The interaction method provided by the embodiment of the present disclosure can automatically operate the target function according to the first interaction information, shorten the operation path of the target function, and improve the human-computer interaction efficiency. The above process sends the first interaction information in the form of a storage instruction, which not only provides a new triggering manner for the storage function, but also improves the accuracy of the picture obtained by the screenshot function, and optimizes the user experience.
[0149] The interaction method shown in the above Figure 13 is described by taking the target function as the screenshot function and the operation information as the time point of the screenshot as an example. In some embodiments, the target function is other storage functions, for example, a screenshot comment function. In the corresponding process, after the terminal stores the picture obtained by the screenshot, the intelligent object displays the text information in reply to the first interaction information in the comment interface, and also displays a picture control. The picture obtained by the screenshot is displayed in the picture control. As shown in Figure 16 Information 1601 is the first interaction information, information 1602 is the text information in reply to the first interaction information by the intelligent object, control 1603 is a picture control, and picture 1604 obtained by the screenshot is displayed in the picture control. The terminal displays a comment window in the comment interface in response to the triggering operation on the picture control, and the picture obtained by the screenshot is displayed in the comment window. The comment window is used to publish a comment. As shown in Figure 17As shown, the window 1701 is an input window, and a screenshot obtained picture 1702 is displayed in the window 1701. The terminal sends the picture in the comment interface in response to a sending operation on the picture. For example, a sending control 1703 is also displayed in the window 1701, and the terminal sends the picture in the form of a comment in the comment interface in response to a triggering operation on the sending control 1703. For another example, the target function corresponding to the first interaction information is a text description extraction function of the multimedia resource, and the terminal displays the text description obtained by the intelligent assistant in response to the first interaction information, such as Figure 18 As shown, in the comment interface, information 1801 is the first interaction information, and information 1802 is the text description of the multimedia resource. For another example, the target function corresponding to the first interaction information is a storage function of multiple pictures in the multimedia resource, and the terminal displays a picture selection control in the comment interface, and the picture selection control displays the multiple pictures and a storage control. As shown, Figure 19 As shown, the picture selection control 1901 displays multiple pictures 1902 and a storage control 1903. The terminal displays that the pictures are selected in response to a selection operation on the pictures, and stores the selected pictures in response to a triggering operation on the storage control.
[0150] In addition, the interaction method shown in the above Figure 13 The interaction method is described by taking the comment interface of the multimedia resource as an example, and in some embodiments, the above interaction method is applied in a multimedia resource playing interface in which a bullet screen display function is opened, and the embodiments of the present disclosure are not limited thereto.
[0151] Taking requesting to search for related content in the comment interface of the multimedia resource as an example, the process in which the interaction method provided by the embodiments of the present disclosure displays the searched related content in the interaction interface is described. Figure 20 is a flowchart of an interaction method provided by the embodiments of the present disclosure, as shown in the figure, the method comprises the following steps. Figure 20 As shown in the figure, the method comprises the following steps.
[0152] 2001, the terminal displays a comment interface of a multimedia resource.
[0153] 2002, the terminal acquires to-be-sent information in response to an input operation on the comment interface.
[0154] 2003, the terminal acquires to-be-sent information as first interaction information for the multimedia resource in response to a sending operation on the to-be-sent information.
[0155] 2004, the terminal identifies a constituent element of the first interaction information, and if the first interaction information includes an interaction request to the intelligent assistant, determines that the interaction target of the first interaction information is the intelligent assistant.
[0156] The steps 2001-2004 are the same as the steps 401-404, and details are not repeated here.
[0157] 2005. The terminal performs semantic recognition on the first interaction information to obtain a semantic recognition result of the first interaction information.
[0158] The process is the same as the step 405, and details are not repeated here.
[0159] 2006. If the semantic recognition result of the first interaction information indicates that a related collection of multimedia resources is searched, the terminal searches the related collection of multimedia resources according to the semantic recognition result of the first interaction information to obtain a search result.
[0160] The related collection of multimedia resources is a video collection or a picture collection related to the multimedia resources, and details are not repeated here.
[0161] In the embodiments of the present disclosure, if the semantic recognition result of the first interaction information indicates that the target function corresponding to the first interaction information is a search function, and the operation information corresponding to the search function indicates a related collection of multimedia resources, the semantic recognition result indicates that the related collection of multimedia resources is searched. The terminal searches the text description of the multimedia resource as a search word, and the collection obtained by the search is regarded as the related collection of multimedia resources to obtain a search result. In the search process, for each collection, the terminal calculates the similarity between the text description of the collection and the search word, and the collection with a similarity greater than or equal to a similarity threshold is regarded as the related collection of multimedia resources.
[0162] 2007. The terminal displays the fourth reply information of the intelligent assistant to the first interaction information in the comment interface, and the fourth reply information includes the search result.
[0163] In the embodiments of the present disclosure, the terminal displays the fourth reply information of the intelligent assistant to the first interaction information in the comment interface in the form of a comment, and the fourth reply information includes a search result and text information. The way of obtaining the text information is the same as the way of obtaining the first reply information in the step 407, and details are not repeated here. Figure 21 is an example diagram provided by the embodiments of the present disclosure for replying to the first interaction information, as shown in Figure 21 The information 2101 is the first interaction information, and the information 2102 is the fourth reply information of the intelligent assistant to the first interaction information. The multiple collections 2103 obtained by the search are displayed in the information 2102, and the multiple collections 2103 are displayed in the information 2102 in the order of similarity from large to small.
[0164] In some embodiments, the fourth reply information further includes a jump control, as shown in Figure 21The terminal jumps from the comment interface to the search page in response to a triggering operation on the jump control, and displays the search result in the search page.
[0165] The interaction method provided in the embodiments of the present disclosure can automatically operate the target function according to the operation information indicated by the first interaction information, shorten the operation path of the target function, and improve the human-computer interaction efficiency. The above process can directly view the search result of the related content in the reply to the first interaction information by sending the first interaction information, which not only enriches the content displayed in the interaction interface, but also enables the user to search for the related content without jumping to other search interfaces, thereby improving the human-computer interaction efficiency.
[0166] The above Figure 20 The interaction method is described by taking searching for a related collection as an example. In some embodiments, the target function corresponding to the first interaction information is a search function for the content of a subsequent event, knowledge, or interesting term, and the embodiments of the present disclosure do not limit this. In some embodiments, the first interaction information indicates searching for a commodity or an order. Taking the first interaction information indicating searching for an order as an example, as shown in Figure 22 After the terminal searches for the order, the terminal displays the reply 2201 of the intelligent assistant to the first interaction information in the form of a comment in the comment interface, and the content of the reply includes a text description of the order progress and a jump link 2202 of the order page. The terminal displays the corresponding order page in response to a triggering operation on the jump link.
[0167] In addition, the above Figure 20 The interaction method is described by taking the comment interface of a multimedia resource as an example. In some embodiments, the above interaction method is applied in a multimedia resource playing interface in which a bullet screen display function is opened. After the terminal obtains the search result, the terminal displays a search control in the multimedia resource playing interface, and displays the search result in the search control. The search control is shown as a control 2301 in Figure 23 The search result 2302 is displayed in the control 2301.
[0168] Taking replying to the information in the comment interface of the multimedia resource containing information of a specified emotion as an example, the process of replying to the information in the interaction interface by using the interaction method provided in the embodiments of the present disclosure is described. Figure 24 is a flowchart of an interaction method provided in the embodiments of the present disclosure, as shown in Figure 24 The method includes the following steps.
[0169] 2401. The terminal displays a comment interface of the multimedia resource.
[0170] 2402. The terminal acquires to-be-sent information in response to an input operation on the comment interface.
[0171] 2403. The terminal acquires the to-be-sent information as first interaction information for the multimedia resource in response to a sending operation on the to-be-sent information.
[0172] The steps 2401 to 2403 are the same as the steps 401 to 403, and thus are not described herein again.
[0173] 2404. The terminal performs sentiment recognition on the first interaction information to obtain a sentiment recognition result of the first interaction information.
[0174] There are various ways to perform sentiment recognition on the first interaction information, and the various ways are described below.
[0175] In some embodiments, the terminal performs word segmentation processing on the first interaction information to obtain a plurality of texts corresponding to the first interaction information. For each text, the terminal matches the text with each text in an emotion text library. If there is a same text as the text in the emotion text library, the terminal takes the same text as the sentiment recognition result of the first interaction information. The emotion text library includes texts corresponding to various emotions.
[0176] In some embodiments, the terminal processes the first interaction information through an emotion recognition model to output the sentiment recognition result of the first interaction information. The emotion recognition model is a pre-trained model that can output an emotion contained in input information according to the input information.
[0177] After obtaining the sentiment recognition result of the first interaction information, the terminal can take the reply function as a target function and take the sentiment recognition result as operation information of the target function.
[0178] 2405. If the sentiment recognition result of the first interaction information is a target result, the terminal displays an animation associated with the sentiment recognition result in the comment interface based on the sentiment recognition result.
[0179] The target result is a pre-set result, for example, a result opposite to an emotion label of the multimedia resource. The emotion label of the multimedia resource can be a pre-set label, such as a label set by a publisher of the multimedia resource. The emotion label of the multimedia resource can also be a label recognized in real time, which is not limited in the embodiments of the present disclosure. The animation associated with the sentiment recognition result can be a pre-set animation or an animation generated in real time according to the sentiment recognition result, which is not limited in the embodiments of the present disclosure.
[0180] In the embodiments of the present disclosure, if the sentiment recognition result of the first interaction information is the target result, the terminal determines that the interaction target of the first interaction information is the intelligent assistant, and displays an animation associated with the sentiment recognition result in the comment interface according to the sentiment recognition result of the first interaction information, so as to adjust the emotion of the user. As shown in Figure 25 , the first interaction information is "I am a little sad today", and the terminal displays a heart animation in the comment interface. The above process is one possible implementation of the terminal displaying an animation associated with the sentiment recognition result in the interaction interface based on the sentiment recognition result through the reply function.
[0181] In some embodiments, the terminal displays a plurality of emotion level options in the form of comments in the comment interface based on the sentiment recognition result of the first interaction information, and different emotion level options correspond to different emotion intensities. As shown in Figure 26 , a plurality of emotion level options 2601 are displayed in the comment interface. The terminal displays an animation corresponding to the emotion level option in the comment interface in response to a triggering operation on any emotion level option.
[0182] The interaction method provided by the embodiments of the present disclosure can automatically operate the target function according to the first interaction information, shorten the operation path of the target function, and improve the human-computer interaction efficiency. The above process can automatically recognize the emotion contained in the first interaction information and give corresponding emotional feedback in the form of animation, which can improve the effectiveness of the interaction and improve the user experience.
[0183] The above Figure 24 interaction method is described by taking the case that the sentiment recognition result of the first interaction information is opposite to the sentiment label of the multimedia resource. In some embodiments, the sentiment recognition result of the first interaction information indicates appreciation for the publisher of the multimedia resource, and as shown in Figure 27 , the terminal displays a flower falling animation in the comment interface, and the central part of the animation displays the avatar of the publisher and a preset dialogue.
[0184] In addition, the above Figure 24 interaction method is described by taking the comment interface of the multimedia resource as an example. In some embodiments, the above interaction method is applied in the multimedia resource playing interface with the opened bullet screen display function, and the terminal displays an animation corresponding to the sentiment recognition result in the multimedia resource playing interface after obtaining the sentiment recognition result.
[0185] Figure 28 is a structural block diagram of an interaction device according to an embodiment of the present disclosure. The device is used to execute the steps of the above-mentioned interaction method, see Figure 28 , the interaction device comprises the following modules.
[0186] The information acquisition module 2801 is configured to execute the interaction interface based on the multimedia resource, and acquire first interaction information for the multimedia resource.
[0187] The function determination module 2802 is configured to execute the following: if the interaction target of the first interaction information is a target object, determine the target function corresponding to the first interaction information and operation information for the target function based on the first interaction information.
[0188] The operation module 2803 is configured to execute the following: based on the target function and the operation information, execute an interaction operation.
[0189] In some embodiments, the above-mentioned interaction device further comprises:
[0190] The first identification module is configured to execute the following: identify the constituent elements of the first interaction information, and if the first interaction information comprises a target word or a target symbol, determine that the interaction target of the first interaction information is a target object.
[0191] In some embodiments, the above-mentioned interaction device further comprises:
[0192] The second identification module is configured to execute the following: perform sentiment identification on the first interaction information to obtain a sentiment identification result, and if the sentiment identification result is a target result, determine that the interaction target of the first interaction information is a target object.
[0193] In some embodiments, the target result is a result opposite to a sentiment label of the multimedia resource.
[0194] In some embodiments, the above-mentioned second identification module is configured to execute the following:
[0195] Based on the sentiment identification result, take a reply function as the target function, and take the sentiment identification result as the operation information of the target function.
[0196] In some embodiments, the above-mentioned interaction device further comprises:
[0197] The third identification module is configured to execute the following: identify the constituent elements of the first interaction information, and if the first interaction information comprises a function keyword, determine that the interaction target of the first interaction information is a target object, and the function keyword indicates a target function.
[0198] In some embodiments, the above-mentioned third identification module is configured to execute the following:
[0199] The function indicated by the function keyword in the first interaction information is taken as a target function, and the part associated with the function keyword in the first interaction information is taken as operation information of the target function.
[0200] In some embodiments, the function determining module 2802 is configured to perform:
[0201] determine, based on the first interaction information, a target function corresponding to the first interaction information;
[0202] display at least one operation control corresponding to the target function based on the target function;
[0203] determine, in response to a triggering operation on any operation control in the at least one operation control, operation information corresponding to the any operation control as operation information for the target function.
[0204] In some embodiments, the target function is a first multimedia playing function, and the operation information indicates an opening operation. The operation module 2803 is configured to perform:
[0205] display an interaction interface after the first multimedia playing function is opened.
[0206] In some embodiments, the target function is a second multimedia playing function, and the operation information indicates a setting target for the second multimedia playing function. The operation module 2803 is configured to perform:
[0207] display an interaction interface after the second multimedia playing function is adjusted to the setting target.
[0208] In some embodiments, the target function is a storage function, and the operation information indicates content to be stored. The operation module 2803 is configured to perform:
[0209] obtain the content to be stored through the storage function;
[0210] store the content to be stored.
[0211] In some embodiments, the operation module 2803 is further configured to perform:
[0212] display the content to be stored in the interaction interface.
[0213] In some embodiments, the operation module 2803 is further configured to perform:
[0214] display the content to be stored in a comment window of the interaction interface, the comment window being used for publishing a comment;
[0215] in response to a sending operation on the content to be stored, send the content to be stored in the interaction interface.
[0216] In some embodiments, the target function is a search function, the operation information indicates search content indicated by the first interaction information, and the operation module 2803 includes:
[0217] a search unit configured to perform searching on the search content indicated by the first interaction information through the search function;
[0218] a display unit configured to perform displaying the search result in the interaction interface.
[0219] In some embodiments, the display unit is configured to perform:
[0220] displaying a jump control in the interaction interface;
[0221] in response to a triggering operation on the jump control, displaying the search result.
[0222] In some embodiments, the target function is a reply function, the operation information indicates a sentiment recognition result of the first interaction information, and the operation module 2803 is configured to perform:
[0223] through the reply function, displaying an animation associated with the sentiment recognition result in the interaction interface based on the sentiment recognition result.
[0224] In some embodiments, the interaction apparatus further includes:
[0225] a display module configured to perform displaying information that an interaction operation is completed in the interaction interface.
[0226] In some embodiments, the display module is configured to perform:
[0227] displaying second interaction information in the interaction interface, the second interaction information being a reply of a target object to the first interaction information, and the second interaction information indicating that the interaction operation is completed.
[0228] It should be noted that: the apparatus provided in the above embodiments is only taken as an example for the division of the above functional modules in the interaction, and in actual applications, the above functions can be completed by different functional modules according to needs, that is, the internal structure of the apparatus is divided into different functional modules to complete all or part of the above described functions. In addition, the apparatus and method embodiments provided in the above embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.
[0229] Figure 29is a structural schematic diagram of a terminal provided by the embodiments of the present disclosure. The terminal 2900 can have great differences due to different configurations or performances, and can include one or more CPUs (Central Processing Units, processors) 2901 and one or more memories 2902. The memory 2902 stores at least one piece of computer program, which is loaded and executed by the processor 2901 to implement the interaction method provided by each method embodiment described above. Of course, the terminal can also have a wired or wireless network interface, a keyboard, an input and output interface, and other components for realizing the functions of the device, and the details are not described here.
[0230] The embodiments of the present disclosure also provide a computer readable storage medium, which stores at least one piece of computer program. The at least one piece of computer program is loaded and executed by the processor of the terminal to implement the operations performed by the terminal in the interaction method of the above embodiments. For example, the computer readable storage medium can be a ROM (Read-Only Memory), a RAM (Random Access Memory), a CD-ROM (Compact Disc Read-Only Memory), a magnetic tape, a floppy disk, an optical data storage device, etc.
[0231] In some embodiments, the computer program related to the embodiments of the present disclosure can be deployed to execute on one terminal, or on multiple terminals located in one place, or on multiple terminals distributed in multiple places and interconnected through a communication network, which can constitute a blockchain system.
[0232] The embodiments of the present disclosure also provide a computer program product or a computer program, which includes at least one piece of program stored in a computer readable storage medium. The processor of the terminal reads the at least one piece of program from the computer readable storage medium, and the processor executes the at least one piece of program to make the terminal execute the interaction method provided in the various optional implementation manners described above.
[0233] Those skilled in the art can understand that all or part of the steps of the above embodiments can be completed by hardware, or by program instructing relevant hardware, and the program can be stored in a computer readable storage medium. The storage medium mentioned above can be a read-only memory, a magnetic disk or an optical disk, etc.
[0234] The above merely describes optional embodiments of the present disclosure, and is not intended to limit the present disclosure. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present disclosure shall be included in the protection scope of the present disclosure.
Claims
1. An interaction method, characterized in that, The method includes: Based on the interactive interface of the multimedia resources, obtain the first interactive information for the multimedia resources; If the interaction target of the first interaction information is a target object, then based on the first interaction information, the target function corresponding to the first interaction information and the operation information for the target function are determined. Based on the target function and the operation information, perform interactive operations, including at least one of the following: If the target function is a screenshot and comment function, and the operation information corresponding to the screenshot and comment function indicates a first time point, which is the time point when the playback process of the multimedia resource arrives, then at the first time point in the multimedia resource playback process, a screenshot of the multimedia resource is taken to obtain an image of the multimedia resource at the first time point; the image is stored, and a storage progress and a cancel control are displayed on the interactive interface; in response to the triggering operation of the cancel control, the storage of the image is canceled; after the image is stored, an image control including the image is displayed on the interactive interface; in response to the triggering operation of the image control, a comment window for posting comments is displayed on the interactive interface, and the image is displayed in the comment window; in response to the sending operation of the image, the image is sent as a comment on the interactive interface. If the target function is a multimedia resource recommendation function; according to the target function, an adjustment entry is displayed on the interactive interface, then in response to the triggering operation of the adjustment entry, an adjustment window including tags corresponding to multiple content types is displayed on the interactive interface; in response to the selection operation of the tags in the adjustment window, the setting target is obtained; according to the setting target, the multimedia resources subsequently recommended to the user are adjusted; If the target function is a search function, and the operation information indicates the search content indicated by the first interaction information, then the search content is searched through the search function. When the search content is a multimedia resource, the search results and a jump control are displayed in the interactive interface. When the multimedia resource includes multiple resources, the multiple multimedia resources are displayed in descending order of similarity to the currently displayed multimedia resource. In response to the triggering operation of the jump control, the user jumps from the interactive interface to the search page, and the search results are displayed on the search page. When the search content is a follow-up to a related order event, a text description of the order progress and a jump link to the order page are displayed in the interactive interface. In response to the triggering operation of the jump link, the corresponding order page is displayed.
2. The interaction method according to claim 1, characterized in that, The method further includes: The components of the first interactive information are identified. If the first interactive information includes target words or target symbols, then the interactive target of the first interactive information is determined to be the target object.
3. The interaction method according to claim 1, characterized in that, The method further includes: Emotion recognition is performed on the first interactive information to obtain an emotion recognition result. If the emotion recognition result is a target result, then the interaction target of the first interactive information is determined to be the target object.
4. The interaction method according to claim 3, characterized in that, The target result is the opposite of the sentiment label of the multimedia resource.
5. The interaction method according to claim 3, characterized in that, The step of determining the target function corresponding to the first interaction information and the operation information for the target function based on the first interaction information includes: Based on the emotion recognition results, the reply function is taken as the target function, and the emotion recognition results are taken as the operation information of the target function.
6. The interaction method according to claim 1, characterized in that, The method further includes: The constituent elements of the first interactive information are identified. If the first interactive information includes a functional keyword, the interaction target of the first interactive information is determined to be the target object, and the functional keyword indicates the target function.
7. The interaction method according to claim 6, characterized in that, The step of determining the target function corresponding to the first interaction information and the operation information for the target function based on the first interaction information includes: The function indicated by the function keyword in the first interaction information is taken as the target function, and the part of the first interaction information associated with the function keyword is taken as the operation information of the target function.
8. The interaction method according to claim 1, characterized in that, The step of determining the target function corresponding to the first interaction information and the operation information for the target function based on the first interaction information includes: Based on the first interaction information, determine the target function corresponding to the first interaction information; Based on the target function, display at least one operation control corresponding to the target function; In response to a trigger operation on any of the at least one operation controls, the operation information corresponding to any one operation control is determined as operation information for the target function.
9. The interaction method according to claim 1, characterized in that, The target function is a first multimedia playback function, the operation information indicates an activation operation, and the interactive operation based on the target function and the operation information includes: Displays the interactive interface after enabling the first multimedia playback function.
10. The interaction method according to claim 1, characterized in that, The target function is a second multimedia playback function, the operation information indicates a setting target for the second multimedia playback function, and the step of performing interactive operations based on the target function and the operation information includes: The interactive interface is displayed after the second multimedia playback function is adjusted to the set target.
11. The interaction method according to claim 1, characterized in that, The target function is a response function, the operation information indicates the emotion recognition result of the first interaction information, and the execution of the interaction operation based on the target function and the operation information includes: The reply function displays an animation associated with the emotion recognition result in the interactive interface, based on the emotion recognition result.
12. The interaction method according to claim 1, characterized in that, The method further includes: The interactive interface displays information indicating that the interactive operation has been completed.
13. The interaction method according to claim 12, characterized in that, The information displayed in the interactive interface indicating the completion of the interactive operation includes: The interactive interface displays second interactive information, which is the target object's response to the first interactive information, and the second interactive information indicates that the interactive operation has been completed.
14. An interactive device, characterized in that, The device includes: The information acquisition module is configured to execute an interactive interface based on multimedia resources and acquire first interactive information for the multimedia resources; The function determination module is configured to perform the following: if the interaction target of the first interaction information is a target object, then based on the first interaction information, determine the target function corresponding to the first interaction information and the operation information for the target function. The operation module is configured to perform interactive operations based on the target function and the operation information; If the target function is a screenshot and comment function, and the operation information corresponding to the screenshot and comment function indicates a first time point, which is the time point when the playback process of the multimedia resource arrives, then the operation module is specifically configured to perform the following: at the first time point in the multimedia resource playback process, take a screenshot of the multimedia resource to obtain an image of the multimedia resource at the first time point; store the image, and simultaneously display the storage progress and a cancel control on the interactive interface; in response to the triggering operation of the cancel control, cancel the storage of the image; after storing the image, display an image control including the image on the interactive interface; in response to the triggering operation of the image control, display a comment window for posting comments on the interactive interface, and the image is displayed in the comment window; in response to the sending operation of the image, send the image as a comment on the interactive interface. If the target function is a multimedia resource recommendation function, then the operation module is specifically configured to perform: displaying an adjustment entry on the interactive interface according to the target function; in response to the triggering operation of the adjustment entry, displaying an adjustment window with tags corresponding to multiple content types on the interactive interface; in response to the selection operation of the tags in the adjustment window, obtaining the setting target; and adjusting the multimedia resources subsequently recommended to the user according to the setting target. If the target function is a search function, and the operation information indicates the search content indicated by the first interaction information, then the operation module is specifically configured to perform the following: searching for the search content using the search function; when the search content is a multimedia resource, displaying the search results and a jump control in the interactive interface; when the multimedia resource includes multiple resources, displaying the multiple multimedia resources in descending order of similarity to the currently displayed multimedia resource; responding to a trigger operation on the jump control, jumping from the interactive interface to the search page, and displaying the search results on the search page; when the search content is a follow-up to a related order event, displaying a text description of the order progress and a jump link to the order page in the interactive interface; responding to a trigger operation on the jump link, displaying the corresponding order page.
15. A terminal, characterized in that, The terminal includes a processor and a memory, the memory being used to store at least one computer program, the at least one computer program being loaded by the processor and executing the method according to any one of claims 1 to 13.
16. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store at least one computer program for performing the method according to any one of claims 1 to 13.
17. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by a processor, it implements the method as described in any one of claims 1 to 13.
Citation Information
Patent Citations
Bullet screen interaction method and device, electronic equipment and storage medium
CN117880540A