Interaction method and device

Abstract

The invention relates to an interaction method and device, and the method comprises the steps: displaying a virtual image of a video assistant under the condition that a display condition is satisfied based on user operation, and carrying out the input detection under the condition that the virtual image is triggered, so as to obtain user input; and displaying a result interface formed in response to the user input, and controlling the virtual image to send a target voice corresponding to the result interface. In the process of searching and playing the video for the user, the interaction with the user is realized by using the video assistant, so that the diversity, timeliness and individuation of the interaction are ensured. Furthermore, the virtual image of the video assistant can respond to various inputs of the user, and the user can realize various requirements only by operating the video assistant, so that the user operation is simplified, and the user experience is improved.

Description

Technical Field

[0001] The present disclosure relates to the technical field of video playback interaction, and in particular to an interaction method and device. Background Art

[0002] With the diversification of video resources, meeting the diverse interactive needs of users when watching videos has become a technical problem that needs to be solved urgently. However, the existing video interaction methods can no longer meet the increasing and more personalized needs of users. How to improve the diversity and personalization of video interaction is a technical problem that needs to be solved urgently. Summary of the invention

[0003] In view of this, the present disclosure proposes an interactive method and device.

[0004] According to one aspect of the present disclosure, an interactive method is provided, the method being performed using a video assistant, the method comprising:

[0005] When it is determined based on the user operation that the display condition is met, displaying the virtual image of the video assistant, so as to perform input detection to obtain user input when the virtual image is triggered;

[0006] A result interface formed in response to the user input is displayed, and the virtual image is controlled to emit a target voice corresponding to the result interface.

[0007] In a possible implementation, the method further includes:

[0008] Displaying the virtual image of the video assistant and the assistant input controls at the same time;

[0009] The triggering of the virtual image includes any one of the following: detecting a triggering operation on the virtual image, detecting a triggering operation on the assistant input control.

[0010] In a possible implementation, satisfying the display condition includes at least one of the following: detecting a trigger operation for a search reminder, detecting a trigger operation for an assistant startup control, detecting that the browsing time for interface browsing exceeds a time threshold, detecting a user's voice to start a virtual image input, detecting a quick operation to start a virtual image, and detecting that a user starts a video client;

[0011] Among them, the search reminder is displayed in response to a trigger operation on the search input box, and the search reminder is used to remind the user to use the video assistant to search for videos.

[0012] In a possible implementation, the result interface includes any one of a video search result interface and a setting result interface;

[0013] The content displayed in the video search result interface is formed by at least one result video obtained by performing a video search based on the user input;

[0014] The content displayed in the setting result interface is formed after the requirements are set according to the user input.

[0015] In a possible implementation, the method further includes:

[0016] In response to a triggering operation for a famous scene selection reminder, displaying a famous scene selection interface for the current video, the famous scene selection interface including description information of each famous scene segment of the current video and a virtual image of the video assistant;

[0017] In response to a selection input detected after the virtual image is triggered, a famous scene clip corresponding to the selection input is played.

[0018] In a possible implementation, the method further includes:

[0019] In the process of displaying a first browsing interface including a plurality of video recommendation information in response to a browsing operation, a video recommendation reminder is displayed, wherein the video recommendation reminder includes a recommended video type and promotional pictures of each first video recommended based on the recommended video type.

[0020] In a possible implementation, the method further includes:

[0021] In the process of displaying a second browsing interface including a plurality of surrounding short video information in response to a browsing operation, in response to a viewing operation on target surrounding short video information among the plurality of surrounding short video information, displaying the second browsing interface is stopped and a target surrounding short video corresponding to the target surrounding short video information is displayed;

[0022] In response to an end display operation for the target surrounding short video, stop playing the target surrounding short video and return to display the second browsing interface, and replace the target surrounding short video information in the second browsing interface with a surrounding reminder;

[0023] The surrounding reminder is used to remind the user to collect the second video related to the target surrounding short video and / or remind the user to give a recommendation evaluation for the target surrounding short video.

[0024] In a possible implementation, the method further includes:

[0025] In response to a configuration operation for the avatar, a avatar setting interface is displayed, and a character and / or voice of the avatar determined according to the detected setting operation is displayed.

[0026] According to another aspect of the present disclosure, an interactive device is provided, the device utilizing a video assistant, the device comprising:

[0027] A virtual image display module, used to display the virtual image of the video assistant when it is determined based on the user operation that the display condition is met, so as to perform input detection to obtain user input when the virtual image is triggered;

[0028] The result display module is used to display a result interface formed in response to the user input, and control the virtual image to emit a target voice corresponding to the result interface.

[0029] According to another aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0030] According to another aspect of the present disclosure, a non-volatile computer-readable storage medium is provided, on which computer program instructions are stored, wherein the computer program instructions implement the above method when executed by a processor.

[0031] According to another aspect of the present disclosure, a computer program product is provided, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0032] Through the interactive method and device provided by the embodiments of the present disclosure, when it is determined that the display conditions are met based on the user operation, the virtual image of the video assistant is displayed, so as to perform input detection to obtain user input when the virtual image is triggered; the result interface formed in response to the user input is displayed, and the virtual image is controlled to emit a target voice corresponding to the result interface. In the process of searching and playing videos for users, the video assistant is used to achieve interaction with users, ensuring the diversity, timeliness and personalization of the interaction. Furthermore, the virtual image of the video assistant can respond to various types of user input, and the user can achieve various needs only by operating the video assistant, which simplifies user operations and improves user experience.

[0033] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

[0035] Figure 1 A flow chart of an interactive method according to an embodiment of the present disclosure is shown.

[0036] Figure 2-Figure 12 A schematic diagram showing an application of an interactive method according to an embodiment of the present disclosure is shown.

[0037] Fig.13 is a block diagram of a device 800 used for the above interaction method according to an exemplary embodiment. DETAILED DESCRIPTION

[0038] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0039] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0040] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

[0041] In order to solve the above technical problems, the embodiments of the present disclosure provide an interactive method and device, which is executed by using a video assistant. When it is determined based on the user operation that the display conditions are met, the virtual image of the video assistant is displayed, so as to perform input detection to obtain user input when the virtual image is triggered; the result interface formed in response to the user input is displayed, and the virtual image is controlled to emit a target voice corresponding to the result interface. In the process of searching and playing videos for users, the video assistant is used to realize the interaction with the user, ensuring the diversity, timeliness and personalization of the interaction. Furthermore, the virtual image of the video assistant can respond to various types of user input, and the user can achieve various needs only by operating the video assistant, which simplifies the user operation and improves the user experience.

[0042] The interactive method and device provided in the embodiments of the present disclosure are implemented using a video assistant. In the process of a user using a video client installed on an electronic device, the video assistant in the video client can respond to user input and perform corresponding operations to achieve interaction with the user, such as performing video retrieval, video client settings, and conversations with the user under the user's instructions. Interactions related to the user's use of the video client, etc., are not limited in this disclosure. The video assistant is pre-set based on a trained model, and can respond to user input and perform matching operations in combination with the preferences of different users, thereby achieving diversity and timeliness of interaction, while meeting the personalized interaction needs of different users.

[0043] Among them, the trained models used to implement the video assistant may include intent recognition models, task routing models, multimodal input models, expert model networks, generative models, speech recognition models, text-to-speech conversion models, optical character recognition models, natural language processing models, machine learning models, retrieval enhancement generation technology, knowledge bases, etc., and the present disclosure does not limit this. Each model can be trained based on the existing technology for the task to be completed, and the present disclosure does not limit this. The video assistant can obtain the user's user preferences by analyzing the user's historical data during the user's use of the video client. Among them, user preferences may include: speed preferences, resolution preferences, frequency preferences for users to watch different types of videos, the proportion of the number of different types of videos watched, language habits, whether to turn on the eye protection mode when watching different types of videos, and other personalized information related to the user watching videos or operating the video client, and the present disclosure does not limit this.

[0044] The interactive method and device provided by the embodiments of the present disclosure are schematically described below with reference to the accompanying drawings.

[0045] like Figure 1 As shown, the interactive method provided by the embodiment of the present disclosure includes step S101 and step S102.

[0046] In step S101, when it is determined that the display condition is met based on the user operation, the virtual image of the video assistant is displayed, so that input detection is performed to obtain user input when the virtual image is triggered. In step S102, a result interface formed in response to the user input is displayed, and the virtual image is controlled to emit a target voice corresponding to the result interface.

[0047] In this embodiment, the virtual image is a form of expression of the video assistant to facilitate interaction with the user. The role effect presented by the virtual image can be Figure 4-Figure 7 , Fig.12 The human image shown can also be a cartoon image, such as Figure 2-Figure 3 , Fig.11The geometric shape image shown, etc., the character effect presented by the virtual image can be flat or three-dimensional, and the present disclosure does not limit this. Moreover, the virtual image has a specific voice to make a voice during the interaction with the user. The optional roles and voices of the virtual image can be pre-set for the user to set and select, and the present disclosure does not limit this. The virtual image can be enlarged when receiving user input and can be displayed in the center of the page. After receiving user input and presenting the result to the user, it can be reduced and displayed at the edge or corner of the page.

[0048] In some embodiments, Figure 2-Figure 11 As shown, a search input box can be displayed to users in the interface provided by other video clients such as the home page, so that users can enter search content through the search input box and then search for videos. In order to facilitate users to search using the video assistant, a trigger operation on the search input box can be displayed. Figure 2 The search reminder shown ("Search for new poses! Click me, you can ask like this~") is used to remind the user to use the video assistant to search for videos.

[0049] In this embodiment, displaying the virtual image of the video assistant to the user can further facilitate reminding the user to use the video assistant and achieve interaction with the user. Therefore, it is necessary to determine that the display conditions are met when it is determined that the user may need the video assistant, and display the virtual image of the video assistant to the user. In the process of displaying the virtual image, a matching target voice can be issued according to the current interface changes or user needs, and the virtual image's mouth shape, movements, expressions, etc. can be controlled to match the content of the target voice. For example, Figure 4 After the virtual image starts to display, the target voice "What do you want to see? Click me to try it" is issued at the same time to remind the user to use the video assistant.

[0050] The display conditions of the virtual assistant can be set as needed, and the virtual assistant can be displayed as long as the user may need the virtual assistant to assist in the operation. In some embodiments, satisfying the display conditions may include any of the following: detecting a request for such Figure 2 The triggering action of the search reminder shown, the detection of the assistant startup control (such as Figure 2 , Figure 3 , Fig.11The display conditions for displaying the virtual image can be set according to actual needs, and the present disclosure does not limit this. Among them, detecting that the browsing time for interface browsing exceeds the time threshold may include detecting that the browsing time for the user to browse the target interface exceeds the time threshold. Among them, the target interface may include such as Figure 4 The homepage of the first video client shown, Figure 8 The first browsing interface is shown. Figure 9-10 The second browsing interface shown is an interface provided by the video client for users to browse content, and the present disclosure does not limit this.

[0051] For example, when a user opens a video client and enters the homepage, or enters any other browsing page, after the browsing video duration exceeds the duration threshold, a virtual image can be automatically displayed on the homepage, and a voice can be output to remind the user to use the virtual image to search for the desired video. Alternatively, after the user triggers the search input box on any page of the video client (for example, clicks on the search input box), a search reminder and an assistant startup control can be displayed near the search input box, and the assistant startup control can be consistent with the pattern design of the virtual image, so that the user can more intuitively discover this function. In response to the user's triggering of the search reminder or the assistant startup control, the virtual image can be displayed and a voice can be output. It is also possible to display the virtual image and output a voice in response to the browsing video duration exceeding the duration threshold while displaying the search reminder and the assistant startup control above. Alternatively, the assistant startup control can be displayed at any location on any page of the video client (for example, near the search input box), and the pattern design of the assistant startup control can be consistent with the virtual image. In response to the user's triggering of the assistant startup control, the virtual image can be displayed and a voice can be output.

[0052] In this embodiment, the video assistant can start user input detection after the virtual image is triggered to obtain the text and / or voice input by the user. In some embodiments, the method may also include: displaying the virtual image of the video assistant while displaying the following Figure 4-Figure 7 , Fig.12 The assistant input control shown is used so that the user can operate the assistant input control to input content, wherein the input content can be text and / or voice, and the present disclosure does not limit this.

[0053] The virtual image being triggered may include any of the following implementations: if a triggering operation for the virtual image is detected, it can be determined that the virtual image is triggered. Figure 2-Figure 3, Fig.11 If a trigger operation such as a click or long press of the virtual image shown in the figure is detected, it can be determined that the virtual image is triggered. The present disclosure does not limit the implementation method of the trigger operation for the virtual image. If a trigger operation for the assistant input control is detected, it can be determined that the virtual image is triggered. For example, Figure 4-Figure 7 , Fig.12 The triggering operations such as clicking and long pressing of the assistant input control shown can also determine that the virtual image is triggered. The present disclosure does not limit the implementation method of the triggering operation for the assistant input control.

[0054] In this embodiment, whether the virtual image is triggered can also be determined by whether a shortcut operation corresponding to the user input is detected, whether a trigger operation for a designated key (such as a volume key) is detected, etc., and the "determining whether the virtual image is triggered to further determine whether to perform user input detection" can be set according to actual needs, and the present disclosure does not impose any restrictions on this.

[0055] In this embodiment, for the convenience of describing the situation of displaying the result interface to the user in step S102, according to the difference in the displayed content, the result interface displayed in step S102 may include a video search result interface and a setting result interface. The target voice for the result interface may include a voice issued by the avatar to remind the user to continue the operation or to complete the operation instructed by the user for the current interface display content.

[0056] Among them, the content displayed in the video search result interface may be formed by at least one result video obtained by performing a video search according to the user input. The content displayed in the video search result interface may include at least one of the following: the video details page of the result video, the result video being played, the video playback mode reminder, the video recommendation information of the result video, and the summary description information for the result video. In the case where the result interface is a video search result interface, the target voice may include at least one of the following: the plot description voice of the result video, the video playback mode reminder voice, the accompanying reminder voice, the recommendation suggestion voice for the result video, etc. Among them, the video playback mode of the video may include a normal mode, an eye protection mode, an elder mode, a children's mode, etc. Compared with the normal mode, the eye protection mode will adjust the color temperature and brightness of the display to reduce the potential stimulation and damage to the eyes. Compared with the normal mode, the elder mode will adjust the font size and brightness of the display to facilitate operation and viewing by relatively older people. Compared with the normal mode, the children's mode will have at least one function of limiting viewing time, filtering viewing content, limiting functions, limiting consumption, and protecting the privacy of minors. The user can continue to operate according to the prompts, such as continuing to trigger the virtual image or assistant input controls, and by inputting voice, instructing the virtual assistant to set the video playback mode, start watching with the user, etc. During the process of watching with the virtual image, the virtual image can output voice to introduce the plot, remind the user through voice that an exciting plot is about to begin, and have a voice conversation with the user.

[0057] The content displayed in the setting result interface may be formed after the requirement setting is performed according to the user input. The requirement setting may be a setting for any user-allowed setting object, such as setting the video client or setting the video playback mode, such as setting the avatar widget, setting the video playback mode, setting the interface viewing mode, etc. The interface viewing mode includes the day mode and the night mode, etc. The target voice of the setting result interface may be a reminder voice of the completed setting result, etc. The present disclosure does not limit the content of the requirement setting and the content of the target voice.

[0058] Depending on different user inputs and responses to user operations, the result interface and target voice may also be different. The following schematically illustrates the corresponding result interface and target voice through several scenario examples.

[0059] Scenario Example 1: Based on user input, the closest video can be found.

[0060] like Figure 2As shown, after detecting a trigger operation such as a click by the user on the search input box on the homepage, when the user enters content into the search input box, a search reminder is displayed to the user ("Search for new postures! Click me, you can ask like this..."). In some embodiments, the assistant startup control can also be displayed together with the search reminder. The assistant startup control can include the logo of the virtual image, and the logo of the virtual image can be consistent with the design style of the virtual image. In response to the user's trigger operation such as a click on the search reminder, the virtual image is further displayed to the user, and the virtual image makes a voice "Please speak, I'm listening" (target voice). Then, after detecting the trigger operation on the virtual image, a user input detection is performed to obtain the user input "There is a movie in which the heroine is very beautiful, and then she accidentally gains super powers due to excessive intake of blue objects." The result videos obtained by searching based on the user input include: movie A that is closest to the user input, multiple similar movies that are close to movie A, and the video clips that are close to movie A. The video search result interface finally displayed to the user includes: the video details page of movie A, video recommendation information of each similar video and each related video, summary description information "other similar results" and "people who have watched movie A love to watch". At the same time, the virtual image sends out the target voice, and the target voice can be a plot description voice for movie A: OK, what you are looking for is the science fiction movie A starring actor MU, which tells the story of a young woman who accidentally takes in excessive objects into her body and gradually develops her brain potential to 100% to become a super-intelligent body... In this scenario, the virtual image collects user input as an interface, and the video assistant can perform semantic analysis on the user input, search for matching video resources based on the semantics in the input, display the search results in the interface, and drive the virtual image to output the corresponding voice. The process of the video assistant obtaining matching video resources based on user input can be implemented based on relevant technologies.

[0061] Among them, the video recommendation information may include: promotional images such as posters corresponding to the video, information describing the content of the video such as the video name, actor name, video type, etc., which is not limited by the present disclosure. The video details page includes video recommendation information, as well as trailers, highlights, etc. of the result video, which is not limited by the present disclosure. The summary description information can be summary description information of one or more videos in the result video to describe the commonalities of these result videos such as "same type", "same country", "similar to certain videos", etc., which is not limited by the present disclosure.

[0062] Scenario Example 2: Based on user input, a specific corresponding video can be found.

[0063] like Figure 3As shown, if the user input detection obtains that the user input is "I want to watch cartoon R", it is determined that the user's demand is very clear at this time, so the cartoon R can be played directly for the user, and the interface of the cartoon R being played is the video search result interface. At the same time, a certain type of video is usually watched by a special user group. For example, cartoons are generally watched by children. The video assistant can determine the special user group corresponding to the video to be played, and play the video in a playback mode matching the special user group. For example, for the health of children's eyes, the user can be controlled to play the cartoon R in the eye protection mode, and at the same time, the video playback mode reminder "eye protection mode" is displayed in the interface, and the virtual image issues a video playback mode reminder voice (target voice) "Okay baby, cartoon R is here. Eye protection mode is turned on, be careful not to get too close to the screen". The video assistant can also recognize the voice features of the user input, or the currently logged-in user information, and after determining that the user is a special user group (such as children, the elderly, etc.), control the user to play the video he searched for in the corresponding mode (such as eye protection mode) and make corresponding voice reminders.

[0064] Scenario Example 3: Multiple videos can be found based on user input.

[0065] like Figure 5 As shown in the figure, if the user input detection obtains that the user input is "Are there any new dramas recently", the result videos are multiple new TV dramas, and the video search result interface finally displayed to the user includes video recommendation information of each result video and summary description information "hot and good dramas". At the same time, the virtual image emits a target voice, which can be a recommendation voice for multiple result videos: Well, there are many good new dramas recently, all of them are here, and the popular TV series xx is recommended for you to watch...

[0066] Scenario Example 4: Multiple videos of a certain fixed type can be found based on user input.

[0067] like Figure 6 As shown, if the user input detection obtains that the user input is "help me find a horror movie to watch", the result videos are multiple horror movies, and the video search result interface finally displayed to the user includes the video recommendation information of each result video and the summary description information "midnight horror". At the same time, the virtual image sends out the target voice, which can be the recommendation suggestion voice for multiple result videos "OK, here is the midnight movie list" and the companion reminder voice "It's very scary, if you are afraid, I can watch it with you...".

[0068] Scenario Example 5: Configure the avatar widget based on user input.

[0069] like Figure 7As shown, if the user input detection obtains that the user input is "help me put on the new avatar pendant", the setting result interface finally displayed to the user can be a setting result interface that can display the avatar with the pendant after the avatar pendant is set, and can highlight the avatar pendant. At the same time, the virtual image sends a target voice, and the target voice can be a setting result reminder voice: OK, it's all dressed up...

[0070] After the result interface is displayed to the user, the virtual image may continue to be displayed to the user in the result interface, and the user may continue to interact with the virtual image, or may Figure 3 , Figure 5-Figure 7 As shown, the virtual image is no longer displayed under user control or automatically, and the present disclosure does not limit this.

[0071] In some embodiments, Figure 8 As shown, the method may also include: in the process of displaying a first browsing interface including multiple video recommendation information in response to a browsing operation, displaying a video recommendation reminder, wherein the video recommendation reminder includes a recommended video type and a promotional picture of each first video recommended based on the recommended video type. The recommended video type may be a classification of movies and / or dramas such as horror films, comedies, action films, etc., which is not limited in the present disclosure. The promotional picture may be a poster, a still, etc., which is not limited in the present disclosure. The video recommendation reminder is used to remind the user to watch videos that may be of interest to him or her. Among them, the video recommendation reminder may be formed according to the user's habit of watching videos determined by the user's historical behavior. The video recommendation reminder may be displayed in the same display area as the logo of the virtual image, presenting a display form in which the virtual image recommends videos to the user, and the logo of the virtual image may be used as an assistant startup control, which can facilitate the user to start the virtual image to further realize the desired function.

[0072] In some embodiments, Fig. 9 , Fig.10 As shown, the method may also include: in the process of displaying a second browsing interface including multiple surrounding short video information in response to a browsing operation, in response to a viewing operation on target surrounding short video information among the multiple surrounding short video information, stopping the display of the second browsing interface and displaying the target surrounding short video corresponding to the target surrounding short video information; in response to an end display operation on the target surrounding short video, stopping the playback of the target surrounding short video and returning to displaying the second browsing interface, and replacing the target surrounding short video information in the second browsing interface with a surrounding reminder. The surrounding reminder is used to remind the user to collect a second video related to the target surrounding short video (such as Fig. 9 ) and / or reminding the user to give a recommendation evaluation for the target surrounding short video (such as Fig.10In this way, the user's response to the surrounding reminder can be used to collect the second video, collect the user's recommendation evaluation, determine the user's viewing preference for the surrounding short video, and further recommend surrounding short videos to the user. The surrounding reminder can be displayed in the same display area as the logo of the virtual image, showing the form of the virtual image reminding the user. The logo of the virtual image can be used as an assistant startup control, which can facilitate the user to operate the virtual image to further achieve the desired function. The surrounding reminder will appear after the target surrounding short video is displayed, which can avoid the user being disturbed during the viewing process.

[0073] Among them, the surrounding short videos can be short videos related to the second video, such as video clips of the corresponding second video, trailers, videos edited based on multiple video pictures, etc. The sound in the surrounding short videos can be the original audio of the second video or the audio recorded by the producer. The surrounding short videos are used to recommend the second video to users.

[0074] In some embodiments, Fig.11 As shown, the method also includes: in response to a trigger operation for a famous scene selection reminder, displaying a famous scene selection interface for the current video, the famous scene selection interface including description information of each famous scene segment of the current video and the virtual image of the video assistant; in response to the selection input detected after the virtual image is triggered, playing the famous scene segment corresponding to the selection input. The current video may be the video currently being played, or the video mainly displayed on the current page, such as the above-mentioned result video. A famous scene refers to a well-known classic segment in the video. The famous scene selection reminder may include the text "Click me to go directly to the famous scene", and may also include a logo consistent with the virtual image pattern. The description information of the famous scene segment may include the main plot name of the famous scene segment, the number of times it is played, and other information related to the famous scene segment, which is not limited in this disclosure. The selection input may be a selection operation for each famous scene in the famous scene selection interface, or it may be a voice or text input for the virtual image.

[0075] Among them, when it is determined that the user may need to watch the famous scene clips of the current video, a famous scene selection reminder can be displayed. For example, the famous scene selection reminder can be displayed simultaneously with the video details page, and can also be displayed in the video playback interface when the user starts to play the video in full screen, so that the user can decide whether to watch the famous scene clips when he starts to watch the current video. It is also possible to display the famous scene selection reminder when it is determined that the user is watching the current video for the second time or multiple times, if it is detected that the user is constantly fast-forwarding the current video, etc. The present disclosure does not limit the triggering conditions for displaying the famous scene selection reminder.

[0076] In some embodiments, Fig.12As shown, the method may further include: in response to a configuration operation for the virtual image, displaying a virtual image setting interface, and displaying a role and / or voice of the virtual image determined according to the detected setting operation.

[0077] In this embodiment, if Fig.12 As shown, the configuration operation for the virtual image can be any method such as the user triggering the control for displaying the virtual image setting interface, or inputting the request of "displaying the virtual image setting interface" through the voice of the virtual image, and the virtual image setting interface can be displayed above the currently displayed interface, or displayed in other forms. The user can be reminded to select the required role from the optional roles of the virtual image in the virtual image setting interface, and after detecting that the user has selected the role (for example, detecting the trigger operation for the "Continue" control), the user is reminded to select the required sound from the optional sounds, and after determining that the user has completed the setting (for example, detecting the trigger operation for the "Finish" control), the home page is returned, and the set virtual image is displayed to the user on the home page. Among them, the optional roles and optional sounds can also include roles and sounds input by the user, and the present disclosure does not limit this.

[0078] The present disclosure also provides an interactive device, the device using a video assistant, the device comprising:

[0079] A virtual image display module, used to display the virtual image of the video assistant when it is determined based on the user operation that the display condition is met, so as to perform input detection to obtain user input when the virtual image is triggered;

[0080] The result display module is used to display a result interface formed in response to the user input, and control the virtual image to emit a target voice corresponding to the result interface.

[0081] In a possible implementation manner, the device further includes:

[0082] An assistant input control display module, used to display the virtual image of the video assistant and the assistant input control at the same time;

[0083] The triggering of the virtual image includes any one of the following: detecting a triggering operation on the virtual image, detecting a triggering operation on the assistant input control.

[0084] In a possible implementation, satisfying the display condition includes at least one of the following: detecting a trigger operation for a search reminder, detecting a trigger operation for an assistant startup control, detecting that the browsing time for interface browsing exceeds a time threshold, detecting a user's voice input for starting a virtual image, detecting a quick operation for starting a virtual image, and detecting that a user starts a video client;

[0085] Among them, the search reminder is displayed in response to a trigger operation on the search input box, and the search reminder is used to remind the user to use the video assistant to search for videos.

[0086] In a possible implementation, the result interface includes any one of a video search result interface and a setting result interface;

[0087] The content displayed in the video search result interface is formed by at least one result video obtained by performing a video search based on the user input;

[0088] The content displayed in the setting result interface is formed after the requirements are set according to the user input.

[0089] In a possible implementation manner, the device further includes:

[0090] A famous scene selection interface display module, for displaying a famous scene selection interface for the current video in response to a trigger operation for a famous scene selection reminder, wherein the famous scene selection interface includes description information of each famous scene segment of the current video and a virtual image of the video assistant;

[0091] The famous scene clip playing module is used to respond to the selection input detected after the virtual image is triggered, and play the famous scene clip corresponding to the selection input.

[0092] In a possible implementation manner, the device further includes:

[0093] A video recommendation reminder display module is used to display a video recommendation reminder in the process of displaying a first browsing interface including multiple video recommendation information in response to a browsing operation. The video recommendation reminder includes a recommended video type and promotional pictures of each first video recommended based on the recommended video type.

[0094] In a possible implementation manner, the device further includes:

[0095] A surrounding short video playback module is used to, in response to a browsing operation, stop displaying the second browsing interface including a plurality of surrounding short video information and display a target surrounding short video corresponding to the target surrounding short video information in response to a viewing operation on target surrounding short video information among the plurality of surrounding short video information;

[0096] A return control module, configured to, in response to an end display operation for the target surrounding short video, stop playing the target surrounding short video and return to display the second browsing interface, and replace the target surrounding short video information in the second browsing interface with a surrounding reminder;

[0097] The surrounding reminder is used to remind the user to collect the second video related to the target surrounding short video and / or remind the user to give a recommendation evaluation for the target surrounding short video.

[0098] In a possible implementation manner, the device further includes:

[0099] The virtual image configuration module is used to display the virtual image setting interface in response to the configuration operation for the virtual image, and to display the role and / or voice of the virtual image determined according to the detected setting operation.

[0100] It should be noted that although the above embodiments are used as examples to introduce the interactive method and device, those skilled in the art will appreciate that the present disclosure should not be limited thereto. In fact, users can flexibly set each step and module according to personal preferences and / or actual application scenarios, as long as they comply with the technical solution of the present disclosure.

[0101] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0102] The embodiment of the present disclosure also provides a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.

[0103] An embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0104] The embodiments of the present disclosure also provide a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0105] Fig.13 800 is a block diagram of an apparatus 800 for the above interactive method according to an exemplary embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or other electronic device.

[0106] Reference Fig.13, the device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output interface 812 (I / O interface), a sensor component 814 , and a communication component 816 .

[0107] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0108] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0109] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0110] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0111] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0112] The input / output interface 812 provides an interface between the processing component 802 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0113] The sensor assembly 814 includes one or more sensors for providing various aspects of the status assessment of the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, and the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800, and the temperature change of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0114] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0115] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0116] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions, which can be executed by the processor 820 of the device 800 to perform the above method.

[0117] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0118] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0119] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0120] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0121] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0122] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0123] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0124] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

[0125] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. An interactive method, characterized in that: The method is performed using a video assistant, and the method includes: When it is determined based on the user operation that the display condition is met, displaying the virtual image of the video assistant, so as to perform input detection to obtain user input when the virtual image is triggered; A result interface formed in response to the user input is displayed, and the virtual image is controlled to emit a target voice corresponding to the result interface.

2. The method according to claim 1, characterized in that The method further comprises: Displaying the virtual image of the video assistant and the assistant input controls at the same time; The triggering of the virtual image includes any one of the following: detecting a triggering operation on the virtual image, detecting a triggering operation on the assistant input control.

3. The method according to claim 1 or 2, characterized in that: Meeting the display conditions includes at least one of the following: detecting a trigger operation for a search reminder, detecting a trigger operation for an assistant startup control, detecting that the browsing time for the interface browsing exceeds a time threshold, detecting that the user starts the voice input of the virtual image, detecting a quick operation to start the virtual image, and detecting that the user starts the video client; Among them, the search reminder is displayed in response to a trigger operation on the search input box, and the search reminder is used to remind the user to use the video assistant to search for videos.

4. The method according to claim 3, characterized in that The result interface includes any one of a video search result interface and a setting result interface; The content displayed in the video search result interface is formed by at least one result video obtained by performing a video search based on the user input; The content displayed in the setting result interface is formed after the requirements are set according to the user input.

5. The method according to claim 1, characterized in that: The method further comprises: In response to a triggering operation for a famous scene selection reminder, displaying a famous scene selection interface for the current video, the famous scene selection interface including description information of each famous scene segment of the current video and a virtual image of the video assistant; In response to a selection input detected after the virtual image is triggered, a famous scene clip corresponding to the selection input is played.

6. The method according to claim 1, characterized in that The method further comprises: In the process of displaying a first browsing interface including a plurality of video recommendation information in response to a browsing operation, a video recommendation reminder is displayed, wherein the video recommendation reminder includes a recommended video type and promotional pictures of each first video recommended based on the recommended video type.

7. The method according to claim 1, characterized in that The method further comprises: In the process of displaying a second browsing interface including a plurality of surrounding short video information in response to a browsing operation, in response to a viewing operation on target surrounding short video information among the plurality of surrounding short video information, displaying the second browsing interface is stopped and a target surrounding short video corresponding to the target surrounding short video information is displayed; In response to an end display operation for the target surrounding short video, stop playing the target surrounding short video and return to display the second browsing interface, and replace the target surrounding short video information in the second browsing interface with a surrounding reminder; The surrounding reminder is used to remind the user to collect the second video related to the target surrounding short video and / or remind the user to give a recommendation evaluation for the target surrounding short video.

8. The method according to claim 1, characterized in that The method further comprises: In response to a configuration operation for the avatar, a avatar setting interface is displayed, and a character and / or voice of the avatar determined according to the detected setting operation is displayed.

9. An interactive device, characterized in that: The device utilizes a video assistant, and the device comprises: A virtual image display module, used to display the virtual image of the video assistant when it is determined based on the user operation that the display condition is met, so as to perform input detection to obtain user input when the virtual image is triggered; The result display module is used to display a result interface formed in response to the user input, and control the virtual image to emit a target voice corresponding to the result interface.

10. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method described in any one of claims 1 to 8 when executing the instructions stored in the memory.

11. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images