Interaction method and device for video

Abstract

The invention relates to an interaction method and device for videos, and the method comprises the steps: displaying a bullet screen for a first video in a process of playing the first video for a target user, and highlighting a first bullet screen sent by the target user in the bullet screens; and displaying reply information generated according to the first bullet screen, wherein the reply information is related to the first video and / or is matched with the preference of the target user. In the process of playing the video for the user, interaction with different users is realized, and diversity, timeliness and individuation of interaction are ensured.

Description

Technical Field

[0001] The present disclosure relates to the technical field of video playback interaction, and in particular to a method and device for video interaction. Background Art

[0002] With the diversification of video resources, meeting the diverse interactive needs of users when watching videos has also become a technical problem that needs to be solved urgently. For example, video barrage (Danmaku) is a common interactive method. It has the advantages of high real-time performance and good interactivity. Different users can interact with each other through barrage. However, the existing video interaction methods can no longer meet the increasing and more personalized needs of users. How to improve the diversity and personalization of video interaction is a technical problem that needs to be solved urgently. Summary of the invention

[0003] In view of this, the present disclosure proposes a video interaction method and device.

[0004] According to one aspect of the present disclosure, a method for interacting with a video is provided, the method comprising:

[0005] In the process of playing the first video for the target user, displaying the bullet comments for the first video, and highlighting the first bullet comment currently sent by the target user in the bullet comments;

[0006] Display reply information generated based on the first barrage, where the reply information is related to the first video and / or matches the preference of the target user.

[0007] In a possible implementation, the reply information includes one or more of answers to questions in the first barrage content, content recommended based on user needs reflected in the first barrage, and comments on the first barrage content.

[0008] In a possible implementation, displaying reply information generated according to the first bullet screen includes:

[0009] In the process of scrolling and displaying the barrage, the reply information is displayed at a position at a preset distance from the first barrage as the first barrage moves.

[0010] In a possible implementation, the reply information further includes prompt information related to the first bullet screen;

[0011] The method further includes: in response to a triggering operation on the prompt information, displaying content corresponding to the prompt information.

[0012] In a possible implementation, in response to a triggering operation on the prompt information, displaying content corresponding to the prompt information includes at least one of the following:

[0013] If the prompt information for the trigger operation is a plot selection prompt, the playback of the first video is paused and the wonderful plot of the first video is displayed, and then the first video is played in response to the wonderful plot display, wherein the wonderful plot display includes sequentially displaying thumbnails of each wonderful plot in the first video, or playing the first video at a preset playback speed, and the preset playback speed is higher than the normal playback speed of the first video;

[0014] If the prompt information for the trigger operation is an object viewing prompt, the first video continues to be played in the first area of ​​the current interface, and detailed information of the object is displayed in the second area of ​​the current interface, where the object includes at least one of a role, an actor, and an object;

[0015] If the prompt information targeted by the trigger operation is a previous review prompt, a video clip corresponding to the previous review prompt is played, and the first video continues to be played after the playback of the video clip ends. The video clip belongs to the first video or a second video associated with the first video.

[0016] In a possible implementation, the method further includes:

[0017] The comment input by the target user for the first video is displayed, and the comment reply information generated for the comment is displayed.

[0018] In a possible implementation, the method further includes:

[0019] When it is determined that the video is in the accompanying viewing mode, performing accompanying viewing display during the playing of the first video;

[0020] The accompanying display includes at least one of the following: displaying a virtual image of the video assistant, displaying an assistant input control, controlling the displayed virtual image to emit a target voice, and displaying a target text corresponding to the target voice; controlling the displayed virtual image to emit a target voice includes emitting a target voice and controlling the expression, lip shape and / or action of the virtual image to match the target voice;

[0021] Among them, the target voice includes at least one of the following: an explanatory voice for the current plot of the first video, a reply voice in response to user input; the user input includes at least one of the following: text and / or voice input by the user detected after the assistant input control is triggered, and the first barrage.

[0022] In a possible implementation, the method further includes:

[0023] During the full-screen display of the first video, in response to a trigger operation on the virtual image, the playback of the first video continues in the first area of ​​the current interface, and the accompanying display is performed in the second area of ​​the current interface.

[0024] According to another aspect of the present disclosure, there is provided an interactive device for a video, the device comprising:

[0025] A barrage display module, used to display barrages for the first video during the process of playing the first video for the target user, and to highlight the first barrage currently sent by the target user in the barrages;

[0026] A reply information display module is used to display reply information generated based on the first barrage, where the reply information is related to the first video and / or matches the preferences of the target user.

[0027] According to another aspect of the present disclosure, an electronic device is provided, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0028] According to another aspect of the present disclosure, a non-volatile computer-readable storage medium is provided, on which computer program instructions are stored, wherein the computer program instructions implement the above method when executed by a processor.

[0029] According to another aspect of the present disclosure, a computer program product is provided, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0030] Through the interactive method and device for videos provided by the embodiments of the present disclosure, in the process of playing a first video for a target user, the bullet screen for the first video is displayed, and the first bullet screen sent by the target user in the bullet screen is highlighted; the reply information generated according to the first bullet screen is displayed, and the reply information is related to the first video and / or matches the preference of the target user. In the process of playing videos for users, interaction with different users is achieved, ensuring the diversity, timeliness and personalization of the interaction.

[0031] Further features and aspects of the present disclosure will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate exemplary embodiments, features, and aspects of the disclosure and, together with the description, serve to explain the principles of the disclosure.

[0033] Figure 1 A flow chart of an interactive method for a video according to an embodiment of the present disclosure is shown.

[0034] Figure 2-Figure 10 A schematic diagram showing a flow chart of a method for interacting with a video according to an embodiment of the present disclosure.

[0035] Fig.11 It is a block diagram of a device 800 for video interaction according to an exemplary embodiment. DETAILED DESCRIPTION

[0036] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numerals in the accompanying drawings represent elements with the same or similar functions. Although various aspects of the embodiments are shown in the accompanying drawings, the drawings are not necessarily drawn to scale unless otherwise specified.

[0037] The word “exemplary” is used exclusively herein to mean “serving as an example, example, or illustration.” Any embodiment described herein as “exemplary” is not necessarily to be construed as preferred or advantageous over other embodiments.

[0038] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following specific embodiments. It should be understood by those skilled in the art that the present disclosure can also be implemented without certain specific details. In some examples, methods, means, components and circuits well known to those skilled in the art are not described in detail in order to highlight the subject matter of the present disclosure.

[0039] In order to solve the above technical problems, the embodiments of the present disclosure provide a method and device for video interaction. In the process of playing a first video for a target user, the bullet screen for the first video is displayed, and the first bullet screen sent by the target user in the bullet screen is highlighted; the reply information generated according to the first bullet screen is displayed, and the reply information is related to the first video and / or matches the preferences of the target user. In the process of playing videos for users, the video assistant is used to realize the interaction with different users, ensuring the diversity, timeliness and personalization of the interaction.

[0040] In this embodiment, the interactive method and device for video provided by the embodiment of the present disclosure can be implemented by using a video assistant. Among them, when users (including all users including the target user) watch videos through a video client installed on an electronic device, the video assistant in the video client can respond to the user's input to perform corresponding operations to achieve interaction with the user, such as responding to the user's input to perform video retrieval, video client settings, dialogue with the user, and other interactions related to the use of the video client, and the present disclosure does not limit this. Among them, the video assistant is set based on a trained model, and can understand the semantics of the user's input in real time and provide real-time feedback. Furthermore, the video assistant can respond to the user's input and perform matching operations in combination with the preferences of different users, thereby realizing the diversification and timeliness of the interaction, while meeting the personalized interaction needs of different users.

[0041] Among them, the trained models used to implement the video assistant may include intent recognition models, task routing models, multimodal input models, expert model networks, generative models, speech recognition models, text-to-speech conversion models, optical character recognition models, natural language processing models, machine learning models, retrieval enhancement generation technology, knowledge bases, etc., and the present disclosure does not limit this. The model can be trained based on relevant technologies according to the tasks to be performed. The video assistant can obtain the user's user preferences by analyzing the user's historical data during the user's use of the video client. Among them, user preferences may include: user speed preferences, resolution preferences, frequency preferences for watching different types of videos, the proportion of the number of different types of videos watched, language habits, whether to turn on the eye protection mode when watching different types of videos, and other personalized information related to the user watching videos or operating the video client, and the present disclosure does not limit this.

[0042] The following is a schematic illustration of the video interaction method and device provided by the embodiments of the present disclosure in conjunction with the accompanying drawings.

[0043] like Figure 1 , Figure 2-Figure 5 , Figure 7 As shown, the interactive method for videos provided by the present disclosure includes steps S101 and S102. In step S101, in the process of playing the first video for the target user, the barrage for the first video is displayed, and the first barrage currently issued by the target user in the barrage is highlighted. In step S102, the reply information generated according to the first barrage is displayed. The reply information may be related to the first video and / or match the preferences of the target user. The reply information may include one or more of answers to questions in the first barrage content, content recommended for user needs reflected in the first barrage, and comments on the first barrage content.

[0044] In this way, the reply information can be displayed to interact with the target user when the user first sends out the first bullet screen for the first video. In some embodiments, in the process of displaying the bullet screen of the first video, the bullet screen previously sent by the target user can also be highlighted, and the reply information corresponding to the previously generated bullet screen can be displayed or the corresponding reply information can be not displayed, that is, the reply information can be displayed together with the first bullet screen only when the corresponding first bullet screen is displayed for the first time, or the corresponding reply information can be displayed together with the first bullet screen every time the first bullet screen appears.

[0045] The reply information may be visible only to the user who sent the first barrage, invisible to other users, or visible to other designated users (such as friends).

[0046] In one possible implementation, the reply information may be generated by the video assistant based on the first barrage and in combination with the video-related information of the first video and / or the user preference of the target user.

[0047] Among them, the video-related information of the video can be information related to the plot, actors, screenwriters, directors, etc. of the video. Since the first bullet screen is sent by the target user in the process of watching the first video, the probability that the first bullet screen is related to the first video is relatively greater. Then, the generation of reply information in combination with the video-related information can ensure that the reply information can match the first bullet screen as much as possible. Due to the different preferences of different users, in order to achieve personalized services, the generation of reply information in combination with user preferences can ensure that the reply information matches the preferences of the target user. In this way, the generation of reply information through the video assistant can bring the user a sense of interaction and dialogue, and give the user an intuitive experience of companionship. The video-related information can be obtained by the video assistant based on the video itself and / or the descriptive text, tags and other information related to the video, or it can be called from the stored video-related information. User preferences can be obtained by the video assistant based on user behavior data, user input data, etc., or they can be called from stored user preferences.

[0048] In this embodiment, the video assistant can analyze the meaning expressed by the first bullet screen based on relevant technologies such as semantic analysis, and choose whether to generate reply information in combination with the video-related information of the first video and / or the user preferences of the target user according to the meaning expressed by the first bullet screen. For example, if the video assistant determines that the first bullet screen is a question that is unrelated to the video-related information of the first video, the video assistant can generate reply information that conforms to the language habits of the target user in the user preferences based on the determined answer to the first bullet screen.

[0049] In some embodiments, if the video assistant determines that there is no need to interact with the target user based on the meaning expressed by the first barrage, it may not generate and display reply information for the first barrage, that is, only highlight the first barrage; alternatively, it may generate fixed reply information, such as fixed text or symbols.

[0050] In one example, based on samples of the first barrage, samples of video-related information, samples of user preferences, and preset reply information for the first barrage, a model related to the video assistant can be trained based on relevant technologies, so that the trained model can analyze the semantics of the first barrage and obtain reply information related to the video-related information and / or user preferences. The present disclosure does not limit the training method.

[0051] In some embodiments, Figure 2-Figure 5 As shown, the implementation method of displaying the reply information generated according to the first barrage may include: in the process of scrolling the barrage, displaying the reply information at a preset distance from the first barrage as the first barrage moves until the entire content of the reply information is displayed. Among them, the preset distance can be set according to actual needs, and the present disclosure does not limit this. In some embodiments, the reply information can also be displayed by means of pop-up windows, etc., and the present disclosure does not limit this.

[0052] In this embodiment, the reply information can be expressed through text, punctuation marks, emoticons, etc., and the present disclosure does not limit this.

[0053] In some embodiments, the reply information may include content recommended for the user needs reflected in the first bullet screen, such as Figure 2 As shown in the figure, the first bullet screen "a bit boring" reflects the user's needs (feeling the current plot boring and wanting to see more exciting plots). The reply information can recommend plots to users, for example Figure 2 "Want to see exciting content? Click me to reach exciting plots." Recommended content can include plots, character introductions, product links, and any other content related to user needs.

[0054] The reply information also includes answers to the questions in the first bullet screen content. Figure 4 As shown, in the first bullet screen, the question "Does character Q want to fight?" is answered with "Yes, it's time for character Q to turn the tide~". Figure 5 In the first bullet screen shown, the question "Why does he do that?" is asked, and the answer is "Remember the three thousand Deadpools raised by the character Q? They have been raising them for a thousand days, just waiting for this moment." Figure 3 The first barrage shown shows a question "Who is this male lead?", and the answer is "Actor A, click me to view his detailed information."

[0055] The reply message may also include comments on the content of the first bullet screen. Figure 4 The first barrage shown is "What truth are you talking about?", and the reply message is "Yes, I'm telling the truth." And so on.

[0056] The first barrage content can be any barrage content sent by the user when watching a video. It can be related to the plot, the characters, the video itself (such as evaluating the quality of the video, etc.), or it can be unrelated to the video, the plot, or the characters.

[0057] The video assistant can derive the semantics of the first bullet comment by analyzing the semantics of the first bullet comment. For example, if the first bullet comment is a question about the plot, the video assistant can give a reply based on the video-related information (such as the plot introduction of the video). The video assistant can also give a reply based on the user's preferences, such as the user's language habits, for example, answering the user's question in a language style similar to the user's previous comments, bullet comments, and the current first bullet comment.

[0058] In some embodiments, the reply information may further include prompt information related to the first bullet screen. The prompt information may include any type of prompt information related to the content of the first bullet screen, and after the prompt information is triggered, the relevant content prompted by the prompt information may be displayed. The prompt information may include at least one of the following: a plot selection prompt related to the playback progress of the first video (such as Figure 2 a previous story review prompt related to the current story of the first video; an object viewing prompt related to an object in the first video, the object including at least one of a character, an actor, and an item, for example, the object viewing prompt includes at least one of the following: an actor viewing prompt related to an actor corresponding to a character in the first video (such as Figure 3 The prompt information may be a part of the reply information together with the above-mentioned answers, recommended content, comments, etc., or may be the answers, recommended content, comments themselves.

[0059] In some embodiments, the method may further include: in response to a trigger operation on the prompt information, displaying content corresponding to the prompt information determined by the video assistant. The content may include a page displaying detailed information or extended information, other application pages linked to, other application pages jumped to, videos or video clips, etc. Among them, the prompt information may include text for reminding the user, and may also include controls to remind the user to further operate. The trigger operation for the prompt information may include operations such as clicking, sliding, and double-clicking on controls and / or text in the prompt information, and the present disclosure does not limit this.

[0060] In some embodiments, in response to a trigger operation on the prompt information, displaying content corresponding to the prompt information determined by the video assistant may include at least one of the following:

[0061] Display form 1: If the prompt information targeted by the trigger operation is a plot selection prompt, the playback of the first video is paused and the wonderful plot of the first video is displayed, and then the first video is played in response to the response operation of the wonderful plot display.

[0062] Among them, the wonderful plot can be pre-selected and set by the platform, and the wonderful plot display can include sequentially displaying thumbnails of each wonderful plot in the first video, wherein each thumbnail of the wonderful plot can include one or more, and each thumbnail of the same wonderful plot can be formed by taking a screenshot of the video clip corresponding to the wonderful plot, or directly extracting some video frames of the corresponding video clip, and all thumbnails of the same wonderful plot can express the plot information of the wonderful plot. Alternatively, the wonderful plot display can include playing the first video at a preset playback speed. The preset playback speed is higher than the normal playback speed of the first video. The normal playback speed can be a speed that the user can choose to play the first video, such as 1x speed, 2x speed, 3x speed, 0.5x speed, etc. The preset playback speed is a speed higher than the normal playback speed to achieve fast playback of the first video, giving the user a fast preview viewing experience, so that the user can choose to play the favorite wonderful plot in the first video. For example, the preset playback speed can be 5x speed, 10x speed, etc., and the present disclosure does not limit this. In order to ensure the smooth playback of the first video at the preset playback speed, the resolution of the first video during playback can be adaptively reduced.

[0063] If a plot selection operation is detected during the wonderful plot display, the wonderful plot display is terminated and the first video is played again from the selected playback progress corresponding to the plot selection operation. The plot selection operation can be as follows: Figure 2As shown, the click and other operations for the wonderful plot display are shown. Since there is a corresponding relationship between the display progress of the wonderful plot display and the playback progress of the first video, then based on the corresponding relationship between the plot selection operation and the display progress of the wonderful plot display, the playback progress relationship with the first video can be determined, and then the selected playback progress that the target user needs to adjust is obtained, and then the first video is played again from the selected playback progress. For example, if the way to display the wonderful plot is to play the first video at a preset playback speed, then if the time point of the plot selection operation is detected, the display progress of the wonderful plot display is displayed to the 59th minute of the first video, then the 59th minute is the selected playback progress. If the way to display the wonderful plot is to display thumbnails of each wonderful plot, then if it is detected that the plot selection operation is for the nth thumbnail among multiple thumbnails, and the playback progress corresponding to the nth thumbnail is the 45th minute of the first video, the 45th minute can be determined as the selected playback progress, that is, the first video can be played starting from the selected wonderful plot.

[0064] If no plot selection operation is detected during the wonderful plot display process, the first video continues to be played after the wonderful plot display is completed. If no plot selection operation is detected, it can be determined that the target user does not need to adjust the playback progress of the first video, and the first video can continue to be played.

[0065] If a return operation is detected during the presentation of the wonderful plot, the presentation of the wonderful plot ends and the first video continues to be played. The return operation can be as follows: Figure 2 The operations shown are clicks on the area other than the wonderful plot display. If a return operation is detected, it can be determined that the target user does not need to continue the wonderful plot display, and the first video can be continued to be played.

[0066] For example, Figure 2 As shown in the figure, if a trigger operation is detected at 00:12:52 of the first video, and if a trigger operation is detected after the prompt "Click me to go directly to the high-energy plot" for the plot selection, the playback of the first video can be paused (stopped at 00:12:52) and the exciting plot can be displayed in the floating window above the first video interface. Figure 2 If the plot selection operation is detected, the wonderful plot display ends and the first video is played again from the playback progress corresponding to the plot selection operation (such as 00:29:42). Alternatively, if the plot selection operation is not detected, the first video is played again from 00:12:52 after the wonderful plot display is completed. If a return operation is detected during the wonderful plot display, the wonderful plot display ends and the first video is played again from 00:12:52.

[0067] Display form 2:

[0068] like Figure 3 As shown, if the prompt information for the trigger operation is an object viewing prompt, the first video continues to be played in the first area of ​​the current interface, and the detailed information of the corresponding object is displayed in the second area of ​​the current interface. The object can be at least one of a role, an actor, and an object.

[0069] Among them, the detailed information of the role may include the photo, name, age, native place, occupation, role experience and other information related to the role, and the present disclosure does not limit this. The detailed information of the actor may include the photo, name, age, native place, education, acting experience, representative works and other information related to the actor, and the present disclosure does not limit this. The items can be corresponding items that can be found in clothing, accessories, furniture, transportation (such as cars, motorcycles, bicycles, etc.), buildings, etc. The detailed information of the items may include price, sales website, sales store address, brand and other information related to the items, and the present disclosure does not limit this. In this way, the user's need to understand roles, actors and various items can be met.

[0070] Among them, the first area and the second area in display form two (as well as other positions between the first area and the second area in the same interface in the present disclosure) can be divided into relative positions, sizes, and shapes in the current interface according to actual needs or user settings, and the present disclosure does not impose any restrictions on this.

[0071] For example, in the process of displaying detailed information of actors (i.e., objects), it is also possible to respond to user operations such as Figure 3 The trigger operation of the "Return to Full Screen" control, the trigger operation of clicking on the first video being played, etc., end the display of the actor's detailed information and continue playing the first video.

[0072] Display form three:

[0073] If the prompt information for the trigger operation is a previous review prompt, the video clip corresponding to the previous review prompt is played, and the first video is played after the playback of the video clip ends. The video clip belongs to the first video or a second video associated with the first video. In this way, the user can review the corresponding video clip for the required plot in the form of previous review, thereby improving the overall experience of the user watching the video.

[0074] The video clip corresponding to the previous review prompt can be a clip of the first video itself, or a clip of the second video. The first video and the second video can be different movies in the same series, different episodes in the same drama (TV series, web series, etc.), etc., which are related in plot, and the present disclosure does not limit this. For example, if the first video is the 5th episode of a certain series, the video clip corresponding to the previous review prompt can be a clip before the current playback progress of the 5th episode, or a clip of the 4th episode.

[0075] In some embodiments, the method may further include: displaying a comment input by the target user on the first video, and displaying comment reply information generated for the comment.

[0076] Among them, Figure 6 As shown, when the target user is watching the first video, if a comment (such as Figure 6 In the example above, for example, "I knew that singer M would win the championship without a doubt!", you can use the video assistant to display the generated comment reply information in the form of a reply below the comment, and you can Figure 6 The content of the comment reply information is gradually displayed as shown, so as to bring a better interactive experience to the user. The comment reply information can be generated by the video assistant based on the comment combined with the video related information of the first video and / or the user preference of the target user, and can include text, punctuation marks, emoticons, etc., which is not limited by the present disclosure.

[0077] The above-mentioned reply information, comment replies, etc. generated by the video assistant can be presented together with the virtual image of the video assistant. The virtual image can be a person, cartoon, geometric pattern, etc.

[0078] In some embodiments, the method may further include: when determining that the video is in the accompanying viewing mode, performing an accompanying viewing display during the playing of the first video. The accompanying viewing mode may be turned on in response to a user's setting operation, voice input, a trigger operation on an accompanying viewing mode control, etc., and the present disclosure does not limit this.

[0079] The accompanying display can be suspended above the interface of the first video so as not to affect the user's continued viewing of the first video. The display position of the accompanying display can be set according to actual needs. For example, when the first video is played in full screen, the accompanying display can be located at the lower right, upper left, lower left, upper right, etc. of the interface. The size, color, transparency, etc. of the accompanying display can be set and adjusted according to actual needs or user settings.

[0080] Wherein, the accompanying display may include at least one of the following: display Figure 7-10The virtual image of the video assistant shown, Figure 7-10 The assistant input control shown controls the virtual image displayed to emit the target voice, display Figure 8 , Fig. 9 The target text corresponding to the target speech is shown in Figure 7-10 Controlling the displayed virtual image to emit a target voice includes emitting the target voice and controlling the expression, mouth shape and / or action of the virtual image to match the target voice. Fig. 9 , Fig.10 As shown, the accompanying display may also include a switching control, which is used to set the user input method to voice input or text input in response to the operation of the target user.

[0081] The target voice may include at least one of the following: a voice explaining the current plot of the first video, a reply voice in response to user input; the user input includes at least one of the following: text and / or voice input by the user detected after the assistant input control is triggered, and the first bullet screen. The reply voice in response to the user input includes a reply voice in response to the text and / or voice input by the user detected after the assistant input control is triggered, and may also include a voice corresponding to the reply information formed by the first bullet screen, and a voice corresponding to the comment reply information, etc. The voice corresponding to the information sent by the video assistant to the user is not limited in this disclosure.

[0082] For example, if Figure 7 As shown, when the target user is watching the first video in full screen, the virtual image of the video assistant and the assistant input control are displayed in the lower right corner of the interface. Then, as the plot of the first video progresses, the current plot can be explained and the virtual image can be controlled to give an explanation voice: "In ancient times, it was a great humiliation for men to wear women's clothes, but the character Q did this, which fully demonstrated his inner strength. He recited the "Chu Shi Biao" and fought back against the character P more forcefully. After this game, the character P has been furious and his physical condition has deteriorated rapidly", giving the target user an interactive experience that the virtual image is explaining to him.

[0083] In some embodiments, Fig. 9 , Fig.10 As shown, the method further includes: in the process of displaying the first video in full screen, in response to a triggering operation on the virtual image, continuing to play the first video in the first area of ​​the current interface, and performing the accompanying display in the second area of ​​the current interface. The first area and the second area can be divided into relative positions in the current interface according to actual needs or user settings ( Fig. 9 The left and right settings shown, Fig.10The present disclosure does not limit the upper and lower settings), size, and shape.

[0084] For example, if Fig. 9 As shown, the first video continues to be played in the first area of ​​the current interface, and the virtual image and assistant input controls are displayed in the second area of ​​the current interface. If the user opens the companion mode for the first time, he can also Fig. 9 As shown, a reminder to watch the show with the target user is issued, and the reminder to watch the show with the virtual image may include controlling the virtual image to issue a prompt voice and / or display a prompt text. For example, the reminder to watch the show with the virtual image may include a prompt voice "Hello, I am your exclusive assistant, I can watch the show with you, and you can find me if you have anything you want to talk about" and the displayed prompt text. Then, if a trigger operation is detected for the assistant input control, the voice or text input by the target user can be collected to obtain the user input, and then a reply is formed based on the user input and the virtual image is controlled to issue a reply voice. The method of generating the reply voice may be similar to the method of generating the reply information above.

[0085] In some embodiments, Fig. 9 As shown, the assistant input control can be displayed in a first manner during input detection after being triggered, and can be displayed in a second manner during input detection when not triggered, so as to highlight the different states of the assistant input control.

[0086] In some embodiments, the target user can set the specific image of the virtual image in advance according to the needs. The virtual image can be Fig. 9 The human image shown may also be a cartoon image or a set geometric shape image, and the present disclosure does not limit this.

[0087] The present disclosure also provides an interactive device for a video, the device comprising:

[0088] A barrage display module, used to display barrages for the first video during the process of playing the first video for the target user, and to highlight the first barrage currently sent by the target user in the barrages;

[0089] A reply information display module is used to display reply information generated based on the first barrage, where the reply information is related to the first video and / or matches the preferences of the target user.

[0090] In a possible implementation, the reply information includes one or more of answers to questions in the first barrage content, content recommended based on user needs reflected in the first barrage, and comments on the first barrage content.

[0091] In a possible implementation, displaying reply information generated according to the first bullet screen includes:

[0092] In the process of scrolling and displaying the barrage, the reply information is displayed at a position at a preset distance from the first barrage as the first barrage moves.

[0093] In a possible implementation, the reply information further includes prompt information related to the first bullet screen;

[0094] The device further includes: a prompt content display module, which is used to display content corresponding to the prompt information in response to a trigger operation on the prompt information.

[0095] In a possible implementation, in response to a triggering operation on the prompt information, displaying content corresponding to the prompt information includes at least one of the following:

[0096] If the prompt information for the trigger operation is a plot selection prompt, the playback of the first video is paused and the wonderful plot of the first video is displayed, and then the first video is played in response to the wonderful plot display, wherein the wonderful plot display includes sequentially displaying thumbnails of each wonderful plot in the first video, or playing the first video at a preset playback speed, and the preset playback speed is higher than the normal playback speed of the first video;

[0097] If the prompt information for the trigger operation is an object viewing prompt, the first video continues to be played in the first area of ​​the current interface, and detailed information of the object is displayed in the second area of ​​the current interface, where the object includes at least one of a role, an actor, and an object;

[0098] If the prompt information targeted by the trigger operation is a previous review prompt, a video clip corresponding to the previous review prompt is played, and the first video continues to be played after the playback of the video clip ends. The video clip belongs to the first video or a second video associated with the first video.

[0099] In a possible implementation manner, the device further includes:

[0100] The comment response module is used to display the comments input by the target user on the first video, and to display the comment reply information generated for the comments.

[0101] In a possible implementation manner, the device further includes:

[0102] A first accompanying viewing module, configured to, when it is determined that the video is in an accompanying viewing mode, perform accompanying viewing display during the process of playing the first video;

[0103] The accompanying display includes at least one of the following: displaying a virtual image of the video assistant, displaying an assistant input control, controlling the displayed virtual image to emit a target voice, and displaying a target text corresponding to the target voice; controlling the displayed virtual image to emit a target voice includes emitting a target voice and controlling the expression, lip shape and / or action of the virtual image to match the target voice;

[0104] Among them, the target voice includes at least one of the following: an explanatory voice for the current plot of the first video, a reply voice in response to user input; the user input includes at least one of the following: text and / or voice input by the user detected after the assistant input control is triggered, and the first barrage.

[0105] In a possible implementation manner, the device further includes:

[0106] The second accompanying viewing module is used to respond to a triggering operation on the virtual image during the full-screen display of the first video, continue playing the first video in the first area of ​​the current interface, and perform the accompanying viewing display in the second area of ​​the current interface.

[0107] It should be noted that although the above embodiments are used as examples to introduce the interactive method and device for videos, those skilled in the art will appreciate that the present disclosure should not be limited thereto. In fact, users can flexibly set each step and module according to personal preferences and / or actual application scenarios, as long as they comply with the technical solution of the present disclosure.

[0108] In some embodiments, the functions or modules included in the device provided by the embodiments of the present disclosure can be used to execute the method described in the above method embodiments. The specific implementation can refer to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0109] The embodiment of the present disclosure also provides a computer-readable storage medium on which computer program instructions are stored, and the computer program instructions implement the above method when executed by a processor. The computer-readable storage medium can be a volatile or non-volatile computer-readable storage medium.

[0110] An embodiment of the present disclosure further proposes an electronic device, comprising: a processor; and a memory for storing instructions executable by the processor; wherein the processor is configured to implement the above method when executing the instructions stored in the memory.

[0111] The embodiments of the present disclosure also provide a computer program product, including a computer-readable code, or a non-volatile computer-readable storage medium carrying the computer-readable code. When the computer-readable code runs in a processor of an electronic device, the processor in the electronic device executes the above method.

[0112] Fig.11 8 is a block diagram of an apparatus 800 for video interaction according to an exemplary embodiment. For example, the apparatus 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0113] Reference Figure 8 , the device 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output interface 812 (I / O interface), a sensor component 814 , and a communication component 816 .

[0114] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0115] The memory 804 is configured to store various types of data to support operations on the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0116] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0117] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0118] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), and when the device 800 is in an operating mode, such as a call mode, a recording mode, and a speech recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 804 or sent via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0119] The input / output interface 812 provides an interface between the processing component 802 and the peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0120] The sensor assembly 814 includes one or more sensors for providing various aspects of the status assessment of the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800, and the sensor assembly 814 can also detect the position change of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800, and the temperature change of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of a nearby object without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0121] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0122] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to perform the above method.

[0123] In an exemplary embodiment, a non-volatile computer-readable storage medium is also provided, such as a memory 804 including computer program instructions, which can be executed by the processor 820 of the device 800 to perform the above method.

[0124] The present disclosure may be a system, a method and / or a computer program product. The computer program product may include a computer-readable storage medium carrying computer-readable program instructions for causing a processor to implement various aspects of the present disclosure.

[0125] A computer-readable storage medium may be a tangible device that can hold and store instructions used by an instruction execution device. A computer-readable storage medium may be, for example, but not limited to, an electrical storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples of computer-readable storage media (a non-exhaustive list) include: a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a static random access memory (SRAM), a portable compact disk read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanical encoding device, such as a punch card or a raised structure in a groove on which instructions are stored, and any suitable combination of the foregoing. As used herein, a computer-readable storage medium is not to be interpreted as a transient signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission medium (e.g., a light pulse through a fiber optic cable), or an electrical signal transmitted through a wire.

[0126] The computer-readable program instructions described herein can be downloaded from a computer-readable storage medium to each computing / processing device, or downloaded to an external computer or external storage device via a network, such as the Internet, a local area network, a wide area network, and / or a wireless network. The network can include copper transmission cables, optical fiber transmissions, wireless transmissions, routers, firewalls, switches, gateway computers, and / or edge servers. The network adapter card or network interface in each computing / processing device receives the computer-readable program instructions from the network and forwards the computer-readable program instructions for storage in the computer-readable storage medium in each computing / processing device.

[0127] The computer program instructions for performing the operation of the present disclosure may be assembly instructions, instruction set architecture (ISA) instructions, machine instructions, machine-related instructions, microcode, firmware instructions, state setting data, or source code or object code written in any combination of one or more programming languages, including object-oriented programming languages, such as Smalltalk, C++, etc., and conventional procedural programming languages, such as "C" language or similar programming languages. Computer-readable program instructions may be executed completely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., using an Internet service provider to connect via the Internet). In some embodiments, an electronic circuit, such as a programmable logic circuit, a field programmable gate array (FPGA), or a programmable logic array (PLA), may be customized by utilizing the state information of the computer-readable program instructions, and the electronic circuit may execute the computer-readable program instructions, thereby realizing various aspects of the present disclosure.

[0128] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices (systems) and computer program products according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0129] These computer-readable program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processor of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0130] Computer-readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operating steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, thereby causing the instructions executed on the computer, other programmable data processing apparatus, or other device to implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0131] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of the module, program segment or instruction includes one or more executable instructions for realizing the specified logical function. In some alternative implementations, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be implemented with a dedicated hardware-based system that performs the specified function or action, or can be implemented with a combination of special hardware and computer instructions.

[0132] The embodiments of the present disclosure have been described above, and the above description is exemplary, not exhaustive, and is not limited to the disclosed embodiments. Many modifications and changes will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The selection of terms used herein is intended to best explain the principles of the embodiments, practical applications, or technical improvements in the market, or to enable other persons of ordinary skill in the art to understand the embodiments disclosed herein.

Claims

1. An interactive method for a video, characterized in that: The method comprises: In the process of playing the first video for the target user, displaying the bullet comments for the first video, and highlighting the first bullet comment currently sent by the target user in the bullet comments; Display reply information generated based on the first barrage, where the reply information is related to the first video and / or matches the preference of the target user.

2. The method according to claim 1, characterized in that The reply information includes one or more of answers to questions in the first barrage content, content recommended based on user needs reflected in the first barrage, and comments on the first barrage content.

3. The method according to claim 1, characterized in that Displaying the reply information generated according to the first bullet screen, including: In the process of scrolling and displaying the barrage, the reply information is displayed at a position at a preset distance from the first barrage as the first barrage moves.

4. The method according to claim 1, characterized in that: The reply information also includes prompt information related to the first bullet screen; The method further includes: in response to a triggering operation on the prompt information, displaying content corresponding to the prompt information.

5. The method according to claim 4, characterized in that In response to a triggering operation on the prompt information, displaying content corresponding to the prompt information includes at least one of the following: If the prompt information for the trigger operation is a plot selection prompt, the playback of the first video is paused and the wonderful plot of the first video is displayed, and then the first video is played in response to the wonderful plot display, wherein the wonderful plot display includes sequentially displaying thumbnails of each wonderful plot in the first video, or playing the first video at a preset playback speed, and the preset playback speed is higher than the normal playback speed of the first video; If the prompt information for the trigger operation is an object viewing prompt, the first video continues to be played in the first area of ​​the current interface, and detailed information of the object is displayed in the second area of ​​the current interface, where the object includes at least one of a role, an actor, and an object; If the prompt information targeted by the trigger operation is a previous review prompt, a video clip corresponding to the previous review prompt is played, and the first video continues to be played after the playback of the video clip ends. The video clip belongs to the first video or a second video associated with the first video.

6. The method according to claim 1, characterized in that The method further comprises: The comment input by the target user for the first video is displayed, and the comment reply information generated for the comment is displayed.

7. The method according to claim 1, characterized in that The method further comprises: When it is determined that the video is in the accompanying viewing mode, performing accompanying viewing display during the playing of the first video; The accompanying display includes at least one of the following: displaying a virtual image of the video assistant, displaying an assistant input control, controlling the displayed virtual image to emit a target voice, and displaying a target text corresponding to the target voice; controlling the displayed virtual image to emit a target voice includes emitting a target voice and controlling the expression, lip shape and / or action of the virtual image to match the target voice; Among them, the target voice includes at least one of the following: an explanatory voice for the current plot of the first video, a reply voice in response to user input; the user input includes at least one of the following: text and / or voice input by the user detected after the assistant input control is triggered, and the first barrage.

8. The method according to claim 7, characterized in that The method further comprises: During the full-screen display of the first video, in response to a trigger operation on the virtual image, the playback of the first video continues in the first area of ​​the current interface, and the accompanying display is performed in the second area of ​​the current interface.

9. An interactive device for video, characterized in that: The device comprises: A barrage display module, used to display barrages for the first video during the process of playing the first video for the target user, and to highlight the first barrage currently sent by the target user in the barrages; A reply information display module is used to display reply information generated based on the first barrage, where the reply information is related to the first video and / or matches the preferences of the target user.

10. An electronic device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to implement the method described in any one of claims 1 to 8 when executing the instructions stored in the memory.

11. A non-volatile computer-readable storage medium having computer program instructions stored thereon, characterized in that: When the computer program instructions are executed by a processor, the method according to any one of claims 1 to 8 is implemented.

Images