Video playback method, device, equipment, medium and product

By displaying a role relationship diagram on the video playback interface and automatically playing video clips of related roles in response to user operations, the problem of difficulty in understanding role relationships in the specified role viewing function is solved, and the user experience and efficiency are improved.

CN118890513BActive Publication Date: 2025-09-16TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF -1 Cites 0 Cited by

Patent Information

Application Number
CN202411149517.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-03-09
Publication Date
2025-09-16
Estimated Expiration
2042-03-09

Smart Images

  • Figure CN118890513B_ABST
    Figure CN118890513B_ABST
Patent Text Reader

Abstract

This application is a divisional application of Chinese application 202210225472.1. This application discloses a video playback method, device, equipment, medium and product, which relate to the field of multimedia technology. The method includes: in response to a search operation for a target video, displaying a role relationship map corresponding to the target video in the video content introduction interface of the target video, the role relationship map including a first role control corresponding to the first role; in response to receiving a trigger operation on the first role control, playing the first video clip associated with the first role; in response to the appearance of a second character in the playback screen of the first video clip, displaying a second role control corresponding to the second character, and there being a role association relationship between the second character and the first character; in response to receiving a trigger operation on the second role control, playing at least one second video clip associated with the second character. It is convenient for users to quickly understand the role relationship between the characters in the target video and improve the efficiency of understanding the plot of the target video.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] This application is a divisional application of the invention patent application with application number 202210225472.1 filed on March 9, 2022, and invention name “Video Playback Method and Device”. Technical Field

[0002] The embodiments of the present application relate to the field of multimedia technology, and in particular to a video playback method, apparatus, device, medium, and product. Background Art

[0003] Video applications usually provide a variety of functions to assist in efficient video viewing, such as: double-speed playback function, opening and ending skip function, specified role viewing function, etc.

[0004] In the related art, after the designated character viewing function is turned on, only the clips of the designated character in the video are played. For example, when watching video A, if you choose to watch character B in video A separately, only the video clips corresponding to character B will be played during the playback of video A.

[0005] However, in the designated character viewing function, it is easy to cause a disconnect between the video content related to the viewed character and other characters in the video, resulting in the user being unable to understand the relationship between the various characters in the film and television work in a timely manner. Multiple playbacks are required for confirmation, the human-computer interaction efficiency is low, and the amount of data interaction between the server and the terminal is large. Summary of the Invention

[0006] The embodiments of the present application provide a video playback method, apparatus, device, medium, and product that improve the efficiency of understanding the storyline of a video clip to a certain extent. The technical solution is as follows.

[0007] In one aspect, a video playback method is provided, the method comprising:

[0008] In response to a search operation for a target video, displaying a character relationship map corresponding to the target video in a video content introduction interface of the target video, the character relationship map being used to indicate association relationships between characters appearing in the target video, the character relationship map including a first character control corresponding to a first character;

[0009] In response to receiving a trigger operation on the first character control, playing the first video clip associated with the first character;

[0010] In response to a second character appearing in the playback screen of the first video clip, displaying a second character control corresponding to the second character, wherein the second character has a role association relationship with the first character, and the second character control is used to play the second video clip associated with the second character in the target video;

[0011] In response to receiving a trigger operation on the second character control, at least one second video clip associated with the second character is played.

[0012] In another aspect, a video playback device is provided, comprising:

[0013] A display module is configured to, in response to a search operation for a target video, display a character relationship map corresponding to the target video in a video content introduction interface of the target video, wherein the character relationship map is configured to indicate association relationships between characters appearing in the target video, and the character relationship map includes a first character control corresponding to a first character;

[0014] a playing module, configured to play the first video clip associated with the first character in response to receiving a triggering operation on the first character control;

[0015] The display module is further configured to display a second character control corresponding to the second character in response to a second character appearing in the playback screen of the first video clip, wherein the second character has a role association relationship with the first character, and the second character control is configured to play the second video clip associated with the second character in the target video;

[0016] The playback module is further configured to, in response to receiving a triggering operation on the second character control, play at least one second video clip associated with the second character.

[0017] On the other hand, a computer device is provided, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the video playback method as described in any of the above-mentioned embodiments of the present application.

[0018] On the other hand, a computer-readable storage medium is provided, in which at least one instruction, at least one program, a code set or an instruction set is stored. The at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by a processor to implement a video playback method as described in any of the above embodiments of the present application.

[0019] In another aspect, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the video playback method described in any of the above embodiments.

[0020] The beneficial effects of the technical solutions provided in the embodiments of the present application include at least:

[0021] When watching the first video clip corresponding to the first character, by identifying the second character in the first video clip, an entry control for jumping to play the second video clip corresponding to the second character is provided in the playback screen, so that users can quickly understand the role relationship between the characters in the target video and improve the efficiency of users in understanding the plot of the target video; in addition, by automatically analyzing the role relationship between the characters, other content related to the target video can be further expanded. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0023] Figure 1 This is a schematic diagram of an interface of a role relationship map provided in an exemplary embodiment of the present application;

[0024] Figure 2 This is a schematic diagram of an implementation environment provided by an exemplary embodiment of the present application;

[0025] Figure 3 This is a flowchart of a video playback method provided by an exemplary embodiment of the present application;

[0026] Figure 4 This is a schematic diagram of an interface corresponding to a video playback method provided by an exemplary embodiment of the present application;

[0027] Figure 5 is a flowchart of a video playback method provided by another exemplary embodiment of the present application;

[0028] Figure 6 is based on Figure 5 The illustrated embodiment provides a schematic diagram of an interface displaying a first character control;

[0029] Figure 7 is based on Figure 5Another exemplary embodiment is shown, providing a schematic diagram of an interface displaying a first character control;

[0030] Figure 8 is based on Figure 5 Another exemplary embodiment is shown as a schematic diagram of an interface display;

[0031] Figure 9 is a flowchart of a video playback method provided by another exemplary embodiment of the present application;

[0032] Figure 10 is based on Figure 9 An exemplary embodiment is shown as a schematic diagram of an interface for displaying a return control on an interface;

[0033] Figure 11 is a flowchart of a video playback method provided by another exemplary embodiment of the present application;

[0034] Figure 12 This is a structural block diagram of a video playback device provided by an exemplary embodiment of the present application;

[0035] Figure 13 is a structural block diagram of a video playback device provided by another exemplary embodiment of the present application;

[0036] Figure 14 This is a structural block diagram of a server provided by an exemplary embodiment of the present application. DETAILED DESCRIPTION

[0037] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0038] First, a brief introduction is given to the terms and technologies involved in the embodiments of this application.

[0039] Target video: used to indicate the video clip to be played, the target video includes but is not limited to at least one of a short video, a film and television drama, and a documentary, the target video contains at least two characters, each character has its own story line, and there is a role association relationship between each character, wherein multiple relationships may exist between each character, in the embodiment of the present application, only the direct relationship between the characters is analyzed, for example, a target video contains a protagonist a, a protagonist b and a supporting role c, the three characters may have a bidirectional role association relationship, a unidirectional role association relationship, or no role association relationship, schematically, protagonist a and protagonist b are lovers, supporting role c is protagonist a's secret admirer, wherein the protagonist a and protagonist b have a bidirectional role association relationship, the supporting role c has a unidirectional role association relationship with protagonist a, and the protagonist b has no role association relationship with supporting role c; in the embodiment of the present application, the role relationship between the important characters in the target video is deeply analyzed, and an entry control for switching video clips is provided based on the determined role relationship.

[0040] Role relationship map: used to indicate the role relationship between the characters in the target video, such as Figure 1 As shown, the terminal interface displays a role relationship map 100 corresponding to the target video. The role relationship map 100 includes roles 101 to 104. The role relationship map 100 also displays the association relationship between the roles. Figure 1 ; optionally, the role relationship map 100 displays role information corresponding to each role, including but not limited to the name of the role played by the role in the target video, the identity information of the role in the target video, the dubbing character information corresponding to the role, and the character information of the role; for details on how to draw the role relationship map and the details of the role relationship map, please refer to the subsequent description content and will not be described here.

[0041] Storyline development sequence: used to indicate the story line composed of various story nodes that are connected in time sequence. There are multiple different story nodes corresponding to each character, and the multiple different story nodes corresponding to the character constitute a complete and independent storyline development sequence. That is, there are complete and independent story lines corresponding to each character in the target video, and the story lines corresponding to each character are combined to form the overall story line of the target video. In an embodiment of the present application, the character control is triggered to play the video clips associated with the character. Here, the video clips can be arranged and aggregated according to the storyline development sequence, that is, a list of video clips corresponding to the character is displayed in the playback interface. The video clip list is arranged in sequence according to the storyline development sequence. Each video clip has an introduction content, and the introduction content can be used to indicate an overview of the events that occurred in the video clip. For example, video clip 1, video clip 2 and video clip 3 correspond to character a. The video clip list is displayed on the interface of playing the video clip corresponding to character a. The list includes the titles of the video clips, the names of other newly appeared characters, etc. For example, the title of video clip 1 is: Character a obtains a key clue; or a new character b appears in video clip 1, and the introduction content is displayed around the title of video clip 1: Character b appears, etc.

[0042] Artificial Intelligence (AI) is the theory, methods, techniques, and application systems that use digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, to perceive the environment, acquire knowledge, and use that knowledge to achieve optimal results. In other words, AI is a comprehensive technology within computer science that seeks to understand the essence of intelligence and produce new intelligent machines that can respond in a manner similar to human intelligence. AI also involves studying the design principles and implementation methods of various intelligent machines, enabling them to possess the capabilities of perception, reasoning, and decision-making.

[0043] Artificial intelligence (AI) technology is a comprehensive discipline encompassing a wide range of fields, encompassing both hardware and software technologies. Foundational AI technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, big data processing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, speech processing, natural language processing, and machine learning / deep learning.

[0044] Computer Vision (CV): Computer vision is the science of making machines "see." As a scientific discipline, CV studies related theories and technologies, aiming to build artificial intelligence systems that can extract information from images or multidimensional data. Computer vision technologies typically include image processing, image recognition, image semantic understanding, image retrieval, optical character recognition (OCR), video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, and common biometric recognition technologies such as facial recognition and fingerprint recognition.

[0045] With the research and advancement of artificial intelligence technology, artificial intelligence technology has been studied and applied in many fields, such as common smart homes, smart wearable devices, virtual assistants, smart speakers, smart marketing, unmanned driving, autonomous driving, drones, robots, smart medical care, smart customer service, etc. It is believed that with the development of technology, artificial intelligence technology will be applied in more fields and play an increasingly important role.

[0046] Next, in conjunction with the above-mentioned noun introduction, the application scenarios involved in the embodiments of this application are introduced:

[0047] First, it is applied to video viewing scenarios;

[0048] When a user watches a target video through a browser or player in a terminal, a character relationship map corresponding to the target video is obtained. The target video can be at least one of a self-created short video, a short video obtained through secondary editing, a film or television series, and a documentary. Optionally, the character relationship map is displayed on the video content introduction page or the interface for playing the target video. The character relationship map includes the corresponding avatars and character description information of each character.

[0049] In an embodiment of the present application, the avatars corresponding to each character displayed in the role relationship map are used to play video clips with a preset relationship with themselves. When a click operation is received on the avatar corresponding to the first character in the role relationship map, the terminal obtains and aggregates at least one first video clip corresponding to the character, and displays the aggregated at least one first video clip in the current display interface. The user selects the first video clip from the at least one first video clip to play. When other characters appear in the playback screen of the first video clip, the current frame is extracted for character recognition, and the role relationship between the newly appeared second character and the first character is determined. Based on the determined role relationship, the second role control corresponding to the second character is displayed in the current interface. The user clicks the second role control to quickly switch from the first video clip corresponding to the first character to the second video clip corresponding to the second character, automatically sorting out the role relationships between the various characters in the target video and the story clips (first video clip and second video clip) corresponding to the characters, helping the user to quickly understand the story line development sequence of the target video, and further improving the efficiency of the user in watching the target video. Among them, the above-mentioned role relationship map can be obtained after analyzing the target video or pre-set.

[0050] Second, it is applied to game analysis scenarios;

[0051] Some games feature multiple virtual characters, each with a pre-set relationship between them. During the game, when a user controls the main virtual character, they use the relevant information displayed in the game to determine the relationship between the newly added virtual character and the main virtual character. However, as the game progresses, the user may lose track of the relationship between each virtual character and the main virtual character, requiring the user to re-watch the game progress, which reduces the user's ability to understand the game storyline.

[0052] In an embodiment of the present application, during the game, when a new virtual object appears, the terminal stores the role association relationship between the newly appeared virtual object and the main virtual object, and displays the avatar entry control of the newly appeared virtual object in the current interface. The avatar entry control is used to display the role description content between the newly appeared virtual object and the main virtual object, effectively improving the user's efficiency in understanding the game storyline and improving the efficiency of human-computer interaction.

[0053] In the embodiment of the present application, the video playback method provided in this embodiment can also be applied to the field of artificial intelligence for automated analysis, which is not limited in this application.

[0054] The above are merely illustrative examples. The video playback method provided in the embodiments of the present application can also be applied to other application scenarios, and the present application does not limit this.

[0055] Finally, combined with the above-mentioned term introduction and application scenarios, the implementation environment of the embodiment of this application is introduced.

[0056] Figure 2 This is a schematic diagram of the implementation environment provided by the embodiment of the present application. Figure 2 As shown, the implementation environment includes a terminal 210 and a server 220. The terminal 210 and the server 220 are connected via a communication network 230. The communication network 230 can be a wireless network or a wired network, which is not limited in this application.

[0057] Optionally, the user searches for the target video in a designated application in the terminal 210, and displays a video content introduction page corresponding to the target video in the current interface. The designated application includes but is not limited to a browser, a player, and image recognition software. The video content introduction page displays a character relationship map corresponding to the target video, and the character relationship map displays character controls for each character corresponding to the target video.

[0058] The user clicks on the first role control in the role relationship map, and the terminal 210 sends a play request to the server 220. The server 220 aggregates at least one first video segment corresponding to the first role in the target video according to the play request, and feeds back the aggregated at least one first video segment to the terminal 210.

[0059] The terminal 210 displays at least one first video segment corresponding to the first character in the current interface according to the feedback information and plays the at least one first video segment in the order of the playback time of the target video.

[0060] Optionally, when a second character appears in the playback screen of the first video clip, and there is a role association relationship between the second character and the first character, a second character control is displayed in the playback interface of the terminal 210 .

[0061] In response to receiving a trigger operation on the second character control (triggering a video switching request), the terminal 210 sends a video switching request to the server 220. The server 220 obtains at least one second video segment corresponding to the second character in the target video according to the video switching request, and feeds back the at least one second video segment to the terminal 210.

[0062] Optionally, the terminal 210 automatically plays at least one second video segment, and a return control is further displayed in the playback screen of the second video segment, where the return control is used to switch the currently played second video segment to the first video segment.

[0063] It is worth noting that the above-mentioned terminal 210 can be implemented as a mobile terminal such as a mobile phone, a tablet computer, a car terminal, a smart home device, a wearable device, a portable laptop computer, etc., or it can be implemented as a terminal such as a desktop computer, and the embodiments of the present application are not limited to this.

[0064] The above-mentioned server 220 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers. It can also be a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDN), as well as big data and artificial intelligence platforms.

[0065] Cloud technology refers to a hosting technology that unifies hardware, software, and network resources within a wide area network (WAN) or local area network (LAN) to enable data computing, storage, processing, and sharing. Cloud technology is a general term for network technology, information technology, integration technology, management platform technology, and application technology, all based on the cloud computing business model. It can form a resource pool that can be used on demand with flexibility and convenience. Cloud computing technology will become a crucial support. Backend services for technical network systems, such as video websites, image websites, and more portals, require significant computing and storage resources. With the rapid development and application of the internet industry, every item will likely have its own unique identification mark and will need to be transmitted to backend systems for logical processing. Data of varying levels will be processed separately, and data from all industries will require a strong system backend, which can only be achieved through cloud computing.

[0066] In some embodiments, the server 220 may also be implemented as a node in a blockchain system.

[0067] The above implementation environment is only an illustrative example. The video playback method provided in the embodiment of the present application can also be applied alone to the terminal 210 or alone to the server 220. The present application does not limit this. In the embodiment of the present application, the video playback method is applied to the joint implementation environment of the server 220 and the terminal 210 for implementation.

[0068] In conjunction with the above implementation environment, the video playback method involved in the embodiment of the present application is described. Figure 3 This is a flowchart of a video playback method provided by an exemplary embodiment of the present application. In the embodiment of the present application, the method is applied to a terminal for illustration. In the embodiment of the present application, Figure 3 As shown, the method includes:

[0069] Step 301: Display a first character control.

[0070] In the embodiment of the present application, the user uses a designated application to search for the target video, and a role relationship map corresponding to each character in the target video is displayed in the video content introduction interface of the target video. The role relationship map displays the role controls corresponding to each character in the target video and the relationship description content between each character. The designated application can be a browser application, a video playback application, a live broadcast application, a cloud disk storage application, etc. For the relevant content of this part, please refer to step 501 and the attached Figure 6 , which will not be described in detail here.

[0071] In other embodiments, the user selects a target video to watch, and a role relationship map is displayed in the playback interface of the target video, and role controls corresponding to multiple roles are displayed in the role relationship map, or the role controls corresponding to each role are directly displayed in the playback interface of the target video. The above-mentioned target video includes but is not limited to at least one of a short video, a film and television series, and a documentary.

[0072] In an optional embodiment, the role relationship map is used to indicate the relationship between the various characters in the target video, and can also be used to indicate the relationship between the core characters in the target video. The role relationship map also displays the role name, role identity and direct relationship between the roles corresponding to each role. This application does not limit this.

[0073] The role relationship map includes role controls corresponding to each role, including a first role control, which is used to indicate the role information of the role in the target video, including but not limited to the character information of the person playing the role, the name of the role played by the character in the target video, the identity of the role played by the character in the target video, and the character information of the person dubbing the role on screen.

[0074] In another optional embodiment, in a related interface displaying the target video, a list of character controls corresponding to the characters included in the target video is displayed, wherein the list of character controls includes a first character control.

[0075] In the embodiment of the present application, the scenarios for displaying the first character control include but are not limited to the following:

[0076] First, a first character control is displayed in the content introduction interface displaying the target video, and the first character control is used to play the first video clip associated with the first character in the target video, wherein the content introduction interface is used to indicate an interface for introducing the target video, which includes a content introduction of the target video, an image corresponding to the target video, and a role relationship map corresponding to each character in the target video, and the role relationship map displays the role controls corresponding to each character, including the first character control corresponding to the first character.

[0077] Second, a first character control is displayed in the playback interface of the target video. Optionally, character controls corresponding to each character are superimposed and displayed in the playback screen of the target video, including displaying the first character control.

[0078] Third, a function control is displayed in the playback interface of the target video. When a trigger operation on the function control is received, a character control list is superimposed and displayed on the playback interface, including the first character control.

[0079] It is worth noting that the display method of the above-mentioned first character control is only an illustrative example and is not limited in this embodiment.

[0080] In the embodiment of the present application, the first character control can be understood as a quick entry for playing the video clip associated with the first character.

[0081] Step 302: In response to receiving a trigger operation on a first character control, play a first video clip associated with the first character.

[0082] Optionally, in response to receiving a trigger operation on the first character control, the trigger operation including but not limited to a click operation, a long press operation, a drag operation, a trigger operation input through an external device, and a voice control operation, the first video clip associated with the first character is obtained. The association relationship is used to indicate the relationship between the video clip and the first character. The association relationship can be that the video clip contains the first character, that is, the first video clip is a video clip in which the first character appears; it can also be a foreshadowing clip that leads to the first character, that is, the first video clip plays a guiding role in the appearance of the first character; it can also be a video clip in which other characters and the first character have a common event, that is, the first character does not appear in the first video clip, but the other characters that appear perform the same event as the first character. In this embodiment, the video clip associated with the role can also be referred to as the video clip corresponding to the role.

[0083] In the embodiment of the present application, methods for obtaining the first video clip include but are not limited to:

[0084] First, in response to receiving a trigger operation on the first character control, a video acquisition request is sent to the server, where the video acquisition request includes relevant information of the first character, a role relationship map corresponding to the target video, the target video, etc.; the server obtains the first video clip containing the first character in the target video (the number of first video clips is greater than or equal to 1) based on the received video acquisition request, and compresses and packages the first video clip and feeds it back to the terminal. The terminal plays the first video clip associated with the first character in sequence in the terminal interface based on the feedback from the server.

[0085] Second, the terminal pre-stores video clips associated with each character in the target video. When the terminal receives a trigger operation of the first character control, the terminal directly obtains the first video clip associated with the first character from the local computer based on the relationship between the first character control, the target video and the first character, and plays the first video clip.

[0086] Third, the server pre-stores video clips associated with each character in the target video. When the terminal receives the trigger operation of the first character control, the terminal sends a video acquisition request to the server, directly obtains the first video clip associated with the first character from the server, and feeds it back to the terminal for playback.

[0087] Fourth, the cloud storage system stores video clips associated with each character in the target video. For details, please refer to Table 1 below. Table 1 shows the storage relationship between the target video, characters and video clips stored in the cloud storage system. Video A includes characters a and b. Character a corresponds to video clip 1, and character b corresponds to video clip 2. When the user watches video A, after triggering the character control of character a, the video clip 1 corresponding to character a in video A is directly obtained from the cloud storage system, and the video clip 1 is fed back to the terminal and played. Optionally, video clips 1 to 7 can be implemented as a collection of video sub-clips, such as: video clip 1 can be implemented as a collection of video sub-clips corresponding to multiple characters a, or, character a corresponds to 1 or more video clips.

[0088] Table 1:

[0089]

[0090] Optionally, the cloud storage system also stores the role relationships between the characters in the target video, and based on the role relationships between the characters, draws a role relationship map corresponding to the characters in the target video.

[0091] Step 303: In response to the second character appearing in the playback screen of the first video clip, a second character control corresponding to the second character is displayed.

[0092] Optionally, the first role corresponds to at least one first video clip, and the at least one first video clip is played sequentially; during the playback of at least one video clip, the terminal performs role recognition on the current frame of the first video clip to obtain a candidate role appearing in the playback screen of the first video clip.

[0093] Optionally, a role relationship map corresponding to the target video is obtained. The role relationship map is used to indicate the relationship between the characters appearing in the target video. The following is a detailed introduction to the process of generating the role relationship map, which specifically includes the following steps:

[0094] Obtain image and text data related to the target video, and based on the image and text data, determine whether the candidate character corresponding to the candidate character information appears in the target video. The image and text data is used to describe the association relationship between the characters in the target video. The image and text data include but are not limited to at least one image data, at least one text data and at least one audio and video data. The image data can be stills, behind-the-scenes footage, promotional posters, etc. of the candidate character appearing in the target video; the text data can be text content that analyzes the story line and / or plot of the target video, text content that recommends the target video, character analysis text content corresponding to each character in the target video, analysis content of the character objects that play the characters in the target video, etc., for example: an article recommending "ABC", an article that deeply analyzes the relationship between the characters in "ABC", an article that analyzes the story line of xx character in "ABC", etc.; the audio and video data is used to indicate the analysis of the plot and / or story line of the target video, each character in the target video, and the character objects corresponding to the characters that play the target video, and can be presented in the form of MP3 or MP4, or presented using other audio and video formats, which is not limited in this application.

[0095] Optionally, character entity words corresponding to each character in the target video are extracted from the image text data, and a character relationship graph corresponding to the target video is generated based on the association relationship between each character described in the image text data; in the embodiment of the present application, the image text data carries labels corresponding to the target video, each character in the target video, and candidate characters, and the image text data with the same / overlapping labels are associated. For details, please refer to Figure 4 When playing the first video clip a corresponding to the first character 101, when the second character 102 appears in the playback screen, the terminal performs face recognition on the current frame and obtains that the candidate character who plays the candidate character 102 is "Li Si". The terminal obtains image text data carrying the label of the candidate character "Li Si" and the label corresponding to the target video, and determines based on the image text data that the candidate character "Li Si" is the person who plays the second character 102. It should be noted that Figure 4 The candidate character 102 is an object to play the second role 102, so the reference numeral 102 can refer to both the candidate character and the second role.

[0096] Optionally, based on the candidate roles and the role relationship map, a second role appearing in the playback screen of the first video clip is determined. In the embodiment of the present application, a role association relationship exists between the second role and the first role.

[0097] In an optional embodiment, the process of determining the second role includes but is not limited to the following:

[0098] First, in response to the appearance of a candidate character in the first video clip, a screenshot corresponding to the candidate character is captured; image data corresponding to the target video is obtained; the screenshot and the image data of the target video object are compared to determine whether the screenshot appears in the image data corresponding to the target video; if so, the candidate character is determined as the second character based on the role relationship image.

[0099] Second, in response to the appearance of a candidate role in the first video clip, face recognition is performed on the current frame of the first video clip to determine the character object corresponding to the candidate role, which includes the name of the object corresponding to the candidate role; it is determined whether the character object has appeared in the target video, in other words, it is determined whether the character object corresponding to the candidate role is a character in the target video; if it is determined that the character object has appeared in the target video, the candidate role is determined as the second role.

[0100] In the embodiment of the present application, the method of determining at least one second video clip corresponding to the second character includes but is not limited to the following methods:

[0101] First, a first candidate video clip that has an association relationship with the second character is identified from a preset video library. The association relationship is used to indicate the relationship between the candidate video clip and the second character. The association relationship can be that the video clip contains the second character, that is, the second video clip is a video clip in which the second character appears; or it can be a foreshadowing clip that leads to the second character, that is, the second video clip plays a guiding role in the appearance of the second character; or it can be a video clip in which other characters and the second character have a common event, that is, the second character does not appear in the second video clip, but the other characters that appear perform the same event as the second character; the first candidate video clip is matched with the target video to obtain at least one corresponding to the target video. The second video clip; the specific process of video matching includes: comparing and deduplicating the first candidate video clip and the target video, and determining the clip that overlaps with the first candidate video clip from the target video as at least one second video clip; wherein, all videos contained in the preset video library each carry their own labels, and the labels may include but are not limited to the label of the target video, the labels corresponding to each character in the target video, the labels derived from each character in the target video, the labels corresponding to the character objects playing the target video, etc. The terminal extracts the first candidate video clip containing the above labels from the preset video library, compares and deduplicates the first candidate video clip with the target video, and determines at least one second video clip associated with the second character.

[0102] Second, the terminal locally stores video clips associated with various characters in the target video in advance. When a second character appears in the playback screen of the first video clip, the terminal directly obtains a second video clip associated with the second character from the local computer.

[0103] Third, the video clips associated with each character in the target video are packaged and stored in a remote storage system. The server updates the video clips associated with each character in the target video stored in the remote storage system in real time according to the tag information in the uploaded video. When a second character appears in the playback screen of the terminal, the terminal sends a request to the server to obtain at least one second video clip corresponding to the second character. The server obtains at least one second video clip associated with the second character in the target video from the remote storage system based on the request.

[0104] Optionally, after determining at least one second video clip associated with the second character, a second character control is displayed in the playback screen of the first video clip, and the second character control is used to play the second video clip associated with the second character in the target video.

[0105] In an embodiment of the present application, the second video clip can be used to indicate a video clip containing the second character, or can be used to indicate a foreshadowing clip that introduces the second character, or can be used to indicate a video clip in which other characters and the second character have a common story (event), that is, the second character does not necessarily appear in the second video clip.

[0106] Step 304: In response to receiving a trigger operation on the second character control, play at least one second video clip associated with the second character.

[0107] Optionally, the second character control can be understood as a quick entry for quickly switching from playing a video clip associated with the first character to playing a video clip associated with the second character, and there is a role association relationship between the second character and the first character.

[0108] Optionally, in response to receiving a trigger operation on the second character control, the trigger operation includes but is not limited to a click operation, a long press operation, a drag operation, a trigger operation input through an external device, a voice control operation, etc., at least one second video clip associated with the second character is obtained and automatically played. For details, please refer to Figure 4 , Figure 4 A schematic diagram of an interface of a video playback method provided in an embodiment of the present application is shown.

[0109] like Figure 4 As shown, the terminal interface 10 displays the content introduction information corresponding to the target video, which includes but is not limited to the introduction content of the target video, the promotional poster corresponding to the target video, the control for playing the target video, the role relationship map corresponding to the target video, etc. In the embodiment of the present application, the role relationship map displays the identity information (role name and / or role identity) corresponding to each role in the target video and the role association relationship between each role ( Figure 4Optionally, the role association description content between the characters can be displayed at the line segment with an arrow, which is convenient for understanding the relationship between the characters in the target video; the role relationship map displays the role avatar control corresponding to the core role of the target video, where the core role is used to indicate the important role that promotes the development of the story line of the target video. Figure 4 It is shown that the target video contains 4 core characters; in response to receiving a trigger operation on the first character control 401, the currently displayed interface 40 is switched to the video playback interface 41 for playing the first video clip corresponding to the first character 401, and the playback interface 41 displays at least one first video clip (first video clips a to c) arranged in a preset order, and the description content corresponding to the first video clip a being played is highlighted; when the second character 402 appears in the playback interface 42 of the first video clip a, the terminal determines that the second character 102 is a character that has a role association relationship with the first character 401, and superimposes the second character control 103 on the playback interface of the first video clip, and the second character control 403 displays the character description information of the second character 402 and the entrance to watching the video clip corresponding to the second character. Control; in response to receiving a trigger operation on the second character control 403, the first video clip a corresponding to the first character 401 played on the current interface 42 is switched to the playback interface 43 for playing the second video clip b corresponding to the second character 402, and the playback interface 43 displays at least one second video clip (second video clips a to c) arranged in a preset order, and highlights the description content corresponding to the second video clip b being played. Optionally, the first video clip a and the second video clip b can be the same video clip or different video clips, and this application does not limit this; when the first video clip a and the second video clip b are the same video clip, during the video playback process, the picture corresponding to the timestamp of ending the playback of the first video clip a is the same as the picture corresponding to the timestamp of starting the playback of the second video clip b.

[0110] In an optional embodiment, the second video clip continues to be played according to the playback content corresponding to the playback progress of the first video clip. The playback progress is used to indicate the playback content indicated by the corresponding timestamp when switching the first video clip. That is, the playback progress can be understood as the playback progress of the first video clip in the target video. For example, when the first video clip is played to a certain moment (specified timestamp), the second character control displayed in the playback interface is triggered to obtain the playback progress of the first video clip in the target video corresponding to the specified timestamp, determine the playback start timestamp of the second video clip according to the specified timestamp, and play the second video clip from the starting timestamp. Optionally, the second video clip continues to be played from the timestamp corresponding to the preset time period before the playback progress of the above-mentioned first video clip, or continues to be played from the timestamp corresponding to the preset time period after the above-mentioned playback progress, or continues to be played from the timestamp corresponding to the above-mentioned playback progress. For example, the playback progress of the first video clip in the target video is 12:00. After switching to the second video clip, the starting playback time of the second video clip (the starting playback time here is the playback time in the target video) can be continued from the timestamp corresponding to 11:55, or can be continued directly from the timestamp corresponding to 12:00, or can be continued from the timestamp corresponding to 12:05. The preset time period is 5 seconds, and the preset time can also be set according to actual needs. This is only an illustrative example.

[0111] In an optional embodiment, in response to receiving a trigger operation on the second character control, a first story context list corresponding to the second character is displayed, and the first story context list includes at least one first story node associated with the second character, wherein the i-th first story node corresponds to the i-th second video clip, and i is a positive integer; in an embodiment of the present application, at least one first story node is displayed in the first story context list according to the development order of the story line of the target video, and at least one first story node is displayed with node introduction content, and the node introduction content is used to summarize the content of the second video clip corresponding to the first story node, for example, the label corresponding to the second video clip is displayed at the first story node. Title information, for example, after triggering the second role control, the first story context list is displayed on the interface (video 1: xx meets xx, video 2: xx successfully obtains clues, video 3: xx and xx have a misunderstanding), wherein there are three story nodes in the first story context list, corresponding to video 1, video 2 and video 3 respectively, and the corresponding node introduction content is displayed at the story node corresponding to the video clip. For example, story node: the node introduction content corresponding to video 1 is xx meets xx, and the user directly watches the node introduction content in the story context list corresponding to the role, quickly understands the story line corresponding to the role, and improves the efficiency of the user in understanding the story line development sequence of the entire target video by understanding the character story line.

[0112] In the embodiment of the present application, the display order of at least one second video clip in the first storyline list includes but is not limited to the following:

[0113] First, according to the playback order of at least one second video clip in the target video, at least one first story node is displayed in the first story context list. For example, three second video clips are stored corresponding to the second character, and the three video clips correspond to three story nodes. The three second video clips can be video clips from the same episode and / or the same album of the target video. Schematically, second video clip 1 (story node 1) is the picture corresponding to the second character from 16 minutes 30 seconds to 19 minutes 30 seconds in episode 2 of season 1 of the target video, second video clip 3 (story node 3) is the picture corresponding to the second character from 20 minutes 15 seconds to 45 minutes 00 seconds in episode 2 of season 1 of the target video, and second video clip 2 (story node 2) is the picture corresponding to the second character from 1 minute 15 seconds to 12 minutes 00 seconds in episode 1 of season 2 of the target video; the first video clips 1 to 3 are aggregated according to the chronological order of the target video, and the arrangement order is as follows: (first video clip 1, second video clip 3, second video clip 2), and the node introduction content is displayed at the story node corresponding to the second video clip; or

[0114] Second, displaying at least one first story node in the first storyline list according to the development order of the storyline of the target video, that is, displaying according to the development order of the storyline of the second character; or,

[0115] Third, at least one first story node is displayed in the first story thread list in a customized sorting order. The customized sorting order is used to indicate the sorting order of the personalized account settings. When the user searches or plays the target video in the specified application, the corresponding account information is logged in. The user can personalize the aggregation rules of the video clips corresponding to each character in the target video (that is, personalize the sorting order of the story nodes corresponding to each character). The personalized setting includes arranging multiple video clips according to the importance of the story development sequence, arranging multiple video clips according to the funny program of the video clips, arranging multiple video clips according to the popularity of the video clips, etc. After receiving the trigger operation of the character control, based on the personalized setting, the multiple video clips (story nodes) of the character are arranged and aggregated, and the arranged and aggregated video clips (story nodes) are displayed on the current playback interface, that is, the story thread list corresponding to the character is displayed.

[0116] In another optional embodiment, in the interface for playing the second video clip corresponding to the second character, a story line list of the second video clip is displayed, wherein the story line list displays at least one first story node corresponding to the second character in the above display order, such as Figure 4 As shown, in the playback interface 43, a story context list corresponding to the second character is displayed, and the story context list includes the second video clip ac. The node introduction content of the second video clip is displayed in the playback list, and the node introduction content can be a title overview corresponding to the second video clip, information about the newly appeared character, etc.

[0117] To sum up, in the video playback method provided in the embodiment of the present application, when watching the first video clip corresponding to the first character, by identifying the second character in the first video clip, an entry control for jumping to play the second video clip corresponding to the second character is provided in the playback screen, so that the user can quickly understand the role relationship between the characters in the target video and improve the efficiency of the user's understanding of the plot of the target video; in addition, by automatically analyzing the role relationship between the characters, other content associated with the target video can be further expanded.

[0118] In an optional embodiment, please refer to 5 for details. Figure 5 This is a flowchart of a video playback method provided by another exemplary embodiment of the present application, which is described by applying the method to a terminal. The solution includes:

[0119] Step 501: Display a first character control.

[0120] In an embodiment of the present application, the first character control is used to play the first video clip associated with the first character in the target video. The first video clip can be used to indicate a video clip containing the first character, or can be used to indicate a foreshadowing clip that introduces the first character, or can be used to indicate a video clip in which other characters and the first character have a common story (event). That is, the first character will not appear in the first video clip at this time.

[0121] Optionally, methods for displaying the first character control include but are not limited to the following:

[0122] First, on the video content introduction interface of the target video, at least one character control corresponding to the target video is displayed, and the character control is used to play a video clip corresponding to at least one character contained in the target video, and the character control includes the first character control; in an optional embodiment, the above-mentioned video content introduction interface is an interface obtained by searching for the target video through a specified application, and the specified application can be a browser application, a video playback application, a live broadcast application, a cloud disk storage application, etc., which is not limited in this application.

[0123] In another optional embodiment, the video content introduction interface can also be an introduction interface of the image corresponding to the target video. The image can be a still, behind-the-scenes footage, promotional poster, hand-drawn work, etc. of the target video. The terminal uses image recognition technology to identify the target video corresponding to the image, and displays the entry control for entering the target video in the introduction interface.

[0124] like Figure 4 As shown, "Romance of the Three Kingdoms" is entered in the search area 601 of the browser display interface 600 for search, and the video introduction area 602 and the role relationship display area 606 corresponding to "Romance of the Three Kingdoms" are displayed in the browser display interface 600. The video introduction area 602 includes a plot introduction area 603 of "Romance of the Three Kingdoms", a poster display area 604 and an entry control 605 for playing "Romance of the Three Kingdoms". The user can understand the general plot of "Romance of the Three Kingdoms" by viewing the relevant text description in the plot introduction area 603. The user can trigger the entry control 605. In response to receiving the trigger operation on the entry control 605, the currently displayed browser display interface 600 is switched to the playback interface of playing Romance of the Three Kingdoms. During this process, the browser can start a third-party video playback application, automatically start the third-party video playback application and play Romance of the Three Kingdoms. The character relationship display area 606 displays the character controls corresponding to the core characters in Romance of the Three Kingdoms. The character relationship display area 606 also displays the character introduction information and the association information between the characters. The introduction information includes the character name and the character identity. The association information is used to indicate the association relationship between the characters. For example, the user can trigger the first character control 607 in the character relationship display area 606 to watch the first video clip corresponding to the first character.

[0125] Second, when the user is watching the target video, a character viewing control is displayed in a designated area of ​​the target video's video playback interface; in response to receiving a trigger operation for the character viewing control, a floating window containing at least one character control in the target video is superimposed on the target video's video playback interface, and the transparency of the floating window can be set according to the user's actual needs. Figure 7 As shown, trigger the role viewing control in the video playback interface ( Figure 7(not shown in the figure), a floating window 701 is superimposed and displayed in the video playback interface 700 of the target video, and the floating window 701 displays at least one character control. The floating window 701 displays the description information of all the characters corresponding to the target video or the description information of part of the characters, and the description information includes the character's avatar information, the character's name information and the character's identity information. For example, a first character control 702 is displayed in the floating window 701, and the first character control 702 includes the avatar information and name information corresponding to the first character "Role A".

[0126] Step 502: In response to receiving a trigger operation on a first character control, obtaining a first video clip associated with the first character.

[0127] In the embodiment of the present application, the method of determining at least one first video clip associated with the first character includes but is not limited to the following methods:

[0128] First, a second candidate video clip that has an association relationship with the first character is identified from a preset video library, and the association relationship is used to indicate the relationship between the candidate video clip and the first character. The association relationship can be that the first character is included in the candidate video clip, that is, the first video clip is a video clip in which the first character appears; or it can be a foreshadowing clip that leads to the first character, that is, the first video clip plays a guiding role in the appearance of the first character; or it can be a video clip in which other characters and the first character have a common event, that is, the first character does not appear in the first video clip, and the other characters that appear do a common event with the first character; the second candidate video clip is matched with the target video to obtain at least one character corresponding to the target video. A first video clip; the specific process of video matching includes: comparing and deduplicating the second candidate video clip with the target video, and determining the clip that overlaps with the second candidate video clip from the target video as at least one first video clip; wherein, all videos contained in the preset video library carry their own labels, which may include but are not limited to the label of the target video, the labels corresponding to each character in the target video, the labels derived from each character in the target video, the labels corresponding to the character object playing the target video, etc. The terminal extracts the second candidate video clip containing the above labels from the preset video library, compares and deduplicates the second candidate video clip with the target video, and determines at least one first video clip associated with the first character. Optionally, the preset video library is a video library of a preset short video program, that is, the video library of the preset short video program includes short videos publicly available on the short video platform of the preset short video program, and the short videos are accompanied by video labels.

[0129] Second, the terminal pre-stores video clips associated with each character in the target video. After receiving the trigger operation on the first character control, the terminal directly obtains at least one first video clip associated with the first character from the local computer.

[0130] Third, the video clips associated with each character in the target video are packaged and stored in a remote storage system. The server updates the video clips associated with each character in the target video stored in the remote storage system in real time according to the tag information in the uploaded video. When the terminal receives a trigger operation on the first character control, the terminal sends a request to the server to obtain at least one first video clip associated with the first character. The server obtains at least one first video clip associated with the first character in the target video from the remote storage system according to the request.

[0131] In an embodiment of the present application, in response to receiving a trigger operation on the first character control, a second story context list corresponding to the second character is displayed, and the second story context list includes at least one second story node associated with the first character, wherein the kth second story node corresponds to the kth first video clip, and k is a positive integer.

[0132] In an embodiment of the present application, at least one second story node is displayed in the second story context list according to the development order of the story line of the target video, and at least one second story node is displayed with node introduction content. The node introduction content is used to summarize the content of the first video clip corresponding to the second story node. For example, the title information corresponding to the first video clip, the summary of the character information appearing in the first video clip, etc. are displayed at the first story node.

[0133] In the embodiment of the present application, the display order of at least one first video clip in the second storyline list includes but is not limited to the following:

[0134] First, displaying at least one second story node in the second storyline list according to the playback order of at least one first video clip in the target video; or,

[0135] Second, displaying at least one second story node in the second storyline list according to the development order of the storyline of the target video, that is, playing and displaying them in sequence according to the development order of the storyline of the first character; or

[0136] Third, at least one second story node is displayed in the second story context list and at least one first video clip is played in sequence according to the customized arrangement order. The customized arrangement order is used to indicate the arrangement order of the account personalization setting. When the user searches or plays the target video in the specified application, the corresponding account information is logged in. The user can personalize the aggregation rules of the video clips corresponding to each character in the target video (that is, personalize the arrangement order of the story nodes corresponding to each character). The personalized setting includes arranging multiple video clips according to the importance of the story development sequence, arranging multiple video clips according to the funny program of the video clips, arranging multiple video clips according to the popularity of the video clips, etc. After receiving the trigger operation of the character control, based on the personalized setting, the multiple video clips (story nodes) of the character are arranged and aggregated, and the arranged and aggregated video clips (story nodes) are set and displayed on the current playback interface, that is, the story context list corresponding to the character is displayed.

[0137] In another optional embodiment, in the interface for playing the first video clip corresponding to the first character, a playlist of the first video clips is displayed, wherein the playlist displays the introduction content of the first video clips in the order of playing at least one first video clip, such as Figure 4 As shown, in the playback interface 41, a story context list corresponding to the first character is displayed, and the story context list includes the first video clip ac. The story context list displays the introduction content of the first video clip, and the introduction content can be a title overview corresponding to the first video clip, information about the newly appeared character, etc.

[0138] In an embodiment of the present application, at least one first video clip in the second story context list is played sequentially according to the order of the second story context list. Optionally, the user can actively trigger the target story node in the second story context list for playback according to viewing needs.

[0139] Step 503: In response to the second character appearing in the playback screen of the first video clip, a second character control corresponding to the second character is displayed.

[0140] Optionally, during the playback of at least one video segment, the terminal performs character recognition on a current frame of the first video segment to obtain candidate characters appearing in the playback screen of the first video segment.

[0141] Optionally, based on the role relationship map corresponding to the candidate roles and the target video, the second role appearing in the playback screen of the first video clip is determined, and the second role control corresponding to the second role is displayed. The second role control can be understood as a quick entry for quickly switching from playing the video clip corresponding to the first role to playing the video clip corresponding to the second role, and there is a role association relationship between the second role and the first role.

[0142] The specific execution process of this step is the same as step 303 and will not be repeated here.

[0143] Step 504: In response to receiving a trigger operation on the second character control, display a character introduction interface.

[0144] Optionally, the second character control also displays a description of the relationship between the first character and the second character, and the relationship description is used to indicate the role association relationship between the first character and the second character. For example, the second character "Zhang San" is a college classmate of the first character "Li Si". After the terminal recognizes the second character "Zhang San", the second character control is displayed in the interface. The second character control displays "Zhang San, is Li Si's college classmate, click to view detailed introduction content". Optionally, the second character control displays the avatar information corresponding to "Zhang San".

[0145] Optionally, in response to receiving a trigger operation on the second character control, a character introduction interface corresponding to the second character is superimposed on the current playback screen, and the character introduction interface includes introduction information of the second character, an entry control for viewing at least one second video clip corresponding to the second character, and a relationship network of the first character in the target video, and the relationship network includes a description of the relationship between the first character and at least one character in the target video; optionally, the relationship description between the first character and the second character is highlighted in the relationship network.

[0146] Optionally, the character introduction interface also includes a playback control, which is used to play at least one second video clip corresponding to the second character; in response to receiving a trigger operation on the playback control, the current interface is switched to the playback interface of at least one second video clip corresponding to the second character. In an embodiment of the present application, the playback screen corresponding to the timestamp of starting to play the second video clip is the same as the playback screen corresponding to the timestamp of ending to play the first video clip. It should be noted that the screens before and after the video switch may also be different, and this application does not limit this.

[0147] Step 505: In response to receiving a trigger operation on a play control in the character introduction information interface, play at least one second video clip associated with the second character.

[0148] Optionally, obtain and play at least one video clip corresponding to the second character.

[0149] For details, please see Figure 8 , Figure 8 A schematic diagram of an interface for displaying relationship description content provided by an exemplary embodiment of the present application is shown. The terminal plays a first video clip corresponding to a first character in a target video, and the first video clip includes the first character 801; in response to the appearance of a second character 802 in the playback screen of the first video clip, a second character control 803 is superimposed on the current playback screen, and the second character control 803 displays the relationship description content between the first character and the second character, for example, the second character is a subordinate of the first character; in response to receiving a trigger operation on the second character control, a character introduction interface 804 is superimposed on the current interface, and the character introduction interface 804 includes an introduction content 805 of the second character, a playback control 807 for playing a second video clip corresponding to the second character, and a relationship network 806 of the first character in the target video, wherein the relationship network 806 of the first character in the target video also includes a control 808 for viewing a complete role relationship map of the target video; optionally, a hide control 809 is also displayed in the character introduction interface 804, and the hide control 809 is used to hide the character introduction interface 804.

[0150] The specific execution process of this step is the same as step 304 and will not be repeated here.

[0151] To sum up, in the video playback method provided in the embodiment of the present application, when watching the first video clip corresponding to the first character, by identifying the second character in the first video clip, an entry control for jumping to play the second video clip corresponding to the second character is provided in the playback screen, so that the user can quickly understand the role relationship between the characters in the target video and improve the efficiency of the user's understanding of the plot of the target video; in addition, by automatically analyzing the role relationship between the characters, other content associated with the target video can be further expanded.

[0152] In this embodiment, video clips are aggregated based on the story development sequence corresponding to the characters or the story development sequence of the target video, and the story development sequence between the characters is linked through the character controls displayed in the playback screen for switching video clips, thereby improving the user's efficiency in understanding the plot of the target video.

[0153] In this embodiment, by superimposing the character introduction interface corresponding to the second character on the playback interface, the user can directly obtain the association relationship between the second character and the first character, the identity information corresponding to the second character, and the relationship network of the first character in the target video from the character introduction interface, avoiding the need for the user to perform unnecessary search steps, thereby improving the efficiency of the user in obtaining the target video information; and controls for jumping to play the second video clip and viewing the complete character relationship map are provided in the character introduction interface, further improving the efficiency of the user in understanding the story line of the target video.

[0154] In an optional embodiment, please refer to 9 for details. Figure 9 FIG. 1 is a flowchart of a video playback method provided by another exemplary embodiment of the present application, which is described by applying the method to a terminal. The method includes:

[0155] Step 901: Display a first character control.

[0156] Optionally, the user selects a target video to watch, where the target video is used to indicate a video clip to be played, and the target video includes but is not limited to at least one of a short video, a film and television series, and a documentary.

[0157] Optionally, in the relevant interface displaying the target video, a role relationship map corresponding to the target video is displayed. The role relationship map is used to indicate the relationship between the various characters in the target video, and can also be used to indicate the relationship between the protagonists in the target video. This application does not limit this.

[0158] Optionally, the role relationship map includes a role control corresponding to each role, which is used to indicate the role information of the role in the target video, including but not limited to the information of the person playing the role, the name of the role played by the character in the target video, the identity of the role played by the character in the target video, and the information of the person who dubs the role on screen.

[0159] The execution process of this step is the same as step 301 and will not be repeated here.

[0160] Step 902: In response to receiving a trigger operation on a first character control, obtaining a first video clip associated with the first character.

[0161] Optionally, the first character control can be understood as a quick entry for playing the video clip corresponding to the first character.

[0162] Optionally, in response to receiving a trigger operation on the first character control, the trigger operation including but not limited to a click operation, a long press operation, a drag operation, a trigger operation input through an external device, and a voice control operation, a first video clip corresponding to the first character is obtained.

[0163] The execution process of this step is the same as step 302 and will not be repeated here.

[0164] Step 903: In response to the second character appearing in the playback screen of the first video clip, a second character control corresponding to the second character is displayed.

[0165] Optionally, the first role corresponds to at least one first video clip, and the at least one first video clip is played sequentially; during the playback of at least one video clip, the terminal performs role recognition on the current frame of the first video clip to obtain a candidate role appearing in the playback screen of the first video clip.

[0166] Optionally, a role relationship map corresponding to the target video is obtained, where the role relationship map is used to indicate the association relationship between the characters appearing in the target video; based on the candidate roles and the role relationship map, a second character appearing in the playback screen of the first video clip is determined, and a second character control corresponding to the second character is displayed in the playback screen.

[0167] The execution process of this step is the same as step 303 and will not be repeated here.

[0168] Step 904: In response to receiving a trigger operation on the second character control, play at least one second video clip associated with the second character.

[0169] Optionally, the second character control can be understood as a quick entry for quickly switching from playing a video clip associated with the first character to playing a video clip associated with the second character, and there is a role association relationship between the second character and the first character.

[0170] Optionally, in response to receiving a trigger operation on the second character control, which trigger operation includes but is not limited to a click operation, a long press operation, a drag operation, a trigger operation input through an external device, a voice control operation, etc., at least one second video clip corresponding to the second character is obtained and played automatically.

[0171] The execution process of this step is the same as step 304 and will not be repeated here.

[0172] Step 905: Display a return control in the playback screen of the second video segment.

[0173] Optionally, a return control is displayed at a preset position on the playback screen, and the return control is used to indicate switching to playing the first video clip corresponding to the first character based on the second video clip currently being played.

[0174] In some embodiments, when switching from playing a first video clip to playing a second video clip, and from playing a second video clip to playing the first video clip again, after a successful switch, a prompt message is superimposed and displayed in the playback interface. The prompt message is used to prompt that the video has been successfully switched. After the display time of the prompt message reaches a preset time, the prompt message is canceled from the interface; or, a close control is provided in the prompt message, and the user actively cancels the display of the prompt message by triggering the close control.

[0175] Optionally, when the display time of the prompt information reaches a preset time, as the display time increases, the display transparency of the prompt information also increases.

[0176] Step 906: In response to receiving a trigger operation on the return control, switching the currently playing second video segment to playing the first video segment associated with the first character.

[0177] Optionally, after switching from playing the second video segment to playing the first video segment, the playing rules of the first video segment include but are not limited to the following:

[0178] First, according to the aggregation order of the first video clips corresponding to the first character, the currently playing second video clip is switched to playing the first first video clip, that is, after receiving the trigger operation of the return control, at least one first video clip corresponding to the first character is replayed.

[0179] Second, the currently played second video segment is switched to the first video segment corresponding to the historical playback timestamp, where the historical playback timestamp is used to indicate the timestamp of the first video segment played most recently.

[0180] Third, in response to the currently playing second video clip overlapping with the content of the first video, the first video clip is switched to be played according to the playback progress of the currently playing second video clip; wherein, in response to the currently playing second video clip being played to be completed, the next first video clip corresponding to the first video clip overlapping with the second video clip is played in sequence, so as to avoid the user from repeatedly watching the same video clip before and after the video switching, thereby improving the efficiency of the user in watching the target video; in response to the currently playing second video clip not being played to be completed, the first video clip is switched to be played according to the playback progress of the currently playing second video clip, thereby achieving smooth plot connection before and after the switching of video clips corresponding to different characters, thereby improving the efficiency of the user in understanding the plot content of the target video.

[0181] For details, please see Figure 10 , Figure 101 and 2. The first video clip of the second character is played back in the play window, and the second video clip corresponding to the second character is played back in the play window, and the first prompt information 1002 is displayed on the play window. The first prompt information 1002 is used to prompt the user that the video switching has been successfully completed (here, it refers to the successful switching from the first video clip to the second video clip). In the interface for playing at least one second video clip corresponding to the second character, the clip name and the clip source of each second video clip are also displayed. For example, the clip title "Second character and first character" corresponding to the second video clip b is displayed in the play window. The second video clip b corresponds to "target video episode 1 06 minutes 30 seconds", and the user can independently select the second video clip corresponding to the second character to be viewed in the current interface; in response to receiving a trigger operation on the return control 1001, the second video clip is switched back to the first video clip, and after the successful switching, the second prompt information 1003 is displayed in the current playback screen. The second prompt information 1003 is used to prompt the user that the video switching has been successfully completed (here refers to the successful switching from the second video clip to the first video clip). The user can independently select the first video clip corresponding to the first character to be viewed in the current interface. It should be noted that Figure 10 The illustration in the figure shows that when switching to the first video clip, the playback time of the original first video clip is returned. This is only an illustrative example. The playback screens of the first video clip and the second video clip before and after the switch can be the same or different, and this application does not limit this.

[0182] In the above embodiment, during the process of switching from the first video clip to the second video clip, the second video clip can be in the playing state or in the paused state; during the process of switching from the second video clip to the first video clip, the first video clip can be in the playing state or in the paused state, and this application does not limit this.

[0183] To sum up, in the video playback method provided in the embodiment of the present application, when watching the first video clip corresponding to the first character, by identifying the second character in the first video clip, an entry control for jumping to play the second video clip corresponding to the second character is provided in the playback screen, so that the user can quickly understand the role relationship between the characters in the target video and improve the efficiency of the user's understanding of the plot of the target video; in addition, by automatically analyzing the role relationship between the characters, other content associated with the target video can be further expanded.

[0184] In an embodiment of the present application, video clips are aggregated based on the story development sequence corresponding to the characters or the story development sequence of the target video, and the story development sequence between the characters is linked through the character controls for switching video clips displayed in the playback screen, thereby improving the user's efficiency in understanding the plot of the target video; by providing controls for switching video clips in the playback screen, it is convenient for users to switch back and forth freely between the video clips corresponding to each character of the target video, thereby improving the user's efficiency in understanding the story line of the target video.

[0185] In an optional embodiment, please refer to 11 for details. Figure 11 This is a flowchart of video playback provided by another exemplary embodiment of the present application, which is described by applying the method to a terminal. The method includes:

[0186] Step 1100, click on the avatar of character A to enter the story line of character A.

[0187] In some embodiments, a role relationship map is displayed in the content introduction interface or playback interface of the target video. The role relationship map displays an avatar corresponding to at least one character in the target video, and the story line corresponding to the specified character can be viewed by triggering the avatar.

[0188] Schematically, the character relationship map corresponding to the target video displays the avatar corresponding to character A. The user clicks on the avatar of character A to view the story line corresponding to character A. The story line corresponding to character A is used to indicate the story experience corresponding to character A, or to indicate the story experience that character A has with other characters; for example, see Figure 6 , users in Figure 6 In the interface shown, click on the avatar 607 corresponding to character A to enter the story line corresponding to character A.

[0189] Step 1101: Identify at least one first video segment corresponding to character A in a target video.

[0190] In some embodiments, after the backend receives a trigger operation on the avatar of character A, it obtains at least one video clip corresponding to character A.

[0191] In other embodiments, candidate video clips carrying character A and / or target video tags are identified from a preset video library, and the candidate video clips and the target video are compared and deduplicated to determine at least one first video clip corresponding to character A, and the at least one video clip is named by manual labeling, that is, each first video clip has a corresponding title; the back end feeds back the identified at least one first video clip to the front end for display.

[0192] In some embodiments, at least one first video clip is played in the playback order of the target video, and the story line process corresponding to character A is displayed in a designated area. The story line process includes a quick entry to at least one first video clip, a title name corresponding to at least one first video clip, and a time origin / source origin corresponding to at least one video clip. Optionally, the appearance of other characters is also displayed around the display area of ​​the title name corresponding to at least one first video clip. For example, if a new character B appears in the first video clip a, a prompt message "Character B appears" is displayed around the first video clip a.

[0193] Step 1102: Automatically play at least one first video segment according to the play order of the target video.

[0194] In some embodiments, the first video clip is automatically played in the playback order of the target video, or a story line list corresponding to character A is displayed in the current interface, and the user selects the target first video clip from the story line list to watch. After watching one first video clip, the next first video clip is automatically played in the aggregation order of at least one first video clip.

[0195] Step 1103, watch the story line of character A.

[0196] In some embodiments, after clicking on the avatar of character A to obtain the story line segment corresponding to character A, at least one first video segment corresponding to character A is automatically played, and the user can select the target first video segment from the at least one first video segment displayed in the interface to watch.

[0197] Step 1104 , character B is identified by comparing the current frame with the character relationship graph.

[0198] In some embodiments, in the first video clip corresponding to character A, the terminal background automatically extracts the playback screen of the current frame for face recognition, compares it with the character relationship image of the target video, identifies character B, and determines whether character B has a direct relationship with character A. For details of the judgment process, please refer to steps 1105 and 1106, which will not be described in detail here.

[0199] Step 1105 , determining whether character B is the core character of the target video.

[0200] Optionally, the core character is used to indicate the main character that drives the story line of the target video, for example, the leading actor number one, the second leading actor, the leading actress, etc.

[0201] In some embodiments, whether character B appears in the character relationship map is determined based on the face recognition results. If it appears in the character relationship map, character B is determined to be the core character of the target video; if it does not appear in the character relationship map, the characters appearing in the first video clip continue to be identified until the newly appearing character is the core character of the target video.

[0202] Step 1106: Determine whether the second video clips corresponding to character B exceed a preset number.

[0203] Optionally, when character B is a core character of the target video, obtaining a second video clip corresponding to character B;

[0204] When the number of second video clips corresponding to character B exceeds a preset number, the second video clips are aggregated. The preset number can be set by the user. In the embodiment of the present application, the preset number is set to 5.

[0205] Step 1107: Aggregate the character B story line corresponding to character B.

[0206] Optionally, based on the second video clips corresponding to character B, the story lines described by each second video clip are manually labeled, and the manually labeled second video clips are aggregated into the character B story line corresponding to character B.

[0207] Step 1108: Display the avatar corresponding to character B, and show the relationship description between character B and character A.

[0208] In some embodiments, when at least one second video clip corresponding to character B is aggregated, an avatar corresponding to character B is displayed in a designated area of ​​the playback interface of the first video clip, and a description of the relationship between character B and character A is displayed.

[0209] Step 1109, click on the portrait of character B.

[0210] In some embodiments, the user clicks on the avatar corresponding to trigger character B to enter the interface for viewing the story line corresponding to character B.

[0211] In other embodiments, in response to receiving a triggering operation of the character B's avatar, the play time / play progress of the story line segment corresponding to the character A is retained and stored.

[0212] Step 1110, click on the character B story line.

[0213] In some embodiments, after clicking on the avatar of character B, a prompt message is displayed in the interface, which is used to prompt the user whether to enter and watch the story line of character B; in response to receiving a confirmation operation on the prompt message, the story line corresponding to character B is displayed in the interface.

[0214] Step 1111, enter the story line of character B and play it from the same segment and time as the story line of character A.

[0215] In response to receiving a trigger operation for character B's story line, the scene in character B's story line that is the same segment and at the same time as character A's story line is automatically played, so that the smoothness of the picture is ensured before and after the story line switches, and the situation where there is a large difference between the previous and next pictures when switching different videos is avoided, thereby improving video playback efficiency.

[0216] Step 1112, watch character B's story line.

[0217] In some embodiments, after clicking on the avatar of character B to obtain the story line segment corresponding to character B, the second video segment of character B corresponding to the timestamp of ending the story line of character A is automatically played. In this embodiment, during the character story line switching process, the first video segment and the second video segment are the same, or the first video segment and the second video segment contain the same video segment.

[0218] In some embodiments, during playback of the second video segment, the user can select a target second video segment from the displayed list of second videos to watch.

[0219] Step 1113, click the return control in character B's story line to return to watching character A.

[0220] In some embodiments, in the playback screen of the second video clip, a return control is displayed in a designated area of ​​the interface, and the return control is used to indicate switching the story line segment corresponding to character B back to the story line segment corresponding to character A.

[0221] Step 1114, return to the original progress moment of the original segment of character A's story line.

[0222] In some embodiments, in response to receiving a trigger operation on the return control, the story line segment corresponding to the currently played character B is switched back to the story line segment corresponding to character A; the playback time / playback progress of the story line segment corresponding to character A is obtained, and the story line segment of character A continues to be played according to the playback time / playback progress.

[0223] Step 1115, continue watching the video clip corresponding to character A's story line.

[0224] In some embodiments, the user continues to watch the first plurality of video clips included in the character A storyline.

[0225] In some optional embodiments, when other character avatars appear in the first video clip, you can click on the other character avatars to view the story line segments corresponding to the other characters, and then switch freely by triggering the return control, so that users can quickly understand the relationship between the characters and the direction of the plot.

[0226] To sum up, in the video playback method provided in the embodiment of the present application, when watching the first video clip corresponding to the first character, by identifying the second character in the first video clip, an entry control for jumping to play the second video clip corresponding to the second character is provided in the playback screen, so that the user can quickly understand the role relationship between the characters in the target video and improve the efficiency of the user's understanding of the plot of the target video; in addition, by automatically analyzing the role relationship between the characters, other content associated with the target video can be further expanded.

[0227] In an embodiment of the present application, video clips are aggregated based on the story development sequence corresponding to the characters or the story development sequence of the target video, and the story development sequence between the characters is linked through the character controls displayed in the playback screen for switching video clips, thereby improving the user's efficiency in understanding the plot of the target video.

[0228] In an embodiment of the present application, when a user watches the first video clip corresponding to the first character in the target video, the role relationship between the various characters appearing in the first video clip is intelligently identified, and by setting role identification conditions, unimportant characters in the target video are filtered out, thereby effectively saving the computing resources of the terminal; entry controls for jumping to video clips corresponding to different characters / different story lines are provided in the playback screen to achieve free switching, thereby effectively improving the efficiency of information acquisition when the user watches the target video.

[0229] Figure 12 This is a structural block diagram of a video playback device provided by an exemplary embodiment of the present application. Figure 12 As shown, the device includes: a display module 1201 and a playback module 1202;

[0230] Display module 1201, configured to display a first character control, wherein the first character control is configured to play a first video clip associated with a first character in a target video;

[0231] A playing module 1202 is configured to play the first video clip associated with the first character in response to receiving a triggering operation on the first character control;

[0232] The display module 1201 is further configured to display a second character control corresponding to the second character in response to the second character appearing in the playback screen of the first video clip, wherein the second character has a role association relationship with the first character, and the second character control is configured to play the second video clip associated with the second character in the target video;

[0233] The playing module 1202 is further configured to play at least one second video clip associated with the second character in response to receiving a triggering operation on the second character control.

[0234] In an optional embodiment, if Figure 13 As shown, the playback module 1202 is further used to continue playing the second video segment according to the playback content corresponding to the playback progress of the first video segment, and the playback progress is used to indicate the playback content indicated by the corresponding timestamp when switching the first video segment.

[0235] In an optional embodiment, the display module 1201 is further used to display a first story context list corresponding to the second character in response to receiving a trigger operation on the second character control; the first story context list includes at least one first story node associated with the second character, wherein the i-th first story node corresponds to the i-th second video clip, and i is a positive integer; the at least one first story node is displayed with node introduction content, and the node introduction content is used to provide an overview of the second video clip associated with the first story node.

[0236] In an optional embodiment, the display module 1201 is further configured to display the at least one first story node in the first story context list according to the development order of the story line of the target video.

[0237] In an optional embodiment, the display module 1201 is further configured to display the at least one first story node in the first story context list according to the playback order of the at least one second video clip in the target video.

[0238] In an optional embodiment, the playback module 1202 is further configured to play the at least one second video clip in sequence according to the arrangement order of the at least one first story node in the first story context list.

[0239] In an optional embodiment, if Figure 13 As shown, the apparatus further includes an identification module 1203, an acquisition module 1204, and a determination module 1205;

[0240] Identification module 1203, configured to perform role identification on the playback image to obtain candidate roles appearing in the playback image;

[0241] An acquisition module 1204 is configured to acquire a role relationship map corresponding to the target video, wherein the role relationship map indicates the relationship between the roles appearing in the target video;

[0242] The determination module 1205 is used to determine the second role appearing in the playback screen based on the candidate roles and the role relationship map, and display the second role control.

[0243] In an optional embodiment, if Figure 13 As shown, the determining module 1205 is further configured to determine the second character appearing in the playback image;

[0244] The identification module 1203 is further configured to identify a first candidate video segment associated with the second character from a preset video library;

[0245] The determining module 1205 is further configured to match the first candidate video segment with the target video, and determine a segment in the target video that overlaps with the first candidate video segment as the at least one second video segment.

[0246] In an optional embodiment, if Figure 13 As shown, the display module 1201 is also used to display at least one character control corresponding to the target video on the video content introduction interface of the target video, and the character control is used to play a video clip associated with at least one character contained in the target video, and the character control includes the first character control; or, on the video playback interface of the target video, a floating window containing the at least one character control is superimposed and displayed.

[0247] In an optional embodiment, if Figure 13 As shown, the identification module 1203 is further configured to identify a second candidate video segment associated with the first character from a preset video library;

[0248] The determination module 1205 is further configured to match the second candidate video segment with the target video, and determine a segment from the target video that overlaps with the second candidate video segment as the at least one first video segment. Figure 13As shown, the display module 1201 is further used to display a second story context list corresponding to the first character in response to receiving a trigger operation on the first character control; the second story context list includes at least one second story node associated with the first character, wherein the nth second story node corresponds to the nth first video clip, and n is a positive integer; the at least one second story node is displayed with node introduction content, and the node introduction content is used to provide an overview of the first video clip corresponding to the second story node.

[0249] In an optional embodiment, if Figure 13 As shown, the display module 1201 is further used to display the at least one second story node in the second story context list according to the development order of the story line of the target video; or, to display the at least one second story node in the second story context list according to the playback order of the at least one first video clip in the target video.

[0250] In an optional embodiment, if Figure 13 As shown, the playing module 1202 is further configured to play the at least one first video clip in sequence according to the arrangement order of the at least one second story interface in the second story context list.

[0251] In an optional embodiment, the display module 1201 is further configured to display a playlist of the at least one first video segment, wherein the playlist displays introduction contents of the at least one first video segment in the order in which the at least one first video segment is played.

[0252] The display module 1201 is further configured to display a description of the relationship between the first role and the second role while displaying the second role control corresponding to the second role.

[0253] In an optional embodiment, if Figure 13 As shown, the display module 1201 is also used to display the relationship network of the first character in the target video, wherein the relationship network includes a description of the relationship between the first character and at least one character in the target video; and the relationship description between the first character and the second character is highlighted in the relationship network.

[0254] In an optional embodiment, if Figure 13 As shown, the display module 1201 is further used to display a return control during the playback of the second video clip, and the return control is used to indicate switching from the currently playing second video clip to the first video clip associated with the first role.

[0255] The playback module 1202 is further configured to switch the currently playing second video clip to the first video clip associated with the first character in response to receiving a trigger operation on the return control, wherein the first video clip after switching is in a playing state or a paused state.

[0256] In an optional embodiment, if Figure 13 As shown, the playback module 1202 is also used to switch the currently playing second video clip to the first first video clip according to the aggregation order of the first video clips associated with the first role; or, switch the currently playing second video clip to the first video clip corresponding to the historical playback timestamp, and the historical playback timestamp is used to indicate the timestamp of the most recent playback of the first video clip; or, in response to the currently playing second video clip overlapping with the content of the first video, switch the playback of the first video clip according to the playback progress of the currently playing second video clip.

[0257] In an optional embodiment, if Figure 13 As shown, the playing module 1202 is further configured to, in response to the completion of playing of the currently played second video segment, sequentially play the next first video segment corresponding to the first video segment that overlaps with the second video segment;

[0258] In response to the second video segment currently being played not being completely played, the playback is switched to the first video segment according to the playback progress of the second video segment currently being played.

[0259] To sum up, the video playback device provided in the embodiment of the present application, when watching the first video clip associated with the first character, automatically analyzes the role relationship between the first character and the second character by identifying the second character in the first video clip, and provides an entry control for jumping to play the second video clip associated with the second character in the playback screen, so as to facilitate the user to quickly understand the role relationship between the characters in the target video and improve the efficiency of the user in understanding the plot of the target video; in addition, by automatically analyzing the role relationship between the characters, the video clips are aggregated based on the story development sequence corresponding to the characters or the story development sequence of the target video, and the character control for switching video clips displayed in the playback screen is used to link the story development sequence between the characters, thereby improving the efficiency of the user in understanding the plot of the target video, and can further expand the consumption of other content associated with the target video.

[0260] It should be noted that the video playback device provided in the above embodiment is merely an example of the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the video playback device provided in the above embodiment and the video playback method embodiment are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0261] Figure 14 A schematic diagram of the structure of a server provided by an exemplary embodiment of the present application is shown. The server may be Figure 2 The server 220 is shown. Specifically:

[0262] Server 220 includes a central processing unit (CPU) 1401, a system memory 1404 including random access memory (RAM) 1402 and read-only memory (ROM) 1403, and a system bus 1405 connecting system memory 1404 and CPU 1401. Server 220 also includes a basic input / output system (I / O system) 1406 that facilitates information transfer between various components within the computer, and a mass storage device 1407 for storing an operating system 1413, application programs 1414, and other program modules 1415.

[0263] The basic input / output system 1406 includes a display 1408 for displaying information and an input device 1409, such as a mouse and keyboard, for user input. Both the display 1408 and the input device 1409 are connected to the central processing unit 1401 via an input / output controller 1410 connected to the system bus 1405. The basic input / output system 1406 may also include an input / output controller 1410 for receiving and processing input from a variety of other devices, such as a keyboard, mouse, or electronic stylus. Similarly, the input / output controller 1410 also provides output to a display screen, printer, or other types of output devices.

[0264] The mass storage device 1407 is connected to the central processing unit 1401 through a mass storage controller (not shown) connected to the system bus 1405. The mass storage device 1407 and its associated computer-readable media provide non-volatile storage for the server 220. That is, the mass storage device 1407 may include a computer-readable medium (not shown) such as a hard disk or a compact disc read-only memory (CD-ROM) drive.

[0265] Without loss of generality, computer-readable media may include computer storage media and communication media. Computer storage media include volatile and non-volatile, removable and non-removable media implemented by any method or technology for storing information such as computer-readable instructions, data structures, program modules or other data. Computer storage media include RAM, ROM, Erasable Programmable Read Only Memory (EPROM), Electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other solid-state storage devices, CD-ROM, Digital Versatile Disc (DVD) or other optical storage, tape cassettes, magnetic tape, disk storage or other magnetic storage devices. Of course, those skilled in the art will appreciate that computer storage media are not limited to the above-mentioned ones. The above-mentioned system memory 1404 and mass storage device 1407 can be collectively referred to as memory.

[0266] According to various embodiments of the present application, the server 220 may also be connected to a remote computer on a network such as the Internet for operation. That is, the server 220 may be connected to the network 1412 via the network interface unit 1411 connected to the system bus 1405, or the network interface unit 1411 may be used to connect to other types of networks or remote computer systems (not shown).

[0267] The memory also includes one or more programs, which are stored in the memory and configured to be executed by the CPU. Figure 14 The structure shown in the figure does not constitute a limitation on the terminal, and may include more or fewer components than shown in the figure, or combine certain components, or adopt a different component arrangement.

[0268] The embodiment of the present application further provides a computer device, which can be implemented as follows: Figure 2The computer device includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, code set, or instruction set, and the at least one instruction, at least one program, code set, or instruction set is loaded and executed by the processor to implement the video playback method provided by each of the above method embodiments.

[0269] An embodiment of the present application also provides a computer-readable storage medium, which stores at least one instruction, at least one program, code set or instruction set, and the at least one instruction, at least one program, code set or instruction set is loaded and executed by a processor to implement the video playback method provided by the above-mentioned method embodiments.

[0270] Embodiments of the present application further provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform any of the video playback methods described in the above embodiments.

[0271] Optionally, the computer-readable storage medium may include: a read-only memory (ROM), a random access memory (RAM), a solid-state drive (SSD), or an optical disk. Among them, the random access memory may include a resistance random access memory (ReRAM) and a dynamic random access memory (DRAM). The serial numbers of the above embodiments of the present application are for description only and do not represent the advantages or disadvantages of the embodiments.

[0272] Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

[0273] The above description is merely an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A video playback method, characterized in that: The method comprises: In response to a search operation for a target video, displaying a character relationship map corresponding to the target video in a video content introduction interface of the target video, the character relationship map being used to indicate association relationships between characters appearing in the target video, the character relationship map including a first character control corresponding to a first character; In response to receiving a trigger operation on the first character control, playing a first video clip associated with the first character; In response to a second character appearing in the playback screen of the first video clip, displaying a second character control corresponding to the second character, wherein a role association relationship exists between the second character and the first character, and the second character control is used to play a second video clip associated with the second character in the target video; In response to receiving a trigger operation on the second character control, at least one second video clip associated with the second character is played.

2. The method according to claim 1, characterized in that The step of playing at least one second video clip associated with the second character in response to receiving a triggering operation on the second character control comprises: The second video segment continues to be played according to the playback content corresponding to the playback progress of the first video segment, where the playback progress is used to indicate the playback content indicated by the corresponding timestamp when switching the first video segment.

3. The method according to claim 1 or 2, characterized in that In response to a search operation for a target video, displaying a role relationship graph corresponding to the target video in a video content introduction interface of the target video includes: Receiving the search operation for the target video in the search area of ​​the browser display interface; In response to the search operation for the target video, the video introduction area and role relationship display area corresponding to the target video are displayed in the browser display interface. The video introduction area is used to display the plot introduction of the target video, and the role relationship display area is used to display the role relationship map.

4. The method according to claim 1 or 2, characterized in that In response to a search operation for a target video, displaying a role relationship graph corresponding to the target video in a video content introduction interface of the target video includes: In response to the search operation for the target video, obtaining image and text data related to the target video, the image and text data being used to describe the association relationship between characters in the target video, the image and text data including at least one of image data, text data, or audio and video data; Based on the association relationship between the various roles described in the image text data, the role relationship graph corresponding to the target video is generated.

5. The method according to claim 1 or 2, characterized in that The method further comprises: In response to receiving a trigger operation on the second character control, displaying a first storyline list corresponding to the second character; the first storyline list includes at least one first story node associated with the second character, wherein the i-th first story node corresponds to the i-th second video clip, where i is a positive integer; The at least one first story node corresponds to a node introduction content, and the node introduction content is used to summarize the second video clip corresponding to the first story node.

6. The method according to claim 5, characterized in that The displaying of the first storyline list corresponding to the second character includes at least one of the following: Displaying the at least one first story node in the first storyline list according to the development order of the story line of the target video; or, The at least one first story node is displayed in the first story context list according to the playback order of the at least one second video clip in the target video.

7. The method according to claim 5, characterized in that The playing of at least one second video clip associated with the second role includes: The at least one second video clip is played in sequence according to the arrangement order of the at least one first story node in the first story context list.

8. The method according to claim 1 or 2, characterized in that The method of displaying a second character control corresponding to the second character in response to the second character appearing in the playback screen of the first video clip includes: Performing role recognition on the playback screen to obtain candidate roles appearing in the playback screen; Based on the candidate roles and the role relationship map, the second role appearing in the playback screen is determined, and the second role control is displayed.

9. The method according to claim 8, characterized in that After determining the second character appearing in the playback screen, the method further includes: determining the second character appearing in the playback screen; Identifying a first candidate video clip associated with the second character from a preset video library; Matching the first candidate video segment with the target video; A segment that overlaps with the first candidate video segment is determined from the target video as the at least one second video segment.

10. The method according to claim 1 or 2, characterized in that The method further comprises: In response to receiving a trigger operation on the first character control, displaying a second storyline list corresponding to the first character; the second storyline list includes at least one second story node associated with the first character, wherein the kth second story node corresponds to the kth first video clip, where k is a positive integer; The at least one second story node corresponds to a node introduction content, and the node introduction content is used to summarize the first video clip corresponding to the second story node.

11. The method according to claim 10, characterized in that The displaying of the second storyline list corresponding to the first character includes: The at least one second story node is displayed in the second story context list according to the development order of the story line of the target video.

12. The method according to claim 1 or 2, characterized in that The method further comprises: While displaying the second role control corresponding to the second role, a description of the relationship between the first role and the second role is displayed.

13. The method according to claim 12, characterized in that The displaying of the description of the relationship between the first role and the second role includes: displaying a relationship network of the first character in the target video, wherein the relationship network includes a description of a relationship between the first character and at least one character in the target video; The relationship description between the first role and the second role is highlighted in the relationship network.

14. The method according to claim 1 or 2, characterized in that The method further comprises: displaying a return control during playback of the second video clip; In response to receiving a trigger operation on the return control, switching the currently playing second video segment to the first video segment associated with the first character; The first video clip after switching is in a playing state or a paused state.

15. The method according to claim 14, characterized in that Switching the currently played second video clip to the first video clip associated with the first character includes at least one of the following: Switching the currently played second video segment to the first video segment corresponding to a historical playback timestamp, where the historical playback timestamp is used to indicate a timestamp of the most recently played first video segment; or, In response to the content of the currently played second video segment overlapping with the content of the first video segment, the first video segment is switched to be played according to the playback progress of the currently played second video segment.

16. The method according to claim 15, characterized in that The switching of playing the first video segment according to the playing progress of the currently playing second video segment includes: In response to the completion of the currently played second video segment, sequentially playing a next first video segment corresponding to the first video segment that overlaps with the second video segment; In response to the second video segment currently being played not being completely played, the first video segment is switched to be played according to the playing progress of the second video segment currently being played.

17. A video playback device, characterized in that: The device comprises: A display module is configured to, in response to a search operation for a target video, display a character relationship map corresponding to the target video in a video content introduction interface of the target video, wherein the character relationship map is configured to indicate association relationships between characters appearing in the target video, and the character relationship map includes a first character control corresponding to a first character; a playing module, configured to play a first video clip associated with the first character in response to receiving a triggering operation on the first character control; The display module is further configured to display a second character control corresponding to the second character in response to a second character appearing in the playback screen of the first video clip, wherein the second character has a role association relationship with the first character, and the second character control is configured to play a second video clip associated with the second character in the target video; The playback module is further configured to, in response to receiving a triggering operation on the second character control, play at least one second video clip associated with the second character.

18. A computer device, characterized in that: The computer device includes a processor and a memory, wherein the memory stores at least one program, and the at least one program is loaded and executed by the processor to implement the video playback method according to any one of claims 1 to 16.

19. A computer-readable storage medium, characterized in that At least one program code is stored in the computer-readable storage medium, and the program code is loaded and executed by the processor to implement the video playback method according to any one of claims 1 to 16.

20. A computer program product, characterized in that The method comprises a computer program or an instruction, which, when executed by a processor, implements the video playback method according to any one of claims 1 to 16.