Display method of audio-visual works, device, equipment and medium

Abstract

The application discloses a method, device and equipment for displaying audio-visual works and a storage medium, and belongs to the field of multimedia playing. The method comprises the following steps: displaying a map control of the audio-visual works, wherein the map control displays a map associated with a plot of the audio-visual works; in response to a plot route selection operation on the map, determining a map marker point on the plot route; and displaying a plot segment corresponding to the plot route in the audio-visual works. The application can enable a user to select different plot routes based on the plot route on the map in interaction, and switch and display between video segments corresponding to different plot routes.

Description

Technical Field

[0001] This application relates to the field of multimedia playback, and in particular to a method, apparatus, device, and medium for displaying audiovisual works. Background Technology

[0002] Audiovisual works such as TV series, novels, and comics are the most widely used multimedia content on the Internet.

[0003] In related technologies, to enhance the user experience and allow users to participate more in the plot development, audiovisual works often insert interactive elements after explaining the story background. These interactive elements allow users to jump to different plot lines based on their choices, leading to different endings. Taking watching a TV series as an example, users can make choices about characters at key junctures based on their judgment and watch the plot unfold according to those choices.

[0004] For certain audiovisual works with complex geographical locations, such as adventure and mystery dramas or variety shows that require reasoning, when using the above method for interactive selection, users often find it difficult to imagine the geographical location and predict the direction of the plot. This may result in the choices made in the interactive segment not meeting their expectations, and making a new choice requires watching the video again from the beginning, which is inefficient. Summary of the Invention

[0005] This application provides a method, apparatus, device, and storage medium for displaying audiovisual works, enabling users to select different plot directions based on a plot route on a map and switch between different plot routes. The technical solution is as follows:

[0006] According to one aspect of this application, a method for displaying an audiovisual work is provided, the method comprising:

[0007] A map control for displaying the audiovisual work, the map control displaying a map associated with the plot of the audiovisual work and no fewer than two plot routes;

[0008] In response to the selection of at least two story routes on the map, map markers are determined on the story routes;

[0009] Display the plot segments in the audiovisual work that correspond to the map markers.

[0010] According to another aspect of this application, a display device for an audiovisual work is provided, the device comprising:

[0011] The display module is used to display a map control of the audiovisual work. The map control displays a map related to the plot of the audiovisual work and no less than two plot routes.

[0012] The interaction module is used to respond to the plot route selection operation on the map and determine the selected plot route on the map;

[0013] The display module is used to display plot segments in the audiovisual work that correspond to the plot line.

[0014] In an optional design of this application, the map control displays a location marker control;

[0015] The display module is configured to, in response to a first movement operation that moves the location marker control to the first storyline of the at least two storylines, display a story segment corresponding to the first storyline on the work display page.

[0016] In an optional design of this application, the interaction module is configured to, in response to a first movement operation that moves the location marker control to a first storyline of the at least two storylines, determine a first map marker point indicated by the location marker control on the first storyline;

[0017] The display module is used to display a first plot segment on the work display page that corresponds to the first plot route and occurs at the first map marker point.

[0018] In an optional design of this application, the device further includes:

[0019] The interaction module is configured to, in response to a second movement operation that moves the location marker control from the first map marker point on the first storyline, determine the second map marker point indicated by the location marker control on the first storyline;

[0020] The display module is used to display a second plot segment on the work display page that corresponds to the first plot route and occurs at the second map marker point.

[0021] In an optional design of this application, the display module is configured to display fast-forward animation when the first plot segment occurs earlier than the second plot segment, and to display rewind animation when the first plot segment occurs later than the second plot segment.

[0022] In an optional design of this application, the display module is configured to display a plot segment corresponding to the second plot route on the work display page in response to a third selection operation on the second plot route of the at least two plot routes.

[0023] In an optional design of this application, the display module is used to display a plot element selection control of the audiovisual work;

[0024] The interaction module is used to respond to the element selection operation on the plot element selection control and determine the first selected plot element;

[0025] The display module is used to respond to a selection operation on the first storyline of the at least two storylines, and to display a story segment corresponding to the first storyline and the first story element on the work display page.

[0026] In an optional design of this application, the interaction module is used to determine the selected second plot element in response to an element selection operation on the plot element selection control;

[0027] The display module is used to switch between displaying plot segments in the audiovisual work that correspond to the first plot route and the second plot element on the work display page.

[0028] In an optional design of this application, the display module is used to highlight map points corresponding to the currently playing plot segment on the map control; or, to highlight map points corresponding to the currently playing target plot character on the map control;

[0029] The highlighted display includes at least one of the following: bold display, zoomed display, inverted color display, changing foreground color, changing background color, and adding animation effects.

[0030] In an optional design of this application, the display module is configured to display a map control of the audiovisual work in response to a first triggering condition being met; the first triggering condition includes any one of the following conditions:

[0031] Play to the specified progress on the playback progress bar;

[0032] The system receives the command to start displaying the audiovisual work.

[0033] Receive a drag or jump operation on the playback progress bar of the audiovisual work;

[0034] The drag operation on the playback progress bar of the audiovisual work is received and the drag distance of the drag operation is greater than a first threshold.

[0035] The jump operation is received on the playback progress bar of the audiovisual work and the number of jump operations is greater than the second threshold;

[0036] The fast forward or rewind operation of the audiovisual work is received;

[0037] The system receives an open, jump, forward, or backward operation on the directory of the audiovisual work.

[0038] In an optional design of this application, the display module is configured to cancel the display of the map control of the audiovisual work in response to a second trigger condition being met; the second trigger condition includes any one of the following conditions:

[0039] Received a close operation to close the map control;

[0040] The duration during which no operation is received on the map control exceeds the third threshold;

[0041] Start playing the aforementioned plot segment;

[0042] Human-computer interaction operations are received in other interactive areas besides the map control.

[0043] According to one aspect of this application, a computer device is provided, the computer device comprising: a processor and a memory, the memory storing a computer program, the computer program being loaded and executed by the processor to implement the method for displaying an audiovisual work as described above.

[0044] According to one aspect of this application, a computer-readable storage medium is provided, the storage medium storing a computer program, the computer program being loaded and executed by a processor to implement the method for displaying an audiovisual work as described above.

[0045] According to one aspect of this application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various alternative implementations of the above-described audiovisual work display aspects.

[0046] The beneficial effects of the technical solutions provided in this application include at least the following:

[0047] By displaying a map associated with the plot of the audiovisual work, and responding to the plot route selected by the user on the map, the system displays plot segments in the audiovisual work that correspond to the plot route. This provides a map-based interactive display solution, allowing users to switch between different plot routes based on the plot route on the map. For audiovisual works such as adventure and puzzle-solving, complex geographical locations, and highly interactive works, this provides a more efficient human-computer interaction solution. Attached Figure Description

[0048] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0049] Figure 1 A block diagram of a computer system provided in an exemplary embodiment is shown;

[0050] Figure 2 A flowchart illustrating a method for displaying an audiovisual work provided by an exemplary embodiment is shown;

[0051] Figure 3 An interface diagram illustrating a method for displaying audiovisual works provided in an exemplary embodiment is shown;

[0052] Figure 4 A flowchart illustrating a method for displaying an audiovisual work provided by an exemplary embodiment is shown;

[0053] Figure 5 An interface diagram illustrating a method for displaying audiovisual works provided in an exemplary embodiment is shown;

[0054] Figure 6 A flowchart illustrating a method for displaying an audiovisual work provided by an exemplary embodiment is shown;

[0055] Figure 7 An interface diagram illustrating a method for displaying audiovisual works provided in an exemplary embodiment is shown;

[0056] Figure 8 An interface diagram illustrating a method for displaying audiovisual works provided in an exemplary embodiment is shown;

[0057] Figure 9 An interface diagram illustrating a method for displaying audiovisual works provided in an exemplary embodiment is shown;

[0058] Figure 10 A flowchart illustrating a method for displaying an audiovisual work provided by an exemplary embodiment is shown;

[0059] Figure 11 An interface diagram illustrating a method for displaying audiovisual works provided in an exemplary embodiment is shown;

[0060] Figure 12 A block diagram of an audiovisual work display device provided in an exemplary embodiment is shown;

[0061] Figure 13 A block diagram of a computer device provided in an exemplary embodiment is shown. Detailed Implementation

[0062] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this application. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this application as detailed in the appended claims.

[0063] It should be understood that "several" in this article refers to one or more, and "multiple" refers to two or more. "And / or" describes the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, or B alone. The character " / " generally indicates that the preceding and following related objects have an "or" relationship.

[0064] Figure 1 A structural block diagram of a computer system provided in an exemplary embodiment of this application is shown. The computer system 100 includes a terminal 120 and a server 140.

[0065] Terminal 120 has a client installed and running for displaying audiovisual works. This client can be an application or a web client. Taking an application as an example, the application can be any one of a video player, a novel reader, a comic book reader, or an audio player. In this embodiment, a video player is used as an example.

[0066] Terminal 120 is connected to server 140 via a wireless network or a wired network.

[0067] Server 140 includes at least one of a single server, multiple servers, a cloud computing platform, and a virtualization center. Server 140 is used to provide background services to clients. Optionally, server 140 undertakes the primary computing work, and the terminal undertakes the secondary computing work; or, server 140 undertakes the secondary computing work, and the terminal undertakes the primary computing work; or, server 140 and the terminal use a distributed computing architecture for collaborative computing.

[0068] Based on the above description of the implementation environment, the method for displaying audiovisual works provided in this application embodiment will be described, taking the execution subject of the method as... Figure 1 The example shown is a client running on the terminal.

[0069] Figure 2 A flowchart illustrating a method for displaying an audiovisual work according to an exemplary embodiment of this application is shown. This embodiment uses this method... Figure 1The method is illustrated by example and is performed using terminal 120 (or a client within terminal 120). The method includes:

[0070] Step 220: Display the work showcase page for the audiovisual works;

[0071] Audiovisual works are works that contain a storyline. The presentation methods of audiovisual works include at least one of visual display and auditory playback.

[0072] Audiovisual works include at least one of the following: video, audio, literary works, and comics. For example, movies, TV series, documentaries, novels, biographies, audiobooks, animation, etc.

[0073] Step 240: Display the map control of the audiovisual work. The map control displays a map related to the plot of the audiovisual work, and the map displays at least two plot routes.

[0074] The map in an audiovisual work is related to the plot. For example, the map is the map where the various characters in the audiovisual work move around, or the map is the map involved in the world view constructed in the audiovisual work.

[0075] For example, the map can be a two-dimensional map or a three-dimensional map. The map can be a natural map, a social map, a cultural map, an economic map, a historical map, a cultural map, a transportation map, an aeronautical chart, a space chart, a nautical chart, or a tourist map.

[0076] In one embodiment, a map control of the audiovisual work is displayed when the audiovisual work reaches a key plot point. A key plot point is a point in time where at least two plot developments begin to occur.

[0077] A map control can be a full-screen control, a window control, or an element control on the interface. For example, a map control is a control displayed on a partial area of ​​the presentation interface of an audiovisual work. A map control can display multiple candidate story routes. Each candidate story route is a story route that appears in the main plot.

[0078] Step 260: In response to a selection operation on the first story route out of at least two story routes, display the story segment corresponding to the first story route on the work display page.

[0079] When the audiovisual work is video or audio, the terminal plays the plot segment corresponding to the user's selected plot route; when the audiovisual work is a literary work, the terminal displays the text segment corresponding to the user's selected plot route, such as chapter, chapter, page, or paragraph; when the audiovisual work is a comic book, the terminal displays the image and text segment corresponding to the user's selected plot route.

[0080] Exemplary Reference Figure 3As shown, taking video as an example, video A is playing on the terminal. When video A reaches a key plot point, a map control 20 is displayed on the playback interface of video A. The map control 20 displays three plot routes: 1. Coastal, 2. Mountain Road, 3. Jungle. When the user clicks on the map control 20, they can select a plot route 22. The terminal then jumps to play the video segment 24 corresponding to plot route 22.

[0081] In summary, the method provided in this embodiment, by displaying a map associated with the plot of the audiovisual work and responding to the plot route selected by the user on the map, displays plot segments in the audiovisual work corresponding to the plot route. It can provide a map-based interactive display solution, allowing users to switch between different plot routes based on the plot route on the map. For audiovisual works such as those with complex geographical locations in the plot, requiring in-depth user experience and strong interactivity, it provides a more efficient human-computer interaction solution.

[0082] Figure 4 A flowchart illustrating a method for displaying an audiovisual work according to an exemplary embodiment of this application is shown. This embodiment uses this method... Figure 1 The method is illustrated by example, performed on terminal 120 (or a client within terminal 120). The method includes:

[0083] Step 242: In response to the fulfillment of the first triggering condition, display the map control of the audiovisual work. The map control displays a map associated with the plot of the audiovisual work, and the map displays at least two plot routes and location marker controls.

[0084] The first triggering condition includes, but is not limited to, at least one of the following conditions:

[0085] • Play to the specified progress bar.

[0086] This specified progress indicates a key point in the plot. When the audiovisual work is video or audio, if the playback reaches a crucial plot point requiring the user to make a choice about the plot's direction, a map control of the audiovisual work is displayed to help the user anticipate the plot and choose a suitable route.

[0087] • The system initiates the display of an audiovisual work upon receipt;

[0088] The start-up operation includes: starting to play the audiovisual work, starting to listen to the audiovisual work, and starting to display the audiovisual work. In response to the start-up operation, the terminal begins to display the audiovisual work, as well as a map control displaying the audiovisual work.

[0089] • Receive drag or jump operations on the playback progress bar of audiovisual works;

[0090] When the audiovisual work is video or audio, if a drag or jump operation is received on the playback progress bar of the audiovisual work, it is predicted that the user has a certain probability of having the intention to jump to the playback based on the map control.

[0091] • A drag operation is received on the playback progress bar of an audiovisual work, and the drag distance of the drag operation is greater than the first threshold;

[0092] When the audiovisual work is video or audio, if a significant dragging action is received on the playback progress bar, it is predicted that the user has a certain probability of intending to jump to a different playback location based on the map control. This first threshold can be 10%, 20%, 30%, etc., of the total length of the playback progress bar.

[0093] • A jump operation is received on the playback progress bar of an audiovisual work, and the number of jump operations exceeds the second threshold;

[0094] When the audiovisual work is video or audio, if multiple jump operations are received on the playback progress bar of the audiovisual work, it is predicted that the user has a certain probability of intending to jump to other playback modes based on the map control. This second threshold can be 3 times or 5 times, etc.

[0095] • Receive fast forward or rewind commands for audiovisual works;

[0096] When the audiovisual work is video or audio, if a fast-forward or rewind operation is received on the playback progress bar of the audiovisual work, it is predicted that the user has a certain probability of intending to jump to the playback based on the map control.

[0097] • To open, jump, move forward, or go back in the directory of received audiovisual works.

[0098] When the audiovisual work is a textual work or a comic work, if an open, jump, forward, or backward operation is received in the directory of the audiovisual work, it is predicted that the user has a certain probability of having the intention to jump to the playback based on the map control.

[0099] In response to the fulfillment of at least one of the above conditions, the terminal displays a map control of the audiovisual work.

[0100] For example, the map control displays a map associated with the plot of the audiovisual work, at least two plot routes corresponding to different plot lines, and location marker controls. Location marker controls are used to select map marker points. For example, a location marker control can be a map flag, a floating droplet, a triangle indicator, a floating cube, etc.

[0101] For example, the map control may display one or more maps. When multiple maps need to be displayed, the user can swipe left or right or up or down on the map control. In response to the swiping operation on the map control, the terminal switches between different map displays. Alternatively, the terminal may display multiple candidate maps simultaneously, and in response to the user's confirmation operation, display the selected target map.

[0102] Step 262: In response to a first move operation that moves the location marker control to the first story route in the story route, determine the first map marker point indicated by the location marker control on the first story route;

[0103] The first story route is one of at least two selectable story routes.

[0104] The first movement operation is an operation used to select a story route on at least two story route selection controls. The first movement operation can be at least one of the following: click operation, drag operation, double-click operation, voice operation, pressure touch operation, eye control, and motion control, and this application does not limit it.

[0105] The first map marker is a map marker on the first storyline route.

[0106] Examples such as Figure 3 As shown, Route 1 (coastal) in the storyline is the currently selected storyline, which is the first storyline; selecting Route 1 (coastal) is the first movement operation; after selecting the first storyline through the first movement operation, the location of the map marker control is the first map marker point.

[0107] Step 264: Display the first story segment that corresponds to the first storyline and occurs at the first map marker on the work display page;

[0108] When the audiovisual work is a video or audio, the terminal plays the plot segment in the audiovisual work that corresponds to the first map marker point in the first plot route; when the audiovisual work is a literary work, the terminal displays the text segment in the audiovisual work that corresponds to the first map marker point in the first plot route, such as chapter, chapter, page, paragraph; when the audiovisual work is a comic book, the terminal displays the graphic and text segment in the audiovisual work that corresponds to the first map marker point in the first plot route.

[0109] Step 282: In response to a second movement operation that moves the location marker control along the first storyline, determine the second map marker point indicated by the location marker control along the first storyline;

[0110] The second movement operation is an operation used to move location marker controls along the same storyline. The second movement operation can be at least one of the following: click operation, drag operation, double-click operation, voice operation, pressure touch operation, eye control, and motion control; this application does not limit it to any of these.

[0111] The second map marker is a map marker determined by moving the location marker control along the same storyline.

[0112] Indicatively, the first correspondence is obtained, which includes the correspondence between map markers and story segments;

[0113] The first correspondence includes the correspondence between different locations and different plot segments. These plot segments are represented by a start time point, or by a start time point and an end time point.

[0114] Examples such as Figure 5 As shown, the story segment corresponding to location 1 on the coastal route starts at 15:00 on the playback progress bar; the story segment corresponding to location 2 on the coastal route starts at 23:00 on the playback progress bar; the story segment corresponding to location 3 on the coastal route starts at 33:10 on the playback progress bar; and the story segment corresponding to location 4 on the coastal route starts at 42:32 on the playback progress bar.

[0115] Step 284: Display the second story segment on the work display page, which corresponds to the first storyline and occurs at the second map marker point;

[0116] For example, assuming the user selects location 3 on the coastal route as the map marker, the story segment corresponding to location 3 on the coastal route will start playing from 33:10 on the playback progress bar.

[0117] When the audiovisual work is a video or audio, the terminal plays the plot segment in the audiovisual work that corresponds to the second map marker point in the first plot route; when the audiovisual work is a literary work, the terminal displays the text segment in the audiovisual work that corresponds to the second map marker point in the first plot route, such as chapter, chapter, page, paragraph; when the audiovisual work is a comic book, the terminal displays the graphic and text segment in the audiovisual work that corresponds to the second map marker point in the first plot route.

[0118] In an optional design, the following steps are included before step 282: if the first plot segment occurs before the second plot segment, a fast-forward animation is displayed; if the first plot segment occurs after the second plot segment, a rewind animation is displayed.

[0119] Step 292: In response to the third selection operation of moving the location marker control to the second story route out of at least two story routes, display the story segment corresponding to the second story route on the work display page;

[0120] The second story route is a story route that differs from the first story route among at least two story routes.

[0121] The third selection operation is an operation used to select a second storyline control that is different from the currently selected storyline. The third movement operation can be at least one of the following: click operation, drag operation, double click operation, voice operation, pressure touch operation, eye control, and motion control; this application does not limit it in this regard.

[0122] Step 294: In response to the fulfillment of the second trigger condition, cancel the display of the map control for the audiovisual work.

[0123] The second triggering condition includes any one of the following conditions:

[0124] • Received a close operation to close the map control;

[0125] • The duration during which no operation is received on the map control exceeds the third threshold;

[0126] • Start playing a scene clip;

[0127] • Receive human-computer interaction operations on interactive areas other than the map control.

[0128] In summary, the method provided in this embodiment, by displaying a map associated with the plot of the audiovisual work and responding to the plot route and map markers selected by the user on the map, provides a map-based interactive display solution. This allows users to not only choose the plot direction through the plot route, but also freely switch between different plot routes and different locations to understand the plot that occurs on different plot routes at the same time. Furthermore, users can choose to repeatedly watch more complex plots to experience the plot of the audiovisual work more comprehensively and deeply, thereby enhancing the user experience and providing an efficient human-computer interaction solution.

[0129] Since the plot development in an audiovisual work is not only related to the plot line, but also to other plot elements, such as plot characters, plot objects, the era in which the plot takes place, etc., this application also provides the following embodiments.

[0130] Figure 6 A flowchart illustrating a method for displaying an audiovisual work according to an exemplary embodiment of this application is shown. This embodiment uses this method... Figure 1 The method is illustrated by example and is performed using terminal 120 (or a client within terminal 120). The method includes:

[0131] Step 602: Display the map control and plot element selection control for the audiovisual work;

[0132] Plot elements include at least one of the following: time in the plot, characters in the plot, and items in the plot. This example uses characters in the plot as a plot element, but the specific type of plot element is not limited.

[0133] A plot element selection control is used to select one or more plot elements from a set of multiple plot elements. A plot element selection control can be a button, menu, list, etc. This example illustrates the plot element selection control as multiple buttons, with each button corresponding to a character.

[0134] In one embodiment, the plot element selection control and the map control may be displayed simultaneously or both may be hidden simultaneously. In another embodiment, the plot element selection control and the map control may not be displayed simultaneously or both may be hidden simultaneously.

[0135] Examples such as Figure 7 As shown, in response to the fulfillment of the triggering condition, a map control 20 and a plot element selection control 26 of the audiovisual work are displayed simultaneously. The plot element selection control 26 includes selection buttons for actor A, actor B, and actor C. Optionally, the map control 20 displays a plot route control 22 associated with the plot of the audiovisual work.

[0136] Step 604: In response to the first element selection operation on the plot element selection control, determine the first selected plot element;

[0137] The first element selection operation is used to select a plot element on the plot element selection control. The first element selection operation can be at least one of the following: click operation, drag operation, double-click operation, voice operation, pressure touch operation, eye control, and motion control; this application does not limit it in this regard.

[0138] The first plot element is one of several plot elements.

[0139] Step 606: In response to a selection operation on the first story route out of at least two story routes, determine the selected first story route;

[0140] This embodiment does not limit the execution order of steps 604 and 606. Step 604 can be executed before step 606, and step 606 can be executed before step 604.

[0141] Step 608: Display the plot segments corresponding to the first plot route and the first plot element on the work display page;

[0142] When the audiovisual work is a video or audio, the terminal plays the plot segments that correspond to the first plot line and the first plot element. When the audiovisual work is a literary work, the terminal displays text segments that correspond to the first plot line and the first plot element, such as chapters, chapters, pages, and paragraphs. When the audiovisual work is a comic book, the terminal displays graphic and text segments that correspond to the first plot line and the first plot element.

[0143] In the example where you first select the first story element and then choose the story route, such as... Figure 8 As shown:

[0144] The terminal displays selection buttons 26a for actor A, B, and C, as well as a map control 20. The map control 20 displays a storyline control 22 and a location marker control 28. In response to a user's click on actor A's selection button 26a, the terminal displays candidate storylines 1, 2, and 3 corresponding to actor A on the map control 20. In response to a user's dragging of the location marker control 28, the storyline closest to the dragged location marker control 28 is identified as storyline 1, and the terminal displays a video clip of actor A appearing on storyline 1.

[0145] In other words, in response to identifying the first plot element, candidate plot routes corresponding to the first plot element are displayed on the map control. These candidate plot routes are those that have appeared alongside the first plot element. If there are other candidate plot routes that do not correspond to the first plot element, these routes are either not displayed or are shown as unselectable.

[0146] For example, after the first plot element is identified, the plot element selection control corresponding to the first plot element will be highlighted. For instance, the selection button corresponding to actor A will be enlarged and bolded.

[0147] For example, in response to a drag operation on the location marker control, the terminal identifies the candidate story route on the map that is closest to the moved location marker control as the story route. If the end position of the drag operation does not coincide with the nearest candidate story route, the terminal displays a snapping animation that snaps the location marker control to the nearest candidate story route. This allows the user to perceive that the story route they selected is the candidate story route closest to the moved location marker control.

[0148] In the example where you first choose the storyline and then select the first story element, such as... Figure 9 As shown:

[0149] The terminal displays a selection button 26a for actor A, a selection button for actor B, a selection button for actor C, and a map control 20. The map control 20 displays a plot route control 22 and a location marker control 28.

[0150] Initially, the map point indicated by the location marker control 28 is the map point corresponding to the current storyline. In response to a touch operation (start touch event) received on the location marker control 28, multiple candidate storylines are displayed on the map control. Optionally, the multiple candidate storylines are storylines in which at least two story elements have appeared. Storylines in which different story elements have appeared can be displayed with different styles.

[0151] In response to receiving a drag operation on the location marker control 28, the terminal determines the story route that is closest to the dragged location marker control 28 as the story route, for example, selecting story route 1 as the story route.

[0152] After the plot route is determined, the terminal displays a plot element selection control for at least two candidate plot elements corresponding to (or appearing in) the plot route. In response to the user's click on the selection button 26a for actor A, the terminal displays a video clip of actor A appearing in plot route 1.

[0153] The multiple candidate plot elements corresponding to the selected map marker are those that have appeared at the map marker. If there are other candidate map elements that have not appeared at the map marker, these other candidate map elements will not be displayed, or will be displayed as unselectable.

[0154] For example, after the first plot element is identified, the plot element selection control corresponding to the first plot element will be highlighted. For instance, the selection button corresponding to actor A will be enlarged and bolded.

[0155] For example, in response to a drag operation on the location marker control, the terminal identifies the candidate route on the map closest to the moved location marker control as the story route. If the end position of the drag operation does not coincide with the nearest candidate story route, the terminal displays a snapping animation that snaps the location marker control to the nearest candidate story route. This allows the user to perceive that the story route they selected is the candidate story route closest to the moved location marker control.

[0156] Step 610: In response to the second element selection operation on the plot element selection control, determine the selected second plot element;

[0157] Optionally, during the display of story segments corresponding to the first storyline and the first story element, if a story segment corresponding to the second story element exists in the first storyline, the story button corresponding to the second story element will be displayed in the selectable style.

[0158] Users can select a second plot element from the plot element selection control while watching the plot segment corresponding to the first plot element. In response to this second selection on the plot element selection control, the terminal confirms the selected second plot element.

[0159] Step 612: On the work display page, switch the display of plot segments in the audiovisual work that correspond to the first plot route and the second plot element.

[0160] When the audiovisual work is a video or audio, the terminal plays the plot segments in the audiovisual work that correspond to the first plot route and the second plot element simultaneously; when the audiovisual work is a literary work, the terminal displays the text segments in the audiovisual work that correspond to the first plot route and the second plot element simultaneously, such as chapters, chapters, pages, and paragraphs; when the audiovisual work is a comic book, the terminal displays the image and text segments in the audiovisual work that correspond to the first plot route and the second plot element simultaneously.

[0161] While watching a scene in an audiovisual work that corresponds simultaneously to the first storyline and the second storyline element, the user can also drag a location marker control on the first storyline. In response to a second movement operation where the location marker control moves along the first storyline, the second map marker point indicated by the location marker control on the first storyline is determined. The first correspondence is obtained, and the scene that corresponds simultaneously to the first storyline and the second storyline element and occurs at the second map marker point is displayed on the work's display page. The specific steps are similar to steps 280 to 284.

[0162] In summary, the method provided in this embodiment, by displaying a map associated with the plot of the audiovisual work, and responding to the plot route and plot elements selected by the user on the map, displays plot segments in the audiovisual work corresponding to the plot route and plot elements. This provides an interactive jump display scheme based on plot routes and plot elements, allowing users to switch between different plot routes and different plot elements, thus experiencing the details of the audiovisual work's plot more deeply. For audiovisual works such as adventure and puzzle-solving, those with high user experience requirements, and strong interactivity, this provides a more efficient human-computer interaction solution.

[0163] Based on Figure 6 In optional embodiments, step 608 described above can be implemented in various technical ways, including but not limited to at least one of the following technical implementation methods:

[0164] The first implementation method: based on the correspondence relationship;

[0165] The terminal obtains the second correspondence, which includes the correspondence between the plot route, plot elements, and plot segments; based on the second correspondence, it displays the plot segments in the audiovisual work that correspond to the plot route and the first plot element.

[0166] In other words, the terminal or server pre-sets a correspondence between the plot route, plot elements, and plot fragments. This correspondence can be stored as a data table, database, etc. After determining the plot route and the first plot element, the terminal uses the plot route and the first plot element as query input to retrieve the corresponding plot fragments.

[0167] The second implementation method: based on facial recognition;

[0168] Assuming the audiovisual work includes video, the first plot element includes the first character. This first character is actor A.

[0169] The terminal acquires a first correspondence, which includes the correspondence between map markers and plot segments; determines the video segment corresponding to the map marker based on the first correspondence; identifies the video segment corresponding to the first character in the video segment corresponding to the map marker, which includes at least one of the first character's face video frames and voice audio frames; and displays the video segment.

[0170] In other words, after obtaining candidate video segments corresponding to map markers, the video segment corresponding to the first character is determined from the candidate video segments based on facial recognition or speech recognition technology. The video frames in this video segment contain the face of the first character, and / or, the audio frames in this video segment contain the voice characteristics of the first character.

[0171] The third implementation method: based on speech recognition;

[0172] Assuming audiovisual works include audio;

[0173] The terminal obtains a first correspondence, which includes the correspondence between map markers and plot segments; determines the audio segment corresponding to the map marker based on the first correspondence; identifies audio segments with keywords containing the first plot element in the audio segments corresponding to the map marker; and plays the audio segments.

[0174] In other words, after obtaining candidate audio segments corresponding to map markers, the audio segment corresponding to the first character is determined from the candidate audio segments based on speech recognition technology. The audio frames in this audio segment contain the voice characteristics of the first character.

[0175] The fourth implementation method: based on text matching;

[0176] Assuming that audiovisual works include literary works;

[0177] The terminal obtains a first correspondence, which includes the correspondence between map markers and plot segments; determines the plot segment corresponding to the map marker based on the first correspondence; identifies chapter segments with keywords containing the first plot element within the plot segments corresponding to the map marker; and displays the chapter segments.

[0178] For example, the unit of measurement for this chapter segment can be at least one of the following: chapter, chapter, paragraph, page, paragraph, line.

[0179] exist Figure 10 In the illustrative example shown, the method is accomplished collaboratively by the user, the terminal, and the backend server:

[0180] Step 1001, Begin;

[0181] Step 1002: The user watches the video and sees the time point 02:30 of the pre-embedded map;

[0182] Step 1003: The terminal displays a map provided by the production company, the coordinates of the main character, and different plot development options, namely 1. Coastal, 2. Mountain Road, 3. Jungle;

[0183] Step 1004, the user selects route 3 (jungle);

[0184] Step 1005: The backend server retrieves the video clip 3 that matches location 3 (jungle) and sends the clip back to the terminal.

[0185] Step 1006: The terminal displays the plot of video clip 3;

[0186] Step 1007: The user then watches the storyline of Route 3 (Jungle);

[0187] Step 1008: When the user sees 15 minutes remaining, switch to Route 2 (Mountain Road);

[0188] Step 1009, the time point for terminal location switching is 15:00;

[0189] Step 1010: The backend server retrieves the video segment 2 that matches location 2 (mountain road), retrieves the video segment corresponding to 15:00, and sends the segment back to the terminal.

[0190] Step 1011: The terminal displays video clip 2 (mountain road) starting at 15:00;

[0191] In step 1012, the user watches the storyline of Route 2 (mountain road) starting at 15:00;

[0192] Step 1013, the user selects role A;

[0193] Step 1014: The backend server uses image recognition technology to identify key frames in the entire video and marks the key frames in which character A appears.

[0194] Step 1015: The backend server extracts video segments from the keyframes marked with character A in the video and sends the results back to the terminal.

[0195] Step 1016: The terminal starts playing the video clip marked with the character A after 15:00;

[0196] Step 1017: The user views Route 2, the storyline about character A;

[0197] Step 1018, End.

[0198] In another exemplary example, the above method can also be applied to novel reading scenarios, such as... Figure 11 As shown, when a user reads Chapter 15, a map control 132 and a character selection control 134 are triggered. Map control 132 includes selection controls for map route 1, map route 2, and map route 3; character selection control 134 includes selection controls for character A, character B, and character C. After selecting map route 3 in map control 132, the user begins reading Chapter 315 corresponding to map route 3. After selecting character A, the terminal jumps to display the paragraph segment corresponding to character A in Chapter 315. After selecting map route 2 in map control 132, assuming Chapter 215 is the descriptive chapter corresponding to map route 2, the terminal jumps to display the paragraph segment corresponding to character A in Chapter 215. After the user selects character B again, the terminal jumps to display the paragraph segment corresponding to character B in Chapter 215.

[0199] Figure 12 A block diagram of a display apparatus for an audiovisual work provided in an exemplary embodiment of this application is shown, the apparatus comprising:

[0200] Display module 1220 is used to display a map control of the audiovisual work. The map control displays a map associated with the plot of the audiovisual work, and the map has no less than two plot routes.

[0201] Interaction module 1240 is used to determine the selected story route on the map in response to a story route selection operation on the map;

[0202] The display module 1260 is used to display plot segments in the audiovisual work that correspond to the plot route.

[0203] In an optional design of this embodiment, a location marker control is displayed on the map control;

[0204] The display module 1260 is configured to, in response to a first movement operation that moves the location marker control to the first storyline of the at least two storylines, display a story segment corresponding to the first storyline on the work display page.

[0205] In an optional design of this embodiment, the interaction module 1240 is configured to determine the first map marker point indicated by the location marker control on the first storyline in response to a first movement operation that moves the location marker control to the first storyline of the at least two storylines;

[0206] The display module 1260 is used to display a first plot segment that corresponds to the first plot route and occurs at the first map marker on the work display page.

[0207] In an optional design of this embodiment, the device further includes:

[0208] The interaction module 1240 is configured to, in response to a second movement operation that moves the location marker control from the first map marker point on the first storyline, determine the second map marker point indicated by the location marker control on the first storyline;

[0209] The display module 1260 is used to display a second plot segment that corresponds to the first plot route and occurs at the second map marker point on the work display page.

[0210] In an optional design of this embodiment, the display module 1260 is used to display fast-forward animation when the first plot segment is earlier than the second plot segment, and to display rewind animation when the first plot segment is later than the second plot segment.

[0211] In an optional design of this embodiment, the display module 1260 is used to display a plot segment corresponding to the second plot route on the work display page in response to a third selection operation on the second plot route of the at least two plot routes.

[0212] In an optional design of this embodiment, the display module 1220 is used to display the plot element selection control of the audiovisual work;

[0213] The interaction module 1240 is used to respond to the element selection operation on the plot element selection control and determine the first selected plot element;

[0214] The display module 1260 is used to respond to a selection operation on the first plot route of the at least two plot routes and to display plot segments corresponding to the first plot route and the first plot element on the work display page.

[0215] In an optional design of this embodiment, the interaction module 1240 is used to determine the selected second plot element in response to an element selection operation on the plot element selection control;

[0216] The display module 1260 is used to switch the display of plot segments in the audiovisual work that correspond to the first plot route and the second plot element on the work display page.

[0217] In an optional design of this embodiment, the display module 1260 is used to highlight map points corresponding to the currently playing plot segment on the map control; or, to highlight map points corresponding to the target plot character currently playing on the map control.

[0218] The highlighted display includes at least one of the following: bold display, magnified display, inverted color display, changing foreground color, changing background color, and adding animation effects.

[0219] In an optional design of this embodiment, the display module 1220 is configured to display a map control of the audiovisual work in response to a first triggering condition being met; the first triggering condition includes any one of the following conditions:

[0220] Play to the specified progress on the playback progress bar;

[0221] The system receives the command to start displaying the audiovisual work.

[0222] Receive a drag or jump operation on the playback progress bar of the audiovisual work;

[0223] The drag operation is received on the playback progress bar of the audiovisual work and the drag distance of the drag operation is greater than a first threshold.

[0224] The jump operation is received on the playback progress bar of the audiovisual work and the number of jump operations is greater than the second threshold;

[0225] The fast forward or rewind operation of the audiovisual work is received;

[0226] The system receives an open, jump, forward, or backward operation on the directory of the audiovisual work.

[0227] In an optional design of this embodiment, the display module 1220 is configured to cancel the display of the map control of the audiovisual work in response to a second trigger condition being met; the second trigger condition includes any one of the following conditions:

[0228] Received a close operation to close the map control;

[0229] The duration during which no operation is received on the map control exceeds the third threshold;

[0230] Start playing the aforementioned plot segment;

[0231] Human-computer interaction operations are received in other interactive areas besides the map control.

[0232] Figure 13 This is a schematic diagram of a terminal according to an exemplary embodiment. The terminal 1300 includes a Central Processing Unit (CPU) 1301, a system memory 1304 including Random Access Memory (RAM) 1302 and Read-Only Memory (ROM) 1303, and a system bus 1305 connecting the system memory 1304 and the CPU 1301. The computer device 1300 also includes a basic input / output system (I / O system) 1306 to facilitate information transfer between various devices within the computer device, and a mass storage device 1307 for storing the operating system 1313, application programs 1314, and other program modules 1315.

[0233] The basic input / output system 1306 includes a display 1308 for displaying information and an input device 1309 for user input, such as a mouse or keyboard. Both the display 1308 and the input device 1309 are connected to the central processing unit 1301 via an input / output controller 1310 connected to the system bus 1305. The basic input / output system 1306 may also include the input / output controller 1310 for receiving and processing input from multiple other devices such as a keyboard, mouse, or electronic stylus. Similarly, the input / output controller 1310 also provides output to a display screen, printer, or other types of output devices.

[0234] The mass storage device 1307 is connected to the central processing unit 1301 via a mass storage controller (not shown) connected to the system bus 1305. The mass storage device 1307 and its associated computer device-readable media provide non-volatile storage for the computer device 1300. That is, the mass storage device 1307 may include computer device-readable media (not shown), such as a hard disk or a compact disc read-only memory (CD-ROM) drive.

[0235] Without loss of generality, the computer device readable medium may include computer device storage media and communication media. Computer device storage media include volatile and non-volatile, removable and non-removable media implemented using any method or technology for storing information such as computer device readable instructions, data structures, program modules, or other data. Computer device storage media include RAM, ROM, erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), CD-ROM, digital video disc (DVD) or other optical storage, magnetic tape cassettes, magnetic tape, disk storage, or other magnetic storage devices. Of course, those skilled in the art will recognize that the computer device storage media are not limited to the above-mentioned types. The system memory 1304 and mass storage device 1307 described above can be collectively referred to as memory.

[0236] According to various embodiments of this disclosure, the computer device 1300 can also be connected to a remote computer device on a network, such as the Internet. That is, the computer device 1300 can be connected to a network 1311 via a network interface unit 1312 connected to the system bus 1305, or it can use a network interface unit 1315 to connect to other types of networks or remote computer device systems (not shown).

[0237] The memory also includes one or more programs stored in the memory, and the central processing unit 1301 executes the one or more programs to implement all or part of the steps of the above-mentioned audiovisual work display method.

[0238] In an exemplary embodiment, a computer-readable storage medium is also provided, which stores at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the audiovisual work display method provided in the above-described method embodiments.

[0239] This application also provides a computer-readable storage medium storing at least one instruction, at least one program, code set, or instruction set, wherein the at least one instruction, the at least one program, the code set, or the instruction set is loaded and executed by a processor to implement the method for displaying audiovisual works provided in the above-described method embodiments.

[0240] This application also provides a computer program product or computer program including computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various alternative implementations of the above-described audiovisual work display.

[0241] Optionally, this application also provides a computer program product containing instructions that, when run on a computer device, causes the computer device to perform the methods for displaying audiovisual works described in the above aspects.

[0242] The sequence numbers of the embodiments in this application are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0243] Those skilled in the art will understand that all or part of the steps of the above embodiments can be implemented by hardware or by a program instructing related hardware. The program can be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0244] The above description is merely an optional embodiment of this application and is not intended to limit this application. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A method of presenting an audiovisual work, characterized in that, The method comprises: displaying a work display page of the audio-visual work, the work display page being used to play a plot segment corresponding to the audio-visual work; displaying a map control and a plot element selection control of the audio-visual work, the map control displaying a geographical map associated with a plot of the audio-visual work, the geographical map displaying a location marker control and at least two plot routes related to a plot development; the plot element selection control being a control used to select one or more plot elements from a plurality of plot elements, the plot elements including characters in the plot; in response to a selection operation of a first plot element on the plot element selection control, displaying a candidate plot route corresponding to the first plot element on the map control; in response to a first movement operation of moving the location marker control along a first plot route in the candidate plot route, determining a first map marker point indicated by the location marker control on the first plot route; displaying a first plot segment corresponding to the first plot route and the first plot element and occurring at the first map marker point on the work display page.

2. The method of claim 1, wherein, The method further comprises: in response to a second movement operation of moving the location marker control from the first map marker point on the first plot route, determining a second map marker point indicated by the location marker control on the first plot route; displaying a second plot segment corresponding to the first plot route and the first plot element and occurring at the second map marker point on the work display page.

3. The method of claim 2, wherein, The method further comprises: in a case where the first plot segment is earlier than the second plot segment, displaying a fast-forward animation; in a case where the first plot segment is later than the second plot segment, displaying a fast-rewind animation.

4. The method of claim 1, wherein, The method further comprises: in response to a third selection operation on a second plot route in the at least two plot routes, displaying a plot segment corresponding to the second plot route on the work display page.

5. The method of claim 1, wherein, The method further comprises: in response to an element selection operation on the plot element selection control, determining a selected second plot element; switching to display a plot segment corresponding to the first plot route and the second plot element and occurring at the first map marker point in the audio-visual work on the work display page.

6. The method of claim 1, wherein, The method further comprises: highlighting a map point corresponding to a playing plot segment on the map control; or highlighting a map point corresponding to a target plot character on the map control on the map control; wherein the highlighting comprises at least one of bold display, magnified display, reverse color display, foreground color change, background color change, and animation effect.

7. The method of claim 1, wherein, The method further comprises: in response to a first trigger condition being met, displaying the map control of the audio-visual work; the first trigger condition comprising any one of the following conditions: playing to a specified progress on a play progress bar; receiving a start display operation of the audio-visual work; receiving a drag operation or a jump operation on a play progress bar of the audiovisual work; receiving the drag operation on the play progress bar of the audiovisual work and a drag distance of the drag operation being greater than a first threshold; receiving the jump operation on the play progress bar of the audiovisual work and a number of operations of the jump operation being greater than a second threshold; receiving a fast-forward operation or a fast-rewind operation of the audiovisual work; receiving an opening operation or a jump operation or a forward operation or a backward operation of a table of contents of the audiovisual work.

8. The method of claim 1, wherein, The method further includes: in response to a second trigger condition being met, canceling display of the map control of the audiovisual work; the second trigger condition includes any one of the following conditions: receiving a closing operation for closing the map control; a time length during which no operation is received on the map control being greater than a third threshold; starting to play the plot segment; receiving a human-computer interaction operation on an interactive region other than the map control.

9. An apparatus for presenting an audiovisual work, characterized in that The apparatus includes: a display module configured to display a map control and a plot element selection control of the audiovisual work, the map control displays a geographical map associated with a plot of the audiovisual work, the geographical map displays a location marker control and at least two plot routes related to a plot development; the plot element selection control is a control for selecting one or more plot elements from a plurality of plot elements, the plot elements including characters in the plot; an interaction module configured to, in response to a selection operation of a first plot element on the plot element selection control, display a candidate plot route corresponding to the first plot element on the map control; in response to a first movement operation of moving the location marker control along a first plot route in the candidate plot route, determine a first map marker point indicated by the location marker control on the first plot route; a presentation module configured to display a first plot segment corresponding to the first plot route and the first plot element and occurring at the first map marker point on a work presentation page.

10. A computer device, comprising: The computer device includes a processor and a memory, the memory stores a computer program, the computer program is loaded and executed by the processor to implement the work presentation method according to any one of claims 1 to 8.

11. A computer readable storage medium, characterized in that, The computer readable storage medium stores a computer program, the computer program is loaded and executed by the processor to implement the work presentation method according to any one of claims 1 to 8.

12. A computer program product, characterised in that, The computer program product includes computer instructions stored in a computer readable storage medium, the processor reads and executes the computer instructions from the computer readable storage medium to implement the work presentation method according to any one of claims 1 to 8.

Images