Display device, server and medium asset content brief introduction display method

Abstract

The embodiment of the invention discloses a display device, a server and a media asset content brief introduction display method, and the method comprises the steps: obtaining media asset information of a first media asset in response to a preset operation inputted by a user when the first media asset is displayed on a media asset playing interface; based on the media asset information, a content brief introduction obtaining request is sent to a server, the content brief introduction obtaining request is used for obtaining first global content brief introduction information of the first media asset from the server, and the first global content brief introduction information comprises fragment brief introduction information of multiple media asset fragments of the first media asset; the plurality of media asset fragments are obtained after the server divides the first media asset according to a preset time granularity and a playing time sequence; receiving first global content brief introduction information sent by the server; and displaying a content brief introduction page on the upper layer of the media asset playing interface, and displaying the first global content brief introduction information on the content brief introduction page. And the global plot of the first media asset is displayed in a segmented manner based on the preset time granularity and the playing time sequence, so that the content brief introduction query efficiency is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device, a server, and a method for displaying a summary of media content. Background Art

[0002] When a user watches a first media resource based on a display device, if the user has not watched the first media resource before, the user cannot know the plot at different playback nodes of the first media resource. Therefore, the user has a need to understand the plot of the first media resource so as to determine whether to continue watching the first media resource or jump to a wonderful or interesting segment in the first media resource to continue watching.

[0003] The display device can provide a query function for the content summary of the media so that the user can view the content summary of the media (such as the plot summary). The user can use the EPG (Electrical Program Guide) to view the content summary of the electronic programs to be broadcast on the channel at different broadcast time periods in the future. However, the content summary is an overall introduction and brief highlights of the program, and the user can only roughly understand the general information of the program. When watching online media, users can view other viewers' exchanges, discussions and spoilers about the media content through barrages and comments, but the content information obtained in this way is relatively divergent and rough, and users still cannot obtain a detailed content summary, and the query efficiency of the media content summary is low. Summary of the Invention

[0004] The embodiments of the present application provide a display device, a server, and a method for displaying a media asset content summary, which realizes the segmented display of the overall plot of the media asset based on a preset time granularity and playback timing, making it convenient for users to view the current playback progress and the content summary at any other playback node, allowing users to quickly understand the content of the media asset and improving the efficiency of content summary query.

[0005] In a first aspect, an embodiment of the present application provides a display device, including:

[0006] The display is configured to display a content introduction page on the upper layer of the media resource playback interface;

[0007] a communication device configured to be communicatively connected with a server;

[0008] A controller, coupled to the display and the communication device, is configured to:

[0009] When a first media asset is displayed on the media asset playback interface, in response to a preset operation input by a user, acquiring media asset information of the first media asset;

[0010] Based on the media asset information, a content summary acquisition request is sent to the server, wherein the content summary acquisition request is used to obtain first global content summary information of the first media asset from the server, wherein the first global content summary information includes segment summary information of multiple media asset segments of the first media asset, wherein the multiple media segments are obtained by dividing the first media asset by the server according to a preset time granularity and a playback sequence;

[0011] The first global content introduction information is received from the server, and the display is controlled to display the content introduction page on the upper layer of the media asset playback interface, and the first global content introduction information is displayed on the content introduction page.

[0012] The technical solution provided by the above-mentioned first aspect embodiment has the following beneficial effects: the server side can pre-segment the first media asset, specifically using a preset time granularity to divide the segments according to the playback time sequence. For example, if the preset time granularity is 5 minutes, then the media asset segment 1 is the 0th to 5th minute, the media asset segment 2 is the 5th to 10th minute, and so on; the display device receives a preset operation, triggering the query and display of the first global content introduction information of the currently playing first media asset, and displays the content introduction page on the upper layer of the media asset playback interface. When the user views it, the segment introduction information corresponding to the multiple media asset segments of the first media asset is displayed on the content introduction page according to the playback sequence, so as to realize the segmented display of the global plot of the first media asset based on the preset time granularity and playback sequence, making it convenient for the user to view the current playback progress and the content introduction at any other playback node, so that the user can quickly understand the content plot of the media asset without the user adjusting the playback progress and playback node to view the plot distribution. In addition, the content introduction of each playback interval on the content introduction page has temporal coherence, which makes it convenient for the user to quickly understand the overall plot of the media asset after reading, thereby improving the query efficiency of the content introduction.

[0013] In some embodiments of the first aspect, the controller executes the steps of controlling the display to display the content introduction page on the upper layer of the media asset playback interface, and displaying the first global content introduction information in the content introduction page, and is specifically configured as follows: obtaining the playback interval information of the media asset segment from the first global content introduction information; wherein, the playback interval information is calculated by the server based on the segment sequence number of the media asset segment and the preset time granularity, the playback interval information includes the starting position and the ending position of the media asset segment, and the segment sequence number is the arrangement sequence number of the media asset segment based on the playback order; according to the playback order of multiple media asset segments, the display is controlled to display the content information rows corresponding to each of the multiple media asset segments in sequence on the content introduction page, and the content information rows include the playback interval information and the segment introduction information. The technical solution provided by this embodiment has the following beneficial effects: the server can assign a segment serial number to each media segment, and the segment serial number can represent the order of the media segments in terms of playback time, and calculate the playback interval information of each media segment based on the playback time axis through the segment serial number and the preset time granularity. The playback interval information can clearly define the starting position and end position of the media segment playback. Assuming that the preset granularity is 5 minutes, the playback interval of media segment 1 is [0,5], and the playback interval of media segment 2 is [5,10]. The server obtains the first global content introduction information based on the playback interval information and segment introduction information of multiple media segments; in this way, the controller can display the playback interval information and segment introduction information corresponding to each media segment in rows on the content introduction page, so that the user can select the segment introduction information they want to view based on the time period distribution, thereby improving user search efficiency.

[0014] In some embodiments of the first aspect, after the controller controls the display to sequentially display content information rows of multiple media asset segments on the content introduction page according to the playback order of the multiple media asset segments, the controller is further configured to: obtain the playback progress of the first media asset; search for the target playback interval to which the playback progress belongs; determine the target media asset segment that matches the playback progress based on the playback interval information of the target playback interval; and control the display to add a prompt mark to the content information row of the target media segment, the prompt mark being used to prompt the user to view the segment introduction information at the playback progress of the first media asset. The technical solution provided by this embodiment has the following advantageous effects: based on the playback progress of the first media asset, the target playback interval to which the playback progress belongs can be determined. For example, if the playback progress is 7 minutes and 52 seconds, the target playback interval to which the playback progress belongs is [5, 10], and the matching target media asset segment is media segment 2. In this way, the content information row of the target media segment can be marked with a prompt, such as highlighting or adding a prompt box, on the content introduction page, so that the user can quickly locate the plot introduction at the current playback progress of the first media asset, eliminating the need for the user to check the playback progress through the progress bar and then view the corresponding plot introduction, thereby improving the efficiency of content introduction query.

[0015] In some embodiments of the first aspect, the content introduction page includes a filter control, and after the controller executes the step of controlling the display to sequentially display content information rows of multiple media asset segments on the content introduction page according to the playback order of multiple media asset segments, the controller is further configured to: obtain the playback progress of the first media asset in response to the user clicking the filter control; search for the target playback interval to which the playback progress belongs; determine the target media asset segment that matches the playback progress based on the playback interval information of the target playback interval; and control the display to display the content information row of the target media asset segment on the content introduction page, and not display the content information rows of other media asset segments. The technical solution provided by this embodiment has the following beneficial effects: a filter control can be set in the content introduction page, and the function of the filter control is to filter out the content information row of the target media asset segment corresponding to the target playback interval to which the current playback progress belongs, and filter out the content information rows of other media asset segments, so as to view the plot summary at the current playback progress with one click, eliminate the interference of other plot summaries, and improve the query efficiency of the content summary.

[0016] In some embodiments of the first aspect, the content information row also includes a play control, and the controller is further configured to: obtain the first play interval information of the first media asset segment in response to a jump play instruction input by the user based on the first play control; wherein the first play control is the play control in the content information row corresponding to the first media asset segment; obtain the first starting position included in the first play interval information; adjust the play progress of the first media asset to the first starting position, and continue to play the first media asset from the first starting position. The technical solution provided by this embodiment has the following beneficial effects: when the user views the segment introduction information of the first media asset segment of interest / prefer based on the content introduction page, the user can quickly jump to the starting point of the first media asset segment through the first play control provided in the content information row corresponding to the first media segment, thereby playing the first media segment, without the user having to manually adjust the progress bar to align the play progress with the starting point of the first media asset segment, and can quickly jump to the media segment of interest to continue watching with one click.

[0017] In some embodiments of the first aspect, the first global content introduction information also includes content summary information of the first media asset. Before executing the steps of controlling the display to display the content introduction page on the upper layer of the media asset playback interface and displaying the first global content introduction information on the content introduction page, the controller is further configured to: control the display to display a first prompt page on the upper layer of the media asset playback interface, the first prompt page displaying the content summary information and a view button; in response to the user clicking the view button, control the display to close the first prompt page and display the content introduction page. The technical solution provided by this embodiment has the following beneficial effects: when the server sets the first global content introduction information for the first media asset, it can add content summary information to the first global content introduction information. The content summary information is a general summary of the overall content of the first media asset and can be regarded as a media asset highlight. In this way, when the display device obtains the first global content introduction information, it can first display the first prompt page on the upper layer of the media asset playback interface, and display the content summary information and the view button on the first prompt page. If the user browses the content summary information and wants to further view the segment introduction information of different playback intervals of the first media asset, he can click the view button to enter the next level of content introduction page. In this way, the content introduction page can be displayed when the user is interested in the first media asset and wants to have an in-depth understanding of the plot distribution of the first media asset, so as to avoid the content introduction page interfering with the user's viewing of the first media asset.

[0018] In some embodiments of the first aspect, the preset operation is a screenshot operation, and the controller is further configured to: in response to the screenshot operation input by the user, capture the media content image of the first media asset displayed on the display; send the media content image to the server; receive the image recognition result sent by the server, the image recognition result including the character detail information and character-related recommendation data of the target person obtained when the server recognizes at least one target person in the media content image; and control the display to display the image recognition result in the first prompt page. The technical solution provided by this embodiment has the following beneficial effects: when a user watches the first media resource, he or she may be interested in the characters involved in the first media resource. In this regard, a solution is provided for linking the media resource character information with the first global content introduction information. In this case, the preset operation can be set to a screenshot operation. In response to the screenshot operation, the controller captures the media content image presented on the screen and sends it to the server, so that the server recognizes the media content image, recognizes the characters contained in the image, and obtains the character's detailed information (such as a character encyclopedia) and character-related recommended data (such as related performances, etc.). In this way, the user can view both the plot introduction and the character information, thereby improving the user's viewing experience.

[0019] In a second aspect, an embodiment of the present application further provides a display device, including:

[0020] The display is configured to display a content introduction page on the upper layer of the media resource playback interface;

[0021] a communication device configured to be communicatively connected with a server;

[0022] A controller, coupled to the display and the communication device, is configured to:

[0023] When a first media asset is displayed on the media asset playback interface, in response to a preset operation input by a user, obtaining media asset information of the first media asset and obtaining a playback progress of the first media asset;

[0024] Based on the media asset information and the playback progress, a content introduction acquisition request is sent to the server, the content introduction acquisition request being used to request target content introduction information of the first media asset, the target content introduction information including segment introduction information of a target media asset segment of the first media asset, the target media segment being a media asset segment obtained by the server from a plurality of media asset segments that matches the playback progress of the first media asset, the plurality of media segments being obtained by the server by dividing the first media asset according to a preset time granularity and a playback sequence;

[0025] The target content introduction information is received from the server, and the display is controlled to display the content introduction page on the upper layer of the media resource playback interface, and the target content introduction information is displayed on the content introduction page.

[0026] The technical solution provided by the above second aspect embodiment has the following beneficial effects: the server side can pre-segment the first media asset, specifically using a preset time granularity to divide the segments according to the playback time order. For example, if the preset time granularity is 5 minutes, then media asset segment 1 is from 0 to 5 minutes, media asset segment 2 is from 5 to 10 minutes, etc.; the display device receives a preset operation, triggers the query and display of the layout content introduction information at the current playback progress of the first media asset, and sends a content introduction acquisition request to the server through the media asset information and real-time playback progress; the server can find the target content introduction information that matches the playback progress from the multiple media asset segments divided by the first media asset, and the display device displays the acquired target content introduction information on the content introduction page, so that when the user enters the preset operation at any playback node, he can view the content introduction of the segment at the current playback progress, so that the user can dynamically view the content introduction based on the changes in the playback progress, which is convenient for the user to quickly understand the real-time content plot of the media asset and improve the query efficiency of the content introduction.

[0027] In a third aspect, an embodiment of the present application further provides a server, including:

[0028] A communicator, used for communicating with a display device;

[0029] A controller, coupled to the communication device, is configured to:

[0030] receiving a content introduction acquisition request sent by the display device, wherein the content introduction acquisition request includes media asset information of the first media asset;

[0031] In response to the content summary acquisition request, obtaining first global content summary information of the first media asset based on the media asset information, the first global content summary information including segment summary information of a plurality of media asset segments of the first media asset, the plurality of media segments being obtained by the server dividing the first media asset according to a preset time granularity and a playback sequence;

[0032] The first global content introduction information is sent to the display device, so that the display device displays the first global content introduction information on a content introduction page.

[0033] The technical solution provided by the above third aspect embodiment has the following beneficial effects: the server side can pre-segment the first media asset, specifically using a preset time granularity to divide the segments according to the order of playback time. For example, if the preset time granularity is 5 minutes, then media asset segment 1 is from 0 to 5 minutes, media asset segment 2 is from 5 to 10 minutes, etc.; in this way, when the server receives the content introduction acquisition request sent by the display device, it matches the first global content introduction information of the first media asset through the media asset information; after the display device obtains the first global content introduction information, it displays the content introduction page on the upper layer of the media asset playback interface. When the user views the video, the segment brief information of multiple media asset segments of the first media asset is displayed on the content brief information page according to the playback sequence, so that the global plot of the first media asset is displayed in segments based on the preset time granularity and playback sequence, which is convenient for the user to view the current playback progress and the content brief information at any other playback node, so that the user can quickly understand the content plot of the media asset without the user adjusting the playback progress and playback node to view the plot distribution. Moreover, the content brief information of each playback interval on the content brief information page has temporal coherence, which is convenient for the user to quickly understand the overall plot of the media asset after reading, thereby improving the query efficiency of the content brief information.

[0034] In a fourth aspect, an embodiment of the present application further provides a method for displaying a media asset content introduction, comprising:

[0035] When a first media asset is displayed on the media asset playback interface, in response to a preset operation input by a user, obtaining media asset information of the first media asset;

[0036] Based on the media asset information, a content summary acquisition request is sent to a server, wherein the content summary acquisition request is used to obtain first global content summary information of the first media asset from the server, wherein the first global content summary information includes segment summary information of multiple media asset segments of the first media asset, wherein the multiple media segments are obtained by the server dividing the first media asset according to a preset time granularity and a playback sequence;

[0037] receiving the first global content brief introduction information sent by the server;

[0038] A content introduction page is displayed on the upper layer of the media asset playback interface, and the first global content introduction information is displayed on the content introduction page.

[0039] The technical solution provided by the above fourth aspect embodiment has the following beneficial effects: the server side can pre-segment the first media asset, specifically using a preset time granularity to divide the segments according to the playback time sequence. For example, if the preset time granularity is 5 minutes, then media asset segment 1 is from 0 to 5 minutes, media asset segment 2 is from 5 to 10 minutes, and so on; the display device receives a preset operation, triggers the query and display of the first global content introduction information of the currently playing first media asset, and displays the content introduction page on the upper layer of the media asset playback interface. When the user views it, the segment introduction information corresponding to multiple media asset segments of the first media asset is displayed on the content introduction page according to the playback sequence, so as to realize the segmented display of the global plot of the first media asset based on the preset time granularity and playback sequence, so that the user can view the current playback progress and the content introduction at any other playback node, so that the user can quickly understand the content plot of the media asset without the user adjusting the playback progress and playback node to view the plot distribution. Moreover, the content introduction of each playback interval on the content introduction page has temporal coherence, so that the user can quickly understand the overall plot of the media asset after reading, thereby improving the query efficiency of the content introduction. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] In order to more clearly illustrate some embodiments of the present application or technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or descriptions of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0041] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments;

[0042] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments;

[0043] Figure 3 A schematic diagram of software configuration of a display device provided in some embodiments;

[0044] Figure 4 A schematic diagram of a user interface for viewing a content introduction based on a progress bar provided in some embodiments;

[0045] Figure 5 A flowchart of a first method for displaying a media asset content summary provided in some embodiments;

[0046] Figure 6 A schematic diagram illustrating the principle of setting global content profile information of a media asset on a server side provided in some embodiments;

[0047] Figure 7Schematic diagram of the content introduction page provided in some embodiments Figure 1 ;

[0048] Figure 8 Schematic diagram of the content introduction page provided in some embodiments Figure 2 ;

[0049] Figure 9 Schematic diagram of changes to the content introduction page provided in some embodiments Figure 1 ;

[0050] Figure 10 Schematic diagram of changes to the content introduction page provided in some embodiments Figure 2 ;

[0051] Figure 11 Schematic diagram of the first prompt page provided in some embodiments Figure 1 ;

[0052] Figure 12 A schematic diagram of a media playback interface provided in some embodiments;

[0053] Figure 13 Schematic diagram of the first prompt page provided in some embodiments Figure 2 ;

[0054] Figure 14 A flowchart of a second method for displaying a media asset content summary provided in some embodiments;

[0055] Figure 15 Schematic diagram of the content introduction page provided in some embodiments Figure 3 ;

[0056] Figure 16 A schematic diagram of a second prompt page provided in some embodiments;

[0057] Figure 17 Timing interaction between a control device, a display device and a server provided in some embodiments Figure 1 ;

[0058] Figure 18 Timing interaction between a control device, a display device and a server provided in some embodiments Figure 2 . DETAILED DESCRIPTION

[0059] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0060] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0061] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0062] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0063] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0064] In the embodiments of the present application, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0065] Figure 1 Schematic diagram of an operation scenario between a display device and a control device provided in some embodiments. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, the mobile terminal 300, and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus pen, a handle, etc.

[0066] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0067] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0068] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0069] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0070] Figure 2 For some embodiments Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0071] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0072] In some embodiments, the tuner-demodulator 210 can receive broadcast television signals via wired or wireless means, and can perform modulation and demodulation processing such as amplification, mixing, and resonance, and is used to demodulate the audio and video signals carried in the frequency of the TV channel selected by the user, as well as additional information (such as EPG data) from multiple wireless or wired broadcast television signals.

[0073] In some embodiments, tuner 210 , based on user selection and controlled by controller 250 , responds to the frequency of a user-selected television channel and the broadcast television signal carried on that frequency.

[0074] In some embodiments, the tuner-demodulator 210 can receive signals in a variety of ways depending on the broadcasting format of the broadcast television signal, including but not limited to: terrestrial broadcasting, cable broadcasting, satellite broadcasting or Internet broadcasting, etc.; and can implement digital modulation or analog modulation depending on the modulation type; and can demodulate analog signals and digital signals depending on the type of broadcast television signal received.

[0075] In some embodiments, the tuner 210 may also be in an external device, such as an external set-top box, etc. In this way, the set-top box outputs the broadcast television signal after modulation and demodulation, and transmits the signal to the display device 200 via the device interface 240 .

[0076] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0077] In some embodiments, the display 260 includes a display component for presenting images and a driver component for driving image display. The display 260 is configured to receive image signals output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces.

[0078] In some embodiments, the communication device 220 is a component used to communicate with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, if the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi functionality. If the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth functionality.

[0079] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0080] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0081] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0082] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0083] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0084] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0085] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0086] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0087] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0088] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0089] In some embodiments, see Figure 3 The application layer can run multiple applications, such as Application 1, Application 2, Application 3, Application 4, etc. In this embodiment of the present application, the display device configures applications related to these functional configurations at the application layer, such as a media playback application or a media content summary display application. The controller (including at least one processor) can implement the technical solutions of this embodiment of the present application by running at least one related application in the application layer.

[0090] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0091] See also Figure 3 In the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0092] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling application exit, opening, and back. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling changes in display windows, such as shrinking, shaking, or distorting the display window.

[0093] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0094] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0095] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0096] When a user watches a first media resource based on a display device, if the user has not watched the first media resource before, the user cannot know the plot at different playback nodes of the first media resource. Therefore, the user has a need to understand the plot of the first media resource so as to determine whether to continue watching the first media resource or jump to a wonderful or interesting segment in the first media resource to continue watching.

[0097] The display device can provide a query function for media asset content summaries, allowing users to view content summaries (e.g., plot summaries) of media assets. Users can use the EPG to view content summaries of electronic programs broadcast at different time slots in the future. However, this content summary only provides an overall overview of the program and a brief summary of its highlights. Users can only roughly understand the program's general information and cannot view content summaries at different locations within the electronic program.

[0098] When watching online media, users can also view other viewers' exchanges, discussions, and spoilers about the media content through barrages and comments. However, the content information obtained in this way is relatively divergent and rough, and users still cannot obtain a detailed content summary.

[0099] Figure 4 A schematic diagram of a user interface for viewing a content summary based on a progress bar is provided in some embodiments.

[0100] See also Figure 4When the video screen of the first media asset is displayed on the media asset playback interface, a progress bar control 41 can be displayed below the first media asset screen. The progress bar control 41 includes a progress prompt button 41a. The progress prompt button 41a is used to prompt the playback progress of the first media asset, and the progress prompt button 41a can be slid along the progress bar to adjust the playback progress.

[0101] When the user moves the control focus to the progress prompt button 41a through a control device (such as a remote control, a mouse, etc.), Figure 4 The controller can control the display to display a video preview image at the playback node corresponding to the progress prompt button 41a on the media playback interface, and display a plot summary below the video preview image, so that the user can know the plot summary at the current playback progress.

[0102] If the user wants to view the plot summary at other playback nodes, the user needs to adjust the position of the control focus on the progress bar control 41. However, this method only allows the user to view the plot summary at a single node, which is a plot summary of local content. If the user wants to know the plot summary of the entire media asset, the user needs to traverse all nodes on the progress bar control 41. Not only is the operation complicated, but the user's traversal operation cannot guarantee that all nodes on the progress bar are covered, resulting in the user being unable to obtain coherent and complete plot summary information.

[0103] Figure 5 A flowchart of a first method for displaying a media asset content summary is provided in some embodiments.

[0104] The controller may execute the media content introduction display method by running a related application (e.g., a media playback application), and the method includes:

[0105] Step S51 : when a first media asset is displayed on a media asset playback interface, in response to a preset operation input by a user, obtaining media asset information of the first media asset.

[0106] In some embodiments, the controller may start a media asset playback application, and in response to a media asset playback instruction, control the display to display the first media asset indicated by the media asset playback instruction on the media asset playback interface.

[0107] In some embodiments, when a user desires to view a media asset content summary, they can enter a preset operation. This preset operation is not limited to a specific operation. For example, the preset operation can include pressing a preset button on a control device (e.g., an AI button, a screenshot button, etc.), clicking a button on the control device that allows users to view a content summary on a media asset playback interface, or issuing a voice command indicating the user's intent to view a content summary. The content summary is a brief introduction to the media asset content. For example, if the first media asset is a film or TV show, the content summary can be a plot summary of the film or TV show.

[0108] In some embodiments, upon receiving a preset operation, the controller may obtain media asset information of the first media asset from the media asset playback application, including but not limited to the media asset name, media asset ID, media asset type, and the like.

[0109] Step S52: Send a content brief information acquisition request to the server based on the media asset information. The content brief information acquisition request is used to acquire first global content brief information of the first media asset from the server.

[0110] In some embodiments, the controller may generate a content introduction acquisition request based on the media asset information (eg, media asset ID) of the first media asset, and send the media asset content acquisition request to the server.

[0111] In some embodiments, the first global content brief description information includes segment brief description information of a plurality of media asset segments of the first media asset. The plurality of media asset segments are obtained by dividing the first media asset by the server according to a preset time granularity and a playback sequence.

[0112] Figure 6 A schematic diagram illustrating the principles of setting global content profile information of media assets on a server side provided in some embodiments.

[0113] In some embodiments, see Figure 6 In order to evenly divide any media asset into multiple media asset segments, the server can set a preset time granularity, which is used to represent the time span of the media asset segment. The larger the preset time granularity, the longer the time span of the media asset segment, and the more media asset segments the media asset is divided into.

[0114] In some embodiments, see Figure 6 The server can mark the playback timeline of the media asset based on the preset time granularity along the playback sequence. Specifically, the server marks the playback timeline at a predetermined time granularity (T0) from the start of the playback timeline to obtain the first mark position D1. The server then marks the playback timeline at a predetermined time granularity from the start of the playback timeline to obtain the second mark position D2. This process is repeated in this way. By marking the playback timeline at every predetermined time granularity along the playback sequence, a total of M mark positions are obtained. Figure 6 In the example, M is equal to 4, and the dot positions include dot position D1, dot position D2, dot position D3, and dot position D4.

[0115] The M value is related to the total duration of the media asset and the preset time granularity. For any media asset, the M value can change as the preset time granularity is adjusted. The smaller the preset time granularity, the larger the M value, and the larger the preset time granularity, the smaller the M value, that is, the M value is negatively correlated with the preset time granularity. The M value of different media assets can be the same or different. When the preset time granularity is the same, the longer the total duration of the media asset, the larger the M value, and the shorter the total duration of the media asset, the smaller the M value, that is, the M value is positively correlated with the total duration of the media asset.

[0116] In some embodiments, assuming i is the serial number of the dot position, 1≤i≤M, then the dot position D i The position on the playback time axis is i*T0.

[0117] In some embodiments, see Figure 6 , the server can obtain N play intervals based on M dot positions, N = M + 1. Assume that j is the serial number of the play interval, 1≤j≤N, when 1<j=i≤M, the jth play interval (i.e. play interval j) is [D i-1 ,D i ]. When j=1, the playback interval 1 is [0, D1]. When j=N, the playback interval N is [D M ,Ts], where Ts is the end point of the playback timeline. Figure 6 In the example, the playback timeline is divided into five playback intervals: playback interval 1 is [0, D1], playback interval 2 is [D1, D2], playback interval 3 is [D2, D3], playback interval 4 is [D3, D4], and playback interval 5 is [D4, Ts]. j is the playback interval number, which is also the media asset segment number. It is the sequence number set for the media asset segment / playback interval based on the playback order.

[0118] In some embodiments, see Figure 6 , one playback interval corresponds to one media asset segment, so the server divides the media asset into N media asset segments. The server can set corresponding segment introduction information for each media asset segment, and the segment introduction information is used to describe the content of the media asset segment (such as a plot summary).

[0119] In some embodiments, see Figure 6 , the server can obtain N segment introduction information arranged in the playback time sequence, thereby obtaining the global content introduction information of the media asset.

[0120] In some embodiments, the global content profile information may include the play interval information and segment profile information of N media asset segments, so that the display device can distinguish the play interval to which each media asset segment belongs. An exemplary global content profile information includes {play interval 1: segment profile information 1; play interval 2: segment profile information 2; play interval 3: segment profile information 3; ...; play interval N: segment profile information N}. The play interval information includes the starting position and the ending position of the media asset segment. For example, for the jth media asset segment, its play interval is [D j-1 ,D j ], then D j-1 is the starting position of the jth media asset segment, D j is the end position of the j-th media asset segment.

[0121] In some embodiments, the server may store a mapping between media asset IDs and global content profile information. Thus, upon receiving a content profile acquisition request from a display device, the server obtains the media asset ID of the first media asset from the content profile acquisition request, searches for the first global content profile information mapped to the media asset ID, and sends the first global content profile information to the display device.

[0122] Step S53: receiving the first global content introduction information sent by the server, controlling the display to display a content introduction page on the upper layer of the media asset playback interface, and displaying the first global content introduction information on the content introduction page.

[0123] In some embodiments, the display device can obtain the playback interval information and segment introduction information corresponding to the N media asset segments included in the first media asset based on the first global content introduction information, and generate a content information row corresponding to each media asset segment according to the playback interval information and segment introduction information.

[0124] Figure 7 Schematic diagram of the content introduction page provided in some embodiments Figure 1 .

[0125] See also Figure 7 The media resource playback interface is displaying the video image of the first media resource. After receiving the first global content introduction information, the controller can control the display to display the content introduction page 70 on the upper layer of the media resource playback interface.

[0126] In some embodiments, the display may display the content introduction page 70 at a preset position on the upper layer of the media resource playback interface, for example Figure 7 In this example, the content introduction page 70 is displayed on the left side of the interface and partially covers the media asset playback interface. The display can set a certain degree of transparency for the content introduction page 70. When the display shows the content introduction page 70, the media asset playback interface plays the first media asset normally, and the playback process of the first media asset is not affected.

[0127] In some embodiments, see Figure 7 The content introduction page 70 includes content information rows 71 corresponding to N media asset segments arranged in the order of play. The content information rows 71 display the play interval information and segment introduction information. Taking the preset time granularity of 10 minutes as an example, the play interval information 1 is presented as "from the beginning to the 10th minute", where the beginning refers to the play starting point of the first media asset (i.e. 0). For the play interval [0,10], the first content information row 71 also displays the segment introduction information 1. Similarly, for the jth content information row 71, its play interval information j is presented as "from the Dth minute". i-1 Minutes to D i In this way, users can select the segment profile information they want to view based on the time period distribution, improving the browsing efficiency and query efficiency of media asset content profiles.

[0128] In some embodiments, when the preset time granularity is small or the total duration of the media asset is large, the number of media asset segments divided into the first media asset is large, that is, the N value is large. Due to the limited area size of the content introduction page 70, it may not be possible to display N content information rows 71 at the same time. Figure 7 A sliding control can be provided on the content introduction page 70, and the sliding control can be slid upward or downward to scroll the content introduction page 70. Thus, when the user slides the sliding control downward, the controller can control the display to scroll the content introduction page 70 upward, so that the previously hidden content information row 71 below enters the visible area of ​​the content introduction page 70, allowing the user to view more segment introduction information of the media asset segment.

[0129] The display device receives a preset operation, triggering the query and display of the first global content introduction information of the first media asset currently being broadcast, and displays the content introduction page 70 on the upper layer of the media asset playback interface. When the user views it, the segment introduction information corresponding to multiple media asset segments of the first media asset is displayed on the content introduction page 70 according to the playback sequence, so as to realize the segmented display of the global plot of the first media asset based on the preset time granularity and playback sequence, so that the user can view the current playback progress and the content introduction at any other playback node, so that the user can quickly understand the content plot of the media asset without the user adjusting the playback progress and playback node to view the plot distribution. Moreover, the content introduction of each playback interval on the content introduction page has temporal coherence, so that the user can quickly understand the overall plot of the media asset after reading, thereby improving the query efficiency of the content introduction.

[0130] Figure 7The example content introduction page 70 displays the segment introduction information of the media asset segments in different playback intervals in sequence according to the playback time sequence, thereby presenting the time continuity and contextual coherence of the content introduction, making it convenient for users to select segments according to their preferences and read the corresponding segment introduction information, as well as understand the overall content plot of the first media asset after reading the global content introduction information.

[0131] In this way, the user needs to view the current playback progress of the first media asset based on the progress bar control (t now ), according to the playback progress (t now ) and playback interval information, obtain playback progress (t now ) to the target playback interval, and then use the slide control to find the target playback interval that matches the playback progress (t now ) and browse the target segment introduction information to obtain the content introduction at the current playback progress. However, when there are many media asset segments, the content introduction page 70 contains many content information rows 71, and it takes a long time for the user to find the target segment introduction information, resulting in low browsing efficiency and query efficiency of the media asset content introduction. In some embodiments, in order to allow users to quickly locate the target segment that matches the playback progress (t now ) matching content information line 71, the controller can also obtain the playback progress (t now ), find the playback progress (t now ) belongs to the target playback interval, and determines the playback progress (t now ) matches the target media asset segment, and controls the display to add a prompt mark to the content information line of the target media asset segment (hereinafter referred to as the target information line). The prompt mark is used to prompt the user to view the segment introduction information at the playback progress of the first media asset.

[0132] In some embodiments, the presentation method of the prompt mark is not limited. For example, the prompt mark can include at least one of the following methods: highlighting the target information line, adding a prompt box outside the target information line, color-coding the text in the target information line (e.g., setting the text to red), etc. In this way, the user can quickly locate the content summary of the current playback progress of the first media asset, eliminating the need for the user to check the playback progress through the progress bar control and then search for the corresponding segment summary information, thereby improving the efficiency of content summary query.

[0133] Figure 8 Schematic diagram of the content introduction page provided in some embodiments Figure 2 .

[0134] In some embodiments, the total duration of the first media asset is 54 minutes and 23 seconds (54′23″), and the controller obtains that the playback progress of the first media asset is 15 minutes and 2 seconds, that is, t now =15′2″, the target playback interval to which the playback progress belongs is [10,20]. The target playback interval corresponds to media asset segment 2, so the target information line is determined to be the second content information line. Figure 8 The controller can control the display to add a prompt mark to the target information line 71a, which includes highlighting and adding a prompt box (for example, an outer solid rectangular box). In this way, the target information line 71a is more eye-catching and prominent than other content information lines in the content introduction page 70, and the user can lock the content introduction at the current playback progress at a glance.

[0135] In some embodiments, as the playback process of the first media asset continues to advance, the playback progress (t now ) also changes dynamically. Assuming that the playback progress (t now ) The current playback range is [D j-1 ,D j ], when the playback progress reaches the end point D of the playback interval j (ie t now =D j ), the playback progress reaches the next playback interval [D j ,D j+1 ] is the starting point of the play, and accordingly, the target information row is changed from the j-th content information row to the j+1-th content information row. The controller can control the display to cancel the prompt mark of the j-th content information row and set the prompt mark for the j+1-th content information row, thereby automatically matching the target information row and refreshing the prompt mark following the playback progress, thereby ensuring the accuracy of the content introduction page display.

[0136] Figure 9 Schematic diagram of changes to the content introduction page provided in some embodiments Figure 1 .

[0137] In some embodiments, in order to allow the user to quickly locate the now ) Matching content information line 71, see Figure 9 In view (a), the content introduction page 70 may include a filter control 72a, which is used to filter out other content information rows except the target information row, so that the content introduction page 70 only displays the target information row.

[0138] In some embodiments, in response to the user clicking the filter control 72a, the controller may obtain the playback progress (t now ) and find the playback progress (t now) belongs to the target playback interval, and according to the playback interval information of the target playback interval, the target media asset segment that matches the playback progress is determined, and then the target information row corresponding to the target media asset segment is determined.

[0139] In some embodiments, see Figure 9 In view (b), the controller can control the display to display the content information row 71a in the content introduction page 70, and not display the content information rows of other media asset segments. In this way, the user can use the filter control 72a to filter out non-target information rows with one click, and only retain the target information row 71a, thereby switching to the mode of displaying the segment introduction information at the current playback progress of the first media asset (referred to as: local display mode), which is convenient for the user to view the content introduction at the current playback progress with one click, eliminates the interference of other content introductions, and does not require the user to find the target information row by himself according to the playback progress, thereby improving the query efficiency of the content introduction.

[0140] In some embodiments, see Figure 9 In view (b), after filtering out non-target information rows in the content introduction page 70 in response to the user clicking the filter control 72a, the controller can also control the display to display a cancel filter control 72b in the content introduction page 70. The cancel filter control 72b is used to restore the mode of displaying the global content introduction information of the first media asset (abbreviated as: global display mode). In response to the user clicking the cancel filter control 72b, the controller controls the display to return the user interface to Figure 9 Thus, the filter control 72a and the cancel filter control 72b are used to switch between the local display mode and the global display mode, allowing users to quickly switch the display mode of the media content summary according to their viewing preferences.

[0141] In global display mode, users can view the segment profiles corresponding to different playback intervals and select the first media asset segment of interest / preferred. At this point, users can view the first playback interval to which the first media asset segment belongs through the content information row corresponding to the first media asset segment and, using the progress bar control, seek the playback progress of the first media asset to any time point within the first playback interval, for example, to the starting point of the first playback interval. However, this method requires the user to manually slide the progress prompt button 41a along the progress bar to any time point within the first playback interval in order to view the first media asset segment, resulting in cumbersome operation and low efficiency in locating and jumping to the first media asset segment.

[0142] Figure 10 Schematic diagram of changes to the content introduction page provided in some embodiments Figure 2 .

[0143] In some embodiments, see Figure 10 Each content information row also includes a play control 73, which is used to trigger a seek action, so that the play progress of the first media asset jumps to the starting point of the first play interval, thereby jumping to the beginning of the first media asset segment, and playing the first media asset segment from the beginning, so that the user can watch the complete first media asset segment.

[0144] In some embodiments, after the user selects the first media asset segment of interest / preferred based on the content introduction page 70, the user can click the play control 73 (i.e., the first play control) in the content information row corresponding to the first media asset segment to input a jump play instruction, which includes the sequence number of the content information row (i.e., the segment sequence number). In response to the jump play instruction, the controller obtains the first play interval information of the first media asset segment according to the segment sequence number in the jump play instruction, and further obtains the first starting position included in the first play interval information. For example, the first play interval information is [D j-1 ,D j ], then the first starting point is D j-1 .

[0145] In some embodiments, the controller can control the media playback application, adjust the playback progress of the first media to the first starting position, and continue to play the first media from the first starting position, so that the user can watch the complete first media segment from the first starting position, without the user having to manually adjust the progress bar to align the playback progress with the starting point of the first media segment, so as to achieve one-click quick jump to the media segment of interest to continue watching.

[0146] In some embodiments, see Figure 10 View (a), the current playback progress is 15 minutes and 2 seconds, that is, t now =15′2″. At this time, the target information row 71a marked with the prompt mark is the second content information row, corresponding to media asset segment 2. The user is interested in media asset segment 3 and can click the play control 73 in the content information row corresponding to media asset segment 3 to enter a jump play instruction for media asset segment 3.

[0147] In some embodiments, the controller responds to the jump play instruction and queries the play interval 3 to which the media asset segment 3 belongs, which is [20′, 30′], and determines that the first starting point position is the 20th minute. Figure 10 In view (b), the media player application is controlled to adjust the playback progress to the 20th minute, i.e., t now Changing to 20′ (the progress bar control is refreshed synchronously) can cancel the prompt mark of the second content information row and set a prompt mark for the third content information row, making the third content information row the new target information row 71a. The media asset playback application continues to play the first media asset from the 20th minute.

[0148] In some embodiments, when setting the global content profile information for a media asset, the server may refine, summarize, and generalize the media asset content based on the global content profile information to obtain content summary information for the media asset. This content summary information can be considered as a comprehensive overview of the media asset. The server may integrate the global content profile information with the content summary information, or integrate the content summary information into the global content profile information.

[0149] Figure 11 Schematic diagram of the first prompt page provided in some embodiments Figure 1 .

[0150] In some embodiments, before the controller controls the display to display the content introduction page, see Figure 11 , the display can be controlled to display a first prompt page 110 on the upper layer of the media resource playback interface. The first prompt page 110 includes content summary information 111 and a first view button 112 .

[0151] In some embodiments, the size of the first prompt page 110 is smaller than that of the content summary page 70. This allows the first prompt page 110 to block less of the media asset playback interface, minimizing interference with the user's viewing of the first media asset. When a user browses the content summary information and determines they are interested in the first media asset and wishes to further review the first asset's global content summary information, they can trigger the display of the content summary page 70 by clicking the first view button 112.

[0152] In some embodiments, see Figure 11 , the user can browse the content summary information 111 to determine whether there is a willingness or interest to view the global content introduction information of the first media asset. If the user is interested in further viewing the global content introduction information of the first media asset, the user can click the first view button 112. In response to the user clicking the first view button 112, the controller can control the display to close the first prompt page 110 and display the next-level content introduction page 70. That is, the first prompt page 110 provides a summary and concise introduction to the media asset content, and the content introduction page 70 provides more detailed segment introduction information of multiple media asset segments in different playback intervals, so as to realize the browsing of the media asset content information from shallow to deep and from rough to fine. In this way, when the user is interested in the first media asset and wants to have a deeper understanding of the plot distribution of the first media asset, the content introduction page 70 can be displayed again to avoid interference with the user's viewing of the first media asset due to the blocking of the media asset playback interface by the content introduction page 70.

[0153] In some embodiments, when a user is viewing a first media asset, they may be interested in a character that appears in the first media asset. For example, when watching a film or TV series, the user may find actor A's performance to be excellent and wish to learn more about actor A. This requires the user to know actor A's name and then search for actor A's encyclopedia information and related film or TV series based on actor A's name, resulting in low information query efficiency. In some embodiments, the preset operation may be a screenshot operation, whereby the user clicks a screenshot button on a control device (e.g., a remote control) to enter the preset operation. Thus, in response to the screenshot operation, the controller activates a screenshot application, which captures an image of the media content of the first media asset displayed on the screen and transmits the image to the server.

[0154] In some embodiments, the display device may first compress the media content image and then send the compressed media content image to the server to improve the transmission efficiency of image data and, in turn, improve the efficiency of person recognition. After decompressing the media content image, the server performs image recognition on the media content image, including facial recognition.

[0155] Figure 12 A schematic diagram of a media resource playback interface provided in some embodiments.

[0156] See also Figure 12 The media playback interface is playing a first video. When the screenshot application captures the screen, the media content image displayed on the media playback interface contains two target people: Person 1 (a woman) and Person 2 (a man). After receiving the media content image uploaded by the display device, the server performs image recognition on the media content image to determine whether it contains a person. If the media content image contains at least one person (e.g., Person 1 and Person 2), the identified target person is segmented from the media content image to obtain the corresponding target person image.

[0157] In some embodiments, the server can input the target person image into the character recognition model, and the character recognition model can compare the target person image with the actor portrait information in the media library for similarity, and then output the character information of the target person (such as name, etc.).

[0158] In some embodiments, the server can obtain detailed character information and character-related recommendation data based on the target character's character information. The character details include the character's name, encyclopedia information, and profile picture, among other information, to help users better understand the target character. The character-related recommendation data includes other works performed by the target character, thereby recommending that users watch other works of the target character.

[0159] In some embodiments, the server may encapsulate character details information and character-related recommendation data and other information to obtain an image recognition result, and send the image recognition result to a display device.

[0160] Figure 13 Schematic diagram of the first prompt page provided in some embodiments Figure 2 .

[0161] In some embodiments, the controller can control the display to simultaneously display the image recognition result of the server on the media content image in the first prompt page. Figure 13 The first prompt page 110 also includes detailed information of the identified target person, such as the name, avatar, and encyclopedia information. Below the detailed information of the person, recommended data related to the person is also displayed. The recommended data related to the person may specifically include cover images, work titles, media IDs, etc. of other recommended works (not the first media resource) of the target person.

[0162] In some embodiments, the first prompt page 110 may include multiple work recommendation controls 113, each of which is used to display a cover image and work title of a recommended work for a target person. The work recommendation controls 113 may be bound to a corresponding media asset's resource address (e.g., URL). In response to a user clicking on any work recommendation control 113, the controller loads and plays the corresponding media asset based on the bound resource address, thereby achieving the goal of pushing related media assets to the target person.

[0163] In some embodiments, when the number of identified target persons is greater than 1, that is, when multiple target persons are identified, the user can adjust the control focus to select the first target person, so that the first prompt page 110 displays the first target person's detailed information and the work recommendation control 113. Figure 13 The target persons to be identified include Person A and Person B. When the control focus is on the avatar control corresponding to Person A, the first prompt page 110 displays Person A's encyclopedia information and related recommended data, and does not display the image recognition results for Person B. When the control focus is moved to Person B's avatar control, the first prompt page 110 displays Person B's encyclopedia information and related recommended data, and does not display the image recognition results for Person A. In this way, the image recognition results of multiple persons are not displayed simultaneously on the first prompt page 110, which can reduce the size of the first prompt page 110 and reduce the area blocked by the first prompt page 110 on the media playback interface.

[0164] The technical solution provided by this embodiment has the following beneficial effects: when a user watches the first media resource, he or she may be interested in the person involved in the first media resource. In this regard, a solution is provided for linking the character identification information of the media resource with the global content introduction information. In this case, the preset operation can be set to a screenshot operation. In response to the screenshot operation, the controller captures the media content image presented on the screen and sends it to the server, so that the server recognizes the media content image, recognizes the person contained in the image, and obtains the person's detailed information and person-related recommendation data. In this way, the user can view the content summary and global content introduction information, as well as the character identification information, thereby improving the user's viewing experience.

[0165] In the above embodiment, the display device obtains the global content introduction information of the first media asset from the server. The content introduction page 70 displays the global content introduction information. The user can view the content introduction at the current playback progress through the target information line 71a with a prompt mark, or click the filter control 72a.

[0166] In other embodiments, the server may search for target content introduction information that matches the playback progress of the first media asset and send the target content introduction information to the display device, so that the display device can quickly display the target content introduction information on the content introduction page 70 .

[0167] Figure 14 This is a flowchart of a second method for displaying a media asset content summary provided in some embodiments.

[0168] The controller may execute the media content introduction display method by running a related application (e.g., a media playback application), and the method includes:

[0169] Step S141 : when a first media asset is displayed on a media asset playback interface, in response to a preset operation input by a user, obtaining media asset information of the first media asset.

[0170] Step S142: Obtain the current playback progress of the first media asset.

[0171] In some embodiments, the controller may obtain the real-time playback progress of the first media asset from the media asset playback application.

[0172] Step S143: Based on the media asset information and the playback progress, a content introduction acquisition request is sent to the server. The content introduction acquisition request is used to acquire target content introduction information of the first media asset from the server.

[0173] In some embodiments, the server may mark the first media asset based on a preset time granularity and playback sequence, and then divide the first media asset into multiple media asset segments corresponding to the playback intervals. This step may refer to the description of the previous related embodiments and will not be repeated here.

[0174] By integrating media asset information and playback progress in the content introduction acquisition request, the server can obtain the target media asset segment that matches the playback progress from multiple media asset segments of the first media asset, and the target content introduction information can include the segment introduction information of the target media asset segment.

[0175] Step S144: receiving the target content introduction information sent by the server, controlling the display to display the content introduction page on the upper layer of the media resource playback interface, and displaying the target content introduction information on the content introduction page.

[0176] Figure 15 Schematic diagram of the content introduction page provided in some embodiments Figure 3 .

[0177] See also Figure 15 , assuming that the current playback progress of the first media asset is 15 minutes and 2 seconds, that is, t now =15′2″, the target content brief information returned by the server includes segment brief information 2 of the media asset segment 2 corresponding to the playback interval [10′, 20′].

[0178] In some embodiments, see Figure 15 , the controller can control the display to display a prompt message "Based on the playback progress of the first media asset, the following content introduction is matched for you" in the content introduction page 70, as well as display the target content introduction information, which includes the segment introduction information of the target media asset segment (media asset segment 2) and the target playback interval information corresponding to the playback interval [10', 20'] (for example, the 10th minute to the 20th minute). In this way, when the user enters a preset operation at any playback node, he can view the target content introduction information that matches the current playback progress, so that the user can dynamically view the content introduction based on the changes in the playback progress, which makes it convenient for the user to quickly understand the real-time content plot of the media asset and improves the query efficiency of the content introduction.

[0179] In some embodiments, see Figure 15 The content introduction page 70 may further include a view global content introduction button 74, which is used to switch to a global display mode so that the content introduction page 70 displays the global content introduction information of the first media asset.

[0180] In some embodiments, in response to a user clicking on "View Global Content Introduction" button 74, the controller sends a content introduction request to the server based on the media asset information of the first media asset, thereby obtaining first global content introduction information for the first media asset from the server. After obtaining the first global content introduction information, the controller controls the display to refresh content introduction page 70, causing the refreshed content introduction page 70 to display the first global content introduction information.

[0181] Figure 16 A schematic diagram of a second prompt page provided in some embodiments.

[0182] See also Figure 16 After the controller obtains the target content introduction information, it can control the display to display a second prompt page 160 on the upper layer of the media playback interface. The second prompt page 160 still displays the image recognition result sent by the server, as well as a prompt message such as "support viewing the content introduction at the real-time playback progress" and a second view button 161. In response to the user clicking the second view button 161, the controller controls the display to display the next level content introduction page, as well as the view button 161. Figure 15 For example, the target content introduction information is displayed in the content introduction page. The presentation effect of the second prompt page 160 is not limited to Figure 16 .

[0183] In some embodiments, a server is also provided, which may include a communicator and a controller, wherein the communicator is used to communicate with a display device, and the controller is configured to execute: receiving a content introduction acquisition request sent by the display device, the content introduction acquisition request including media asset information of a first media asset; in response to the content introduction acquisition request, acquiring first global content introduction information of the first media asset based on the media asset information, the first global content introduction information including segment introduction information of multiple media asset segments of the first media asset, the multiple media segments being obtained after the server divides the first media asset according to a preset time granularity and playback timing; sending the first global content introduction information to the display device so that the display device displays the first global content introduction information on the content introduction page.

[0184] In some embodiments, a server is also provided, which may include a communicator and a controller, wherein the communicator is used to communicate with a display device, and the controller is configured to execute: receiving a content introduction acquisition request sent by the display device, the content introduction acquisition request including the media asset information and playback progress of the first media asset; in response to the content introduction acquisition request, acquiring target content introduction information of the first media asset based on the media asset information and playback progress, the target content introduction information including the segment introduction information of the target media asset segment of the first media asset, the target media segment being a media asset segment obtained by the server from multiple media segments that matches the playback progress of the first media asset, and the multiple media segments being obtained by the server after dividing the first media asset according to a preset time granularity and playback timing; sending the target content introduction information to the display device so that the display device displays the target content introduction information on the content introduction page.

[0185] Figure 17 Timing interaction between a control device, a display device and a server provided in some embodiments Figure 1.

[0186] See also Figure 17 The interactive objects include a control device that receives user operations, a display device, and a server. The display device includes a controller and runs a screenshot application and a media playback application, and the server is equipped with an image recognition system and a media management system.

[0187] See also Figure 17 When a media player application plays a first media source, the user presses a preset key (e.g., an AI key or a screenshot key) via a control device. The control device then sends a key command to the display device. The key command may include a key value, allowing the display device to identify the type of key pressed by the user. The controller receives the key command, recognizes that the user has pressed the preset key and entered the preset operation, and then launches the screenshot application.

[0188] See also Figure 17 After the screenshot application captures the media content image, on the one hand, the screenshot application sends a first query instruction to the media playback application, and on the other hand, the media content image is compressed and uploaded to the server.

[0189] See also Figure 17 In response to the first query instruction, the media asset playback application returns the media asset information of the first media asset to the screenshot application. The screenshot application sends a content introduction acquisition request to the server based on the media asset information.

[0190] See also Figure 17 The media asset management system of the server responds to the content introduction acquisition request, obtains first global content introduction information of the first media asset based on the media asset information, and sends the first global content introduction information to the screenshot application.

[0191] See also Figure 17 The server's image recognition system receives the media content image, decompresses it, and then segments and identifies people in the media content image to obtain an image recognition result, which is then returned to the screenshot application. The image recognition result is obtained by encapsulating the person's detailed information and person-related recommendation data.

[0192] See also Figure 17 The screenshot application generates and displays a first prompt page 110 based on the image recognition result and the content summary information. In response to the user clicking a first view button 112, the controller sends a first display instruction to the screenshot application. In response to the first display instruction, the screenshot application displays the first global content summary information on the content summary page 70.

[0193] Figure 18 Timing interaction between a control device, a display device and a server provided in some embodiments Figure 2 .

[0194] Figure 18 and Figure 17 The difference in the temporal interaction logic of the example is that: after the screenshot application captures the media content image, it sends a second query instruction to the media playback application; the media playback application responds to the second query instruction and returns the media information and playback progress of the first media to the screenshot application; in this way, the media management system responds to the content introduction acquisition request, obtains the target content introduction information of the first media based on the media information and playback progress, and returns the target content introduction information to the screenshot application; the screenshot application generates and displays the second prompt page 160 based on the image recognition result; in this way, after the user clicks the second view button 161, the controller sends a second display instruction to the screenshot application; the screenshot application responds to the second display instruction and displays the target content introduction information on the content introduction page.

[0195] Some embodiments of the present application further provide a computer storage medium that can store a program. When the computer storage medium is configured in a display device, the program, when executed, can include the program steps involved in the media content summary display method in each of the above embodiments. The computer storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0196] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

[0197] For ease of explanation, the above description has been presented in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations are possible. The above embodiments have been selected and described to better explain the content of this disclosure, thereby enabling those skilled in the art to better utilize the embodiments.

Claims

1. A display device, characterized in that: include: The display is configured to display a content introduction page on the upper layer of the media resource playback interface; a communication device configured to be communicatively connected with a server; A controller, coupled to the display and the communication device, is configured to: When a first media asset is displayed on the media asset playback interface, in response to a preset operation input by a user, acquiring media asset information of the first media asset; Based on the media asset information, a content summary acquisition request is sent to the server, wherein the content summary acquisition request is used to obtain first global content summary information of the first media asset from the server, wherein the first global content summary information includes segment summary information of multiple media asset segments of the first media asset, wherein the multiple media segments are obtained by dividing the first media asset by the server according to a preset time granularity and a playback sequence; The first global content introduction information is received from the server, and the display is controlled to display the content introduction page on the upper layer of the media asset playback interface, and the first global content introduction information is displayed on the content introduction page.

2. The display device according to claim 1, wherein The controller controls the display to display the content introduction page on the upper layer of the media resource playback interface, and displays the first global content introduction information on the content introduction page. The controller is specifically configured as follows: Obtaining playback interval information of the media asset segment from the first global content profile information; wherein the playback interval information is calculated by the server based on the segment sequence number of the media asset segment and the preset time granularity, the playback interval information includes the start position and end position of the media asset segment, and the segment sequence number is the sequence number of the media asset segment based on the playback order; According to the playback order of the multiple media asset segments, the display is controlled to sequentially display content information rows corresponding to the multiple media asset segments on the content introduction page, wherein the content information rows include the playback interval information and the segment introduction information.

3. The display device according to claim 2, wherein After executing the step of controlling the display to sequentially display content information rows of the plurality of media asset segments on the content introduction page according to the playback order of the plurality of media asset segments, the controller is further configured to: Obtaining the playback progress of the first media asset; Find the target playback interval to which the playback progress belongs; Determining a target media asset segment that matches the playback progress according to the playback interval information of the target playback interval; The display is controlled to add a prompt mark to the content information row of the target media asset segment, where the prompt mark is used to prompt the user to view the segment brief information at the playback progress of the first media asset.

4. The display device according to claim 2, wherein: The content introduction page includes a filter control. After the controller controls the display to sequentially display content information rows of the plurality of media asset segments on the content introduction page according to the playback order of the plurality of media asset segments, the controller is further configured to: In response to a user clicking on the filter control, obtaining a playback progress of the first media asset; Find the target playback interval to which the playback progress belongs; Determining a target media asset segment that matches the playback progress according to the playback interval information of the target playback interval; The display is controlled to display the content information row of the target media asset segment in the content introduction page, and not to display the content information rows of other media asset segments.

5. The display device according to claim 2, wherein: The content information row also includes a play control, and the controller is further configured to: In response to a jump play instruction input by a user based on a first play control, obtaining first play interval information of a first media asset segment; wherein the first play control is a play control in a content information row corresponding to the first media asset segment; Acquiring the first playback interval information including the first starting point position; The playback progress of the first media asset is adjusted to the first starting position, and the first media asset is continued to be played from the first starting position.

6. The display device according to claim 1, wherein The first global content introduction information also includes content summary information of the first media asset. Before executing the steps of controlling the display to display the content introduction page on the upper layer of the media asset playback interface and displaying the first global content introduction information on the content introduction page, the controller is further configured to: Controlling the display to display a first prompt page on the upper layer of the media resource playback interface, wherein the first prompt page displays the content summary information and a view button; In response to the user clicking the view button, the display is controlled to close the first prompt page and display the content introduction page.

7. The display device according to claim 6, wherein: The preset operation is a screenshot operation, and the controller is further configured to: In response to the screenshot operation input by the user, capturing a media asset content image of the first media asset displayed on the display; Sending the media content image to the server; receiving an image recognition result sent by the server, the image recognition result including detailed information of the target person and person-related recommendation data obtained when the server recognizes at least one target person in the media content image; The display is controlled to display the image recognition result in the first prompt page.

8. A display device, characterized in that: include: The display is configured to display a content introduction page on the upper layer of the media resource playback interface; a communication device configured to be communicatively connected with a server; A controller, coupled to the display and the communication device, is configured to: When a first media asset is displayed on the media asset playback interface, in response to a preset operation input by a user, obtaining media asset information of the first media asset and obtaining a playback progress of the first media asset; Based on the media asset information and the playback progress, a content introduction acquisition request is sent to the server, the content introduction acquisition request being used to request target content introduction information of the first media asset, the target content introduction information including segment introduction information of a target media asset segment of the first media asset, the target media segment being a media asset segment obtained by the server from a plurality of media asset segments that matches the playback progress of the first media asset, the plurality of media segments being obtained by the server by dividing the first media asset according to a preset time granularity and a playback sequence; The target content introduction information is received from the server, and the display is controlled to display the content introduction page on the upper layer of the media resource playback interface, and the target content introduction information is displayed on the content introduction page.

9. A server, characterized in that: include: A communicator, used for communicating with a display device; A controller, coupled to the communication device, is configured to: receiving a content introduction acquisition request sent by the display device, wherein the content introduction acquisition request includes media asset information of the first media asset; In response to the content summary acquisition request, obtaining first global content summary information of the first media asset based on the media asset information, the first global content summary information including segment summary information of a plurality of media asset segments of the first media asset, the plurality of media segments being obtained by the server dividing the first media asset according to a preset time granularity and a playback sequence; The first global content introduction information is sent to the display device, so that the display device displays the first global content introduction information on a content introduction page.

10. A method for displaying a media asset content introduction, characterized in that: include: When a first media asset is displayed on the media asset playback interface, in response to a preset operation input by a user, obtaining media asset information of the first media asset; Based on the media asset information, a content summary acquisition request is sent to a server, wherein the content summary acquisition request is used to obtain first global content summary information of the first media asset from the server, wherein the first global content summary information includes segment summary information of multiple media asset segments of the first media asset, wherein the multiple media segments are obtained by the server dividing the first media asset according to a preset time granularity and a playback sequence; receiving the first global content brief introduction information sent by the server; A content introduction page is displayed on the upper layer of the media asset playback interface, and the first global content introduction information is displayed on the content introduction page.

Images