Display device and media asset viewing method

Abstract

Some embodiments of the present application show a display device and a media asset viewing method, the method comprising: in a case where a first page plays media assets, in response to an image recognition instruction input by a user, intercepting display content of the first page to obtain a screenshot image; obtaining a media asset label corresponding to the screenshot image; under the condition that the media asset fragment corresponding to the media asset label is identified as the scene fragment with the associated content, scene information corresponding to the media asset label is obtained, the scene information comprises information of a plurality of associated media asset fragments, and the associated media asset fragments correspond to the associated content; and displaying the plurality of associated media asset fragment controls on the floating layer page based on the scene information. According to the embodiment of the invention, the image of the current user interface can be intercepted, and the screenshot image is identified to determine the scene corresponding to the screenshot image and display the media asset fragment related to the scene plot, so that a user can quickly know and view the plot fragment related to the current scene only by inputting the image identification instruction.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a method for viewing media resources. Background Art

[0002] When watching media, users may not watch it from the beginning. When scenes or plots appear in the media, users may be confused if they don't understand the cause and effect. In addition, there may be some special scenes in the media, and users are eager to see the subsequent development of the plot.

[0003] To quickly understand the causes and consequences of confusing scenes or the plot related to a particular scene, users can adjust the playback progress by fast forwarding or rewinding. However, if the adjustment progress for a single fast forward or rewind is small, it will take a long time to find the desired plot segment. If the adjustment progress for a single fast forward or rewind is large, the desired plot segment may be skipped. As a result, users cannot quickly understand and view the plot segments related to the current scene. Summary of the Invention

[0004] Some embodiments of the present application provide a display device and a media viewing method, which can capture an image of the current user interface and identify the screenshot image to determine the scene corresponding to the screenshot image, and display media clips related to the plot of the scene. The user only needs to enter an image recognition command to quickly understand and view the plot clips related to the current scene.

[0005] In a first aspect, some embodiments of the present application provide a display device, including:

[0006] A display configured to display a user interface;

[0007] A controller is coupled to the display and is configured to:

[0008] In the case where the media resource is played on the first page, in response to the image recognition instruction input by the user, the display content of the first page is intercepted to obtain a screenshot image;

[0009] Obtaining the media asset tag corresponding to the screenshot image, where the media asset tag is the tag corresponding to the media asset segment containing the preset plot;

[0010] When it is identified that the media asset segment corresponding to the media asset tag is a scene segment with associated content, scene information corresponding to the media asset tag is obtained, where the scene information includes information of multiple associated media asset segments, and the associated media asset segments correspond to the associated content;

[0011] Based on the scene information, a plurality of associated media asset segment controls are displayed on the floating layer page, wherein the associated media asset segment controls correspond to the associated media asset segments, and the floating layer page is displayed on an upper layer of the first page.

[0012] The above technical solution has the following advantages or beneficial effects: after receiving the image recognition command input by the user, the image of the current user interface can be captured, and the screenshot image can be identified to determine the scene corresponding to the screenshot image, and display media clips related to the plot of the scene. The user only needs to enter the image recognition command to quickly understand and view the plot clips related to the current scene.

[0013] In some embodiments, the controller is further configured to:

[0014] Get the media resource name and playback progress corresponding to the screenshot image;

[0015] The media asset tag corresponding to the playback progress is searched in the media asset information corresponding to the media asset name. The media asset information includes the corresponding relationship between the playback progress of the corresponding media asset and the media asset tag.

[0016] The above technical solution has the following advantages or beneficial effects: using the display device to directly obtain the media resource name and playback progress corresponding to the screenshot image, and quickly lock the media resource tag based on the media resource name and playback progress, facilitating the rapid identification of subsequent target scenes without the need to interact with the server, shortening the identification link and improving the identification speed.

[0017] In some embodiments, the controller is further configured to:

[0018] Get the scene identifier corresponding to the media resource tag;

[0019] When the scene identifier is a preset value, the media asset segment corresponding to the media asset tag is identified as a scene segment with associated content. The scene identifier is a preset value for indicating that the media asset segment corresponding to the media asset tag is a scene segment with associated content.

[0020] The above technical solution has the following advantages or beneficial effects: By setting a scene identifier for a media asset tag, it helps to quickly determine whether the media asset segment corresponding to the media asset tag is a scene segment with associated content. The display device can directly identify whether the media asset segment corresponding to the media asset tag is a scene segment with associated content, without interacting with the server, shortening the identification process and improving the recognition speed.

[0021] In some embodiments, the controller is further configured to:

[0022] Send the screenshot image to the image recognition server;

[0023] Receive the media resource name and playback progress obtained by identifying the screenshot image sent by the image recognition server;

[0024] Send the media resource name and playback progress to the media resource server, so that the media resource server searches for the media resource tag corresponding to the playback progress in the media resource information corresponding to the media resource name;

[0025] Receive media asset tags sent by the media asset server.

[0026] The above technical solution has the following advantages or beneficial effects: utilizing the powerful image recognition capability of the image recognition server to identify the media resource name and playback progress corresponding to the screenshot image, the media resource playback scenario is not limited to media resource application playback, but can also cover more media resource playback scenarios such as local media resource playback.

[0027] In some embodiments, the controller is further configured to:

[0028] Sending the media asset tag to the media asset server, so that the media asset server feeds back first identification information when it recognizes that the scene identifier corresponding to the media asset tag is a preset value, wherein the scene identifier is the preset value for indicating that the media asset segment corresponding to the media asset tag is a scene segment with associated content;

[0029] The first identification information is parsed to identify the media asset segment corresponding to the media asset tag as a scene segment with associated content.

[0030] The above technical solution has the following advantages or beneficial effects: the media server can store information on more channels and more media, so that the media server can accurately identify whether the media segment corresponding to the media tag is a scene segment with related content, so that the media playback scenario is not limited to media application playback, but can also cover more media playback scenarios such as local media playback.

[0031] In some embodiments, the controller is further configured to obtain scene information corresponding to the media asset tag:

[0032] Get the scene number corresponding to the media resource tag;

[0033] Send the scene number to the server;

[0034] Receive the scene information corresponding to the media resource tag issued by the server based on the scene number.

[0035] The above technical solution has the following advantages or beneficial effects: if the media asset segment corresponding to the identified media asset tag is a scene segment with associated content, the media asset tag will correspond to a scene number, and the scene information corresponding to the media asset segment can be quickly found according to the scene number.

[0036] In some embodiments, after displaying multiple associated media asset segment controls on the floating page based on the scene information, the controller is further configured to:

[0037] In response to a confirmation instruction input by the user for the associated media asset segment control, obtaining a playback start position of the associated media asset segment from information of the associated media asset segment corresponding to the associated media asset segment control;

[0038] The associated media asset segment is played starting from the play start position on the second page, and the second page is displayed on the upper layer of the floating page.

[0039] The above technical solution has the following advantages or beneficial effects: the media playback content is still in the original media, and the starting position is set for different related media segments, which can quickly position the playback progress to the media segment that the user wants to watch, helping users to efficiently find the required information and improve the accessibility and practicality of media content.

[0040] In some embodiments, after displaying multiple associated media asset segment controls in the floating layer based on the scene information, the controller is further configured to:

[0041] In response to a confirmation instruction input by a user for the associated media asset segment control, obtaining a media asset identifier from information of the associated media asset segment corresponding to the associated media asset segment control;

[0042] The associated media asset segment corresponding to the media asset identifier is played on the second page, and the second page is displayed on the upper layer of the floating page.

[0043] The above technical solution has the following advantages or beneficial effects: the media assets are fragmented, each related media asset segment is an independent media asset, and each media asset has a corresponding media asset identifier, which can help users accurately find and play the media asset segment of interest.

[0044] In some embodiments, after executing the operation of capturing the displayed content of the user interface and obtaining the screenshot image, the controller is further configured to:

[0045] Send the screenshot image to the server;

[0046] The receiving server identifies the person in the screenshot image and sends the person information corresponding to the person;

[0047] The controller executes the display of multiple associated media asset fragment controls on the floating page based on the scene information and is further configured as follows:

[0048] The screenshot image is displayed on the floating page, and multiple related media asset segment controls are displayed on the floating page based on the scene information, and character controls are displayed on the floating page based on the character information, where the character controls correspond to the character information.

[0049] The above technical solution has the following advantages or beneficial effects: displaying the screenshot image can enable the user to clearly identify the screenshot image, and by identifying the person in the screenshot image and displaying it on the display, the user can understand the person information in the screenshot image.

[0050] In a second aspect, some embodiments of the present application provide a method for viewing media resources, including:

[0051] In the case where the media resource is played on the first page, in response to the image recognition instruction input by the user, the display content of the first page is intercepted to obtain a screenshot image;

[0052] Obtaining the media asset tag corresponding to the screenshot image, where the media asset tag includes a tag corresponding to a media asset segment of a preset plot;

[0053] When it is identified that the media asset segment corresponding to the media asset tag is a scene segment with associated content, scene information corresponding to the media asset tag is obtained, where the scene information includes information of multiple associated media asset segments, and the associated media asset segments correspond to the associated content;

[0054] Based on the scene information, a plurality of associated media asset segment controls are displayed on the floating layer page, wherein the associated media asset segment controls correspond to the associated media asset segments, and the floating layer page is displayed on an upper layer of the first page.

[0055] The above technical solution has the following advantages or beneficial effects: after receiving the image recognition command input by the user, the image of the current user interface can be captured, and the screenshot image can be identified to determine the scene corresponding to the screenshot image, and display media clips related to the plot of the scene. The user only needs to enter the image recognition command to quickly understand and view the plot clips related to the current scene.

[0056] In the embodiment of the present application, when the media is played on the first page, in response to the image recognition instruction input by the user, the display content of the first page is intercepted to obtain a screenshot image; the media tag corresponding to the screenshot image is obtained; when it is identified that the media segment corresponding to the media tag is a scene segment with associated content, the scene information corresponding to the media tag is obtained, and the scene information includes information of multiple associated media segments, and the associated media segments correspond to the associated content. Based on the scene information, multiple associated media segment controls are displayed on the floating page, wherein the floating page is displayed on the upper layer of the first page. In the embodiment of the present application, the image of the current user interface can be intercepted, and the screenshot image can be identified to determine the scene corresponding to the screenshot image, and the media segments related to the plot of the scene can be displayed. The user only needs to input the image recognition instruction to quickly understand and view the plot segments related to the current scene. BRIEF DESCRIPTION OF THE DRAWINGS

[0057] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0058] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0059] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0060] Figure 3 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0061] Figure 4 A flowchart of a method for viewing media resources provided in some embodiments of the present application;

[0062] Figure 5 A flowchart of a method for acquiring and identifying media asset tags provided in some embodiments of the present application;

[0063] Figure 6 A flowchart of another method for acquiring and identifying media asset tags provided in some embodiments of the present application;

[0064] Figure 7 A schematic diagram of a media playback page provided in some embodiments of the present application;

[0065] Figure 8 A schematic diagram of a recognition result page provided in some embodiments of the present application;

[0066] Figure 9 A schematic diagram of another recognition result page provided in some embodiments of the present application;

[0067] Figure 10 A flowchart of a method for viewing media resources provided in some embodiments of the present application;

[0068] Figure 11 A flowchart of another media asset viewing method provided in some embodiments of the present application. DETAILED DESCRIPTION

[0069] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0070] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0071] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0072] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0073] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functionality associated with that element.

[0074] In the embodiments of the present application, the display device 200 generally refers to a device capable of displaying images and processing data. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0075] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, a user can operate the display device 200 through touch operation, a mobile terminal 300, and a control device 100. The control device 100 is configured to receive user input and convert the operation instructions into control instructions that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a controller, etc. The mobile terminal 300 includes a mobile phone, a tablet computer, a laptop computer, a smartwatch, etc.

[0076] The mobile terminal 300 can function as a control device for performing human-computer interaction between a user and the display device 200. The mobile terminal 300 can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, enabling connection and communication via a network communication protocol, enabling one-to-one control operations and data communication. Audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 for synchronized display.

[0077] In some embodiments, the mobile terminal 300 or other electronic devices can also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0078] like Figure 1 As shown in FIG, the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0079] In the embodiment of the present application, the server includes an image recognition server and a media resource server. The image recognition server is used to identify image content. The media resource server is used to provide media resource related information.

[0080] In some embodiments, after receiving an image recognition command input by the user, the display device 200 sends the captured screenshot image to the image recognition server. The image recognition server recognizes the characters, media asset name, and playback progress in the screenshot image, and then sends the recognition result to the display device 200. The display device 200 sends the media asset name and playback progress to the media asset server. Based on the media asset name and playback progress, the media server identifies whether the media segment corresponding to the media asset tag to which the playback progress belongs is a scene segment with associated content, and sends the recognition result to the display device 200.

[0081] In some embodiments, after receiving a command to play a media asset, the display device 200 sends a media asset acquisition request to a media asset server. The media asset server then sends the media asset information for the media asset. The media asset information includes the media asset playback address, the time range of multiple media asset tags, and the scene identifiers corresponding to the media tags.

[0082] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart TV, Internet Protocol television (IPTV), etc.

[0083] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0084] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0085] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0086] In some embodiments, the display 260 includes a display component for presenting images and a driver component for driving image display. The display 260 is configured to receive image signals output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces.

[0087] In some embodiments, the communication device 220 is a component used to communicate with an external device or server 400 according to various communication protocol types. The display device 200 can be provided with multiple communication devices 220 depending on the supported communication methods. For example, if the display device 200 supports wireless network communication, the display device 200 can be provided with a communication device 220 including WiFi functionality. If the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including Bluetooth functionality.

[0088] The communication device 220 can establish a communication connection between the display device 200 and an external device or server 400 via a wireless or wired connection. A wired connection can connect the display device 200 to an external device via a data cable, an interface, or other components. A wireless connection can connect the display device 200 to an external device via a wireless signal or wireless network. The display device 200 can establish a connection with an external device directly or indirectly through a gateway, router, or connection device.

[0089] In some embodiments, the controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processor, and a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in a memory. The controller 250 controls the overall operation of the display device 200.

[0090] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0091] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0092] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may further be provided with an external audio output terminal, through which the audio output device may be connected to the display device 200 to output the sound of the display device 200.

[0093] In some embodiments, the user input interface 280 may be configured to receive a command input by a user. For example, the user input interface 280 may receive a confirmation command from a user for a control in a user interface.

[0094] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. An operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0095] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for display devices.

[0096] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0097] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer can host at least one application, which can include built-in window programs, system settings programs, clock programs, and the like, or applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0098] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0099] like Figure 3 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to the system location service; a package manager for retrieving various information related to the application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0100] In some embodiments, the activity manager is used to manage the lifecycle of each application and common navigation back functions, such as controlling application exit, opening, and back. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, taking screenshots, and controlling changes in display windows, such as shrinking, shaking, or distorting the display window.

[0101] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0102] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer can be configured with hardware drivers, and the drivers included in the kernel layer can be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0103] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0104] When users watch media on a daily basis, they may not start watching from the beginning. When certain scenes or plots appear in the media, users may be relatively confused if they don't understand the cause and effect. For example, the media widget on the media application homepage can display the corresponding highlight clip of the media. In order to allow users to directly view the content corresponding to the clip, after the user clicks the media widget, the video will start playing directly from the progress corresponding to the highlight clip. The clip is a scene where the characters in the play quarrel, and the user is not very familiar with the reason for the quarrel. In addition, some special scenes may appear in the media, and users are more excited about the subsequent development of the related plot. For example, when users see the scene where the characters in the play meet, they are curious about the subsequent emotional development between the two.

[0105] To quickly understand the causes and consequences of confusing scenes or the plot related to a particular scene, users can adjust the playback progress by fast forwarding or rewinding. However, if the adjustment progress for a single fast forward or rewind is small, it will take a long time to find the desired plot segment. If the adjustment progress for a single fast forward or rewind is large, the desired plot segment may be skipped. As a result, users cannot quickly understand and view the plot segments related to the current scene.

[0106] In order to facilitate users to quickly understand and view the plot segments related to the current scene, the embodiment of the present application provides a display device 200. The structure and functions of each part of the display device 200 can refer to the above embodiment. In addition, based on the display device 200 shown in the above embodiment, this embodiment further improves some functions of the display device 200. Figure 4 As shown, the controller 250 is configured to perform the following steps:

[0107] Step S401: When the first page plays media resources, a picture recognition instruction input by the user is received.

[0108] When playing media resources on the first page, receive the image recognition command input by the user,

[0109] In some embodiments, the step of playing the media asset on the first page may include: upon receiving a user input command to open a media asset application, displaying a media asset application page, the media asset application page including a plurality of media asset controls; and in response to the user inputting a confirmation operation on a media asset control, playing the media asset corresponding to the media asset control on the first page.

[0110] In some embodiments, the step of playing the media asset on the first page may include: playing the local media asset on the first page after receiving an instruction input by the user to play the local media asset.

[0111] In some embodiments, the step of playing the media asset on the first page may include: playing a broadcast program on the first page after receiving a user input instruction to open a live TV application.

[0112] In some embodiments, a screenshot recognition key is provided on the control device 100, and the step of receiving a screenshot recognition instruction input by the user may include: receiving a screenshot recognition instruction generated by the user by pressing the screenshot recognition key on the control device 100.

[0113] In some embodiments, the step of receiving the image recognition instruction input by the user may include: after receiving the instruction by the user pressing the voice key on the control device 100, collecting the user's input voice information, recognizing the voice information, and obtaining the image recognition instruction. Alternatively, after waking up the voice assistant through the far-field wake-up word, collecting the user's input voice information through the sound collector, recognizing the voice information, and obtaining the image recognition instruction. The voice information may be "Who is this person" or "Why did the quarrel happen?"

[0114] Step S402: capturing the display content of the first page to obtain a screenshot image.

[0115] Screenshot refers to capturing part or all of the screen content currently displayed on the monitor to obtain a screenshot image.

[0116] After receiving the image recognition command from the user, the image recognition application sends a screenshot command to the screenshot application. The screenshot application captures the displayed content of the user interface, obtains a screenshot image, and sends the screenshot image to the image recognition application. The screenshot application can be an application in the entire device system or a downloaded third-party application.

[0117] Step S403: Obtain the media resource tag corresponding to the screenshot image.

[0118] Step S404: Identify whether the media asset segment corresponding to the media asset tag is a scene segment with associated content.

[0119] The media tag is a tag corresponding to the media segment that contains a preset plot or a key plot. Associated content may refer to content that is associated by a plot or a storyline. For example, taking the emotional development plot as an example, the following associated media segments may be defined: media segment A (acquaintance) - media segment B (love) - media segment C (misunderstanding, quarrel) - media segment D (misunderstanding resolution, reconciliation) - media segment E (marriage). The contents of media segment A and media segment E are associated, and their corresponding scene identifiers can be set to preset values. Media segment F (work) does not have a corresponding media segment for a work-related plot, and its corresponding scene identifier can be set to a non-preset value.

[0120] Related content can also refer to content that is linked by characters or relationships. For example, if A and B complete multiple tasks together, the tasks themselves are not related. However, because they are the two individuals who complete the tasks, they become related, and the content of the media assets corresponding to each task is linked.

[0121] In some embodiments, as Figure 5 As shown, a first implementation method of obtaining a media asset tag corresponding to a screenshot image and identifying whether a media asset segment corresponding to the media asset tag is a scene segment with associated content may include:

[0122] Step S501: Obtain the media resource name and playback progress corresponding to the screenshot image.

[0123] After receiving the image recognition command from the user, the image recognition application sends a scene information acquisition request to the media asset application. While playing media, the media asset application can retrieve the currently playing media asset information from the media asset server and save it locally. This media asset information includes the media asset playback address, the playback progress range of multiple media asset tags, and the scene identifiers corresponding to the media tags. Upon receiving the scene information acquisition request from the image recognition application, the media asset application can obtain the currently playing media asset's name and playback progress.

[0124] It should be noted that there is a certain difference between the time when the image recognition application receives the image recognition instruction and the time when the media resource application receives the scene information acquisition request. In order to more accurately obtain the scene information corresponding to the screenshot image, the average time difference between the media resource application receiving the scene information acquisition request and the time when the image recognition application receives the image recognition instruction can be calculated. After receiving the scene information acquisition request, the media resource application can obtain the first timestamp of the currently playing video frame, calculate the difference between the first timestamp and the average time difference, and obtain a second timestamp, which is determined as the playback progress.

[0125] Step S502: Query the media asset tag corresponding to the playback progress in the media asset information corresponding to the media asset name.

[0126] After obtaining the media asset name and playback progress, you can query the media asset tag corresponding to the current playback progress in the media asset information. The media asset information includes the corresponding relationship between the playback progress of the corresponding media asset and the media asset tag.

[0127] Multiple media asset tags can be set for a media asset. Each tag corresponds to a playback progress range. The playback progress is then determined by checking whether it falls within the playback progress range of the media asset tag to determine the corresponding media asset tag. For example, if media asset tag A corresponds to the content about Xiao X going to XX Company for an interview, the corresponding playback progress range is: 00:30:30-00:40:05. If the current playback progress is 00:35:59, which is within the playback progress range of media asset tag A, the corresponding media tag is determined to be media tag A.

[0128] It's important to note that not every playback progress item has a corresponding media asset tag. Some non-plot content, such as landscape footage, doesn't have a media asset tag. If the playback progress item isn't within the range of any media asset tag, indicating that the screenshot doesn't belong to any media asset tag, the message is sent to the image recognition application, which doesn't need to determine whether the media asset segment corresponding to the media tag is a scene segment with associated content.

[0129] Step S503: Determine whether the scene identifier corresponding to the media asset tag is a preset value.

[0130] After querying the media resource tag corresponding to the playback progress, the media resource application obtains the scene identifier corresponding to the media resource tag and determines whether the scene identifier is a preset value. For example, the preset value can be set to 1.

[0131] If the scene identifier corresponding to the media asset tag is a preset value, step S504 is executed: identifying the media asset segment corresponding to the media asset tag as a scene segment with associated content.

[0132] If the scene identifier corresponding to the media asset tag is not a preset value, step S505 is executed: identifying that the media asset segment corresponding to the media asset tag is not a scene segment with associated content.

[0133] The scene identifier being a preset value is used to indicate that the media asset segment corresponding to the media asset tag is a scene segment with associated content, and the scene identifier not being a preset value is used to indicate that the media asset segment corresponding to the media asset tag is not a scene segment with associated content.

[0134] After the media asset application identifies that the media asset segment corresponding to the media asset tag is a scene segment with associated content, it obtains the scene number corresponding to the media asset tag, adds the scene number to the first identification information, and sends it to the image recognition application. The image recognition application can then execute the step of obtaining scene information. The first identification information is used to characterize that the media asset segment corresponding to the media asset tag is a scene segment with associated content. After the media asset application identifies that the media asset segment corresponding to the media asset tag is not a scene segment with associated content, it sends the second identification information to the image recognition application. The image recognition application does not need to execute the step of obtaining scene information. The second identification information is used to characterize that the media asset segment corresponding to the media asset tag is not a scene segment with associated content.

[0135] In the embodiment of the present application, after receiving the image recognition instruction, the image recognition application will synchronously call the interface of the media application to query the name and playback progress of the currently playing media, and identify whether the currently playing screen is the content of a scene segment with related content. The media application is responsible for playing the media and can directly obtain the played media, the progress range corresponding to the media tag, and the scene identifier corresponding to the media tag from the media server in advance when playing the media. The embodiment of the present application is suitable for scenarios where the image recognition application can directly interact with the media application. Information is directly transmitted within the display device without the need for interaction with the server, resulting in a short recognition link and a fast recognition speed.

[0136] In some embodiments, as Figure 6 As shown, a second implementation of obtaining a media asset tag corresponding to a screenshot image and identifying a media asset segment corresponding to the media asset tag as a scene segment with associated content may include:

[0137] Step S601: Send the screenshot image to the image recognition server.

[0138] After receiving the screenshot image sent by the screenshot application, the image recognition application sends the screenshot image to the image recognition server, and displays the screenshot image on a floating page, which is displayed on the upper layer of the first page.

[0139] Step S602: Receive the media resource name and playback progress obtained by identifying the screenshot image sent by the image recognition server.

[0140] In some embodiments, after receiving the screenshot image, the image recognition server compares the screenshot image with the media in the media library, identifies the name of the currently playing media and the playback progress, and sends the media name and playback progress to the image recognition application.

[0141] In other embodiments, after receiving a screenshot image, the image recognition server identifies the screenshot image and obtains the media asset name and playback progress. The playback progress can be directly identified from the screenshot image. However, identifying the media asset name requires pre-training an image recognition model using a large number of images labeled with media asset names. After inputting the screenshot image into the trained image recognition model, the media asset name corresponding to the screenshot image can be output. The image recognition server sends the media asset name and playback progress to the image recognition application.

[0142] Step S603: sending the media resource name and the playback progress to the media resource server, so that the media resource server feeds back the first identification information or the second identification information.

[0143] The media resource server searches for the media resource tag corresponding to the playback progress in the media resource information corresponding to the media resource name, and feeds back first identification information when the scene identifier corresponding to the media resource tag is a preset value, and feeds back second identification information when the scene identifier corresponding to the media resource tag is not a preset value.

[0144] Step S604: parse the first identification information sent by the media asset server to identify that the media asset segment corresponding to the media asset tag is a scene segment with associated content, or parse the second identification information sent by the media asset server to identify that the media asset segment corresponding to the media asset tag is not a scene segment with associated content.

[0145] After receiving the media asset name and playback progress sent by the image recognition server, the image recognition application sends the media asset name and playback progress to the media asset server. The media asset server queries the media asset tag corresponding to the playback progress in the media asset information corresponding to the media asset name. The media asset server directly obtains the scene identifier of the media asset tag, or sends the media asset tag to the image recognition application, and the image recognition application sends the media asset tag to the media asset server so that the media asset server obtains the scene identifier of the media asset tag. When the scene identifier corresponding to the media asset tag is a preset value, first identification information is generated, and the first identification information is sent to the image recognition application. The image recognition application parses the first identification information sent by the media asset server to identify that the media asset segment corresponding to the media asset tag is a scene segment with associated content. When the scene identifier corresponding to the media asset tag is not a preset value, second identification information is generated, and the second identification information is sent to the image recognition application. The image recognition application parses the second identification information sent by the media asset server to identify that the media asset segment corresponding to the media asset tag is not a scene segment with associated content.

[0146] In the embodiment of the present application, the image recognition application transmits the screenshot to the image recognition server. The image recognition server identifies the currently playing media and its playback progress based on the screenshot image. Based on the media and playback progress, the server then retrieves information from the media storage server to determine whether the currently playing image belongs to a scene segment with related content. The solution of the present application is not limited to media application playback scenarios that can interact with the image recognition application, but can cover all playback scenarios. For example, it can also achieve the acquisition of media segments related to the screenshot image in scenarios such as local media playback and broadcast program playback.

[0147] In some embodiments, a third implementation of obtaining a media asset tag corresponding to a screenshot image and identifying a media asset segment corresponding to the media asset tag as a scene segment with associated content may include obtaining an application that plays the media asset and determining whether the application is a target media asset application. The target media asset application is a media asset application that can exchange information with an image recognition application.

[0148] If the target media asset application is the image recognition application, the image recognition application sends a scene information acquisition request to the target media asset application. The target media asset application obtains the media asset name and playback progress of the currently playing media asset and searches the media asset information corresponding to the media asset name for the media asset tag corresponding to the playback progress. The target application then determines whether the scene identifier corresponding to the media asset tag is a preset value to identify whether the media asset segment corresponding to the media tag is a scene segment with associated content.

[0149] If the application is not the target media asset application, the image recognition application sends the screenshot image to the image recognition server, which identifies and provides feedback on the media asset name and playback progress corresponding to the screenshot image. The media asset name and playback progress are then sent to the media asset server, which searches the media asset information corresponding to the media asset name for the media asset tag corresponding to the playback progress. The server then determines whether the scene identifier corresponding to the media tag is a preset value, identifies whether the media segment corresponding to the media tag is a scene segment with associated content, and provides feedback on the identification information to the image recognition application.

[0150] In the embodiment of the present application, scene identification information for obtaining a screenshot image can be determined based on the application playing the media asset. If the application playing the media asset is the target application, a method with a short identification link can be selected to obtain scene identification information, which is more accurate. If the application playing the media asset is not the target application, the server's powerful identification and judgment capabilities can be utilized to obtain scene identification information, thereby helping users quickly understand and view plot segments related to the current scene.

[0151] When it is identified that the media asset segment corresponding to the media asset tag is a scene segment with associated content, step S405 is executed: scene information corresponding to the media asset tag is obtained.

[0152] In some embodiments, the step of obtaining scene information corresponding to a media asset tag may include: obtaining a scene number corresponding to the media asset tag from the first identification information, then sending the scene number to a server, and receiving the scene information corresponding to the media asset tag issued by the server based on the scene number. The scene information includes information about multiple associated media asset segments, where the associated media asset segments correspond to associated content. The information about the associated media asset segments includes, for example, a display title and a jump address. The display title is displayed in the associated media asset segment control, and the jump address indicates the path to obtaining the associated media asset segment.

[0153] For example, if the media asset tag corresponding to the playback progress is found to be media segment C, and media segment C is a scene segment with associated content, the scene number corresponding to media segment C may be returned as 123456. The scene information corresponding to scene number 123456 is obtained. The scene information includes information corresponding to the following media asset segments: media segment A (acquaintance), media segment B (love), media segment C (misunderstanding, quarrel), media segment D (misunderstanding resolved, reconciliation), and media segment E (marriage).

[0154] The image recognition application can obtain the scene number from the first identification information and send the scene number to the media resource server. The media resource server can obtain the scene information corresponding to the scene number and feed the scene information back to the image recognition application after assembling it.

[0155] Step S406: Displaying a plurality of associated media asset segment controls on the floating page based on the scene information.

[0156] The image recognition application draws the page corresponding to the recognition result based on the scene information, that is, multiple associated media segment controls are displayed on the floating page. Each associated media segment control corresponds to the associated media segment in the scene information. The floating page is displayed on the upper layer of the first page. The first page is the media playback page, and the screenshot image is obtained by capturing the display content of the first page.

[0157] In some embodiments, the floating page can completely cover the first page, the display area of ​​the floating page can also be smaller than the display area of ​​the first page, or the display area of ​​the floating page is equal to the display area of ​​the first page, but all areas except the display area of ​​the recognition result are transparent.

[0158] In some embodiments, after receiving the image recognition instruction input by the user, the image recognition application can send a pause instruction to the media asset application to cause the media asset application to pause playing the media asset. After receiving the image recognition instruction input by the user, the image recognition application can also not send the pause instruction to the media asset application to cause the media asset application to continue playing the media asset.

[0159] For example, in Figure 7 In the media resource playback page shown, after receiving the image recognition command input by the user, the following is displayed: Figure 8The recognition result page shown includes a screenshot image 81 and an associated media asset segment control 82 .

[0160] In some embodiments, after receiving the screenshot image, the image recognition application can also send the screenshot image to the server, and then the server identifies the person in the screenshot image and sends down the person information corresponding to the person, and also displays the screenshot image and person control on the floating page, and the person control corresponds to the person information.

[0161] The image recognition app displays the screenshot on a pop-up page and sends it to the image recognition server. The image recognition server identifies the person in the screenshot and sends a corresponding person ID to the image recognition app. The image recognition app sends the person ID to the media server. The media server retrieves the person's information based on the ID and sends it to the image recognition app. This information includes the person's encyclopedia, a brief introduction to the character in the drama, and their TV and movie appearances. The image recognition app then displays a character widget on the pop-up page based on this information.

[0162] In some embodiments, after receiving a media asset name, the image recognition application may send the media asset name to a media asset server. The media asset server retrieves the recommended media asset information corresponding to the media asset name from a recommended media asset list and sends the recommended media asset information to the image recognition application. The image recognition application may display a recommended media asset control corresponding to the recommended media asset information in a floating page. The recommended media asset corresponding to the recommended media asset name in the recommended media asset list may include media assets with similar content or the same actors. Media asset content may include media asset subject matter, media asset type, etc.

[0163] For example, in Figure 7 In the media resource playback page shown, after receiving the image recognition command input by the user, the following is displayed: Figure 9 The recognition result page shown includes a screenshot image 81 , an associated media asset segment control 82 , a character control 83 , and a recommended media asset control 84 .

[0164] It should be noted that this application does not limit the display order of the content on the floating page, such as screenshot images, associated media clip controls, character controls and recommended media controls. As long as any content is received, the floating page can be pulled up and the content can be displayed on the floating page. The remaining content can be displayed successively according to the order of acquisition. The floating page can also be pulled up after each content is acquired and displayed together.

[0165] In some embodiments, the information about the associated media segment includes a playback start position. After multiple associated media segment controls are displayed on the floating page based on the scene information, in response to a user input confirming an associated media segment control, the playback start position of the associated media segment can be obtained from the information about the associated media segment corresponding to the associated media segment control, and the media segment can be played starting from the playback start position on a second page, which is displayed above the floating page.

[0166] The information of the associated media asset segment may also include the playback end position. When the playback progress reaches the playback end position, the playback may be stopped, or the playback may be automatically started from the starting position of the next associated media asset segment immediately or after a period of time.

[0167] For example, after receiving the user's confirmation operation on the control of media segment A, playback can start from the playback start position 00:10:00 corresponding to media segment A. The media playback page can also include a previous control and a next control, which are used to switch the associated media segments.

[0168] In the embodiment of the present application, the media playback content is still in the original media, and a starting position is set for different media segments, which can quickly position the playback progress to the media segment the user wants to watch, helping users to efficiently find the required information and improving the accessibility and practicality of media content.

[0169] In some embodiments, the information about the associated media asset segment includes a media asset identifier. After multiple associated media asset segment controls are displayed on the floating page based on the scene information, in response to a user inputting a confirmation instruction for the associated media asset segment controls, the media asset identifier is obtained from the information about the associated media asset segment corresponding to the associated media asset segment controls, and the media segment corresponding to the media asset identifier is played on the second page.

[0170] For example, after receiving a user confirmation operation on the control for media asset segment A, the media asset identifier can be obtained from the information of media asset segment A, and a media asset request carrying the media asset identifier can be sent to the media asset server. The media asset server then sends the media asset segment to the media asset application, or the media server sends the media asset address to the media asset application, so that the media application can obtain the media asset segment from the media asset address.

[0171] It should be noted that the media resources on the first page need to be stopped before playing the associated media resource segments.

[0172] When displaying the home page of a media application, a confirmation instruction for the media asset control input by the user is received, the media asset content is displayed on the first page, and the first page is added to the current application stack. After receiving the image recognition instruction input by the user, the scene information is obtained, and the floating page is called up, the associated media asset segment control is displayed on the floating page, and the floating page is added to the application stack, and inserted to the top of the stack according to the specific principles of the stack. The floating page is displayed on the upper layer of the first page. After receiving the confirmation instruction for the associated media asset segment control from the user, the second page is called up, and the associated media asset segment content is displayed on the second page, and the second page is displayed on the upper layer of the floating page. The second page is added to the application stack and inserted to the top of the stack according to the specific rules of the stack.

[0173] When playing an associated media asset segment, if a return instruction input by the user is received, a pop-stack operation is performed. According to the principle of the stack, the top element of the stack is preferentially exited, that is, the display of the second page is canceled. If a return instruction input by the user is received again, a pop-stack operation is performed. According to the principle of the stack, the top element of the stack is preferentially exited. At this time, the top element of the stack is a floating page, and the display of the floating page can be canceled. After canceling the display of the second page or canceling the display of the floating page, the media asset can be continued to be played in the first page with the saved playback progress. The embodiment of the present application can quickly return to the original media asset playback progress and continue playback after exiting the playback of the media asset segment.

[0174] In some embodiments, the timing diagram of the media asset viewing method may be as follows: Figure 10 As shown. When displaying the first page of media playback, the image recognition application sends a screenshot instruction to the screenshot application after receiving the image recognition instruction input by the user, and sends a scene information acquisition request to the media application. The screenshot application captures the display content of the user interface, obtains a screenshot image, and sends the screenshot image to the image recognition application. The media application obtains the media name and playback progress of the currently playing media, and queries the media tag corresponding to the playback progress in the media information corresponding to the media name. When the scene identifier corresponding to the media tag is a preset value, the first identification information carrying the scene number is sent to the image recognition application. The first identification information is used to characterize that the media segment corresponding to the media tag is a scene segment with associated content. The image recognition application sends the scene number to the media server, and the media server feeds back the scene information corresponding to the scene number. The scene information includes information of multiple associated media segments, and the multiple associated media segments correspond to the associated content. The image recognition application displays the screenshot image and displays multiple associated media segment controls on a floating page based on the scene information. Each associated media segment control corresponds to an associated media segment in the scene information, and the floating page is displayed on the upper layer of the first page.

[0175] In some embodiments, the timing diagram of the media asset viewing method may be as follows: Figure 11As shown. When the first page of media playback is displayed, the image recognition application sends a screenshot instruction to the screenshot application after receiving the image recognition instruction input by the user. The screenshot application captures the display content of the user interface, obtains a screenshot image, and sends the screenshot image to the image recognition application. The image recognition application sends the screenshot image to the image recognition server. The image recognition server identifies the media asset name and playback progress of the played media asset from the screenshot image, and sends the media asset name and playback progress to the image recognition application. The image recognition application sends the media asset name and playback progress to the media asset server. The media asset server queries the media asset tag corresponding to the playback progress in the media asset information corresponding to the media asset name. When the scene identifier corresponding to the media asset tag is a preset value, the first identification information carrying the scene number is sent to the image recognition application. The first identification information is used to characterize that the media asset segment corresponding to the media asset tag is a scene segment with associated content. The image recognition application sends the scene number to the media asset server, and the media server feeds back the scene information corresponding to the scene number. The scene information includes information of multiple associated media asset segments, and the associated media asset segments correspond to the associated content. The image recognition application displays multiple associated media asset segment controls on a floating page based on the scene information. Each associated media asset segment control corresponds to an associated media asset segment in the scene information. The floating page is displayed on the upper layer of the first page.

[0176] In this embodiment of the present application, the causes and consequences of a particular scene are visualized and aggregated in the form of media segments, each identified by a scene number. After identifying that the image captured by the user is the content of one of these media segments, the set of media segments representing the causes and consequences can be retrieved using the scene number and displayed to the user. The user can then select the media segment they wish to view to quickly understand the context and causes and consequences of the current scene.

[0177] Some embodiments of the present application further provide a computer-readable storage medium that may store a program. When the computer storage medium is configured in a display device or server, the program, when executed, may include the procedural steps involved in the media viewing method in the above embodiments. The computer storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

[0178] An embodiment of the present application provides an electronic device comprising: a processor and a memory for storing processor-executable instructions, wherein the processor is configured to read the executable instructions from the memory and execute the instructions to implement the media viewing method of the above embodiment.

[0179] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some or all of the technical features therein. These modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

[0180] For ease of explanation, the above description has been presented in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations are possible. The above embodiments have been selected and described to better explain the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: monitor; configured to display a user interface; a controller coupled to the display and configured to: In the case where the media resource is played on the first page, in response to an image recognition instruction input by the user, the display content of the first page is intercepted to obtain a screenshot image; Obtaining a media resource tag corresponding to the screenshot image, where the media resource tag is a tag corresponding to a media resource segment containing a preset plot; When it is identified that the media asset segment corresponding to the media asset tag is a scene segment with associated content, obtaining scene information corresponding to the media asset tag, the scene information including information of a plurality of associated media asset segments, the associated media asset segments corresponding to the associated content; Based on the scene information, a plurality of associated media asset segment controls are displayed on a floating layer page, wherein the associated media asset segment controls correspond to the associated media asset segments, and the floating layer page is displayed on an upper layer of the first page.

2. The display device according to claim 1, wherein The controller executes acquiring the media resource tag corresponding to the screenshot image, and is further configured to: Obtain the media resource name and playback progress corresponding to the screenshot image; The media asset tag corresponding to the playback progress is searched in the media asset information corresponding to the media asset name, wherein the media asset information includes a corresponding relationship between the playback progress of the corresponding media asset and the media asset tag.

3. The display device according to claim 2, wherein The controller identifies the media asset segment corresponding to the media asset tag as a scene segment with associated content, and is further configured to: Obtaining a scene identifier corresponding to the media asset tag; When the scene identifier is a preset value, the media asset segment corresponding to the media asset tag is identified as a scene segment with associated content. The scene identifier is a preset value used to indicate that the media asset segment corresponding to the media asset tag is a scene segment with associated content.

4. The display device according to claim 1, wherein The controller executes acquiring the media resource tag corresponding to the screenshot image, and is further configured to: Sending the screenshot image to an image recognition server; receiving a media resource name and a playback progress obtained by identifying the screenshot image, sent by the image recognition server; Sending the media resource name and the playback progress to a media resource server, so that the media resource server searches for a media resource tag corresponding to the playback progress in the media resource information corresponding to the media resource name; Receive the media resource tag sent by the media resource server.

5. The display device according to claim 4, wherein: The controller identifies the media asset segment corresponding to the media asset tag as a scene segment with associated content, and is further configured to: Sending the media asset tag to the media asset server, so that the media asset server feeds back first identification information when recognizing that the scene identifier corresponding to the media asset tag is a preset value, wherein the scene identifier is a preset value for indicating that the media asset segment corresponding to the media asset tag is a scene segment with associated content; The first identification information is parsed to identify that the media asset segment corresponding to the media asset tag is a scene segment with associated content.

6. The display device according to claim 1, wherein The controller executes acquisition of scene information corresponding to the media asset tag, and is further configured to: Obtain the scene number corresponding to the media asset tag; Sending the scene number to a server; Receive scene information corresponding to the media asset tag issued by the server based on the scene number.

7. The display device according to claim 1, wherein After executing the process of displaying a plurality of associated media asset segment controls on the floating layer page based on the scene information, the controller is further configured to: In response to a confirmation instruction input by a user for the associated media asset segment control, obtaining a playback start position of the associated media asset segment from information of the associated media asset segment corresponding to the associated media asset segment control; The associated media asset segment is played starting from the play start position on a second page, and the second page is displayed on an upper layer of the floating page.

8. The display device according to claim 1, wherein After executing the step of displaying a plurality of associated media asset segment controls in the floating layer based on the scene information, the controller is further configured to: In response to a user inputting a confirmation instruction for the associated media asset segment control, obtaining a media asset identifier from information of the associated media asset segment corresponding to the associated media asset segment control; The associated media asset segment corresponding to the media asset identifier is played on the second page, and the second page is displayed on the upper layer of the floating page.

9. The display device according to claim 1, wherein After executing the operation of intercepting the display content of the user interface and obtaining a screenshot image, the controller is further configured to: Sending the screenshot image to a server; The receiving server identifies a person in the screenshot image and sends person information corresponding to the person; The controller is further configured to: The screenshot image is displayed on the floating page, and a plurality of associated media asset segment controls are displayed on the floating page based on the scene information, and a character control is displayed on the floating page based on the character information, wherein the character control corresponds to the character information.

10. A method for viewing media resources, characterized in that: include: In the case where the media resource is played on the first page, in response to an image recognition instruction input by the user, the display content of the first page is intercepted to obtain a screenshot image; Obtaining a media resource tag corresponding to the screenshot image, where the media resource tag is a tag corresponding to a media resource segment containing a preset plot; When it is identified that the media asset segment corresponding to the media asset tag is a scene segment with associated content, obtaining scene information corresponding to the media asset tag, the scene information including information of a plurality of associated media asset segments, the associated media asset segments corresponding to the associated content; Based on the scene information, a plurality of associated media asset segment controls are displayed on a floating layer page, wherein the associated media asset segment controls correspond to the associated media asset segments, and the floating layer page is displayed on an upper layer of the first page.

Images