Display device and media asset picture positioning method

Abstract

Some embodiments of the invention provide a display device and a media asset picture positioning method, and the method can control a display to display a subtitle display window on a media asset playing interface in response to a subtitle display instruction input by a user based on the media asset playing interface. And acquiring subtitle information, and adding the subtitle information in the subtitle display window. And in response to a subtitle selection instruction input by a user based on the subtitle display window, obtaining selected subtitle information selected by the focus cursor when the subtitle selection instruction is received. And acquiring a positioning time point associated with the selected subtitle information in the subtitle data, and playing the media asset data according to the positioning time point. According to the method, the positioning time point associated with the subtitle information can be determined by selecting the subtitle information, and the media asset data playing progress can be quickly positioned to the positioning time point, so that the problem that the positioning speed and accuracy of a user on a media asset picture are low is solved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a method for positioning a media resource screen. Background Art

[0002] Display devices are intelligent devices that can present user interfaces and support user interaction. Taking smart TVs as an example, smart TVs are based on Internet application technology, have open operating systems and chips, have open application platforms, can realize two-way human-computer interaction functions, and are TV products that integrate multiple functions such as audio and video, entertainment, and data to meet the diverse and personalized needs of users. Display devices have video playback functions. In order to facilitate users to quickly locate the video screen of interest during video playback, display devices can fast forward or rewind when playing videos.

[0003] When a user uses the fast forward or fast rewind function to find a video scene of interest in the playing video, the fast forward or fast rewind increases the playing speed of the playing video, making it difficult for the user to find the video scene that meets the needs. Therefore, the display device adds a picture preview function on the basis of the fast forward or fast rewind function, so that the user can view the video scene being played at the current moment in real time.

[0004] However, when the video being played is a language program or other video type with similar images at different time periods, the difference between the multiple frames in the video is small, and it is difficult for users to quickly locate the video screen of interest through the fast forward or fast rewind and screen preview functions, which reduces the speed and accuracy of video screen positioning. Summary of the invention

[0005] The present application provides a display device and a method for locating a media resource screen to solve the problem of low speed and accuracy in locating a media resource screen by a user.

[0006] In a first aspect, some embodiments of the present application provide a display device, including: a display, a memory, and a controller.

[0007] The display is configured to display a media playback interface; the memory is configured to store subtitle data, the subtitle data includes subtitle information and a playback time point, and the subtitle information and the playback time point are associated; the controller is configured to:

[0008] In response to a subtitle display instruction input by a user based on the media asset playback interface, controlling the display to display a subtitle display window on the media asset playback interface;

[0009] Acquire the subtitle information, and add the subtitle information to the subtitle display window;

[0010] In response to a subtitle selection instruction input by a user based on the subtitle display window, the selected subtitle information is obtained; wherein the selected subtitle information is the subtitle information selected by the focus cursor when the subtitle selection instruction is received;

[0011] A positioning time point is obtained in the subtitle data, and media asset data is played according to the positioning time point; wherein the positioning time point is a playing time point associated with the selected subtitle information.

[0012] In a second aspect, some embodiments of the present application further provide a method for locating a media asset screen, which is applied to the display device provided in the first aspect, wherein the display device includes: a display, a memory, and a controller. The method includes:

[0013] In response to a subtitle display instruction input by a user based on a media asset playback interface, controlling the display to display a subtitle display window on the media asset playback interface;

[0014] Acquire subtitle information, and add the subtitle information to the subtitle display window;

[0015] In response to a subtitle selection instruction input by a user based on the subtitle display window, the selected subtitle information is obtained; wherein the selected subtitle information is the subtitle information selected by the focus cursor when the subtitle selection instruction is received;

[0016] A positioning time point is obtained in the subtitle data, and media asset data is played according to the positioning time point; wherein the positioning time point is a playing time point associated with the selected subtitle information.

[0017] It can be seen from the above technical solutions that some embodiments of the present application provide a display device and a method for positioning a media asset screen, which can control the display to display a subtitle display window on the media asset playback interface in response to a display subtitle instruction input by a user based on a media asset playback interface. And obtain subtitle information, and add subtitle information to the subtitle display window. In response to a subtitle selection instruction input by a user based on the subtitle display window, obtain the selected subtitle information selected by the focus cursor when the subtitle selection instruction is received. And obtain the positioning time point associated with the selected subtitle information in the subtitle data, and play the media asset data according to the positioning time point. The method can select subtitle information, confirm the positioning time point associated with the subtitle information, and quickly position the media asset data playback progress to the positioning time point to solve the problem of low speed and accuracy of user positioning of the media asset screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solution of the present application, the drawings required for use in the embodiments are briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0019] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0020] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0021] Figure 3 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0022] Figure 4 A thumbnail of a media asset screen played at a fast-forward time point provided in some embodiments of the present application;

[0023] Figure 5 A schematic diagram of a method for locating a media asset screen provided in some embodiments of the present application;

[0024] Figure 6 A diagram of the display device system architecture provided for some embodiments of the present application;

[0025] Figure 7 A schematic diagram of a subtitle display window displayed on a display device provided in some embodiments of the present application;

[0026] Figure 8 A timing diagram of a media asset screen positioning method provided in some embodiments of the present application;

[0027] Fig. 9 A flow chart of a method for determining whether to display a subtitle positioning prompt control provided in some embodiments of the present application;

[0028] Fig.10 A schematic diagram of a subtitle positioning prompt control provided in some embodiments of the present application;

[0029] Fig.11 A schematic diagram of a method for acquiring and storing subtitle data provided in some embodiments of the present application;

[0030] Fig.12 A schematic diagram of a method for displaying subtitle information in a subtitle display window provided in some embodiments of the present application;

[0031] Fig.13 A complete schematic diagram of a subtitle display window provided for some embodiments of the present application;

[0032] Fig.14A schematic diagram of changing position information of a subtitle selection control provided in some embodiments of the present application;

[0033] Fig.15 A schematic diagram of a method for obtaining selected subtitle information by a display device 200 provided in some embodiments of the present application;

[0034] Fig.16 A schematic diagram of another method for selecting subtitle information provided in some embodiments of the present application;

[0035] Fig.17 A schematic diagram of a method for locating media asset data according to a positioning time point provided in some embodiments of the present application;

[0036] Fig.18 A schematic diagram of a media resource screen positioned by a display device according to user instructions provided in some embodiments of the present application. DETAILED DESCRIPTION

[0037] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0038] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their common and usual meanings.

[0039] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0040] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0041] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0042] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0043] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , a user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. The control device 100 is used to receive operation instructions input by the user and convert the operation instructions into control instructions that can be recognized and responded to by the display device 200. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0044] The mobile terminal 300 can be used as a control device for performing human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device for establishing a communication connection with the display device 200 and performing data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0045] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application program for controlling the display device 200 .

[0046] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0047] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0048] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0049] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0050] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures, or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0051] In some embodiments, the display 260 includes a display function component for presenting a picture, and a driving component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0052] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0053] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0054] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0055] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0056] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0057] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0058] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0059] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may control the display device 200 to provide a user interface, for example, the operating system may directly control the display device 200 to provide a user interface, or may provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0060] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device 200 .

[0061] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0062] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0063] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0064] like Figure 3 As shown, in the embodiment of the present application, the application framework layer includes a view system, managers, content providers, etc., wherein the view system can design and implement the interface and interaction of the application, and the view system includes lists, grids, text boxes, buttons, etc. The manager includes at least one of the following modules: an activity manager for interacting with all activities running in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to the application package currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0065] In some embodiments, the activity manager is used to manage the life cycle of each application and the usual navigation back function, such as controlling the exit, opening, and back of the application. The window manager is used to manage all window programs, such as obtaining the display screen size, determining whether there is a status bar, locking the screen, capturing the screen, and controlling the display window changes, for example, reducing the display window, shaking the display, distorting the display, etc.

[0066] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0067] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. Figure 3 As shown, the kernel layer may be configured with hardware drivers, and the drivers included in the kernel layer may be at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0068] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0069] In some embodiments, the display device 200 may display a specific user interface in response to a specific control instruction input by the user. For example, the display device 200 may display a home page interface in response to a power-on instruction input by the user, and may also display a corresponding media playback interface in response to a media playback instruction input by the user.

[0070] In some embodiments, the media playback interface displayed by the display device 200 includes a media playback option. The media playback option is used to play the playback media, where the playback media can be the media recorded by the display device 200 from the live media and stored in the memory. Since the memory of the display device 200 can store the complete playback media, the user can input a fast forward or fast rewind instruction for the playback media to the display device 200, so as to locate the playback media to any media screen that the user is interested in.

[0071] In order to locate the playback media to the media screen of interest, the user can input a fast forward or fast rewind command to locate the media screen through the control device 100 supporting the display device 200, such as a remote control, a remote control simulated by the mobile terminal 300, etc. Taking the control device 100 as an example, when the user inputs the fast forward or fast rewind command, the user long presses the button on the control device 100, and the control device 100 generates a key command containing a key value for the key pressed by the user, and sends the key command to the display device 200 through a wireless transmission method such as Bluetooth or infrared. In response to the received key command, the display device 200 parses the key value from the key command, and queries the control command corresponding to the key value according to the key configuration table of the control system, and then responds to the command by executing the queried control command, thereby realizing the corresponding control function.

[0072] For example, the user sends a key command for fast forwarding to the display device 200 by long pressing the right key of the remote control, and sends a key command for fast rewinding to the display device 200 by long pressing the left key of the remote control. When the playback media is fast forwarded or rewinded to the media screen that the user is interested in, the user stops long pressing the right key or stops long pressing the left key, and controls the display device 200 to locate the media screen currently selected by the user.

[0073] It should be understood that in addition to playing back media, the user can also send fast-forward or fast-rewind instructions to other media in the display device 200, including media data stored in the server 400, media data stored in applications installed on the display device 200, etc. As long as the display device 200 can play the media data with complete content, fast-forward or fast-rewind operations can be performed, and no specific limitations are made in the embodiments of the present application.

[0074] In some embodiments, when fast forwarding or rewinding, the display device 200 may display a progress bar below the media interface. Since long pressing the button on the remote control to fast forward or rewind the media increases the playing speed of the media, it is difficult for the user to accurately find the media screen of interest. Figure 4 As shown, during the fast forward or fast rewind process, a thumbnail of the media asset screen played at the current fast forward or fast rewind time point can be displayed above the progress bar, so that the user can quickly view the media asset screen at the current time point.

[0075] However, the display device 200 can play various types of media, including language media, action media, music media, etc. If the media type currently being played on the media playback interface is language media or other audio-based media, and the difference between each frame of the media is small, it will make it difficult for the user to distinguish the corresponding media content based on the preview screen, thereby reducing the speed and accuracy of the user's control of the display device 200 to position the media screen.

[0076] In some embodiments, the display device 200 can also perform a media asset screen positioning method to position the media asset screen to solve the problem of low speed and accuracy of the user's positioning of the media asset screen. In order to meet the implementation of the media asset screen positioning method, the display device 200 should at least include a display 260, a memory, and a controller 250. The display 260 is configured to display a media asset playback interface; the memory is configured to store subtitle data, the subtitle data includes subtitle information and playback time points, and the subtitle information and playback time points have an associated relationship; Figure 5 As shown, the controller 250 is configured to execute program steps corresponding to the media asset screen positioning method, including the following contents:

[0077] S100: In response to a subtitle display instruction input by a user based on a media asset playback interface, controlling a display to display a subtitle display window on the media asset playback interface.

[0078] In some embodiments, Figure 6 As shown, the display device 200 includes an application layer, that is, a view of a user interface displayed on the display 260 of the display device 200, for interacting with the user. After receiving a media playback instruction input by the user and controlling the display 260 to display the media playback interface, the display device 200 can again receive a subtitle display instruction input by the user based on the media playback interface. For example, Figure 7 As shown, if the user interface currently displayed by the display 260 is a media asset playback interface and the first media asset is being played, when the user sends a subtitle display instruction to the display device 200, the display device 200 displays a subtitle display window on the right side of the media asset playback interface to display all subtitle information contained in the first media asset.

[0079] In some embodiments, the subtitle display window may include multiple display forms. In order to reduce the obstruction of the subtitle display window on the media currently being played by the display device 200, the ratio of the display area of ​​the subtitle display window to the screen area of ​​the display 260 may be set to a first threshold, and the transparency of the subtitle display window may be set to a second threshold. For example, the display area of ​​the subtitle display window is set to half of the screen area of ​​the display 260, the position is on the right side of the display screen of the display 260, and the transparency of the subtitle display window is set to 20%, so that the user can continue to watch the media content while viewing the subtitle information, thereby improving the user experience.

[0080] In some embodiments, Figure 6As shown, the display device 200 also includes a service layer. The service layer includes a subtitle positioning prompt module, a subtitle data receiving module, a subtitle data parsing module, a subtitle data storage module, and a subtitle playback module. The display device 200 implements the media asset screen positioning method through the cooperation of various modules in the service layer. Figure 8 As shown, the display device 200 performs the media asset screen positioning method including three stages: a subtitle positioning prompt stage, a subtitle data storage stage, and a media asset screen positioning stage. The display device 200 implements the tasks of the subtitle positioning prompt stage through a subtitle positioning prompt module; implements the tasks of the subtitle data storage stage through a subtitle data receiving module, a subtitle data parsing module, and a subtitle data storage module; and implements the tasks of the media asset screen positioning stage through a subtitle playback module.

[0081] In some embodiments, the display device 200 receives a subtitle display instruction input by a user based on a media playback interface, and controls the display 260 to display a subtitle display window on the media playback interface before executing the following steps: Figure 8 In the subtitle positioning prompt stage shown, it is determined whether to display the subtitle positioning prompt control. Fig. 9 As shown, when the display device 200 determines whether to display the subtitle positioning prompt control, it can first obtain the media type and the number of subtitles of the media data currently being played (S901). The display device 200 can play different types of media, such as language media, speech media, poetry media, and action media. In the process of determining whether to display the subtitle positioning prompt control, the display device 200 first needs to obtain the media type and the number of subtitles of the media being played on the current interface, and make a joint judgment based on the media type and the number of subtitles. For example, the display device 200 obtains that the media currently being played is "Speech Contest", then the media type is speech media, and the number of subtitles obtained for "Speech Contest" is 300.

[0082] Then, prompt information is generated according to the media type and the number of subtitles (S902). In some embodiments, the type of media played by the display device 200 and the number of subtitles will affect the effectiveness of the media screen positioning method. For example, when the media type is action media, the user is more concerned about the screen content and has a low degree of dependence on subtitles, making it difficult to accurately position by selecting subtitles. Therefore, the display device 200 needs to generate different types of prompt information according to the media type and the number of subtitles.

[0083] If the media asset type is a preset type, or the number of subtitles is greater than or equal to a preset threshold, a first prompt message is generated, and the first prompt message is used to characterize the display of the subtitle positioning prompt control. For example, the preset type is non-action media assets such as language media assets, speech media assets, and poetry media assets, and the preset threshold is 100. When the media asset currently played by the display device 200 is "Poetry Recitation", that is, poetry media assets, and the number of subtitles is 350, the media asset type is a preset type, and the number of subtitles 350 is greater than the preset threshold 100, then the first prompt message is generated. Among them, the first prompt message is used to characterize the display of the subtitle positioning prompt control.

[0084] For another example, the preset types are non-action media such as language media, speech media, poetry media, and the preset threshold is 100. When the media currently played by the display device 200 is "Action Media A", that is, action media, and the number of subtitles is 200, the media type is a non-preset type, but the number of subtitles 350 is greater than the preset threshold of 100, so the first prompt information is generated.

[0085] It should be understood that the subtitle positioning prompt control can be displayed at any screen position of the display 260, and is not specifically limited in the embodiments of the present application.

[0086] If the media asset type is not a preset type, and the number of subtitles is less than a preset threshold, a second prompt message is generated, and the second prompt message is used to indicate that the subtitle positioning prompt control is not displayed. For example, the preset type is non-action media assets such as language media assets, speech media assets, and poetry media assets, and the preset threshold is 100. When the media asset currently played by the display device 200 is "Action Media Asset A", that is, action media assets, and the number of subtitles is 50, the media asset type is a non-preset type, and the number of subtitles 50 is less than the preset threshold of 100, so the second prompt message is generated. Among them, the second prompt message is used to indicate that the subtitle positioning prompt control is not displayed.

[0087] If the prompt information is to display the subtitle positioning prompt control, a subtitle positioning prompt control is generated through a subtitle positioning prompt module (S903). In some embodiments, if the prompt information generated by the display device 200 is the first prompt information, that is, to display the subtitle positioning prompt control, the display device 200 will generate a subtitle positioning prompt control through a subtitle positioning prompt module. For example, the media asset "Poetry Recitation" currently played by the display device 200 is a preset type of media asset, and the number of subtitles is 350, which is greater than the preset number of 100. At this time, the display device 200 generates the first prompt information, and generates a subtitle positioning prompt control with the words "subtitle positioning" through the subtitle positioning prompt module, which is used to prompt the user to enter a subtitle display instruction and control the display 260 to display a subtitle display window.

[0088] Finally, add a subtitle positioning prompt control to the media asset playback interface (S904). In some embodiments, after the display device 200 generates a subtitle positioning prompt control through the subtitle positioning prompt module, it can add a subtitle positioning prompt control to the media asset playback interface, and control the display 260 to display the media asset playback interface with the subtitle positioning prompt control. In order to improve the utilization rate of the subtitle positioning prompt function, the display device 200 can control the display level of the subtitle positioning prompt control to be higher than the display level of the playback control and the playback screen in the media asset playback interface. For example, when the display device 200 is playing the "Poetry Recitation" media asset, the generated prompt information is the first prompt information, then a subtitle positioning prompt control is generated through the subtitle positioning prompt module, and the display 260 is controlled to display the subtitle positioning prompt control. Fig.10 As shown, the media asset playback interface, including playback controls and playback screen, is displayed on the display 260. After the subtitle positioning prompt module generates a subtitle positioning prompt control, the display device 200 controls the display 260 to display a subtitle positioning prompt control with the words "subtitle positioning", and sets the display level of the subtitle positioning prompt control to be higher than the playback controls and playback screen in the "Poetry Recitation" media asset.

[0089] In some embodiments, after the display device 200 generates a subtitle positioning prompt control through the subtitle positioning prompt module and controls the display 260 to display the subtitle positioning prompt control, the user can input an instruction to select the subtitle positioning prompt control to control the display device 200 to generate a subtitle display window.

[0090] S200: Acquire subtitle information, and add subtitle information to the subtitle display window.

[0091] In some embodiments, when the display device 200 generates a subtitle display window in response to a user input selection instruction for a subtitle positioning prompt control, i.e., a display subtitle instruction, the display device 200 can obtain subtitle information of the currently playing media asset and add the subtitle information to the subtitle display window.

[0092] In some embodiments, the subtitle information added by the display device 200 in the subtitle display window is obtained by the display device 200 executing the following steps: Figure 8 The subtitle information is obtained in the subtitle data storage stage. Fig.11 As shown, when the display device 200 acquires and stores subtitle data, it can first respond to the media recording instruction input by the user and acquire the initial subtitle data in the media data through the subtitle data receiving module (S1101). In some embodiments, the display device 200 acquires and stores subtitle data while recording the media. First, the display device 200 receives the media recording instruction input by the user and acquires the initial subtitle data in the media data through the subtitle data receiving module.

[0093] In some embodiments, the media data recorded by the display device 200 in response to the media recording instruction may include initial subtitle data or may not include initial subtitle data. Therefore, the method for the display device 200 to obtain initial subtitle data includes two methods: directly obtaining initial subtitle data and generating initial subtitle data through a subtitle data generation module.

[0094] If the media asset data includes initial subtitle data, the initial subtitle data is directly obtained through the subtitle data receiving module. For example, the media asset recorded by the display device 200 is "Singer Contest", and the media asset content of "Singer Contest" includes initial subtitle data. Therefore, the display device 200 directly obtains the initial subtitle data through the subtitle data receiving module, and the initial subtitle data includes all subtitle information in "Singer Contest" and the appearance time point of each subtitle information.

[0095] If the media asset data does not include initial subtitle data, the subtitle data generation module needs to obtain the audio data in the media asset data, and then generate the initial subtitle data based on the audio data. For example, the media asset recorded by the display device 200 is "Diving Competition", and the media asset content of "Diving Competition" does not include initial subtitle data. Therefore, the display device 200 needs to generate initial subtitle data of "Diving Competition" through the subtitle data generation module.

[0096] In some embodiments, the subtitle data generation module includes a sound collection component, a speech recognition component and a subtitle generation component. In the process of generating initial subtitle data through the subtitle data generation module, the display device 200 can first collect the audio data of the media asset currently recorded by the display device 200 through the sound collection component. Then, the audio data is subjected to pre-processing operations such as denoising and enhancement, and feature parameters that can characterize the speech characteristics are extracted from the pre-processed audio data. The feature parameters are matched with the template through the speech recognition component to identify the corresponding text content. Then, the text content is subjected to text cleaning, error correction, sentence segmentation and other processing, and the subtitle generation component generates initial subtitle data. The generated initial subtitle data includes all subtitle information in the media asset of "Diving Competition" and the time point of appearance of each subtitle information.

[0097] After the display device 200 acquires the initial subtitle data, it can send the initial subtitle data to the subtitle data receiving module. For example, the initial subtitle data included in the "Singer Contest" is sent to the subtitle data receiving module.

[0098] After receiving the initial subtitle data, the subtitle data receiving module sends the initial subtitle data to the subtitle data parsing module (S1102). In some embodiments, after the display device 200 obtains the initial subtitle data through the subtitle data receiving module, it is necessary to further process the initial subtitle data to generate the subtitle data required by the media asset screen positioning method. Therefore, the initial subtitle data needs to be sent to the subtitle data parsing module for processing.

[0099] After receiving the initial subtitle data, the subtitle data parsing module performs mapping on the subtitle information and the playback time point so that the subtitle information and the playback time point form an association relationship, and obtains the subtitle data (S1103). In some embodiments, after the subtitle data parsing module receives the initial subtitle data, since the initial subtitle data includes the subtitle information and the generation time point of each subtitle information, that is, the playback time point, the subtitle data parsing module can perform mapping on each subtitle information in the subtitle data and the playback time point. In some embodiments, when the subtitle data parsing module performs mapping, the time code information of each subtitle information in the subtitle data can be first obtained. Then, the time code information is combined with the playback time point to form a one-to-one corresponding association relationship between the subtitle information and the playback time point. For example, the media resource currently recorded by the display device 200 is "Singer Contest", and some of the subtitle data parsed by the subtitle data parsing module include {[The moon is passing through white lotus-like clouds, 01:05:20][The evening breeze brings bursts of joyful singing, 01:05:25][We sit next to the tall grain pile, 01:05:28][Listen to mother telling stories about the past, 01:05:33]}.

[0100] S1104: Send subtitle data to the subtitle data storage module.

[0101] In some embodiments, after the subtitle data parsing module parses the initial subtitle data in the media asset currently recorded by the display device 200 to generate subtitle data, the display device 200 controls the subtitle data parsing module to send the subtitle data to the subtitle data storage module. For example, during the process of the display device 200 recording the "Singer Contest" media asset, the subtitle data parsing module sends the parsed subtitle data to the subtitle data storage module. Finally, the subtitle data storage module saves the complete subtitle data of the "Singer Contest" media asset to the display device 200.

[0102] In some embodiments, when the display device 200 receives a subtitle display instruction input by a user, it needs to obtain the complete subtitle information in the currently playing media asset from the subtitle data storage module and display the subtitle information in the subtitle display window. Fig.12As shown, when the display device 200 controls the subtitle display window to display subtitle information, the subtitle information and the playback time point associated with the subtitle information can be first obtained (S1201). In some embodiments, before displaying the subtitle information in the subtitle display window, the subtitle data of the currently playing media asset must first be obtained from the subtitle data storage module, and the complete subtitle information in the subtitle data and the playback time point associated with the subtitle information are obtained. For example, when the display device 200 is playing the "Singer Contest" media asset, the user controls the display device 200 to display the subtitle display window, and the display device 200 obtains the subtitle information in the subtitle data of the "Singer Contest" media asset and the playback time point associated with the subtitle information from the subtitle data storage module.

[0103] Then, the subtitle information is sorted in the order of the playback time points from early to late to generate ordered subtitles (S1202). In some embodiments, after the display device obtains the subtitle data, the subtitle information in the subtitle data is sorted in the order of the playback time points from early to late to generate ordered subtitles. For example, the display device 200 obtains the complete subtitle data of "Singer Contest" in response to the display subtitle instruction, and takes part of the subtitle data as an example: {[The moon is passing through the white lotus-like clouds, 01:05:20][The evening breeze blows bursts of joyful singing, 01:05:25][We sit next to the tall grain pile, 01:05:28][Listen to my mother tell about the past, 01:05:33]}. The ordered subtitles obtained by the display device 200 after sorting the above subtitle data are: {The moon is passing through the white lotus-like clouds; the evening breeze blows bursts of joyful singing; we sit next to the tall grain pile; listen to my mother tell about the past}.

[0104] Finally, the subtitle display window is controlled to display ordered subtitles (S1203). In some embodiments, when the display device 200 sorts the complete subtitle information in the currently played media and obtains ordered subtitles, the ordered subtitles can be added to the subtitle display window for the user to select the ordered subtitles according to the screen content of interest.

[0105] In some embodiments, after the display device 200 generates a subtitle display window, a subtitle selection control and a subtitle confirmation control may be added to the subtitle display window. To improve the convenience of the user in selecting subtitle information, the display level of the subtitle selection control and the subtitle confirmation control is higher than the display level of the display screen in the subtitle display window. Fig.13The complete schematic diagram of the subtitle display window includes ordered subtitles, subtitle selection controls, and subtitle confirmation controls. Among them, the complete subtitle information in the "Singer Contest" media resource is displayed as ordered subtitles in the subtitle display window. The "arrow" control is a subtitle selection control. The user controls the movement of the subtitle selection control through the direction keys on the control device 100 to select different subtitle information; the "confirm" control is a subtitle confirmation control. When the user selects the subtitle information of interest through the subtitle selection control, the "confirm" control is selected through the control device 100 to control the display device 200 to position the currently playing media resource to the screen of interest to the user.

[0106] In some embodiments, the subtitle selection control includes position information, and the position information is associated with the subtitle information. It should be noted that the number of position information included in the subtitle selection control is the same as the number of subtitle information in the currently playing media, that is, each subtitle information is associated with a position information in the subtitle selection control. Therefore, when the user controls the subtitle selection control to move to a certain position through the control device 100, the position information of this position corresponds to a unique subtitle information.

[0107] In some embodiments, when the display device 200 controls the display 260 to display the subtitle display window in response to the user input of the subtitle display instruction, the default position of the subtitle selection control is as follows: Fig.13 As shown, the position information of the subtitle selection control is associated with the first subtitle information of the currently playing media asset. When the user controls the subtitle selection control to move through the control device 100, the display position of the subtitle selection control can be set according to the position of other subtitle information.

[0108] For example, Fig.14 As shown, the media currently played by the display device 200 is "Singer Contest". When the user inputs a move instruction based on the subtitle display window and controls the subtitle selection control to move to the position corresponding to the subtitle "In the Blue Sky and the Milky Way" through the control device 100, the position information of the subtitle selection control is the position information associated with the subtitle "In the Blue Sky and the Milky Way".

[0109] It should be understood that the various controls in the subtitle display window may also be arranged in other ways, as long as the user can arbitrarily select all subtitle information of the currently playing media, and no specific limitation is made in the embodiments of the present application.

[0110] S300: In response to a subtitle selection instruction input by a user based on a subtitle display window, information of selected subtitles is obtained.

[0111] In some embodiments, when the display device 200 controls the display 260 to display the subtitle display window, and complete subtitle information has been added to the subtitle display window, the user can select any subtitle information in the currently playing media to control the display device 200 to perform the following operations: Figure 8 The media asset screen positioning stage is shown.

[0112] In some embodiments, the user can input a subtitle selection command in the subtitle display window, control the focus cursor of the subtitle selection control to move, and control the subtitle confirmation control to be in a selected state to select the subtitle information of interest, so that the display device 200 obtains the selected subtitle information. Fig.15 As shown, the method in which the display device 200 obtains the selected subtitle information in response to the subtitle selection instruction input by the user includes:

[0113] S1501: In response to a subtitle selection instruction input by a user based on a subtitle display window, obtaining position information of a subtitle selection control.

[0114] In some embodiments, the user can control the subtitle selection control to move through the control device 100 to change the position information of the subtitle selection control, thereby associating the position information of the subtitle selection control with the subtitle information that the user is interested in. After the user controls the position information of the subtitle selection control to be associated with the subtitle information of interest, the user can move the focus cursor to the subtitle confirmation control through the control device 100, and press the "Confirm" button on the control device 100 to input the subtitle selection instruction, and control the display device 200 to obtain the position information of the subtitle selection control.

[0115] For example, if the media resource currently played by the display device 200 is "Singer Contest", the user controls the subtitle display window displayed by the display device 200 by inputting a subtitle display instruction. Fig.13 When the user moves the subtitle selection control to Fig.14 When the position is changed, the user inputs a subtitle selection instruction through the control device 100, and selects Fig.14 By clicking the “Confirm” control in the subtitle selection control, the display device 200 can be controlled to obtain the position information of the current subtitle selection control.

[0116] S1502: Acquire subtitle information associated with the position information.

[0117] In some embodiments, after the display device 200 obtains the position information of the current subtitle selection control, it then obtains the subtitle information associated with the position information. Fig.14As shown, the user controls the subtitle selection control to move to the changed position and selects the subtitle confirmation control. At this time, the position information of the subtitle selection control is associated with the subtitle information "In the Blue Sky and the Milky Way", so the subtitle information obtained by the display device 200 is "In the Blue Sky and the Milky Way".

[0118] It should be understood that the user can also select the subtitle information in the subtitle display window by other methods. Fig.16 As shown, the focus cursor is controlled to move on the subtitle information, and the selected subtitle information "The blue sky and the Milky Way" is set to be highlighted. When a subtitle selection instruction is input, the display device 200 obtains the highlighted subtitle information.

[0119] S1503: Mark the subtitle information as selected subtitle information.

[0120] In some embodiments, after the display device 200 obtains the subtitle information associated with the position information of the subtitle selection control, it marks the subtitle information as the selected subtitle information. Fig.14 When the position information is changed, the user inputs a subtitle selection instruction, and the currently selected subtitle information "Blue Sky Milky Way" is the subtitle information associated with the position information of the subtitle selection control. Therefore, "Blue Sky Milky Way" is marked as the selected subtitle information.

[0121] S400: Obtaining a positioning time point in the subtitle data, and playing media asset data according to the positioning time point.

[0122] In some embodiments, when the display device 200 receives a subtitle selection instruction input by a user and obtains the selected subtitle information, it can determine the playback time point corresponding to the selected subtitle information, i.e., the positioning time point, according to the mapping relationship between the subtitle information in the subtitle data and the playback time point, and locate the media asset data according to the positioning time point to play the positioned media asset picture. Fig.17 As shown, the method for the display device 200 to locate the media asset data according to the location time point includes:

[0123] S1701: traverse the subtitle data through the subtitle playback module to obtain the playback time point associated with the selected subtitle information, and mark the playback time point as the positioning time point.

[0124] First, the display device 200 traverses the subtitle data in the subtitle data storage module through the subtitle playback module to obtain the playback time point associated with the selected subtitle information, which is the positioning time point. For example, if the selected subtitle information determined by the user through the subtitle selection instruction is "In the Blue Sky and the Milky Way", the display device 200 traverses the subtitle data of the current media resource "Singer Contest" and finds that the playback time point associated with "In the Blue Sky and the Milky Way" is 2:06:10, and marks the playback time point 2:06:10 as the positioning time point.

[0125] S1702: Obtain the positioned media asset picture played at the positioned time point in the media asset data.

[0126] In some embodiments, after the display device 200 determines the positioning time point according to the selected subtitle information, it is necessary to retrieve the positioning media asset screen played at the positioning time point in the currently played media asset data from the subtitle data storage module. For example, the media asset currently played by the display device 200 is "Singer Contest", and the positioning time point obtained is 2:06:10. Then, according to the association between the positioning time point 2:06:10 and the media asset screen, the display device retrieves the positioning media asset screen in the media asset data of "Singer Contest" as follows: Fig.18 shown.

[0127] S1703: Control the display to play the positioned media resource image.

[0128] In some embodiments, after the display device 200 retrieves the located media asset picture in the subtitle data storage module according to the located time point, it can display the located media asset picture, realizing the location function of the media asset picture that the user is interested in. For example, the media picture that the user is interested in is the picture corresponding to the subtitle information "Blue sky and Milky Way", then the display device 200 controls the display 260 to display the following Fig.18 The media assets screen shown.

[0129] Based on the above display device 200, some embodiments of the present application further provide a method for media asset screen positioning, including: in response to a display subtitle instruction input by a user based on a media asset playback interface, controlling the display to display a subtitle display window on the media asset playback interface;

[0130] Acquire subtitle information, and add the subtitle information to the subtitle display window;

[0131] In response to a subtitle selection instruction input by a user based on the subtitle display window, the selected subtitle information is obtained; wherein the selected subtitle information is the subtitle information selected by the focus cursor when the subtitle selection instruction is received;

[0132] A positioning time point is obtained in the subtitle data, and media asset data is played according to the positioning time point; wherein the positioning time point is a playing time point associated with the selected subtitle information.

[0133] It can be seen from the above technical solutions that some embodiments of the present application provide a display device and a method for positioning a media asset screen, which can control the display to display a subtitle display window on the media asset playback interface in response to a display subtitle instruction input by a user based on a media asset playback interface. And obtain subtitle information, and add subtitle information to the subtitle display window. In response to a subtitle selection instruction input by a user based on the subtitle display window, obtain the selected subtitle information selected by the focus cursor when the subtitle selection instruction is received. And obtain the positioning time point associated with the selected subtitle information in the subtitle data, and play the media asset data according to the positioning time point. The method can select subtitle information, confirm the positioning time point associated with the subtitle information, and quickly position the media asset data playback progress to the positioning time point, so as to solve the problem of low positioning speed and accuracy when the user positions the media asset screen.

[0134] The same and similar parts between the various embodiments in this specification can be referenced to each other and will not be described again here.

[0135] Those skilled in the art can clearly understand that the technology in the embodiments of the present invention can be implemented by means of software plus a necessary general hardware platform. Based on this understanding, the technical solution in the embodiments of the present invention is essentially or the part that contributes to the prior art can be embodied in the form of a software product, which can be stored in a storage medium such as ROM / RAM, a disk, an optical disk, etc., and includes a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods of various embodiments of the present invention or certain parts of the embodiments.

[0136] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

[0137] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that: include: A display, configured to display a media playback interface; A memory configured to store subtitle data, wherein the subtitle data includes subtitle information and a play time point; wherein the subtitle information and the play time point are associated with each other; The controller is configured as: In response to a subtitle display instruction input by a user based on the media asset playback interface, controlling the display to display a subtitle display window on the media asset playback interface; Acquire the subtitle information, and add the subtitle information to the subtitle display window; In response to a subtitle selection instruction input by a user based on the subtitle display window, the selected subtitle information is obtained; wherein the selected subtitle information is the subtitle information selected by the focus cursor when the subtitle selection instruction is received; A positioning time point is obtained in the subtitle data, and media asset data is played according to the positioning time point; wherein the positioning time point is a playing time point associated with the selected subtitle information.

2. The display device according to claim 1, characterized in that The controller is configured with a subtitle data receiving module, a subtitle data parsing module and a subtitle data storage module; before the controller executes a subtitle display instruction input by a user based on the media asset playback interface and controls the display to display a subtitle display window on the media asset playback interface, the controller is also configured to: In response to a media resource recording instruction input by a user, initial subtitle data in the media resource data is acquired through the subtitle data receiving module; wherein the initial subtitle data includes subtitle information and a playback time point; Sending the initial subtitle data to the subtitle data parsing module; Mapping the subtitle information and the playback time point by the subtitle data parsing module so that the subtitle information and the playback time point form an association relationship to obtain the subtitle data; The subtitle data is sent to the subtitle data storage module.

3. The display device according to claim 2, characterized in that The controller is provided with a subtitle data generating module; the controller executes a media resource recording instruction in response to a user input, and obtains initial subtitle data in the media resource data through the subtitle data receiving module, and is specifically configured as follows: Generate initial subtitle data according to the media asset data, wherein, if the media asset data includes initial subtitle data, obtain the initial subtitle data through the subtitle data receiving module; if the media asset data does not include initial subtitle data, obtain audio data in the media asset data through the subtitle data generating module, and generate initial subtitle data according to the audio data; The initial subtitle data is sent to the subtitle data receiving module.

4. The display device according to claim 1, characterized in that The controller is provided with a subtitle positioning prompt module; before the controller executes a subtitle display instruction input by a user based on the media asset playback interface and controls the display to display a subtitle display window on the media asset playback interface, the controller is further configured to: In response to a media playback instruction input by a user, controlling the display to display a media playback interface; Obtaining the media asset type and the number of subtitles of the media asset data; Generate prompt information according to the media asset type and the number of subtitles; If the prompt information is a subtitle positioning prompt control, the subtitle positioning prompt control is generated by the subtitle positioning prompt module; wherein the subtitle positioning prompt control is used to prompt the user to input the subtitle display instruction; The subtitle positioning prompt control is added to the media asset playback interface, and the display level of the subtitle positioning prompt control is higher than the display level of the playback control and the playback screen in the media asset playback interface.

5. The display device according to claim 4, characterized in that The controller generates prompt information according to the media asset type and the number of subtitles, and is specifically configured as follows: If the media asset type is a preset type, or the number of subtitles is greater than or equal to a preset threshold, generating first prompt information, wherein the first prompt information is used to indicate a subtitle positioning prompt control; If the media asset type is a non-preset type and the number of subtitles is less than a preset threshold, a second prompt information is generated, where the second prompt information is used to indicate that the subtitle positioning prompt control is not displayed.

6. The display device according to claim 4, characterized in that The controller executes a subtitle display instruction in response to a user input based on the media asset playback interface, and controls the display to display a subtitle display window on the media asset playback interface, and is specifically configured as follows: In response to a selection instruction of the subtitle positioning prompt control input by a user, generating the subtitle display window; A subtitle selection control and a subtitle confirmation control are added to the subtitle display window, and the display level of the subtitle selection control and the subtitle confirmation control is higher than the display level of the display screen in the subtitle display window; wherein the subtitle selection control includes position information, and the position information is associated with the subtitle information.

7. The display device according to claim 6, characterized in that The controller executes the subtitle selection instruction in response to the user input based on the subtitle display window to obtain the selected subtitle information, and is specifically configured as follows: In response to a subtitle selection instruction input by a user based on the subtitle display window, obtaining position information of the subtitle selection control; Acquire subtitle information associated with the position information; The subtitle information associated with the position information is marked as the selected subtitle information.

8. The display device according to claim 1, characterized in that The controller is configured with a subtitle playing module, and the controller executes obtaining a positioning time point in the subtitle data and playing media asset data according to the positioning time point, and is specifically configured as follows: Traversing the subtitle data through the subtitle playing module to obtain a playing time point associated with the selected subtitle information, and marking the playing time point as a positioning time point; Obtaining a positioned media resource picture played at the positioned time point in the media resource data; Control the display to play the positioning media image.

9. The display device according to claim 1, characterized in that: The controller executes acquiring the subtitle information and adding the subtitle information to the subtitle display window, and is specifically configured as follows: Acquire the subtitle information and a playback time point associated with the subtitle information; Sorting the subtitle information in order of the playback time points from early to late to generate ordered subtitles; The subtitle display window is controlled to display the ordered subtitles.

10. A method for locating a media asset screen, characterized in that: Applied to the display device according to any one of claims 1 to 9, the method comprising: In response to a subtitle display instruction input by a user based on a media asset playback interface, controlling the display to display a subtitle display window on the media asset playback interface; Acquire subtitle information, and add the subtitle information to the subtitle display window; In response to a subtitle selection instruction input by a user based on the subtitle display window, the selected subtitle information is obtained; wherein the selected subtitle information is the subtitle information selected by the focus cursor when the subtitle selection instruction is received; A positioning time point is obtained in the subtitle data, and media asset data is played according to the positioning time point; wherein the positioning time point is a playing time point associated with the selected subtitle information.

Images