A display device and a method for displaying subtitles

Abstract

This application provides a display device and a subtitle display method. The method, in response to a subtitle display command, calculates a first size ratio based on the image size and video size of the subtitle data, calculates a second size based on the first size of the subtitle text data, and then calculates a target size based on the second size ratio based on the screen size and video size of the display device, thereby displaying the subtitle text data at a target size and position during the display of the image subtitle data. This application improves the accuracy of subtitle text display by converting the subtitle text data in the image subtitle data according to the display size and position in the video, and also according to the display size and position on the screen, through two ratio conversions.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a method for displaying subtitles. Background Technology

[0002] A display device is a terminal device used to display images and the applications installed on it. Display devices can output different images. Users can directly view the output images or interact with the display device by inputting operation commands based on the guidance of the output images. To meet diverse and personalized user needs, display devices can install a variety of applications with different functions.

[0003] When users watch media asset videos on a display device, they can understand the meaning of the characters' speech through the subtitles displayed in the video. Subtitles in media asset videos can include two types: text subtitles and image subtitles. Text subtitles are subtitles displayed as text on the media asset screen, while image subtitles are subtitles in image format overlaid on the media asset screen. Image subtitles are transparent in areas outside the subtitle area so that users can see the media asset screen outside the subtitle area through the image subtitle.

[0004] When creating and editing image captions, they need to be edited according to the dimensions of the editing device, and during playback, they need to be displayed according to the dimensions of the playback device. When the dimensions of the editing device and the playback device are different, the text data in the image captions will not be displayed according to the pre-edited caption positions when the media video is played, resulting in incorrect display positions of the image captions. Summary of the Invention

[0005] This application provides a display device and a subtitle display method to solve the problem of incorrect display position of image subtitles.

[0006] In a first aspect, some embodiments of this application provide a display device, including a display and a controller, configured to display a user interface, wherein the display is configured to display the user interface and the controller is configured to:

[0007] In response to a subtitle display instruction, the target media asset data is parsed to obtain the image subtitle data and the video size of the target media asset data. The image subtitle data includes image data set to be transparent and subtitle text data embedded in the image data.

[0008] The initial position of the subtitle text data in the image data and the first size of the subtitle text data are obtained, wherein the first size is used to represent the set size of the subtitle text data in the editing state;

[0009] Calculate a first size ratio between the video size and the image size of the image caption data;

[0010] Based on the first size ratio and the first size, calculate the second size of the subtitle text data when it is displayed in the target media asset data, and determine the first position of the subtitle text data when it is displayed in the target media asset data based on the initial position, so as to obtain the updated image subtitle data;

[0011] Calculate a second size ratio between the screen size of the display device and the video size;

[0012] Based on the second size ratio and the second size, calculate the target size of the subtitle text data when it is displayed on the user interface, and determine the target position of the subtitle text data when it is displayed on the user interface based on the first position;

[0013] The subtitle text data is displayed at the target position according to the target size.

[0014] The above technical solution has the following advantages or beneficial effects: By acquiring the video size of the target media asset data and the first size of the subtitle text data in the image subtitle data in the editing state, a first size ratio is calculated, thereby converting the subtitle size in the editing state to the subtitle size in the media asset data. Then, according to the second size ratio between the video size and the screen size, the subtitle size in the media asset data is converted to the subtitle size for playback display, thereby displaying the subtitle text data in the image subtitle data at the target size in the corresponding position of the user interface, improving the accuracy of the displayed subtitle position and subtitle size.

[0015] In some embodiments, before performing the step of displaying the subtitle text data at the target position according to the target size, the controller is further configured to:

[0016] Obtain the target language information of the subtitle text data;

[0017] If there are other image caption data that are different from the target language information, then the intersection area between the caption position of the other image caption data and the target position is detected;

[0018] If the intersection area is not 0, then in the vertical direction, the subtitle text data is moved away from the subtitle position of the other image subtitle data.

[0019] The above technical solution has the following advantages or beneficial effects: When there are multiple image caption data in different languages, the intersection area of ​​the caption position of other image caption data and the target position of the caption text data can be determined. When the intersection area is not 0, it indicates that there is caption stacking between the caption text data in different languages. Therefore, the position of the caption text data can be adjusted in the vertical direction to avoid the image caption data in different languages ​​from obscuring each other.

[0020] In some embodiments, the controller performs the step of calculating a first size ratio between the video size and the image size of the image caption data, specifically configured to:

[0021] Calculate the first horizontal ratio between the horizontal dimension of the video size and the horizontal dimension of the image size;

[0022] Calculate a first vertical ratio between the vertical dimension of the video size and the vertical dimension of the image size;

[0023] The first size ratio is generated based on the first lateral ratio and the first longitudinal ratio.

[0024] The above technical solution has the following advantages or beneficial effects: the first horizontal ratio in the horizontal direction is calculated by using the horizontal dimension of the video size and the horizontal dimension of the image size, and the first vertical ratio in the vertical direction is calculated by using the vertical dimension of the video size and the vertical dimension of the image size, thereby generating a first size ratio based on the first horizontal ratio and the first vertical ratio.

[0025] In some embodiments, the first size includes a first horizontal size and a first vertical size, and the controller is configured to perform the step of calculating a second size of the subtitle text data when displayed in the target media asset data based on the first size ratio and the first size, wherein:

[0026] Update the first horizontal dimension to the second horizontal dimension based on the first horizontal ratio;

[0027] The first longitudinal dimension is updated to the second longitudinal dimension based on the first longitudinal ratio;

[0028] The second dimension is generated based on the second lateral dimension and the second longitudinal dimension.

[0029] The above technical solution has the following advantages or beneficial effects: by adjusting the first horizontal dimension to the second horizontal dimension according to the first horizontal ratio in both horizontal and vertical directions, and by adjusting the first vertical dimension to the second vertical dimension according to the first vertical ratio, the size and position of the subtitles can be adjusted proportionally.

[0030] In some embodiments, the controller performs the step of determining a first position for displaying subtitle text data in target media asset data based on the initial position, specifically configured to:

[0031] The horizontal position of the initial position is adjusted according to the first horizontal ratio to obtain the adjusted subtitle position;

[0032] The vertical position of the adjusted subtitle position is adjusted according to the first vertical ratio to obtain the first position.

[0033] The above technical solution has the following advantages or beneficial effects: by adjusting the horizontal position of the initial position according to the first horizontal ratio, and then adjusting the vertical position of the subtitle position according to the first vertical ratio, the first position is obtained, thereby improving the accuracy of adjusting the subtitle position.

[0034] In some embodiments, if the first size ratio is a non-integer ratio, the controller is further configured to:

[0035] Scale the target media asset data according to the image size of the image caption data;

[0036] In the target media asset data, the initial position is updated to the first position.

[0037] The above technical solution has the following advantages or beneficial effects: when the first size ratio is a non-integer ratio, it indicates that the size ratio of the image size and the video size is different. Therefore, the target media data can be scaled according to the image size and the initial position can be updated to the first position.

[0038] In some embodiments, after the controller performs the step of displaying the subtitle text data at the target location, it is further configured to:

[0039] Obtain the display threshold of the image caption data;

[0040] Record the display duration of the image caption data;

[0041] When the display duration equals the display threshold, receive the image caption end command sent by the application layer;

[0042] In response to the image caption end command, the caption text data in the image caption data is cleared.

[0043] The above technical solution has the following advantages or beneficial effects: by setting a display threshold, when the display duration is equal to the display threshold, the subtitle text data is cleared so as to facilitate the display of the subtitle text data of the next line.

[0044] In some embodiments, after the controller performs the step of clearing the subtitle text data from the image subtitle data, it is further configured to:

[0045] Obtain the next subtitle text data and the display time point of the next subtitle text data;

[0046] After the subtitle text data is cleared, when the playback progress of the target media data reaches the display time point, the display is controlled to show the next subtitle text data at the target position of the image subtitle data.

[0047] The above technical solution has the following advantages or beneficial effects: after clearing the subtitle text data, when the display time of the next subtitle text data is reached, the next subtitle text data is displayed at the target position and target size of the image subtitle data.

[0048] In some embodiments, the controller performs the step of displaying the subtitle text data at the target location, specifically configured as follows:

[0049] Obtain the playback type of the target media asset data, where the playback type includes application playback type and player playback type;

[0050] When the playback type is an application playback type, the subtitle text data is displayed at the target position according to the application's preset subtitle display method;

[0051] When the playback type is a player playback type, the image subtitle data is converted into a player format, and the subtitle text data corresponding to the player format is displayed at the target position.

[0052] The above technical solution has the following advantages or beneficial effects: it displays subtitle text data according to different playback types and display methods, thereby improving the adaptability of the displayed image subtitle data.

[0053] Secondly, this application provides a subtitle display method, applied to the display device provided in the first aspect, the method comprising:

[0054] In response to a subtitle display instruction, the target media asset data is parsed to obtain the image subtitle data and the video size of the target media asset data. The image subtitle data includes image data set to be transparent and subtitle text data embedded in the image data.

[0055] The initial position of the subtitle text data in the image data and the first size of the subtitle text data are obtained, wherein the first size is used to represent the set size of the subtitle text data in the editing state;

[0056] Calculate a first size ratio between the video size and the image size of the image caption data;

[0057] Based on the first size ratio and the first size, calculate the second size of the subtitle text data when it is displayed in the target media asset data, and determine the first position of the subtitle text data when it is displayed in the target media asset data based on the initial position, so as to obtain the updated image subtitle data;

[0058] Calculate a second size ratio between the screen size of the display device and the video size;

[0059] Based on the second size ratio and the second size, calculate the target size of the subtitle text data when it is displayed on the user interface, and determine the target position of the subtitle text data when it is displayed on the user interface based on the first position;

[0060] The subtitle text data is displayed at the target position according to the target size.

[0061] As can be seen from the above technical solutions, this application provides a display device and a subtitle display method. The method, in response to a subtitle display command, calculates a first size ratio based on the image size and video size of the image subtitle data, calculates a second size based on the first size of the subtitle text data, and then calculates a target size based on the second size ratio based on the screen size and video size of the display device, thereby displaying the subtitle text data at a target size and position during the display of the image subtitle data. This application improves the accuracy of subtitle text display by converting the subtitle text data in the image subtitle data according to the display size and position in the video, and the display size and position on the screen, through two ratio conversions. Attached Figure Description

[0062] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0063] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application;

[0064] Figure 2 This is a schematic diagram of the hardware configuration of a display device provided in some embodiments of this application;

[0065] Figure 3 This is a schematic diagram of the software configuration of a display device provided in some embodiments of this application;

[0066] Figure 4 A flowchart illustrating the process of displaying subtitles using a display device, provided in some embodiments of this application;

[0067] Figure 5 Timing diagrams for display devices performing subtitle display according to some embodiments of this application;

[0068] Figure 6 This is a schematic diagram illustrating the display of image caption data on a display device provided in some embodiments of this application;

[0069] Figure 7 A flowchart for calculating a first size ratio for a display device provided in some embodiments of this application;

[0070] Figure 8 A schematic diagram illustrating how a display device, according to a first size ratio, determines a first position based on some embodiments of this application;

[0071] Figure 9 A flowchart for calculating a second size ratio for a display device provided in some embodiments of this application;

[0072] Figure 10 A schematic diagram illustrating the display of subtitles in different languages ​​on a display device provided in some embodiments of this application;

[0073] Figure 11 A flowchart illustrating the adjustment of stacked subtitles on a display device provided in some embodiments of this application;

[0074] Figure 12 A flowchart illustrating the clearing of image caption data in a display device provided in some embodiments of this application;

[0075] Figure 13 A flowchart illustrating the display of subtitle data at a display time point provided in some embodiments of this application;

[0076] Figure 14 A flowchart illustrating how a display device displays subtitle text data according to playback type, as provided in some embodiments of this application. Detailed Implementation

[0077] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0078] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0079] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0080] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0081] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0082] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0083] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, a user can operate the display device 200 via touch operation, a mobile terminal 300, and a control device 100. The control device 100 receives user input commands and converts them into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0084] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0085] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0086] like Figure 1 The diagram also shows that the display device 200 communicates with the server 400 via various communication methods. This allows the display device 200 to communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0087] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0088] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0089] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0090] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0091] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0092] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0093] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0094] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0095] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0096] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface receives user input commands through the graphical user interface (GUI).

[0097] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0098] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0099] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0100] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0101] An operating system can be divided into different modules or levels based on the functions it implements, for example... Figure 3 As shown, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0102] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0103] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0104] like Figure 3As shown, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0105] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0106] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0107] In some embodiments, the kernel layer is a functional layer situated between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, ... Figure 3 As shown, hardware drivers can be configured in the kernel layer. The drivers included in the kernel layer can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0108] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0109] Display device 200 can perform different application functions based on various installed applications, such as browsing web pages, listening to music, and playing videos. For video playback, display device 200 can display a media asset interface after running the video playback program. This interface can include control icons corresponding to various media asset data, allowing users to generate selection commands based on the icons. Display device 200 can respond to user-inputted selection commands by playing the corresponding media asset data and displaying the corresponding media asset screen.

[0110] Display device 200 may include communication device 220. Upon receiving a selection command, it can acquire target media asset data, establish a communication connection with server 400 via communication device 220, and send a resource request for the target media asset data to server 400. Server 400 can respond to the resource request by sending the target media asset data to display device 200, enabling display device 200 to play the target media asset data, thereby completing the interactive process of video playback.

[0111] When the video content corresponding to the target media asset data includes dialogue, in order to facilitate users' understanding of the meaning of the dialogue, the display device 200 can parse the subtitle data in the target media asset data. The subtitle data includes the text data corresponding to the dialogue. The display device 200 can display the media asset screen corresponding to the target media asset data and simultaneously display the subtitle data on the media asset screen, so that users can understand the content of the dialogue in the target media asset data by watching the media asset screen and reading the displayed subtitle data.

[0112] Subtitle data can include two types: text subtitle data and image subtitle data. Text subtitle data is the subtitle data displayed as text on top of the corresponding screen of the target media asset data. Image subtitle data is the subtitle data displayed as an image on top of the corresponding screen of the target media asset data, including transparent image data and subtitle text data embedded in the image data. During the display of image subtitle data, the image subtitle data covers the media asset screen, and users can view the media asset screen through the transparent area other than the subtitle text data, thus achieving the effect of viewing the media asset screen and subtitle data simultaneously.

[0113] When creating and editing image caption data, it needs to be edited according to the size of the editing device. During playback, it needs to be displayed according to the size of the playback device. When the size of the editing device is different from that of the playback device, the text data in the image caption data will not be displayed according to the pre-edited caption position when the media video is played, resulting in incorrect display position of the image caption data.

[0114] To address the problem of displaying image caption data in the correct position, this application provides a display device 200, including a display 260 and a controller 250, wherein the display 260 is configured to display a user interface, and the controller 250 is configured to execute a caption display method. Figure 4 A flowchart illustrating the subtitle display process performed by the display device provided in this embodiment of the application. Figure 5 This is a timing diagram showing the display device 200 performing subtitle display according to an embodiment of this application. The display device 200 follows the procedure as follows: Figure 5 The timing sequence shown will trigger the caption display. See also Figure 4 and Figure 5 The method includes the following:

[0115] S100: In response to the subtitle display instruction, parse the target media asset data to obtain the image subtitle data and the video size of the target media asset data.

[0116] During the playback of target media asset data on display device 200, the user can input subtitle display commands to display device 200. Display device 200 can respond to the subtitle display commands by parsing the target media asset data to obtain the image subtitle data within the target media asset data. For example... Figure 6 As shown, the image caption data includes image data set to be transparent and caption text data embedded in the image data. The embedding method of the caption text data into the image data can include various methods, such as covering the caption text data at a specified position in the image data and splicing the data between the upper and lower layers.

[0117] S200: Obtain the initial position of the subtitle text data in the image data and the first size of the subtitle text data.

[0118] The image caption data needs to be edited in advance on an editing device, which can be another device other than the display device 200. After the editing is completed, the editing device can integrate the edited image caption data into the target media data so that when the display device 200 plays the target media data, it can parse the target media data to obtain the image caption data and display the captions.

[0119] In editing mode, the editing device can set the initial position and first size of the subtitle text data in the image subtitle data. The first size represents the set size of the subtitle text data in editing mode. The first size can be represented by font size, such as 12pt, 12pt, 12pt, 12pt, 12pt, etc., or by preset size states, such as small font, medium font, large font, etc. This embodiment does not impose specific limitations on the setting of the text size. The initial position represents the subtitle position of the subtitle text data in the image subtitle data in editing mode.

[0120] The size of the image caption data is the same as the size of the editing device used to edit the image caption data. When the size of the editing device differs from the video size of the target media asset data, during the playback of the target media asset data on the display device 200, the display position and size of the caption text data in the image caption data will deviate from the initial position based on the video size. This causes the display position of the caption text data in the image caption data to deviate from its initial position, and also causes the display size of the caption text data in the image caption data to deviate from its initial size. For example, when the resolution corresponding to the video size is 1080P, and the corresponding resolution of the editing device is 480P, when the target media asset data is displayed on the display device 200, the image caption data will be displayed according to the video size, i.e., the resolution of 1080P. Because the display resolution is different from the resolution of the editing device, a display deviation will occur when the caption text data is displayed at 1080P resolution during the playback of the target media asset data.

[0121] Therefore, the display device 200 needs to acquire the initial position of the subtitle text data within the image data and the first size of the subtitle text data, so as to facilitate subsequent adjustments to the initial position and first size to improve the accuracy of the subtitle text data display. It should be understood that image subtitle data is subtitle data in image form; therefore, the subtitle text data should always be displayed within the image area corresponding to the image data.

[0122] It should be noted that, in editing mode, the editing device can also add other data besides subtitle text data to the image subtitle data, such as icon data, non-subtitle text data, or bullet screen data. The embedding method for this data can be the same as for the subtitle text data, or other embedding methods can be used. This embodiment does not impose specific restrictions on the data content that can be added during the editing process.

[0123] S300: Calculate a first size ratio between the video size and the image size of the image caption data.

[0124] In order to adjust the display position and display size of the subtitle text data, the display device 200 can calculate a first size ratio between the video size and the image size of the image subtitle data, and then perform a first adjustment on the initial position and first size of the subtitle text data in the image subtitle data according to the first size ratio.

[0125] In some embodiments, the video size includes the video's horizontal and vertical dimensions, and the image size includes the image's horizontal and vertical dimensions. Therefore, the display device 200 may calculate the first size ratio separately for both the horizontal and vertical directions. Figure 7 As shown, the display device 200 can calculate a first horizontal ratio between the horizontal dimension of the video size and the horizontal dimension of the image size, and adjust the display position and size of the subtitle text data in the horizontal direction according to the first horizontal ratio. The display device 200 can also calculate a first vertical ratio between the vertical dimension of the video size and the vertical dimension of the image size, and adjust the display position and size of the subtitle text data in the vertical direction according to the first vertical ratio.

[0126] It should be understood that the display device 200 provided in this application does not consider the order of calculation when calculating the first horizontal ratio and the first vertical ratio. That is, the first horizontal ratio can be calculated first and then the first vertical ratio, or the first vertical ratio can be calculated first and then the first horizontal ratio, or the first horizontal ratio and the first vertical ratio can be calculated simultaneously.

[0127] After calculating the first horizontal ratio and the first vertical ratio, the display device 200 can generate a first size ratio based on the first horizontal ratio and the first vertical ratio, so as to adjust the position and size of the subtitle text data when the size of the editing device is different from the size of the playback device.

[0128] S400: Calculate the second size of the subtitle text data when it is displayed in the target media asset data based on the first size ratio and the first size, and determine the first position of the subtitle text data when it is displayed in the target media asset data based on the initial position, so as to obtain the updated image subtitle data.

[0129] After calculating the first size ratio, the display device 200 can adjust the display position and size of the subtitle text data in the image subtitle data according to the first size ratio. To this end, the display device 200 can calculate the second size of the subtitle text data when displayed in the target media asset data based on the first size ratio and the first size. It should be understood that during the above calculation process, the subtitle text data should be kept within the area displayed by the image subtitle data.

[0130] When the first size ratio is less than 1, it means the video size is relatively smaller than the image size. Therefore, the size of the subtitle text data in the image subtitle data needs to be adaptively reduced, meaning the second size is larger than the first size. When the first size ratio is greater than 1, it means the video size is relatively larger than the image size. Therefore, the size of the subtitle text data in the image subtitle data needs to be adaptively increased, meaning the second size is smaller than the first size.

[0131] After adjusting the size of the subtitle text data, it is also necessary to adjust the display position of the subtitle text data, that is, to determine the adjusted display position of the subtitle text data according to the first size ratio. In order to distinguish it from the initial position of the subtitle text data, this embodiment refers to the display position of the subtitle text data in the target media asset data as the first position.

[0132] In some embodiments, when the display device 200 adjusts the display size of the subtitle text data in the image subtitle data according to the first size ratio, it can adjust it both horizontally and vertically. The first size represents the size of the display area corresponding to the subtitle text data. The display area corresponding to the subtitle text data can be a bounded rectangular area; therefore, the first size can include a length and a width, i.e., a first vertical dimension and a first horizontal dimension, where the first vertical dimension corresponds to the width dimension and the first horizontal dimension corresponds to the length dimension.

[0133] The display device 200 can update the first horizontal dimension to a second horizontal dimension based on a first horizontal ratio. The second horizontal dimension can be the product of the first horizontal dimension and the first horizontal ratio. If the first horizontal ratio is less than 1, the second horizontal dimension is smaller than the first horizontal dimension, meaning the subtitle text data is reduced in the horizontal direction. If the second horizontal ratio is greater than 1, the second horizontal dimension is larger than the first horizontal dimension, meaning the subtitle text data is enlarged in the horizontal direction. The display device 200 can also update the first vertical dimension to a second vertical dimension based on a first vertical ratio. The second vertical dimension can be the product of the first horizontal dimension and the first vertical ratio. If the first vertical ratio is less than 1, the second vertical dimension is smaller than the first horizontal dimension, meaning the subtitle text data is reduced in the vertical direction. If the second vertical ratio is greater than 1, the second vertical dimension is larger than the first vertical dimension, meaning the subtitle text data is enlarged in the vertical direction. The display device 200 can generate a second dimension based on the second horizontal dimension and the second vertical dimension.

[0134] It should be understood that this embodiment does not show the adjustment order of the first horizontal dimension and the first vertical dimension. The first horizontal dimension and the first vertical dimension can be adjusted sequentially, that is, the first horizontal dimension can be adjusted first, and then the first vertical dimension can be adjusted, or the first vertical dimension can be adjusted first, and then the first horizontal dimension can be adjusted. The display device 200 can also adjust the first horizontal dimension and the first vertical dimension simultaneously.

[0135] In some embodiments, when the display device 200 determines the first position of the subtitle text data when it is displayed in the target media asset data based on the initial position of the subtitle text data, the position can also be adjusted by a first size ratio, such as... Figure 8 As shown, the horizontal position of the initial position can be adjusted according to the first horizontal ratio to obtain the adjusted subtitle position. Then, the vertical position of this adjusted subtitle position can be adjusted according to the first vertical ratio to obtain the first position. It should be understood that... Figure 8 The difference between the initial position and the first position shown is only for illustrating the process of position change. In practical applications, the display device 200 can make small position adjustments based on factors such as the length of the subtitle text data.

[0136] S500: Calculate a second size ratio between the screen size of the display device and the video size.

[0137] Display device 200 needs to display target media data through monitor 260. Therefore, display device 200 also needs to convert the image caption data from video size to the screen size of display device 200. For this purpose, such as... Figure 9 As shown, the display device 200 can obtain its screen size and calculate a second size ratio between the screen size and the video size. The calculation of the second size ratio can be performed in the same way as the calculation of the first size ratio. The screen size can include both the horizontal and vertical dimensions; therefore, the display device 200 can calculate the second horizontal ratio using the horizontal screen size and the horizontal video size. Similarly, in the vertical direction, the second vertical ratio can be calculated using the vertical screen size and the vertical video size, thereby generating a second size ratio based on the second horizontal ratio and the second vertical ratio.

[0138] S600: Calculate the target size of the subtitle text data when it is displayed on the user interface based on the second size ratio and the second size, and determine the target position of the subtitle text data when it is displayed on the user interface based on the first position.

[0139] The display of subtitle text data on the user interface needs to be based on the screen size of the display device 200. Therefore, in order to obtain the size of the subtitle text data when displayed on the user interface, the display device 200 can calculate the target size of the subtitle text data on the user interface based on the second size ratio and the second size.

[0140] After obtaining the target size, the display device 200 can calculate the target position of the subtitle text data when it is finally displayed in the user interface of the display device 200, based on the second size ratio and the first position of the subtitle text data in the target media asset data.

[0141] In some embodiments, the display device 200 may adjust the position of the second position in the horizontal direction according to a second horizontal ratio to obtain an adjusted first position. Then, according to a second vertical ratio, the adjusted second position is adjusted in the vertical direction to obtain the second position.

[0142] S700: Display the subtitle text data at the target position according to the target size.

[0143] After determining the target size and target position, the display device 200 can display the subtitle text data at the target position of the image subtitle data according to the target size during the process of displaying image subtitle data, thereby improving the accuracy of subtitle display.

[0144] When acquiring subtitles, the image subtitle data needs to be parsed sequentially. For target media data with subtitles in multiple languages, the display device 200 can parse and obtain image subtitle data in different languages. When a user requires the display of subtitles in multiple languages, the display device 200 will simultaneously display image subtitle data in multiple different languages.

[0145] Different image caption data can be overlaid to display simultaneously. For example, Chinese and English image caption data can be overlaid on top of the media asset, allowing both English and Chinese captions to be displayed concurrently. However, because different image caption data are created using different methods, using the same parsing method may result in incorrect display positions of the image captions, causing the image caption data of different languages ​​to overlap during display. Figure 10 As shown, the upper layer of the display screen includes one layer of image caption data in English and one layer in Chinese. The caption text data in the two image caption data are in the same position. When the two image caption data are simultaneously overlaid on the media asset screen, the English caption data and the Chinese caption data will overlap, affecting the user's viewing of the captions.

[0146] Based on this, before displaying subtitle text data at the target location, the display device 200 can obtain the target language information of the subtitle text data. During the parsing of the target media asset data, if other image subtitle data exists that differs from the target language information, the intersection area between the subtitle positions of the other image subtitle data and the target position is detected. For example, such as... Figure 11 As shown, when the target language information is Chinese, and the display device 200 also detects other languages ​​besides Chinese, such as English subtitle data, the display device 200 can determine the subtitle position of the subtitle text data in the image subtitle data corresponding to the English language, thereby detecting the intersection area between the subtitle position of the English subtitle data and the target position to be displayed in the Chinese subtitle data.

[0147] If the intersection area is not zero, it indicates that the English subtitle data and the target position of the Chinese subtitle data intersect, resulting in mutual occlusion between the subtitles. Therefore, it is necessary to move either the Chinese or English subtitle data. Taking moving the Chinese subtitle data as an example, since the content size of the subtitle text data is not fixed, longer subtitle text data will occupy a larger display area in the horizontal display direction. To avoid occlusion of long text in the horizontal direction, the display device 200 can move the Chinese subtitle data in the vertical direction away from the subtitle position of the English subtitle data, thereby gradually reducing the intersection area between the Chinese and English subtitle data and thus reducing mutual occlusion between subtitles of different languages.

[0148] In some embodiments, when the image size and video size are non-integer ratios, the calculated first size ratio is also a non-integer ratio, meaning the video size and image size are not proportional. For example, when the video size is 16:9 and the image size is 4:3, the ratio is a non-integer ratio. Therefore, when the first size ratio is a non-integer ratio, it is necessary to scale the image size or video size to determine the first position.

[0149] In the first case, the display device 200 can scale the target media asset data according to the image size of the image caption data so that the video size of the target media asset data is the same as the image size. During the scaling of the target media asset data, the size and position of the caption text data in the image caption data remain unchanged. At this time, the initial position of the caption text data is the first position, and the display device 200 can update the initial position to the first position.

[0150] In the second scenario, the display device 200 can maintain the video and image sizes unchanged, and move the smaller data element into the other data element, then display them centered and merged. For example, when the video size is smaller than the image size, the display device 200 moves the media asset corresponding to the target media asset data into the image caption data's corresponding image caption screen and displays it centered, thus determining the first position based on the position of the caption text data during centered display. When the video size is larger than the image size, the display device 200 moves the image caption data's corresponding image caption data into the media asset screen corresponding to the target media asset data, thereby determining the first position of the caption text data.

[0151] In some embodiments, for the same language, multiple frames of image caption data may be included. The image caption data can be displayed according to the speaking duration of the characters in the target media asset data. For example, if the duration of a character's line in the target media asset data is 5 seconds, the display device 200 will display the image caption data for a duration of 5 seconds. When the character speaks the next line, the display device 200 will switch the image caption data to display the image caption data corresponding to the next line.

[0152] However, when the interval between lines spoken by the same character or different characters is long, the image subtitle data corresponding to the line interval will be treated as empty subtitle data, that is, no new subtitle data will be replaced or updated. Therefore, the display device 200 will continue to display the current image subtitle data until the target media data shows a character speaking new lines.

[0153] To address the issue where characters in the target media asset data do not speak their lines, but the image captions continue to be displayed, such as... Figure 12 As shown, the display device 200 can acquire the display threshold of the image caption data. The display threshold is the duration for which the image caption data should be displayed, and it can be set by the duration of the dialogue spoken by the characters in the target media asset data. Different display thresholds correspond to different lengths of dialogue content. For example, for short dialogue, a relatively short display threshold can be set, such as a 1-second display threshold for the dialogue "Hello". For long dialogue, a relatively long display threshold can be set, such as a 3-5 second display threshold for the dialogue "The weather is nice today, let's go play basketball later".

[0154] It should be noted that the display threshold can also be set in conjunction with the speaking speed of the characters. For example, for long text dialogue, if the characters in the target media data speak at a fast speed, the duration of the long text dialogue may be shorter than the duration of other short text dialogues with normal or slow speaking speeds.

[0155] Display device 200 can record the display duration of image caption data. The display duration can be started from when display device 200 switches to image caption data. When the display duration equals the display threshold, the application layer can generate an image caption end command. Display device 200 can receive the image caption end command sent by the application layer and, in response to the image caption end command, clear the caption text data in the image caption data. In this way, when the characters in the target media data have not yet spoken their lines, display device 200 can clear the image caption data, improving the user's viewing experience.

[0156] In some embodiments, when multiple languages' subtitle text data are displayed simultaneously, multiple languages' subtitle text data can be displayed simultaneously in the same image subtitle data. In this way, when switching subtitles between different lines, switching an image subtitle data set can update the subtitle text data of multiple languages ​​at the same time, improving subtitle update efficiency and saving image subtitle data resource usage.

[0157] In some embodiments, when displaying the current image caption data, the display device 200 can also obtain the next caption text data and the display time point of the next caption text data based on the current caption text data. The display time point corresponds to the time point when the character speaks next in the target media data. For example... Figure 13 As shown, after the current character finishes speaking, the display device 200 responds to the image subtitle end command, clears the subtitle text data, detects the playback progress of the target media data, and when the playback progress of the target media data reaches the display time point, controls the display 260 to display the next subtitle text data at the target position of the image subtitle data, thereby realizing the switching of different subtitle text data in the image subtitle data.

[0158] In some embodiments, the image caption data may also employ different display methods depending on the playback type of the target media asset data. To this end, the display device 200 can obtain the playback type of the target media asset data, such as... Figure 14 As shown, playback types include application playback type and player playback type. Application playback type involves playback via a video playback application. After parsing the image subtitle data, the display device 200 calculates the target position and size, and then sends the image subtitle data, target position, and target size to the application layer. The application layer calls a pre-set display program within the video playback application, which may include the video playback application's preset subtitle display method. The display device 200 can use the video playback application as the playback medium and display the image subtitle data according to the target media data's playback progress and subtitle display method, based on the target position and target size, to intelligently display subtitles and improve display efficiency and accuracy. Player playback type involves directly playing the target media data using the display device 200's player program. However, some target media data may have a different playback format than the player's initial playback format. The display device 200 needs to perform format conversion on the target media data. During this conversion, the display device 200 can simultaneously perform format conversion on the image subtitle data, thus converting the image subtitle data to the player's format when the subtitle format differs from the player's format. After the format conversion is complete, the subtitle text data corresponding to the player's format can be displayed at the target location.

[0159] This application also provides a subtitle display method applied to a display device 200. To facilitate the execution of the method, the display device 200 should include at least a display 260 and a controller 250. The method includes:

[0160] S100: In response to a subtitle display instruction, parse the target media asset data to obtain the image subtitle data and the video size of the target media asset data. The image subtitle data includes image data set to be transparent and subtitle text data embedded in the image data.

[0161] S200: Obtain the initial position of the subtitle text data in the image data and the first size of the subtitle text data.

[0162] Wherein, the first size is used to represent the set size of the subtitle text data in the editing state.

[0163] S300: Calculate a first size ratio between the video size and the image size of the image caption data.

[0164] S400: Calculate the second size of the subtitle text data when it is displayed in the target media asset data based on the first size ratio and the first size, and determine the first position of the subtitle text data when it is displayed in the target media asset data based on the initial position, so as to obtain the updated image subtitle data.

[0165] S500: Calculate a second size ratio between the screen size of the display device and the video size.

[0166] S600: Calculate the target size of the subtitle text data when it is displayed on the user interface based on the second size ratio and the second size, and determine the target position of the subtitle text data when it is displayed on the user interface based on the first position.

[0167] S700: Display the subtitle text data at the target position according to the target size.

[0168] As can be seen from the above technical solutions, this application provides a display device and a subtitle display method. The method, in response to a subtitle display command, calculates a first size ratio based on the image size and video size of the image subtitle data, calculates a second size based on the first size of the subtitle text data, and then calculates a target size based on the second size ratio based on the screen size and video size of the display device, thereby displaying the subtitle text data at a target size and position during the display of the image subtitle data. This application improves the accuracy of subtitle text display by converting the subtitle text data in the image subtitle data according to the display size and position in the video, and the display size and position on the screen, through two ratio conversions.

[0169] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0170] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0171] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0172] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The monitor is configured to display the user interface; The controller is configured as follows: In response to a subtitle display instruction, the target media asset data is parsed to obtain the image subtitle data and the video size of the target media asset data. The image subtitle data includes image data set to be transparent and subtitle text data embedded in the image data. The initial position of the subtitle text data in the image data and the first size of the subtitle text data are obtained, wherein the first size is used to represent the set size of the subtitle text data in the editing state; Calculate a first size ratio between the video size and the image size of the image caption data; Based on the first size ratio and the first size, calculate the second size of the subtitle text data when it is displayed in the target media asset data, and determine the first position of the subtitle text data when it is displayed in the target media asset data based on the initial position and the first size ratio, so as to obtain the updated image subtitle data; Calculate a second size ratio between the screen size of the display device and the video size; Calculate the target size of the subtitle text data when it is displayed on the user interface based on the second size ratio and the second size, and determine the target position of the subtitle text data when it is displayed on the user interface based on the first position and the second size ratio; The subtitle text data is displayed at the target position according to the target size.

2. The display device according to claim 1, characterized in that, Before executing the step of displaying the subtitle text data at the target position according to the target size, the controller is further configured to: Obtain the target language information of the subtitle text data; If there are other image caption data that are different from the target language information, then the intersection area between the caption position of the other image caption data and the target position is detected; If the intersection area is not 0, then in the vertical direction, the subtitle text data is moved away from the subtitle position of the other image subtitle data.

3. The display device according to claim 1, characterized in that, The controller performs the step of calculating a first size ratio between the video size and the image size of the image caption data, specifically configured as follows: Calculate the first horizontal ratio between the horizontal dimension of the video size and the horizontal dimension of the image size; Calculate a first vertical ratio between the vertical dimension of the video size and the vertical dimension of the image size; The first size ratio is generated based on the first lateral ratio and the first longitudinal ratio.

4. The display device according to claim 3, characterized in that, The first size includes a first horizontal size and a first vertical size. The controller is configured to perform the step of calculating a second size for displaying the subtitle text data in the target media asset data based on the first size ratio and the first size. Update the first horizontal dimension to the second horizontal dimension based on the first horizontal ratio; The first longitudinal dimension is updated to the second longitudinal dimension based on the first longitudinal ratio; The second dimension is generated based on the second lateral dimension and the second longitudinal dimension.

5. The display device according to claim 3, characterized in that, The controller performs the step of determining the first position of the subtitle text data when it is displayed in the target media asset data based on the initial position, and is specifically configured as follows: The horizontal position of the initial position is adjusted according to the first horizontal ratio to obtain the adjusted subtitle position; The vertical position of the adjusted subtitle position is adjusted according to the first vertical ratio to obtain the first position.

6. The display device according to claim 1, characterized in that, If the first size ratio is a non-integer ratio, the controller is further configured to: Scale the target media asset data according to the image size of the image caption data; In the target media asset data, the initial position is updated to the first position.

7. The display device according to claim 1, characterized in that, After the controller performs the step of displaying the subtitle text data at the target location, it is further configured to: Obtain the display threshold of the image caption data; Record the display duration of the image caption data; When the display duration equals the display threshold, receive the image caption end command sent by the application layer; In response to the image caption end command, the caption text data in the image caption data is cleared.

8. The display device according to claim 7, characterized in that, After the controller performs the step of clearing the subtitle text data from the image subtitle data, it is further configured to: Obtain the next subtitle text data and the display time point of the next subtitle text data; After the subtitle text data is cleared, when the playback progress of the target media data reaches the display time point, the display is controlled to show the next subtitle text data at the target position of the image subtitle data.

9. The display device according to claim 1, characterized in that, The controller is specifically configured to perform the step of displaying the subtitle text data at the target position as follows: Obtain the playback type of the target media asset data, where the playback type includes application playback type and player playback type; When the playback type is an application playback type, the subtitle text data is displayed at the target position according to the application's preset subtitle display method; When the playback type is a player playback type, the image subtitle data is converted into a player format, and the subtitle text data corresponding to the player format is displayed at the target position.

10. A method for displaying subtitles, characterized in that, Applied to a display device, the display device including a display and a controller, the display being configured to display a user interface, the method includes: In response to a subtitle display instruction, the target media asset data is parsed to obtain the image subtitle data and the video size of the target media asset data. The image subtitle data includes image data set to be transparent and subtitle text data embedded in the image data. The initial position of the subtitle text data in the image data and the first size of the subtitle text data are obtained, wherein the first size is used to represent the set size of the subtitle text data in the editing state; Calculate a first size ratio between the video size and the image size of the image caption data; Based on the first size ratio and the first size, calculate the second size of the subtitle text data when it is displayed in the target media asset data, and determine the first position of the subtitle text data when it is displayed in the target media asset data based on the initial position and the first size ratio, so as to obtain the updated image subtitle data; Calculate a second size ratio between the screen size of the display device and the video size; Calculate the target size of the subtitle text data when it is displayed on the user interface based on the second size ratio and the second size, and determine the target position of the subtitle text data when it is displayed on the user interface based on the first position and the second size ratio; The subtitle text data is displayed at the target position according to the target size.

Images