Subtitle brightness adjustment method and related equipment

Abstract

The present application relates to the field of computer technology, and provides a subtitle brightness adjustment method and related equipment. The subtitle brightness adjustment method can be applied to a terminal device including a display screen. The subtitle brightness adjustment method may include: obtaining the brightness level of subtitles in a high dynamic range (HDR) video, and obtaining the screen backlight brightness of the display screen before playing the HDR video; determining a subtitle brightness adjustment parameter based on the screen backlight brightness; updating the subtitle brightness level based on the subtitle brightness adjustment parameter, and displaying the subtitle based on the updated brightness level. By using the above method, the brightness of subtitles in an HDR video is adjusted based on the screen backlight brightness of the terminal device before playing the HDR video, which can solve the problem of excessive brightness of subtitles causing glare to users during the HDR video playback process, and improve the user's viewing experience.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a subtitle brightness adjustment method and related equipment. Background Art

[0002] Compared with the traditional standard dynamic range (SDR), high dynamic range (HDR) technology can express richer brightness details and dark details, making the entire picture richer and presenting better picture quality.

[0003] In the related art, when playing HDR videos, the picture can be processed by increasing the picture brightness and expanding the dynamic range, thereby improving the image playback effect. However, when the picture brightness is adjusted, the subtitle brightness will also be adjusted. Since the subtitles in the video are usually white, subtitles with too high brightness are more likely to produce a glaring feeling, affecting the user's viewing experience. Summary of the invention

[0004] In view of the above, it is necessary to provide a subtitle brightness adjustment method and related equipment to solve the problem that the brightness of HDR video subtitles is too high and causes glare to users.

[0005] In a first aspect, the present application provides a subtitle brightness adjustment method, which is applied to a terminal device, the terminal device including a display screen, and the subtitle brightness adjustment method including: obtaining the brightness level of subtitles in an HDR video, and obtaining the screen backlight brightness of the display screen before playing the HDR video; determining a subtitle brightness adjustment parameter based on the screen backlight brightness; updating the brightness level of the subtitles based on the subtitle brightness adjustment parameter, and displaying the subtitles based on the updated brightness level.

[0006] By adopting the above technical solution, when playing an HDR video, the brightness of the subtitles in the HDR video is adjusted based on the screen backlight brightness of the terminal device before playing the HDR video, so that the subtitle brightness can be adapted to the screen backlight brightness before playing the HDR video. The color of the subtitles is generally white, which can avoid the dazzling feeling of overly bright white subtitles to the user's eyes. In addition, since the brightness of HDR subtitles is reduced, the power consumption of the display screen can also be reduced, thereby increasing the battery life of the terminal device.

[0007] In one possible implementation, subtitle brightness adjustment parameters are determined based on the screen backlight brightness, including: obtaining the user's viewing time, where the viewing time is determined based on one of the screen-on time of the terminal device, the playback time of the HDR video, and the running time of the video application in the terminal device; and determining the subtitle brightness adjustment parameters based on the viewing time and the screen backlight brightness.

[0008] With the above technical solution, since the human eye will easily cause visual fatigue if it watches highlighted subtitles for a long time, the brightness of the subtitles in the HDR video is adjusted by further setting the screen backlight brightness of the terminal device before playing the HDR video and the user's viewing time, so that the subtitle brightness can be adapted to the screen backlight brightness before playing the HDR video and matched with the viewing time, and the subtitle brightness can be reduced as the viewing time increases. The present application can also determine the user's viewing time according to the screen-on time of the terminal device, the playback time of the HDR video, or the running time of the video application in the terminal device. For example, the screen-on time of the terminal device on that day, or the playback time of the HDR video, or the running time of the video application in the terminal device on that day is used as the user's viewing time. The running time of the video application may refer to the running time of the application that plays the HDR video, or the total running time of all video applications installed on the terminal device. The screen-on time of the terminal device, the playback time of the HDR video, and the running time of the video application in the terminal device can be obtained by obtaining the device or application operation record.

[0009] In a possible implementation, the viewing time is re-determined according to a preset reset time.

[0010] By adopting the above technical solution, the preset reset time can be in units of days or in units of preset screen-off time. By setting the user's viewing time in units of days or in units of preset screen-off time, the time is cleared and re-determined, and the brightness adjustment of the subtitles is linked to human eye fatigue / device usage habits, thereby further improving the user's viewing experience.

[0011] In a possible implementation, obtaining the viewing time of the user includes: when playing the HDR video, obtaining the viewing time at intervals of a first preset time.

[0012] By adopting the above technical solution, since the brightness adaptation value of the subtitles is set to be related to the viewing time, in order to avoid frequently updating the brightness adaptation value of the subtitles based on the viewing time, by setting the terminal device to update the brightness value of the subtitles once every first preset time after playing the HDR video, the terminal device is avoided from frequently changing the brightness of the HDR video subtitles, which can further enhance the user's viewing experience and reduce screen power consumption. The first preset time can be set according to actual needs, for example, the first preset time is 0.5h, 0.6h, etc.

[0013] In a possible implementation, the subtitle brightness adjustment parameter includes a brightness adaptation value of the subtitle, and updating the brightness level of the subtitle based on the subtitle brightness adjustment parameter includes: updating the brightness level of the subtitle to a brightness level corresponding to the brightness adaptation value, wherein the brightness adaptation value of the subtitle is positively correlated with the brightness value of the screen backlight brightness before playing the HDR video, and negatively correlated with the viewing time of the user.

[0014] By adopting the above technical solution, the brightness adaptation value of the subtitles is determined based on the screen backlight brightness before playing the HDR video and the user's viewing time, and the brightness adaptation value of the subtitles is positively correlated with the brightness value of the screen backlight brightness before playing the HDR video, and negatively correlated with the user's viewing time. That is, the higher the screen backlight brightness before playing the HDR video, the higher the subtitle brightness, so as to avoid the dazzling feeling of high-brightness white subtitles to the user's eyes before and after playing the HDR video, and as the viewing time increases, the brightness of the HDR subtitles decreases, so as to avoid visual fatigue caused by watching high-brightness subtitles for a long time.

[0015] In a possible implementation, the subtitle brightness adjustment parameter includes a brightness adjustment value or a brightness adjustment rate of the subtitle, and updating the brightness level of the subtitle based on the subtitle brightness adjustment parameter includes: determining a brightness setting value of the subtitle based on the brightness level of the subtitle; updating the brightness setting value of the subtitle based on the brightness adjustment value or the brightness adjustment rate of the subtitle; determining a first target brightness level of the subtitle based on the updated brightness setting value; updating the brightness level of the subtitle to the first target brightness level, wherein the brightness adjustment value or the brightness adjustment rate of the subtitle is negatively correlated with the brightness value of the screen backlight brightness before playing the HDR video, and positively correlated with the viewing time.

[0016] By adopting the above technical solution, the brightness adjustment value or brightness adjustment rate (for example, percentage, thousandth, etc.) of the subtitles is determined based on the screen backlight brightness before playing the HDR video and the user's viewing time, and the brightness adjustment value or brightness adjustment rate of the subtitles is set to be negatively correlated with the brightness value of the screen backlight brightness before playing the HDR video, and positively correlated with the user's viewing time, so that the higher the screen backlight brightness before playing the HDR video, the lower the brightness adjustment value or brightness adjustment rate, so as to avoid the dazzling feeling of the user's eyes caused by the high-brightness white subtitles before and after playing the HDR video, and as the viewing time increases, the brightness of the HDR subtitles decreases, so as to avoid visual fatigue caused by watching high-brightness subtitles for a long time.

[0017] In a possible implementation, displaying subtitles based on the updated brightness level includes: obtaining the screen backlight brightness when playing the HDR video, and displaying subtitles based on the screen backlight brightness when playing the HDR video and the updated brightness level.

[0018] By adopting the above technical solution, after updating the brightness level of the subtitles based on the screen backlight brightness before playing the HDR video, or based on the screen backlight brightness before playing the HDR video and the user's viewing time, the brightness level of the subtitles can be further updated based on the screen backlight brightness when playing the HDR video, so that the subtitle brightness can be adjusted as the user manually adjusts the screen backlight brightness, further improving the user's viewing experience.

[0019] In one possible implementation, subtitles are displayed based on the screen backlight brightness when playing an HDR video and an updated brightness level, including: determining a difference between the screen backlight brightness when playing the HDR video and a reference backlight brightness corresponding to the HDR video; determining a second target brightness level for the subtitles based on the difference and the updated brightness level; and displaying the subtitles based on the second target brightness level.

[0020] By adopting the above technical solution, the screen backlight brightness when the device plays HDR video normally can be used as the reference backlight brightness, and the updated brightness level can be adjusted again based on the difference between the screen backlight brightness when the HDR video is currently played and the reference backlight brightness corresponding to the HDR video. The larger the difference, the greater the adjustment range, so that the subtitle brightness can also be adjusted as the user manually adjusts the screen backlight brightness. The reference backlight brightness can also be set according to actual needs, for example, pre-defined by the developer.

[0021] In one possible implementation, the terminal device includes a brightness sensor and displays subtitles based on an updated brightness level, including: when playing an HDR video, determining the ambient brightness using brightness data collected by the brightness sensor at every second preset time interval; and displaying subtitles based on the ambient brightness and the updated brightness level.

[0022] By adopting the above technical solution, after adjusting the brightness level of the subtitles based on the screen backlight brightness before playing the HDR video and the user's viewing time, the brightness level of the subtitles can be further adjusted based on the ambient brightness when the HDR video is currently playing, so that the subtitle brightness can be adjusted as the ambient brightness changes, further improving the user's viewing experience.

[0023] In one possible implementation, displaying subtitles based on ambient brightness and an updated brightness level includes: determining a difference between ambient brightness and a reference ambient brightness corresponding to an HDR video; determining a third target brightness level for the subtitles based on the difference and the updated brightness level; and displaying the subtitles based on the third target brightness level.

[0024] By adopting the above technical solution, the benchmark ambient brightness corresponding to the HDR video can be set according to actual needs and stored in the terminal device. The terminal device can also adjust the updated brightness level again based on the difference between the ambient brightness when the HDR video is currently playing and the benchmark ambient brightness corresponding to the HDR video. The larger the difference, the greater the adjustment range, so that the subtitle brightness can also be adjusted according to the ambient brightness.

[0025] In one possible implementation, obtaining the screen backlight brightness before playing the HDR video includes: obtaining multiple screen backlight brightness values ​​of the display screen within a preset time period before playing the HDR video; and determining the screen backlight brightness of the display screen before playing the HDR video based on the multiple screen backlight brightness values.

[0026] By adopting the above technical solution, the moment of playing the HDR video can be taken as the current moment, and multiple screen backlight brightness values ​​within a preset time period from the current moment can be obtained. For example, the mean, median, etc. of the multiple screen backlight brightness values ​​can be used as the screen backlight brightness before playing the HDR video, so as to more accurately characterize the screen backlight brightness before playing the HDR video, set the subtitle brightness to match the screen backlight brightness before playing the HDR video, and avoid the dazzling feeling of the bright white subtitles to the user's eyes before and after playing the HDR video.

[0027] In one possible implementation, obtaining the screen backlight brightness of the display screen before playing the HDR video includes: obtaining the screen backlight brightness of the SDR video played before playing the HDR video; and determining the screen backlight brightness of the display screen before playing the HDR video based on the screen backlight brightness of the SDR video.

[0028] By adopting the above technical solution, the screen backlight brightness of the SDR video played before the HDR video is played can be used as the screen backlight brightness of the display screen before the HDR video is played. For example, the mean or median of the screen backlight brightness during the SDR video playback process can be used as the screen backlight brightness before the HDR video is played, so as to more accurately characterize the screen backlight brightness before the HDR video is played, set the subtitle brightness to match the screen backlight brightness before the HDR video is played, and avoid the dazzling feeling of the bright white subtitles to the user's eyes before and after the HDR video is played.

[0029] In a second aspect, an embodiment of the present application provides a terminal device, including a memory and a processor, wherein the memory is used to store computer-readable instructions; the processor is used to read the computer-readable instructions and implement the method provided by the first aspect and its optional implementation method.

[0030] In a third aspect, an embodiment of the present application provides a computer storage medium storing computer-readable instructions, and the computer-readable instructions, when executed by a processor, implement the method provided by the first aspect and its optional implementation.

[0031] In a fourth aspect, an embodiment of the present application provides a computer program product, which includes computer-readable instructions. When the computer-readable instructions are executed by a processor, the method provided by the first aspect and its optional implementation method is implemented.

[0032] The technical effects obtained by the above-mentioned second, third and fourth aspects are similar to the technical effects obtained by the corresponding technical means in the first or second aspect, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0033] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0034] Figure 1 A schematic diagram of an SDR photoelectric conversion curve provided in an embodiment of the present application;

[0035] Figure 2 A schematic diagram of an HDR photoelectric conversion curve provided in an embodiment of the present application;

[0036] Figure 3 A schematic diagram of an application scenario of the subtitle brightness adjustment method provided in an embodiment of the present application;

[0037] Figure 4 A schematic diagram of the subtitle display effect of playing an SDR video on a terminal device provided in an embodiment of the present application;

[0038] Figure 5 A schematic diagram of the subtitle display effect of playing an HDR video on a terminal device provided in an embodiment of the present application;

[0039] Figure 6 A schematic diagram of a process for adjusting the subtitle brightness of an HDR video by a terminal device provided in an embodiment of the present application;

[0040] Figure 7 A schematic diagram of a process for adjusting the brightness level of subtitles in an HDR video by a terminal device provided in an embodiment of the present application;

[0041] Figure 8 A schematic diagram of a process for adjusting the subtitle brightness of an HDR video by a terminal device provided in an embodiment of the present application;

[0042] Fig. 9 A schematic diagram of a flow chart of a subtitle brightness adjustment method provided in an embodiment of the present application;

[0043] Fig.10 A software architecture diagram of a terminal device provided in an embodiment of the present application;

[0044] Fig.11 A software architecture diagram for implementing brightness settings of HDR video images and subtitles in a terminal device provided in an embodiment of the present application;

[0045] Fig.12 A schematic diagram of the structure of a terminal device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] The following will describe the technical solutions in the embodiments of the present application in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0047] In the following, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, words such as "exemplary", "or", "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary", "or", "for example" is intended to present related concepts in a concrete way.

[0048] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by technicians in the technical field of the present application. The terms used in the specification of the present application are only for the purpose of describing specific embodiments and are not intended to limit the present application. It should be understood that, unless otherwise specified in the present application, " / " means or. For example, A / B can represent A or B. "And / or" in the present application is only a kind of association relationship describing associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. "At least one" means one or more. "Multiple" means two or more than two. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, a, b and c seven situations. It should be understood that the order of the steps shown in the flowchart of this article can be changed, and some can also be omitted.

[0049] Dynamic range can be used to describe the brightness variation range of a frame of image, which can represent the difference between the maximum brightness and the minimum brightness in the image. The larger the dynamic range, the larger the brightness variation range of the image.

[0050] Generally, the dynamic range can include standard dynamic range (SDR) and high dynamic range (HDR). For SDR, the maximum brightness of the image can generally only reach 100 nits, and the minimum brightness can generally only reach 0.1 nits. Generally speaking, the brightness of indoor lighting is 100-300 nits, the brightness of outdoor cloudy weather is 500 nits, and the brightness of outdoor sunny weather is 2000 nits. When using SDR display technology for image display, the maximum brightness value of some pixels with strong light in the image is only 100 nits, which is lower than the actual brightness value in the scene. It is impossible to express the bright details in the image, and the display effect is poor. Compared with SDR, HDR has a larger exposure range. When using HDR display technology for image display, the minimum brightness of the image can reach 0.001, and the maximum brightness can reach 1000 nits, or even 10000 nits. For HDR, since the brightness variation range of different pixels in a frame of image is large, the brightness corresponding to the pixels with stronger light and the pixels with darker light in the image can match the actual brightness in the scene, so that the image can express richer brightness details and dark details, the entire picture is richer, and can present better picture quality.

[0051] When a terminal device plays an HDR video, the terminal device processes the video frames of the HDR video so that the brightness of the pixels in the bright part of the HDR video frame is higher, while the brightness of the pixels in the dark part is lower, thereby being able to express richer brightness details and dark details, and presenting better image quality. However, since the subtitles in the video are usually white, when the brightness of the pixels in the bright part of the image is increased, the brightness of the subtitles will also be increased, resulting in excessive brightness of the subtitles, which creates a glaring feeling and affects the user's viewing experience.

[0052] For example, when users watch HDR videos through application software, the brightness value of the video frame will be significantly improved, the screen backlight brightness of the terminal device will be significantly brighter, and the brightness of the subtitles will also be significantly improved. The color of subtitles is generally white. Overly bright white subtitles may produce a dazzling feeling, causing discomfort to the user's eyes and affecting the user's viewing experience.

[0053] For another example, when a user is watching a video through an application, if the currently playing video is an SDR video, the brightness value of the video frame can reach up to 100 nits. When the user switches to the next video, if the next video is an HDR video, the brightness value of the pixel points corresponding to the bright part of the video frame will increase significantly (for example, from 100 nits to 1000 nits), and the brightness of the subtitles will also increase significantly, which may cause a glare and affect the user's viewing experience.

[0054] In response to the above technical problems, an embodiment of the present application provides a subtitle brightness adjustment method, which can be applied to a terminal device. When the terminal device plays an HDR video and the HDR video includes subtitles, the method can adjust the brightness of the subtitles in the HDR video according to the screen backlight brightness of the terminal device before playing the HDR video and the user's viewing time (for example, the viewing time is determined based on the device's screen-on time or the running time of the video application). This can solve the problem of glare caused by excessive brightness of the subtitles in the HDR video when playing the HDR video in the related technology, thereby improving the user's viewing experience.

[0055] In some embodiments, the terminal device may refer to an electronic device including a display screen. The terminal device includes but is not limited to mobile phones, tablet computers, desktop computers, laptop computers, handheld computers, notebook computers, ultra-mobile personal computers (UMPC), netbooks, augmented reality (AR) and virtual reality (VR) devices, smart TVs, smart screens, and other devices including display screens. The embodiments of the present application do not impose any special restrictions on the specific form of the electronic device.

[0056] In most color digital images currently, the grayscale of the three channels of red (R), green (G) and blue (B) is stored in one byte respectively, that is, the grayscale range of the three channels of R, G, and B is 0~255 respectively. Since the storage method of the terminal device cannot reach the high brightness of the real world, the optical-electro transfer function (OETF) is required to represent the brightness in the real world as the brightness corresponding to the storage method of the terminal device. For example, the brightness in the real world is 10000 nits, and the terminal device uses 8 bits to store the brightness information. The maximum value that can be stored in this storage method is 255. Therefore, in this case, 10000 nits can be represented as 255. For another example, the brightness in the real world is 10000 nits, and the terminal device uses 10 bits to store the brightness information. The maximum value that can be stored in this storage method is 1023. Therefore, in this case, 10000 nits can be represented as 1023.

[0057] For SDR, the Gamma function is generally used as the electro-optical transfer function (EOTF), which can be expressed as:

[0058] f(x)=x 2.2 ;

[0059] Among them, x is the value obtained by normalizing the brightness level of the picture / subtitle, x can also be called a nonlinear RGB value, and the value range of x is [0, 1]. For example, the value range of the brightness level of the picture / subtitle is 0~255, that is, x can be expressed as the value obtained by normalizing 0~255. f(x) is the light signal value, and the range of f(x) is [0, 1].

[0060] After calculating the value of f(x), we can use Figure 1 The Gamma curve shown in the figure is used to find the corresponding brightness value. Figure 1 In the figure, the horizontal axis is the brightness value and the vertical axis is the light signal value. Figure 1 It can be seen that the gamma curve cuts off the highlight part, and the dynamic range of brightness that can be expressed is limited, with the maximum brightness being only 100 nits.

[0061] For HDR, in order to store a wider range of brightness, a hybrid log-gamma (HLG) curve or a perceptual quantization (PQ) curve is generally used to characterize the mapping relationship between light signal values ​​and brightness values.

[0062] Taking the PQ function as EOTF as an example, the EOTF can be expressed as:

[0063] ;

[0064] Among them, F D Indicates the brightness value of the display. E' is a nonlinear RGB value. The value range of E' is [0, 1]. For example, the value range of the brightness level of the picture / subtitle is 0~1023, that is, E' can be expressed as the value obtained by normalizing 0~1023. m1, m2, c1, c2, and c3 are all PO photoelectric transfer coefficients. For example, m1=0.1593017578125, m2=78.84375, c1= c3-c2+1, c2=18.8515625, and c3=18.6875.

[0065] like Figure 2 The following is a schematic diagram of the PQ curve, where the horizontal axis is the nonlinear RGB value (E') and the vertical axis is the displayed brightness value (F D ).

[0066] like Figure 3 FIG. 1 is a schematic diagram of a scenario applicable to an embodiment of the present application. The scenario includes a terminal device 100 and a server 200. Figure 3 The terminal device 100 is taken as a mobile phone as an example for explanation.

[0067] The terminal device 100 and the server 200 can communicate data through various communication methods. For example, the terminal device 100 can communicate with the server 200 through a wired or wireless method. The wireless method can be a mobile communication network, a wireless local area network (WLAN), etc. The server 200 can provide various video contents to the terminal device 100, and the video contents can be SDR videos or HDR videos, so that the user can use the terminal device 100 to play the video contents provided by the server 200.

[0068] In some embodiments, the server 200 may refer to a single server device, a server cluster, or multiple server clusters, which is not limited in the embodiments of the present application.

[0069] In some embodiments, the terminal device 100 can also play the video content stored locally, that is, the terminal device can play the video content even when it is not connected to the server 200.

[0070] When playing video content, in order to help users accurately understand the video content, the voice content in the video content is generally displayed in the form of subtitles, and users watch it through a combination of subtitle text and audio and voice. In addition, subtitles can also be used to translate foreign language videos, so that viewers who do not understand the foreign language can hear the original soundtrack and understand the video content at the same time.

[0071] like Figure 4 As shown, assuming that the video content played by the terminal device 100 at the first moment is an SDR video, in the display interface viewed by the user, the subtitle 111 has a first font brightness. Figure 5 As shown, assuming that the video content played by the terminal device 100 at the second moment after the first moment is an HDR video, in the display interface viewed by the user, the subtitles 112 have a second font brightness.

[0072] from Figure 4 and Figure 5 It can be seen that the font brightness of subtitle 111 is lower than the font brightness of subtitle 112. As for the font brightness of subtitle 112, when the user uses the terminal device 100 to play the HDR video in a dark environment, it is easy to bring a dazzling experience to the user.

[0073] In order to further understand that the terminal device of the present application can solve the problem that when the brightness value of the HDR video frame is increased, the brightness value of the subtitles in the HDR video frame increases significantly, causing eye discomfort to the user, combined with Figure 6 The step flow of adjusting the subtitle brightness of an HDR video by a terminal device provided in an embodiment of the present application is described in detail.

[0074] S61: Obtain a first brightness level of subtitles in the HDR video.

[0075] In some embodiments, the terminal device can decode the data stream of the HDR video, and display and play the decoded video data, audio data, and subtitle data, so that the user can watch the HDR video pictures and subtitles through the display screen of the terminal device and hear the sound of the HDR video through the speaker of the terminal device.

[0076] In some embodiments, the data stream of the HDR video may be a data stream in a transport stream (TS) format, or a data stream in other similar formats. For example, the data stream may also use an audio video interleaved (AVI) format to encapsulate audio data, video data, and subtitle data. The present application does not limit the transmission format of the data stream of the HDR video.

[0077] In some embodiments, the subtitle data may include information such as the font, size, position, brightness level, and text content of the subtitle. The terminal device may obtain the first brightness level of the subtitle by parsing the subtitle data packet. For an HDR video, the brightness level of the initially configured subtitle is generally a fixed value, that is, the first brightness level of the subtitle displayed on different HDR video frames is the same.

[0078] In some embodiments, for a terminal device with an automatic brightness adjustment function, when the automatic brightness adjustment function is turned off, the terminal device can set the brightness of the picture content based on the brightness level of the picture, and set the brightness of the subtitles based on the first brightness level of the subtitles. For example, if the HDR brightness curve stored in the terminal device is Figure 2 In the PQ curve shown, the first brightness level is stored in 10 bytes. The terminal device can first normalize the first brightness level, and then search the PQ curve based on the value obtained by the normalization process to obtain the brightness value corresponding to the brightness level to set the brightness. For another example, after the terminal device normalizes the first brightness level, it can obtain the brightness value corresponding to the first brightness level based on the pre-stored EOTF.

[0079] In some embodiments, when the automatic brightness adjustment function is turned off, the terminal device can also obtain the current screen backlight brightness, and adjust the brightness level of the picture and the first brightness level of the subtitles based on the current screen backlight brightness (for example, the screen backlight brightness is increased / decreased by a first percentage relative to the reference backlight brightness, and the brightness level of the picture and the first brightness level of the subtitles are correspondingly increased / decreased by a second percentage, and the reference backlight brightness can be set according to actual needs, or set according to the brightness of the picture / subtitles initially configured by the HDR video), so that when the screen backlight brightness is high, the brightness of the picture and subtitles also increases accordingly, and when the screen backlight brightness is low, the brightness of the picture and subtitles also decreases accordingly.

[0080] In some embodiments, when the automatic brightness adjustment function is turned on, the terminal device can detect the brightness of the current environment through a brightness sensor, and adjust the brightness level of the picture and the first brightness level of the subtitles based on the brightness of the current environment (for example, the ambient brightness is increased / decreased by a third percentage relative to the reference ambient brightness, and the brightness level of the picture and the first brightness level of the subtitles are correspondingly increased / decreased by a fourth percentage, and the reference ambient brightness can be set according to actual needs, or according to the brightness of the picture / subtitles initially configured by the HDR video), so as to automatically adjust the brightness of the picture and subtitles based on the brightness of the current environment. For example, when the brightness of the current environment is high, the brightness of the picture and subtitles is also increased accordingly, and when the brightness of the current environment is low, the brightness of the picture and subtitles is also decreased accordingly.

[0081] In some embodiments, the first brightness level of the subtitle may refer to the brightness level of the subtitle text, or may refer to the brightness level of the subtitle area, where the subtitle area is a rectangular frame portion surrounding the subtitle text.

[0082] S62, obtaining the screen backlight brightness before playing the HDR video and the user's viewing time.

[0083] In some embodiments, the terminal device includes a display screen, and obtaining the screen backlight brightness before playing the HDR video may refer to obtaining the screen backlight brightness of the display screen before playing the HDR video.

[0084] For example, the moment when the terminal device starts playing the HDR video is the current moment, and the screen backlight brightness of the terminal device before playing the HDR video can refer to the preset time period from the current moment, and the mean, median, etc. of the screen backlight brightness within the preset time period. The preset time period can be set according to actual needs, and the embodiment of the present application does not limit this. For example, the preset time period can be 1 minute, 10 minutes, etc.

[0085] In some embodiments, if an SDR video is played before the HDR video is played, the screen backlight brightness of the SDR video played before the HDR video is played can also be used as the screen backlight brightness of the display screen before the HDR video is played.

[0086] In some embodiments, the user's viewing time may refer to the screen-on time of the terminal device, the playback time of the HDR video, or the running time of the video playback application in the terminal device. The user's viewing time can be reset and re-counted in units of days, or reset and re-counted in units of preset screen-off time. The preset screen-off time can be set according to actual needs, and the embodiments of the present application are not limited to this. For example, the preset screen-off time can be set to 2h, 3h, etc.

[0087] In some embodiments, the terminal device can record the screen off time period of the display screen, and obtain the time interval between two adjacent screen off time periods by traversing each screen off time period. If the time interval is less than the first duration, it can be considered that the two adjacent screen off time periods belong to the same screen off time period. In this case, the two adjacent screen off time periods can be merged to obtain a new screen off time period, that is, the two adjacent screen off time periods constitute a screen off duration. The first duration can be set according to actual needs, and the embodiment of the present application is not limited to this. The first duration can be selected as 5 minutes, 10 minutes, etc.

[0088] S63: Determine a brightness adaptation value for the subtitles based on the screen backlight brightness before playing the HDR video and the viewing time of the user.

[0089] In some embodiments, after obtaining the screen backlight brightness of the terminal device before playing the HDR video and the user's viewing time, the brightness adaptation value of the subtitles can be determined based on the screen backlight brightness before playing the HDR video and the user's viewing time, so that the brightness of the subtitles is adapted to the brightness of the terminal device before playing the HDR content, and at the same time adapted to the viewing time. This can reduce the glare of highlighted white subtitles caused by the sudden change in brightness caused by the terminal device switching from displaying a low dynamic range (LDR) or SDR picture to displaying an HDR picture (compared with a sudden change in high-brightness pictures, a sudden change in high-brightness white subtitles is more likely to produce a glare), and can reduce the visual fatigue caused by users watching high-brightness subtitles for a long time.

[0090] In some embodiments, the brightness adaptation value of the subtitles may be positively correlated with the screen backlight brightness before playing the HDR video, and negatively correlated with the user's viewing time.

[0091] For example, a functional relationship between the brightness adaptation value of the subtitles and the screen backlight brightness before playing the HDR video and the user's viewing time can be pre-constructed, and the brightness adaptation value of the subtitles can be determined based on the functional relationship. For example, the functional relationship can be expressed as: Brightness_H = (k*Brightness_S) / T. Among them, Brightness_H is the brightness adaptation value of the subtitles, Brightness_S is the screen backlight brightness before playing the HDR video, T is the user's viewing time, and k is a preset coefficient value. The value of k can be set according to actual needs, and the embodiment of the present application is not limited to this.

[0092] In some embodiments, since the parameters Brightness_S and T have order of magnitude characteristic differences, the parameters Brightness_S and T may be standardized first and then substituted into the above functional relationship to calculate the corresponding Brightness_H.

[0093] In some embodiments, the value of k can also be adjusted according to the initial brightness level of the subtitles in the HDR video, so that when playing different HDR videos, even with the same screen backlight brightness and user viewing time before playing the HDR video, different subtitle brightness adaptation values ​​can still be corresponded. That is, the adjusted subtitle brightness adaptation value is associated with the brightness level of the subtitles initially configured for the HDR video.

[0094] As an optional embodiment, the terminal device may also determine the brightness adaptation value of the subtitles based only on the screen backlight brightness before playing the HDR video.

[0095] As an optional embodiment, the terminal device may also determine the brightness adaptation value of the subtitles based on the screen backlight brightness before playing the HDR video and the first brightness level of the subtitles.

[0096] S64, determining a second brightness level of the subtitles based on the brightness adaptation value of the subtitles, and updating the brightness level of the subtitles from the first brightness level to the second brightness level.

[0097] In some instances, when determining the brightness adaptation value of the subtitles, a normalized value of the second brightness level corresponding to the brightness adaptation value can be obtained based on the OETF (OETF can be regarded as the inverse function of the corresponding EOTF) pre-stored in the terminal device or the EOTF, and then the normalized value can be converted into the second brightness level.

[0098] After obtaining the second brightness level of the subtitles, the brightness level of the subtitles can be updated from the first brightness level to the second brightness level. Generally speaking, since playing HDR video will make the picture brighter, the second brightness level will generally be lower than the first brightness level, and as the viewing time increases, the second brightness level will further decrease. When the terminal device plays the HDR video, the brightness of the subtitles is set based on the second brightness level of the subtitles. This can reduce the glare caused by white highlighted subtitles when users watch HDR videos, reduce the power consumption of the terminal device, and improve the battery life of the terminal device (including battery-powered terminal devices).

[0099] In some instances, after the brightness level of the subtitles is updated from the first brightness level to the second brightness level, the terminal device can also adjust the second brightness level of the subtitles based on the screen backlight brightness or the ambient brightness, so that the subtitle brightness can also be adjusted along with the screen backlight brightness or the ambient brightness. For example, when the automatic brightness adjustment function is turned off, the terminal device can obtain the current screen backlight brightness, and adjust the brightness level of the picture and the second brightness level of the subtitles based on the current screen backlight brightness (for example, the screen backlight brightness is increased / decreased by the fifth percentage, and the brightness level of the picture and the second brightness level of the subtitles are correspondingly increased / decreased by the sixth percentage), so that when the screen backlight brightness is high, the brightness of the picture and the subtitles is also increased accordingly, and when the screen backlight brightness is low, the brightness of the picture and the subtitles is also decreased accordingly. For another example, when the automatic brightness adjustment function is turned on, the terminal device can adjust the brightness level of the picture and the second brightness level of the subtitles based on the brightness of the current environment (for example, if the brightness of the current environment is increased / decreased by the seventh percentage, the brightness level of the picture and the second brightness level of the subtitles will be increased / decreased by the eighth percentage accordingly), thereby automatically adjusting the brightness of the picture and subtitles based on the brightness of the current environment, so that when the brightness of the current environment is high, the brightness of the picture and subtitles will also increase accordingly, and when the brightness of the current environment is low, the brightness of the picture and subtitles will also decrease accordingly.

[0100] In some embodiments, since the brightness adaptation value of the subtitle is set to be negatively correlated with the viewing time, in order to avoid frequently updating the brightness adaptation value of the subtitle based on the viewing time, the terminal device can be set to update the brightness adaptation value of the subtitle every preset time after playing the HDR video. The preset time can be set according to actual needs, and the embodiment of the present application does not limit this. For example, the preset time is 0.5h.

[0101] In some embodiments, before updating the brightness adaptation value of the subtitles, the currently determined brightness adaptation value may be compared with the last determined brightness adaptation value (if the brightness adaptation value is updated for the first time, the currently determined brightness adaptation value is compared with the initial brightness setting value). If the difference between the two is less than a preset threshold, it indicates that the condition for adjusting the brightness adaptation value of the subtitles is not met. At this time, the brightness adaptation value of the subtitles may not be updated. If the difference between the two is greater than or equal to the preset threshold, it indicates that the last determined brightness adaptation value needs to be updated to the currently determined brightness adaptation value.

[0102] like Figure 7 As shown, the terminal device can play a certain HDR video in response to a user operation. When the terminal device plays the HDR video, the moment when the HDR video starts to be played can be used as the starting moment, and the brightness level of the subtitles can be updated every preset time. For example, the brightness level of the subtitles can be updated by executing the following process:

[0103] i. Get the current brightness level Gray_A of the subtitles in the HDR video. The current brightness level Gray_A may be the initially set brightness level or the last determined brightness level;

[0104] ii. Determine the current brightness setting value Brightness_A of the subtitle based on the current brightness level Gray_A;

[0105] In some embodiments, after the current brightness level Gray_A of the subtitles is acquired, the current brightness setting value Brightness_A corresponding to the current brightness level Gray_A can be converted based on the EOTF pre-stored in the terminal device.

[0106] iii. Get the screen backlight brightness Brightness_S and the user's viewing time T before playing the HDR video;

[0107] iv. Based on the screen backlight brightness Brightness_S before playing the HDR video and the user's viewing time T, determine the brightness adaptation value Brightness_H of the subtitles;

[0108] v. When the difference between the current brightness setting value Brightness_A of the subtitle and the brightness adaptation value Brightness_H is greater than or equal to the preset threshold, determining the target brightness level Gray_B of the subtitle based on the brightness adaptation value Brightness_H;

[0109] In some embodiments, the target brightness level Gray_B corresponding to the brightness adaptation value Brightness_H can be converted based on the OETF pre-stored in the terminal device.

[0110] vi. Update the brightness level of the subtitles from the current brightness level Gray_A to the target brightness level Gray_B.

[0111] In some embodiments, if the difference between the current brightness setting value Brightness_A of the subtitles and the brightness adaptation value Brightness_H is less than a preset threshold, the target brightness level Gray_B is not calculated, and the update process ends. In this case, since the current brightness level Gray_A is not updated, the terminal device can still display subtitles according to the current brightness level Gray_A.

[0112] In order to further understand that the terminal device of the present application can solve the problem that when the brightness value of the HDR video frame is increased, the brightness value of the subtitles in the HDR video frame increases significantly, causing eye discomfort to the user, the following is combined with Figure 8 The step flow of adjusting the subtitle brightness of an HDR video by a terminal device provided in another embodiment of the present application is described in detail.

[0113] S81: Obtain the brightness level of subtitles in the HDR video.

[0114] The step process S81 of the embodiment of the present application is similar to the step process S61 of the aforementioned embodiment, and will not be described again here to avoid repetition.

[0115] S82, obtaining the screen backlight brightness before playing the HDR video and the user's viewing time.

[0116] The step process S82 of the embodiment of the present application is similar to the step process S62 of the aforementioned embodiment, and will not be described again here to avoid repetition.

[0117] S83: Determine a brightness adjustment coefficient of the subtitles based on the screen backlight brightness before playing the HDR video and the viewing time of the user.

[0118] In some embodiments, the brightness adjustment coefficient of the subtitles may be a brightness adjustment value of the subtitles, or a percentage / per-thousandth of the brightness adjustment of the subtitles, etc. Since the present application is to solve the problem that the brightness of the subtitles in the HDR video frame may be glaring, the terminal device may reduce the brightness of the subtitles based on the determined brightness adjustment coefficient.

[0119] In some embodiments, the functional relationship between the brightness adjustment coefficient of the subtitles and the screen backlight brightness before playing the HDR video and the user's viewing time can be set according to the actual subtitle brightness adjustment requirements. The brightness adjustment coefficient of the subtitles is negatively correlated with the screen backlight brightness before playing the HDR video, and positively correlated with the user's viewing time. That is, as the user's viewing time increases, the larger the brightness adjustment coefficient of the subtitles, the larger the screen backlight brightness before playing the HDR video, and the smaller the brightness adjustment coefficient of the subtitles.

[0120] For example, the functional relationship can be set as Coefficient_B = (m*T) / Brightness_S. Wherein, Coefficient_B is the brightness adjustment coefficient of the subtitles, Brightness_S is the screen backlight brightness before playing the HDR video, T is the user's viewing time, and m is the preset coefficient value. The value of m can be set according to actual needs, and the embodiment of the present application is not limited to this.

[0121] In some embodiments, since the parameters Brightness_S and T have order of magnitude characteristic differences, the parameters Brightness_S and T may be standardized first and then substituted into the above functional relationship to calculate the corresponding Coefficient_B.

[0122] As an optional embodiment, the terminal device may also determine the brightness adjustment coefficient of the subtitles based only on the screen backlight brightness before playing the HDR video.

[0123] S84, updating the brightness level of the subtitles based on the brightness adjustment coefficient of the subtitles.

[0124] In some embodiments, after determining the brightness adjustment coefficient of the subtitles, the terminal device may update the brightness level of the subtitles based on the brightness adjustment coefficient of the subtitles. Assuming that the brightness adjustment coefficient of the subtitles is the brightness adjustment value of the subtitles, adjusting the brightness level of the subtitles based on the brightness adjustment coefficient of the subtitles may include: converting the brightness level Gray_1 of the subtitles to the corresponding brightness setting value Value_1 through EOTF; reducing the brightness setting value Value_1 by the brightness adjustment value Value_0 to obtain the adjusted brightness setting value Value_2 (Value_2=Value_1-Value_0); converting the adjusted brightness setting value Value_2 to the adjusted brightness level Gray_2 through OETF; updating the brightness level of the subtitles from Gray_1 to Gray_2.

[0125] Assuming that the brightness adjustment coefficient of the subtitle is the brightness adjustment percentage of the subtitle, adjusting the brightness level of the subtitle based on the brightness adjustment coefficient of the subtitle may include: converting the brightness level Gray_1 of the subtitle into a corresponding brightness setting value Value_1 through EOTF; reducing the brightness setting value Value_1 by the brightness adjustment percentage Value_p to obtain an adjusted brightness setting value Value_2 (Value_2=Value_1*(1-Value_p); converting the adjusted brightness setting value Value_2 into an adjusted brightness level Gray_2 through OETF; and updating the brightness level of the subtitle from Gray_1 to Gray_2.

[0126] In some embodiments, since the brightness adjustment coefficient of the subtitles is set to be positively correlated with the viewing time, in order to avoid frequently adjusting the brightness of the subtitles based on the viewing time, the terminal device can be set to perform a brightness adjustment process for the subtitles every preset time after playing the HDR video, and adjust the brightness level of the subtitles based on the brightness adjustment coefficient determined by the brightness adjustment process. The preset time can be set according to actual needs, and the embodiment of the present application does not limit this. For example, the preset time is 0.5h.

[0127] In some embodiments, after the brightness level of the subtitles is updated based on the brightness adjustment coefficient of the subtitles, the terminal device can also adjust the brightness level of the subtitles based on the screen backlight brightness or the ambient brightness, that is, the brightness level obtained based on the brightness adjustment coefficient is used as a reference to adjust with the screen backlight brightness or the ambient brightness, so that the subtitle brightness can also be adjusted with the screen backlight brightness or the surrounding environment brightness.

[0128] See also Fig. 9As shown, a subtitle brightness adjustment method provided by an embodiment of the present application is provided. The subtitle brightness adjustment method can be applied to a terminal device, and the terminal device includes a display screen. The subtitle brightness adjustment method may include:

[0129] S91, obtains a brightness level of subtitles in an HDR video and a screen backlight brightness of a display screen before playing the HDR video.

[0130] In some embodiments, the terminal device may parse the transport stream of the HDR video to obtain the brightness level of the subtitles in the HDR video.

[0131] In some embodiments, obtaining the screen backlight brightness before playing the HDR video may include: obtaining multiple screen backlight brightness values ​​within a preset time before playing the HDR video; and determining the screen backlight brightness before playing the HDR video based on the multiple screen backlight brightness values.

[0132] In some embodiments, obtaining the screen backlight brightness before playing the HDR video may include: if an SDR video is played before playing the HDR video, the screen backlight brightness of the SDR video played before playing the HDR video can be used as the screen backlight brightness of the display screen before playing the HDR video.

[0133] S92: Determine a subtitle brightness adjustment parameter based on the screen backlight brightness before playing the HDR video.

[0134] In some embodiments, the subtitle brightness adjustment parameters may include a brightness adaptation value of the subtitles, that is, based on the screen backlight brightness before playing the HDR video, the brightness adaptation value of the subtitles is determined, and then the brightness level of the subtitles is updated to a brightness level corresponding to the brightness adaptation value.

[0135] In some embodiments, the subtitle brightness adjustment parameters may also include a brightness adjustment value or a brightness adjustment rate of the subtitles, that is, based on the screen backlight brightness before playing the HDR video, the brightness adjustment value or the brightness adjustment rate (for example, percentage, thousandth, etc.) of the subtitles is determined, and then the brightness level of the subtitles is updated based on the brightness adjustment value or the brightness adjustment rate of the subtitles.

[0136] In some embodiments, the terminal device may also determine the subtitle brightness adjustment parameters based on the screen backlight brightness before playing the HDR video and the user's viewing time.

[0137] In some embodiments, when playing an HDR video, the user's viewing time can be obtained at intervals of a first preset time. The first preset time can be set according to actual needs, and the embodiment of the present application is not limited to this. For the HDR video, the first acquisition of the user's viewing time can be completed when the HDR video is ready to play or before the HDR video is played, so that the subtitles of the HDR video are displayed based on the updated brightness level.

[0138] In some embodiments, obtaining the user's viewing time may include: obtaining the screen-on time of the terminal device, the playback time of the HDR video, or the running time of the video application in the terminal device, the video application includes an application that plays the HDR video; determining the user's viewing time based on the screen-on time, the playback time of the HDR video, or the running time of the video application. For example, the screen-on time of the terminal device on that day, or the running time of the video application in the terminal device on that day is used as the user's viewing time, or the playback time of the HDR video is used as the user's viewing time. The running time of the video application may refer to the running time of the application that plays the HDR video, or the total running time of all video applications installed on the terminal device. The screen-on time of the terminal device, the playback time of the HDR video, or the running time of the video application in the terminal device can be obtained by obtaining the device or application operation record, that is, the screen-on time of the terminal device, the playback time of the HDR video, or the running time of the video application in the terminal device can be obtained by using the existing method.

[0139] In some embodiments, the user's viewing time can be re-determined based on a preset reset time, for example, the preset reset time is in days or in preset screen-off time, that is, the user's viewing time can be cleared and recalculated in days or in preset screen-off time.

[0140] S93, updating the brightness level of the subtitles based on the subtitle brightness adjustment parameter, and displaying the subtitles based on the updated brightness level.

[0141] In some embodiments, after the brightness level of the subtitles is updated based on the subtitle brightness adjustment parameters, the brightness level of the subtitles can be further adjusted based on the ambient brightness or the screen backlight brightness when the HDR video is currently playing, so that the subtitle brightness can be adjusted as the ambient brightness or the screen backlight brightness changes.

[0142] See also Fig.10As shown, it is a software architecture diagram of the terminal device provided in the embodiment of the present application. The layered architecture divides the software into several layers, and each layer has a clear role and division of labor. The layers communicate with each other through software interfaces. The following is an example of an Android operating system installed in the terminal device, but the present application is not limited to this, and the terminal device can also install other types of operating systems.

[0143] For example, the Android system is divided into four layers, which are, from top to bottom, an application layer 101 , a framework layer 102 , an Android runtime and system library 103 , a kernel layer 104 , and a hardware layer 105 .

[0144] The application layer can include a series of application packages. For example, an application package can include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, device control service, etc.

[0145] The framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions. For example, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, a brightness setting framework, etc.

[0146] Among them, the window manager is used to manage window programs. The window manager can obtain the size of the display screen, determine whether there is a status bar, lock the screen, capture the screen, etc. The content provider is used to store and obtain data and make the data accessible to the application. The data may include video, images, audio, calls made and received, browsing history and bookmarks, phone books, etc. The view system includes visual controls, such as controls for displaying text, controls for displaying pictures, etc. The view system can be used to build applications. The display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying pictures. The phone manager is used to provide the communication function of the terminal device. The resource manager provides various resources for the application, such as localized strings, icons, pictures, layout files, video files, etc. The notification manager enables the application to display notification information in the status bar, which can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify the completion of downloads, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as a notification of an application running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, the terminal device vibrates, the indicator light flashes, etc. The brightness setting framework can be used to set the display backlight brightness, screen brightness, and subtitle brightness. The brightness setting framework can be used to set the screen brightness and subtitle brightness, which can refer to adjusting the brightness level of the screen and adjusting the brightness level of the subtitles.

[0147] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system. The core library contains two parts: one is the function that the Java language needs to call, and the other is the Android core library.

[0148] The application layer and framework layer run in the virtual machine. The virtual machine executes the java files of the application layer and framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0149] The system library may include multiple functional modules, such as a surface manager, a media library, a 3D graphics processing library (such as OpenGL ES), a 2D graphics engine (such as SGL), etc.

[0150] Among them, the surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of multiple commonly used audio and video formats, as well as static image files. The media library can support multiple audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, synthesis, and layer processing. The 2D graphics engine is a drawing engine for 2D drawing.

[0151] The kernel layer is the layer between hardware and software. The kernel layer may include at least display drivers, audio drivers, etc. The kernel layer is the core of the operating system of the terminal device. It is the first layer of software expansion based on hardware, providing the most basic functions of the operating system. It is the basis for the operation of the operating system and is responsible for managing the system's processes, memory, device drivers, files, and network systems, and determines the performance and stability of the system. For example, the kernel can determine the operating time of an application on a certain part of the hardware.

[0152] The kernel layer includes programs that are closely related to the hardware, such as interrupt handlers, device drivers, etc. It also includes basic, common, and high-frequency modules, such as clock management modules, process scheduling modules, etc. It also includes key data structures. The kernel layer can be set in the processor or solidified in the internal memory.

[0153] The hardware layer is the hardware of the terminal device, and the hardware layer may at least include a display screen.

[0154] See also Fig.11 , which is a software architecture diagram of a terminal device provided in one embodiment of the present application.

[0155] At the application layer 101 , the video application may play the HDR video in response to a user operation.

[0156] At the framework layer 102, the brightness setting framework may obtain the brightness level of the picture of the HDR video and the brightness level of the subtitles.

[0157] In the kernel layer 104, the display driver may drive the display screen of the hardware layer to display based on the brightness level of the picture and the brightness level of the subtitles acquired by the brightness setting framework.

[0158] In the hardware layer 105, the picture brightness of the HDR video displayed on the display screen is the brightness set based on the brightness level of the picture, and the subtitle brightness of the HDR video displayed on the display screen is the brightness set based on the brightness level of the subtitle.

[0159] See also Fig.12As shown, the terminal device 100 involved in the embodiment of the present application is introduced below. The terminal device in the embodiment of the present application can be a mobile phone, a tablet computer, a desktop, a laptop, a handheld computer, a notebook computer, an ultra-mobile personal computer (UMPC), a netbook, and a cellular phone, a personal digital assistant (PDA), an augmented reality (AR)\virtual reality (VR) device, a smart TV, a smart screen, and other devices including a display screen. The embodiment of the present application does not impose any special restrictions on the specific form of the terminal device. Please refer to Fig.12 , Fig.12 It is a structural diagram of the terminal device 100 provided in an embodiment of the present application.

[0160] The terminal device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0161] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the terminal device 100. In other embodiments of the present application, the terminal device 100 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0162] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0163] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0164] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instructions or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0165] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0166] The wireless communication function of the terminal device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0167] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In some other embodiments, the antenna can be used in combination with a tuning switch.

[0168] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to the terminal device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0169] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be sent into a medium-high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. After the low-frequency baseband signal is processed by the baseband processor, it is passed to the application processor. The application processor outputs a sound signal through an audio device (not limited to a speaker 170A, a receiver 170B, etc.), or displays an image or video through a display screen 194. In some embodiments, the modem processor may be an independent device. In other embodiments, the modem processor may be independent of the processor 110 and may be set in the same device as the mobile communication module 150 or other functional modules.

[0170] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the terminal device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and filters it, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0171] In some embodiments, the antenna 1 of the terminal device 100 is coupled to the mobile communication module 150, and the antenna 2 is coupled to the wireless communication module 160, so that the terminal device 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), wideband code division multiple access (WCDMA), time-division code division multiple access (TD-SCDMA), long term evolution (LTE), BT, GNSS, WLAN, NFC, FM, and / or IR technology, etc. The GNSS may include global positioning system (GPS), global navigation satellite system (GLONASS), Beidou navigation satellite system (BDS), quasi-zenith satellite system (QZSS) and / or satellite based augmentation system (SBAS).

[0172] The terminal device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs, which execute program instructions to generate or change display information.

[0173] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light emitting diode or an active-matrix organic light emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oled, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the terminal device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1. Among them, the display screen 194 in the embodiment of the present application may be a touch screen. That is, the touch sensor 180K is integrated in the display screen 194.

[0174] Video codecs are used to compress or decompress digital videos. The terminal device 100 may support one or more video codecs. Thus, the terminal device 100 may play or record videos in multiple coding formats, such as moving picture experts group (MPEG) 1, MPEG2, MPEG3, MPEG4, etc.

[0175] The internal memory 121 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM). The non-volatile memory may include a disk storage device and a flash memory. The random access memory may be directly read and written by the processor 110, and may be used to store executable programs (such as machine instructions) of an operating system or other running programs, and may also be used to store user and application data, etc.

[0176] The non-volatile memory may also store executable programs and user and application data, etc., and may be loaded into the random access memory in advance for direct reading and writing by the processor 110 .

[0177] The external memory interface 120 can be used to connect to an external non-volatile memory to expand the storage capacity of the terminal device 100. The external non-volatile memory communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos are stored in the external non-volatile memory.

[0178] The terminal device 100 can implement audio functions such as media data playback and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone interface 170D, and the application processor.

[0179] The subtitle brightness adjustment methods in the above embodiments can all be implemented in the terminal device 100 having the above hardware structure.

[0180] This embodiment further provides a computer-readable storage medium, in which computer instructions are stored. When the computer instructions are executed on the terminal device 100, the terminal device 100 executes the above-mentioned related method steps to implement the subtitle brightness adjustment method in the above-mentioned embodiment.

[0181] This embodiment further provides a computer program product. When the computer program product is run on a computer, the computer is enabled to execute the above-mentioned related steps to implement the subtitle brightness adjustment method in the above-mentioned embodiment.

[0182] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, a component or a module, and the device may include a connected processor and a memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory, so that the chip executes the subtitle brightness adjustment method in the above-mentioned method embodiments.

[0183] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0184] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0185] The unit described as a separate component may or may not be physically separated, and the component shown as a unit may be one physical unit or multiple physical units, that is, it may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the embodiment.

[0186] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0187] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions to enable a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program code.

[0188] The above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, a person skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A subtitle brightness adjustment method, applied to a terminal device, characterized in that: The terminal device includes a display screen, the terminal device stores a conversion function for high dynamic range HDR display, and the subtitle brightness adjustment method includes: Acquire a data stream of an HDR video, and decode the data stream to obtain a brightness level of subtitles in the HDR video; Determining a brightness setting value of the subtitle based on the brightness level of the subtitle and the conversion function; Obtaining the screen backlight brightness of the standard dynamic range SDR video played before playing the HDR video; Determining a subtitle brightness adjustment parameter based on the screen backlight brightness and the brightness level of the subtitle; Updating the brightness setting value of the subtitle based on the subtitle brightness adjustment parameter; The brightness level of the subtitles is updated based on the updated brightness setting value, and the subtitles are displayed on the display screen based on the updated brightness level.

2. The method according to claim 1, characterized in that The determining of the subtitle brightness adjustment parameter based on the screen backlight brightness and the brightness level of the subtitle includes: Obtaining a viewing time of a user, where the viewing time is determined based on one of a screen-on time of the terminal device, a playback time of the HDR video, and a running time of a video application in the terminal device; The subtitle brightness adjustment parameter is determined based on the viewing time, the brightness level of the subtitle and the screen backlight brightness.

3. The method according to claim 2, characterized in that The viewing time is re-determined according to the preset reset time.

4. The method according to claim 2, characterized in that The obtaining of the user's viewing time includes: When playing the HDR video, the viewing time is obtained at intervals of a first preset time.

5. The method according to claim 2, characterized in that The subtitle brightness adjustment parameter includes a brightness adaptation value of the subtitle, and updating the brightness setting value of the subtitle based on the subtitle brightness adjustment parameter includes: The brightness setting value of the subtitle is updated to the brightness adaptation value, wherein the brightness adaptation value of the subtitle is positively correlated with the brightness value of the screen backlight brightness of the SDR video played before playing the HDR video, and is negatively correlated with the viewing time.

6. The method according to claim 2, characterized in that The subtitle brightness adjustment parameter includes a brightness adjustment value or a brightness adjustment rate of the subtitle, and updating the brightness setting value of the subtitle based on the subtitle brightness adjustment parameter includes: The brightness setting value of the subtitle is updated based on the brightness adjustment value or the brightness adjustment rate of the subtitle, wherein the brightness adjustment value or the brightness adjustment rate of the subtitle is negatively correlated with the brightness value of the screen backlight brightness of the SDR video played before playing the HDR video, and is positively correlated with the viewing time.

7. The method according to any one of claims 1 to 6, characterized in that The step of displaying the subtitles on the display screen based on the updated brightness level comprises: The screen backlight brightness when playing the HDR video is obtained, and the subtitles are displayed on the display screen based on the screen backlight brightness when playing the HDR video and the updated brightness level.

8. The method according to claim 7, characterized in that The displaying the subtitles on the display screen based on the screen backlight brightness when playing the HDR video and the updated brightness level includes: Determine a difference between a screen backlight brightness when playing the HDR video and a reference backlight brightness corresponding to the HDR video; determining a second target brightness level for the subtitle based on the difference and the updated brightness level; The subtitles are displayed on the display screen based on the second target brightness level.

9. The method according to any one of claims 1 to 6, characterized in that The terminal device includes a brightness sensor, and the displaying of the subtitles on the display screen based on the updated brightness level includes: When playing the HDR video, determining the ambient brightness using the brightness data collected by the brightness sensor at every second preset time interval; The subtitles are displayed on the display screen based on the ambient brightness and the updated brightness level.

10. The method according to claim 9, characterized in that The displaying the subtitles on the display screen based on the ambient brightness and the updated brightness level comprises: Determine a difference between the ambient brightness and a reference ambient brightness corresponding to the HDR video; determining a third target brightness level of the subtitle based on the difference and the updated brightness level; The subtitles are displayed on the display screen based on the third target brightness level.

11. A terminal device, characterized in that: The invention comprises a display screen, a memory and a processor, wherein the display screen, the memory and the processor are coupled, the memory is used to store computer-readable instructions; the processor is used to read the computer-readable instructions and implement the subtitle brightness adjustment method according to any one of claims 1 to 10.

12. A computer storage medium, characterized in that: Computer-readable instructions are stored, and when the computer-readable instructions are executed by a processor, the subtitle brightness adjustment method according to any one of claims 1 to 10 is implemented.

Images