Terminal, control method thereof, and storage medium

Abstract

A terminal (10), a control method, a correction and degradation model generation method, and a storage medium relate to the field of display technology. The terminal (10) includes a display panel (110) and a control circuit (120). The control circuit (120) is configured to control the display panel (110) to display an image based on initial display data and target display data generated based on the initial display data and the correction model when a correction instruction is received.

Description

Technical Field

[0001] The present disclosure relates to the field of display technology, and in particular to a terminal, a terminal control method, and a storage medium. Background Art

[0002] When using mobile phones, tablets, and other devices, users often apply screen protectors for protection. Some screen protectors also offer blue light protection and voyeurism prevention, while others offer special visual effects, such as ceramic frosted films. However, screen protectors can cause the display brightness and color to differ from the original image, and different screen protectors have different effects on the image.

[0003] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute prior art known to ordinary technicians in the field. Summary of the Invention

[0004] The present disclosure provides a terminal, a terminal control method, and a storage medium.

[0005] According to one aspect of the present disclosure, there is provided a terminal, including:

[0006] Display panel;

[0007] The control circuit is connected to the display panel and is configured to control the display panel to display an image according to initial display data and target display data generated based on the initial display data and a correction model when a correction instruction is received.

[0008] In an exemplary embodiment of the present disclosure, the control circuit is further configured to control the display panel to display an image according to the initial display data and the target display data generated based on the initial display data and the correction model when receiving the correction instruction and the model instruction; the model instruction includes identification information matching the correction model, and the correction model matching the identification information is one of multiple different preset correction models.

[0009] In an exemplary embodiment of the present disclosure, the control circuit includes:

[0010] a storage circuit storing a plurality of correction models;

[0011] The processing circuit is configured to obtain the correction instruction and the model instruction, and select a correction model that matches the identification information.

[0012] In an exemplary embodiment of the present disclosure, the control circuit is further configured to control the display panel to generate a setting interface upon receiving a setting instruction, the setting interface including a first interactive control and a second interactive control;

[0013] The control circuit is further configured to generate the correction instruction based on a user's specified operation on the first interactive control; and generate the model instruction based on a user's operation on the second interactive control.

[0014] In an exemplary embodiment of the present disclosure, the correction model is used to correct the display effect of the terminal after the protective film is applied, so as to ensure that the display effect is consistent with that without the protective film.

[0015] According to one aspect of the present disclosure, a method for controlling a terminal is provided, wherein the terminal includes a display panel; the method comprising:

[0016] receiving a correction instruction and generating target display data according to the initial display data and a correction model;

[0017] The display panel is controlled to display an image according to the target display data.

[0018] In an exemplary embodiment of the present disclosure, a correction instruction is received, and target display data is generated according to initial display data and a correction model; the method includes:

[0019] receiving the correction instruction and the model instruction, and selecting, according to the identification information of the model instruction, one of a plurality of different preset correction models that matches the identification information as a target correction model;

[0020] Target display data is generated according to the initial display data and the target correction model.

[0021] In an exemplary embodiment of the present disclosure, receiving the correction instruction and the model instruction includes:

[0022] receiving a setting instruction, and controlling the display panel to generate a setting interface, wherein the setting interface includes a first interactive control and a second interactive control;

[0023] generating the correction instruction in response to a user operation on the first interactive control;

[0024] The model instruction is generated in response to a user operation on the second interactive control.

[0025] In an exemplary embodiment of the present disclosure, when the correction instruction is not generated, the second interactive control is locked.

[0026] In an exemplary embodiment of the present disclosure, the control method further includes a method for generating the correction model, and the method for generating the correction model includes:

[0027] Testing a standard test screen displayed on a display panel of a terminal without a protective film attached thereto to obtain standard display information;

[0028] converting the standard display information into reference display information using a correction model; the reference display information is different from the standard display information;

[0029] Controlling the display panel to display a reference detection screen according to the reference display information, and detecting the reference detection screen when the display panel of the terminal is in a state where a protective film is attached, to obtain comparative display information;

[0030] The correction model is updated according to the difference between the standard display information and the comparative display information until the difference between the comparative display information and the standard display information reaches a specified condition, and then the correction model is output.

[0031] In an exemplary embodiment of the present disclosure, the control method further includes a method for generating the correction model, and the method for generating the correction model includes:

[0032] Testing a test screen displayed on a display panel of a terminal without a protective film attached thereto to obtain standard display information;

[0033] converting the standard display information into reference display information using a correction model; the reference display information is different from the standard information;

[0034] converting the reference display information into target display information using a degradation model; the target display information is different from the reference information;

[0035] The correction model is updated according to the difference between the target display information and the standard display information until the difference between the target display information and the standard display information reaches a specified condition, and then the correction model is output.

[0036] In an exemplary embodiment of the present disclosure, updating the correction model according to the difference between the target display information and the standard display information includes:

[0037] determining correction adjustment information according to the target display information, the standard display information and a correction loss function;

[0038] The correction model is updated according to the correction adjustment information.

[0039] In an exemplary embodiment of the present disclosure, the standard display information includes at least one of brightness information and color information.

[0040] In an exemplary embodiment of the present disclosure, the control method further includes a method for generating the degradation model, and the method for generating the degradation model includes:

[0041] Testing a test image displayed on a display panel of a terminal without a protective film attached thereto to obtain reference display information;

[0042] detecting a detection screen displayed on a display panel of the terminal in a state where the protective film is attached, to obtain degradation display information;

[0043] converting the reference display information into simulated display information using a degradation model; wherein the simulated display information is different from the reference information;

[0044] The degradation model is updated according to the difference between the simulation display information and the degradation display information until the difference between the simulation display information and the degradation display information reaches a specified condition, and then the degradation model is output.

[0045] In an exemplary embodiment of the present disclosure, updating the degradation model according to the difference between the simulation display information and the degradation display information includes:

[0046] determining degradation adjustment information according to the simulation display information, the degradation display information, and a degradation loss function;

[0047] The degradation model is updated according to the degradation adjustment information.

[0048] In an exemplary embodiment of the present disclosure, at least one of the reference display information, the degraded display information, and the simulated display information includes at least one of brightness information and color information.

[0049] According to one aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, any one of the control methods described above is implemented.

[0050] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0051] The accompanying drawings are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification, are used to explain the principles of the present disclosure. Obviously, the drawings described below are only some embodiments of the present disclosure, and those skilled in the art can derive other drawings based on these drawings without inventive effort.

[0052] Figure 1 This is a schematic diagram of an embodiment of the terminal disclosed herein.

[0053] Figure 2 Schematic diagram of a display panel and a control mainboard in one embodiment of the terminal disclosed herein.

[0054] Figure 3 1 is a circuit schematic diagram of a terminal in one embodiment of the terminal disclosed herein.

[0055] Figure 4 Schematic diagram of a 3D-LUT model used for grayscale information conversion of pixels in one embodiment of the terminal disclosed herein.

[0056] Figure 5 Schematic diagram of a 3D-LUT model in one embodiment of the terminal disclosed herein.

[0057] Figure 6 This is a schematic diagram of a correction model in one embodiment of the terminal disclosed herein.

[0058] Figure 7 This is a schematic diagram of another correction model in one embodiment of the terminal disclosed herein.

[0059] Figure 8 Generate an interface for the first interactive control and the second interactive control in an embodiment of the terminal of the present disclosure Figure 2 .

[0060] Figure 9 Generate an interface for the first interactive control and the second interactive control in an embodiment of the terminal of the present disclosure Figure 1 .

[0061] Figure 10 This is a flow chart of an implementation of the control method disclosed herein.

[0062] Figure 11 This is a flow chart of an embodiment of the method for generating a degradation model disclosed in the present invention.

[0063] Figure 12 This is a flow chart of an embodiment of the method for generating a correction model disclosed in the present invention.

[0064] Figure 13 This is a flow chart of another embodiment of the method for generating a correction model disclosed herein. DETAILED DESCRIPTION

[0065] Example embodiments will now be described more fully with reference to the accompanying drawings. However, the example embodiments can be implemented in many forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the concepts of the example embodiments to those skilled in the art. Like reference numerals in the figures represent identical or similar structures, and thus their detailed descriptions will be omitted. Furthermore, the figures are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale.

[0066] The terms "a", "an", "the", "said" and "at least one" are used to indicate the presence of one or more elements / components / etc.; the terms "including" and "having" are used to express open-ended inclusion and mean that additional elements / components / etc. may be present in addition to the listed elements / components / etc.; the terms "first", "second" and "third" etc. are used only as labels and are not intended to limit the quantity of their objects.

[0067] The embodiment of the present disclosure provides a terminal, which can be a mobile terminal such as a mobile phone, a tablet computer, or a wearable device such as a smart watch, as long as it can display images. Figure 1-Figure 3 As shown, the terminal 10 of the present disclosure may include a display panel 110 and a control circuit 120, wherein:

[0068] The control circuit 120 is connected to the display panel 110 and is configured to control the display panel 110 to display an image according to the initial display data and target display data generated based on the initial display data and the correction model when receiving the correction instruction.

[0069] The terminal of the embodiment of the present disclosure can pre-set at least one correction model based on different protective films, and the correction model corresponds to the degree of degradation of the image caused by the protective film; when the initial display data is obtained, the correction function can be turned on according to the correction instruction, the initial display data can be converted according to the correction model to obtain target display data, and the display panel 110 can be controlled to display the image according to the target display data, rather than directly displaying the image according to the initial display data; the display effect after the image displayed according to the target display data is superimposed with the degradation effect caused by the protective film can be consistent with the display effect of the image directly displayed according to the initial display data without the protective film, thereby weakening the influence of the protective film on the display effect viewed by the user.

[0070] The following is a detailed description of the terminal:

[0071] Terminal 10 can display images through its display panel 110. For example, display panel 110 includes multiple light-emitting devices. These light-emitting devices can be OLEDs (organic light-emitting diodes) using organic light-emitting materials; LEDs (light-emitting diodes) using inorganic light-emitting materials, such as Micro LEDs (micrometer light-emitting diodes) and Mini LEDs (sub-millimeter light-emitting diodes); or QLEDs (quantum dot diodes). Furthermore, display panel 110 can also be a liquid crystal display panel. The specific structure of display panel 110 is not particularly limited herein, as long as it can display images.

[0072] Furthermore, to enable interaction between the terminal and the user, the display panel 110 may be a touch display panel. This panel may include a display substrate and a touch layer located on the light-emitting side of the display substrate. The display substrate is capable of displaying images; the touch layer is capable of sensing touch operations, thereby displaying specific images in response to the touch operations. The touch layer may employ a capacitive touch structure, such as a self-capacitive or mutual-capacitive touch structure. Alternatively, a resistive touch structure may be employed. The structure of the touch layer and the touch principle are not specifically limited herein; as long as the touch function is implemented, any suitable design is acceptable.

[0073] In some embodiments of the present disclosure, taking the display panel 110 as an OLED display panel 110 as an example, it may include a driving backplane and a plurality of light-emitting devices arrayed and distributed on one side of the driving backplane. The driving backplane has a driving circuit for driving the light-emitting device to emit light, and the driving circuit may include a pixel circuit and a peripheral circuit, wherein: the pixel circuit may be a 7T1C, 3T1C or other pixel circuit, as long as it can drive the light-emitting device to emit light, and its structure is not specifically limited here. Among them, nTmC means that a pixel circuit includes n transistors (represented by the letter "T") and m capacitors (represented by the letter "C"). The number of pixel circuits may be the same as the number of light-emitting devices, and they are connected to each light-emitting device in a one-to-one correspondence so as to control each light-emitting device to emit light separately. Of course, the number of pixel circuits may also be less than the number of light-emitting devices. For example, the same pixel circuit may also be connected to multiple light-emitting devices to drive multiple light-emitting devices to emit light at the same time, and no special limitation is made here.

[0074] The display panel 110 may have multiple pixels, each of which may include multiple sub-pixels. For example, a pixel may include three sub-pixels, each of which may emit light independently, and the sub-pixels of the same pixel may emit light of different colors. For example, a pixel may include a sub-pixel that emits red light, a sub-pixel that emits green light, and a sub-pixel that emits blue light. A sub-pixel may include a light-emitting device. If different light-emitting devices can emit light of different colors, the light-emitting color of the sub-pixel is the light-emitting color of the light-emitting device. If the light-emitting colors of the light-emitting devices are the same, the sub-pixel may include a light-emitting device and a corresponding color filter. That is, the display panel 110 may also include a color filter located on the side of the light-emitting device away from the driver backplane, and the light-emitting device and the color filter define the light-emitting color of the sub-pixel.

[0075] The display panel 110 can be further divided into at least a display area 101 and a peripheral area 102 outside the display area 101. The peripheral area 102 can be a closed or open annular region surrounding the display area 101. The display area 101 includes light-emitting devices and pixel circuits connected to the light-emitting devices. The aforementioned pixels can be located in the display area 101. The peripheral area 102 includes peripheral circuits that can output signals to the pixel circuits to control the light-emitting timing and grayscale of the light-emitting devices, thereby allowing the display panel 110 to display images.

[0076] Furthermore, the peripheral area 102 and the control mainboard 140 can be connected via a flexible circuit board 130, and the control circuit 120 can be located on the control mainboard 140. For example, in the case of a mobile phone, the control mainboard 140 is the mainboard of the mobile phone. A driver chip circuit can be located on the peripheral area 102 or the flexible circuit board 130, and the peripheral circuits and pixel circuits can be connected to the driver chip. After powering on, the control circuit 120 generates display data and transmits it to the driver chip circuit. The driver chip circuit outputs control signals to the peripheral circuits and pixel circuits based on the display data, controlling the light-emitting devices to emit light. This control circuit 120 can then control the display panel 110 to display an image. The display data can be used to display video or still images, and its specific content is not specifically limited here.

[0077] In addition, the control circuit 120 can also output a touch driving signal to the touch layer through the driver chip circuit to sense the touch operation, and the sensing signal output by the touch layer can also be transmitted to the driver chip circuit. After being processed by the driver chip, it is transmitted to the control circuit 120 to determine the touch position and generate a corresponding image.

[0078] like Figure 2 and Figure 3As shown, the control circuit 120 may include at least a processing circuit 121 and a storage circuit 122. The processing circuit 121 may include a main processing subcircuit and an image processing subcircuit, which may transmit display data to the driver chip circuit via the image processing subcircuit. The main processing subcircuit and the image processing subcircuit may be integrated into the same chip or may be separate circuits. For example, the main processing subcircuit may be a central processing unit (CPU), and the image processing subcircuit may be a graphics processing unit (GPU). The storage circuit 122 is used to store the information required by the processing circuit 121 to display images for easy access.

[0079] The control circuit 120 generates display data and controls the display panel 110 to display images based on the display data. When the display panel 110 is not covered with a protective film, the user can view an undegraded image without the film's influence. However, if the display panel 110 is covered with a protective film, such as an anti-blue light film or a privacy film, the brightness of light emitted from the display panel 110 may decrease after passing through the protective film, and color defects such as color shift may occur, resulting in the user viewing a degraded image that differs from the undegraded image.

[0080] like Figure 10 As shown, in some embodiments of the present disclosure, the display data generated by the control circuit 120 can be used as initial display data. After receiving the initial display data, the display panel 110 does not directly display an image based on the initial display data. Instead, the control circuit 120 detects whether a correction instruction has been received. If a correction instruction has been received, the control circuit 120 converts the initial display data into target display data using the correction model, and controls the display panel 110 to display an image based on the target display data.

[0081] The correction model is pre-trained, generated, and stored using a specific generation method. For example, the correction model can be pre-burned into the control circuit's memory for easy recall. A correction model can correspond to the image degradation effect of a protective film. Based on the correction model, the initial display data can be converted to target display data, which differs from the initial display. The control circuit controls the display panel to display an image based on the target display data. When combined with the degradation effect of the protective film, the user can view an undegraded image, achieving a display effect similar to or similar to that without the protective film.

[0082] The number of correction models can be two or more, and the number depends on the type of protective film that can be attached to the display panel. For example, there are four correction models, corresponding to anti-blue light film, anti-peep film, anti-blue light + anti-peep film, and frosted film. Different correction models have different conversion results for the initial display data. Accordingly, the terminal can provide correction for these four protective films respectively. If you want to correct the display effect of other protective films, you can add correction models. Of course, the number of correction models can also be only one, and only the display effect of one protective film can be corrected. Of course, the same correction mode can also be used for correction of multiple protective films.

[0083] like Figure 4 and Figure 5 As shown, in some embodiments of the present disclosure, the correction model can use a 3D-LUT, that is, a three-dimensional lookup table. Taking one frame as an example, the initial display data may include the grayscale information corresponding to each pixel, and the 3D-LUT may include new grayscale information corresponding to at least a portion of the pixels in the initial display data. Based on the initial display data and the 3D-LUT, the new grayscale information of at least a portion of the pixels, that is, the target display data, can be directly obtained by looking up the table. At the same time, in order to reduce the amount of calculation, the 3D-LUT may only include the new grayscale information of some pixels, while the new grayscale information of other pixels can be calculated through an interpolation algorithm. Of course, the grayscale information of each pixel in the initial display data is set as new grayscale information in the 3D-LUT without interpolation calculation.

[0084] For example, a pixel consists of three sub-pixels of different colors, red (R), green (G), and blue (B). The three-dimensional lookup table can be expressed as follows:

[0085]

[0086] Here, i, j, and k are coordinates of three colors in a color space (which can reflect grayscale information of different colors).

[0087] The pixels of the input image can be represented as:

[0088]

[0089] The pixels of the output image can be represented as:

[0090]

[0091] Since 3D-LUT is based on the grayscale information of pixels, that is, it is based on the grayscale information of a group of sub-pixels, rather than the grayscale information of a single sub-pixel, Figure 4As shown, the grayscale information of the three sub-pixels of the output pixel changes on a pixel-by-pixel basis compared to the input grayscale information. For example, the input values ​​of the sub-pixels of a pixel are 50, 50, 50, and the corresponding output values ​​are 70, 70, 70. If the input values ​​change to 50, 50, 60, the corresponding output values ​​are 80, 80, 75. It can be seen that this can better reflect the correlation between the grayscales of the sub-pixels of the same pixel, which is not only beneficial for brightness correction, but also helps preserve color information such as saturation and subjective information such as detail preference, thereby achieving brightness and color correction of the image.

[0092] The correction model can use a 1D lookup table, which may only include the new grayscale information of some sub-pixels, while the new grayscale information of other sub-pixels is calculated through interpolation. Of course, the grayscale information of each sub-pixel in the initial display data is set in the 1D lookup table without interpolation.

[0093] The correction model can also be a convolutional neural network model, such as a residual network (ResNet), a dense network (DenseNet), a U-type network (Unet), etc.

[0094] In some embodiments of the present disclosure, a network model such as a residual network (ResNet), a dense network (DenseNet), or a U-shaped network may be used in combination with an attention mechanism to establish a correction model; for example:

[0095] In some embodiments of the present disclosure, Figure 6 As shown, Figure 6 The figure shows a network structure of a correction model, where Conv is the convolution layer, k1f64s1 is the convolution kernel size, k is 1, the number of feature layers f is 64, and the step size s is 1. Figure 6 The model structure in the [1] can use 1x1 convolution, taking pixels as the basic unit, to perform point-to-point spatial mapping on the initial display information, and the CAR residual structure (self-residual structure) can achieve the residual capability without introducing redundant calculations, effectively improving the training efficiency of the model. Figure 6 (The second row in the figure shows the final output feature layer number f = 64m, where m is the number of CAR modules.) These 64m feature layers are then sequentially multiplied with the output of the self-recovery structure in CAR as coefficients to perform more refined coefficient correction on the backbone network. Furthermore, ReLU is the first activation function layer, Maxpool is the pooling layer, InsNorm is the normalization layer, Bilinear is the bilinear layer, and Sigmoid is the second activation function layer.

[0096] The attention network described above extracts global features from the initial display information and maps these extracted feature parameters to the first row of the backbone network via sigmoid regression, thereby correcting the backbone network. This global correction of the backbone network using global image information allows for better adaptation to color mapping for diverse styles and content (e.g., daytime, nighttime, TV series, movies, and variety shows). Furthermore, the model's simple structure, primarily using 1x1 pixels, and the second row performing calculations at a relatively small resolution, makes it suitable for terminal integration.

[0097] In other embodiments of the present disclosure, Figure 7 As shown in the figure, conv 3x3 is a convolutional layer with a kernel of 3, RDB is a combination of a residual network and a dense network, GCT represents the attention mechanism, and Guided filter is a guided filter. The correction model consists of three parts: image reconstruction (IR), detail restoration (DR), and low contrast enhancement (LCE). IR can achieve basic HDR (color mapping), DR enriches the texture details of the initial display information based on IR, and LCE uses guided filtering to achieve temporal brightness equalization, enabling more refined contrast adjustment of the corrected image.

[0098] In other embodiments of the present disclosure, after receiving initial display data, the image is not directly displayed based on the initial display data. Instead, the system detects whether a correction instruction has been received. If a correction instruction has been received, the system further detects whether a model instruction has been received. If a model instruction has been received, a matching correction model is selected from a set of preset correction models based on the identification information of the model instruction. For example, each correction model has unique identification information. Based on the identification information of the model instruction, the system can find the correction model corresponding to the same identification information, thereby enabling the selection of the correction model.

[0099] Of course, after receiving the initial display data, if neither the correction instruction nor the model instruction is received, the image may be displayed according to the initial display data.

[0100] By controlling the above-mentioned correction instructions and model instructions, the selection of the display mode can be achieved. Both the correction instructions and the model instructions can be generated based on the user's specified operations, and the specified operations of the two can be different operations.

[0101] In some embodiments of the present disclosure, upon receiving a setup instruction, the control circuit may control the display panel to generate a setup interface that may include a first interactive control and a second interactive control. A correction instruction may be generated based on a user's specified operation on the first interactive control; and a model instruction may be generated based on a user's specified operation on the second interactive control. Furthermore, if a correction instruction is not generated, the second interactive control may be locked. That is, if no specified operation is performed on the first interactive control, the second interactive control is inoperable, and no model instruction can be generated.

[0102] The setting instruction may be generated by clicking a specific control in the screen of the display panel. For example, a setting option in the setting control may be selected in the screen through a touch operation to enter the setting interface.

[0103] like Figure 8 and Figure 9 As shown, the first interactive control can be presented in the settings interface as a slidable button, and sliding the button can switch between the correction and non-correction modes. Of course, the first interactive control can also be a menu with correction and non-correction options, and its presentation form is not particularly limited here.

[0104] like Figure 8 and Figure 9 As shown, the second interactive control can be presented in the form of multiple options that can be selected and scrolled through by arrows. Each option corresponds to a protective film, and thus corresponds to a correction model. By switching options, the correction model can be selected, and a correction model can correspond to a display mode. Figure 8 As shown, Figure 8 The protective film selected is an anti-blue light film. Of course, other protective films can also be used, such as tempered film, anti-peeping film, anti-blue light + anti-peeping film, etc. In view of relevant industry standards, the method provided in this embodiment can ensure that the display effect of the terminal before and after the protective film is applied is consistent. In addition, the second interactive control can also be a menu with multiple protective film options. As long as the selection of the correction model can be achieved, there is no special limitation on its presentation form. Among them, when the user selects an option, a mode instruction can be generated. The mode instruction has unique identification information. The identification information of different mode instructions generated when different options are selected is different, so that different correction models can be selected.

[0105] The processing circuit 121 may be configured to generate initial display data and obtain correction instructions and model instructions, and select a correction model that matches the identification information according to the identification information of the mode instruction.

[0106] In addition, if Figure 9 As shown, if no correction instruction is generated through the first interactive control, the second interactive control can be closed, for example, Figure 9The correction button is in the off state, and no correction instruction is issued at this time. Correspondingly, the arrow and option for selecting the protective film are also closed and in an inoperable state. Figure 8 As shown, when the button showing correction is in the on state, the correction instruction is issued, and the arrow and option for selecting the protective film are also opened for the user to select.

[0107] The present disclosure also provides a method for controlling a terminal according to any of the above embodiments. The structure and related contents of the terminal have been described in detail above and will not be described in detail here. The control method may include steps S110 and S120, wherein:

[0108] Step S110 : receiving a correction instruction, and generating target display data according to the initial display data and a correction model.

[0109] Step S120 : controlling the display panel to display an image according to the target display data.

[0110] The control method disclosed herein can pre-set at least one correction model based on different protective films, and the correction model corresponds to the degree of degradation of the image caused by the protective film; when the initial display data is obtained, the correction function can be turned on according to the correction instruction, the initial display data can be converted according to the correction model to obtain target display data, and the display panel can be controlled to display the image according to the target display data, rather than directly displaying the image according to the initial display data; the display effect after the image displayed according to the target display data is superimposed with the degradation effect caused by the protective film can be consistent with the display effect of the image directly displayed according to the initial display data without the protective film, thereby weakening the influence of the protective film on the display effect viewed by the user.

[0111] In some embodiments of the present disclosure, step S110 may include step S1110 and step S1120, wherein:

[0112] Step S1110: Receive the correction instruction and the model instruction, and select one that matches the identification information from a plurality of different preset correction models as a target correction model according to the identification information of the model instruction.

[0113] like Figure 10 As shown, after receiving the initial display data, the image is not directly displayed based on the initial display data. Instead, the system detects whether a correction instruction has been received. If a correction instruction has been received, the system further detects whether a model instruction has been received. If a model instruction has been received, a matching correction model is selected from the preset correction models based on the identification information of the model instruction. For example, each correction model has unique identification information. Based on the identification information of the model instruction, the correction model corresponding to the same identification information can be found, thereby achieving the selection of the correction model.

[0114] Step S1120: Generate target display data according to the initial display data and the target correction model.

[0115] The correction model transforms the initial display data into target display data, which differs from the initial display. The control circuit directs the display panel to display an image based on the target display data. When combined with the degradation effect of the protective film, the user sees an undegraded image, achieving a display effect similar to or similar to that without the protective film.

[0116] In other embodiments of the present disclosure, after receiving the initial display data, the image is not displayed directly based on the initial display data, but rather it is detected whether a correction instruction is received; if a correction instruction is received, the initial display data can be converted into target display data through the correction model, and the display panel can be controlled to display the image according to the target display data.

[0117] In some embodiments of the present disclosure, in step S1110, the correction instruction and the model instruction are received; and steps S210 to S230 may be included, wherein:

[0118] Step S210: receiving a setting instruction, controlling the display panel to generate a setting interface, wherein the setting interface includes a first interactive control and a second interactive control;

[0119] Step S220: Generate the correction instruction in response to the user's operation on the first interactive control.

[0120] Step S230: Generate the model instruction in response to the user's operation on the second interactive control.

[0121] Upon receiving a setup instruction, the control circuitry may control the display panel to generate a setup interface, which may include a first interactive control and a second interactive control. A correction instruction may be generated based on a user's specified operation on the first interactive control; and a model instruction may be generated based on a user's specified operation on the second interactive control. Furthermore, if no correction instruction is generated, the second interactive control may be locked. That is, if no specified operation is performed on the first interactive control, the second interactive control is inoperable, and no model instruction can be generated.

[0122] The setting instruction may be generated by clicking a specific control in the screen of the display panel. For example, a setting option in the setting control may be selected in the screen through a touch operation to enter the setting interface.

[0123] The second interactive control can be presented in a manner that can be selected and scrolled through multiple options by arrows. Each option corresponds to a protective film, and thus corresponds to a correction model. By switching options, the correction model can be selected, and one correction model can correspond to one display mode. Of course, the second interactive control can also be a menu with multiple protective film options. As long as the selection of the correction model can be achieved, its presentation form is not specifically limited here. Among them, when the user selects an option, a mode instruction can be generated. The mode instruction has unique identification information. The identification information of different mode instructions generated when different options are selected is different, so that different correction models can be selected.

[0124] The details of the control method disclosed herein have been described in detail in the above terminal implementation manner and will not be repeated here.

[0125] The terminal control method disclosed herein may further include a method for generating a correction model. The correction model may be generated based on the degradation model. Therefore, the control method may further include a method for generating a degradation model. The method for generating a degradation model is described below:

[0126] like Figure 11 As shown, the method for generating a degradation model according to an embodiment of the present disclosure may include steps S310 to S340, wherein:

[0127] Step S310: Detect a detection screen displayed on a display panel of a terminal without a protective film attached thereto to obtain reference display information.

[0128] Without a protective film attached, the display panel can display a test image. The test image can be one or more crystalline images or a continuous video. The display panel image can be inspected using an optical inspection device such as a camera to obtain display information, which serves as baseline display information. The display information can include both brightness and color information, or alternatively, only one of the two. Color information can include saturation, color cast, and other information.

[0129] Step S320: Detect a detection image displayed on the display panel of the terminal in a state where the protective film is attached, and obtain degradation display information.

[0130] like Figure 11 As shown, the protective film can be an anti-blue light film, an anti-peep film, etc., and its type is not specifically limited here. When the protective film is attached, the display panel can still display the detection screen, which is the same as the detection screen in step S310. The detection screen is detected by an optical detection device to obtain display information as the degraded display information. Due to the influence of the protective film, the user's viewing experience is different from when the film is not attached, causing the degraded display information to be different from the baseline display information.

[0131] Step S330: using a degradation model to convert the reference display information into simulated display information; the simulated display information is different from the reference information.

[0132] like Figure 11 As shown, the simulated display information is not obtained by testing the display panel, but rather by transforming the baseline display information using a degradation model. Before any update to the degradation model, the simulated display information may differ from the degraded display information. The initial degradation model can be generated based on empirical data, randomly, or in other ways. Since the degradation model will be trained (i.e., cyclically updated) in subsequent steps, there is no requirement for a difference between the degraded display information and the simulated display information obtained based on the initial degradation model.

[0133] Step S340: updating the degradation model according to the difference between the simulation display information and the degradation display information, until the difference between the simulation display information and the degradation display information reaches a specified condition, and outputting the degradation model.

[0134] like Figure 11 As shown, the measured degraded display information can be used as a benchmark for comparison with the simulated display information. The degradation model is updated based on the difference between the two. When the difference reaches a specified condition, the degradation model is output. This allows the degradation model to simulate the impact of applying a protective film on the display information. The specified condition can be that the degraded display information is the same as the simulated display information, or that the difference between the two is within a certain range, such as less than 10%.

[0135] In some embodiments of the present disclosure, step S340 may include step S3410 and step S3420, wherein:

[0136] Step S3410: Determine degradation adjustment information according to the simulation display information, the degradation display information, and the degradation loss function.

[0137] like Figure 11 As shown, the degradation loss function can be an L1 loss function, an MSE loss function, or the like, and its specific type is not particularly limited herein. The loss function can be calculated for the simulated display information and the degraded display information to obtain degradation adjustment information. The degradation adjustment information can include weights for different information in the degradation model, such as brightness weights and weights for specific colors.

[0138] Step S3420: Update the degradation model according to the degradation adjustment information.

[0139] like Figure 11As shown, the parameters in the degradation model can be updated based on the weights of the degradation adjustment information, increasing or decreasing the relevant parameters to obtain an updated degradation model. Simulation display information can be regenerated based on the updated degradation model, and step S340 is performed again until the difference between the simulation display information and the degradation display information meets a specified condition. The desired degradation model is then obtained and output.

[0140] The degradation model can adopt a 3D-LUT or a convolutional neural network model. The model structure thereof refers to the model structure of the correction model mentioned above and will not be described in detail here.

[0141] like Figure 12 As shown, the embodiment of the present disclosure further provides a method for generating a correction model, which may include steps S410 to S440, wherein:

[0142] Step S410: Detect a standard detection screen displayed on a display panel of a terminal without a protective film attached thereto to obtain standard display information.

[0143] Without a protective film attached, the display panel can display a standard inspection image. This standard inspection image can be one or more crystalline images or a continuous video. The display panel image can be inspected using an optical inspection device such as a camera to obtain display information as standard display information. This display information can include both brightness and color information, or alternatively, only one of these can be included. Color information can include saturation, color cast, and other information.

[0144] Step S420: using a correction model to convert the standard display information into reference display information; the reference display information is different from the standard display information.

[0145] like Figure 12 As shown, the correction model can be a 3D-LUT or a convolutional neural network model. Its model structure can refer to the description of the correction model in the embodiment of the terminal above, and will not be described in detail here. The correction model in step S420 can be an initial correction model, not the correction model finally used for the above-mentioned control method. The standard display information can be used as input information to generate reference display information through the correction model. The reference display information is not obtained by detecting the display panel, but is obtained by converting the standard display information using the correction model. Before any update of the correction model, there may be a difference between the reference display information and the standard display information. The initial correction model can be generated based on empirical data, or it can be generated randomly or in other ways. Since the subsequent steps will train the correction model, that is, cyclically update it, there is no requirement for the difference between the standard display information and the reference display information obtained based on the initial correction model.

[0146] Step S430 : Control the display panel to display a reference detection screen according to the reference display information, and detect the reference detection screen when the display panel of the terminal is in a state of being covered with a protective film to obtain comparative display information.

[0147] like Figure 12 As shown, the protective film can be an anti-blue light film, an anti-peep film, etc., and its type is not specifically limited here. When the protective film is attached, the display panel can display a reference detection screen based on the reference display information. The reference detection screen is detected by an optical detection device to obtain display information as comparative display information. Due to the influence of the protective film, the user's viewing experience may be different from when the film is not attached, making the comparative display information different from the standard display information.

[0148] Step S440: updating the correction model according to the difference between the standard display information and the comparison display information, and outputting the correction model when the difference between the comparison display information and the standard display information reaches a specified condition.

[0149] like Figure 12 As shown, the comparison display information can be compared with the standard display information, and a correction model can be updated based on the difference between the two. When the difference reaches a specified condition, the correction model is output. This correction model can then be used to correct the initial display information, preemptively compensating for the impact of the protective film on the image. This ensures that the display effect viewed by the user with the protective film attached is consistent or nearly consistent with that without the protective film. The specified condition can be that the comparison display information is identical to the standard display information, or that the difference between the two is within a certain range, such as less than 10%.

[0150] like Figure 13 As shown, based on the degradation model of any of the above embodiments, the embodiments of the present disclosure further provide another method for generating a correction model, which may include steps S510 to S540, wherein:

[0151] Step S510: Detect a detection screen displayed on a display panel of a terminal without a protective film attached thereto to obtain standard display information.

[0152] like Figure 13 As shown, without a protective film attached, the display panel can display a standard inspection image. The standard inspection image can be one or more crystalline images or a continuous video. The display panel image can be inspected using an optical inspection device such as a camera to obtain display information as standard display information. The display information can include brightness information and color information, or alternatively, only one of the two. Color information can include saturation, color cast, and other information.

[0153] Step S520: using a correction model to convert the standard display information into reference display information; the reference display information is different from the standard information.

[0154] like Figure 13 As shown, the correction model can be a 3D-LUT or a convolutional neural network model. Its model structure can refer to the description of the correction model in the embodiment of the terminal above, and will not be described in detail here. The correction model in step S520 can be an initial correction model, not the correction model finally used for the above-mentioned control method. The standard display information can be used as input information to generate reference display information through the correction model. The reference display information is not obtained by detecting the display panel, but is obtained by converting the standard display information using the correction model. Before any update of the correction model, there may be a difference between the reference display information and the standard display information. The initial correction model can be generated based on empirical data, or it can be generated randomly or in other ways. Since the subsequent steps will train the correction model, that is, cyclically update it, there is no requirement for the difference between the standard display information and the reference display information obtained based on the initial correction model.

[0155] Step S530: using a degradation model to convert the reference display information into target display information; the target display information is different from the reference information.

[0156] like Figure 13 The method for generating the degradation model has been described above and will not be detailed here. The degradation model can be used to simulate the display effect with a protective film applied. In other words, the degradation model can be used to convert reference display information into target display information. The target display information obtained through the degradation model simulation can be used to replace the display information actually measured with the protective film applied, which helps improve efficiency.

[0157] Step S540: Update the correction model according to the difference between the target display information and the standard display information, and output the correction model when the difference between the target display information and the standard display information reaches a specified condition.

[0158] like Figure 13 As shown, the target display information can be compared with the standard display information, and the correction model can be updated based on the difference between the two. When the difference between the two reaches a specified condition, it indicates that the reference display information converted by the correction model has sufficiently compensated for the degradation caused by the protective film. At this point, the correction model can be output, and the initial display information can be corrected using the correction model to preemptively compensate for the impact of the protective film on the image. This ensures that the display effect viewed by the user with the protective film attached is consistent or nearly consistent with that without the protective film. The specified condition can be that the comparison display information is the same as the standard display information; or that the difference between the two is within a certain range, such as less than 10%.

[0159] like Figure 13 As shown, in some embodiments of the present disclosure, step S540 may include step S5410 and step S5420, wherein:

[0160] Step S5410: Determine correction adjustment information according to the target display information, the standard display information and the correction loss function.

[0161] The correction loss function can be an L1 loss function, a MSE loss function, or the like, and its specific type is not specifically limited herein. The loss function can be calculated for the target display information and the standard display information to obtain correction adjustment information. The correction adjustment information can include weights for different information in the correction model, such as brightness weights, weights for specific colors, and so on.

[0162] Step S5420: Update the correction model according to the correction adjustment information.

[0163] Based on the weights of the correction adjustment information, the parameters in the correction model can be updated, increasing or decreasing the relevant parameters to obtain an updated correction model. Based on the updated correction model, the reference display information can be regenerated, and steps S530 and S540 are repeated until the difference between the target display information and the standard display information meets a specified condition. The desired correction model is then obtained and output.

[0164] An embodiment of the present disclosure further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, at least one of the above-mentioned control method and generation method is implemented.

[0165] Through the description of the above embodiments, it is easy for those skilled in the art to understand that the example embodiments described herein can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the embodiments of the present disclosure can be embodied in the form of a program product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes a number of instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the control method and generation method according to the embodiments of the present disclosure.

[0166] It should be noted that although the steps of the method disclosed herein are depicted in a particular order in the accompanying drawings, this does not require or imply that the steps must be performed in that particular order, or that all steps must be performed to achieve the desired result. Additionally or alternatively, certain steps may be omitted, multiple steps may be combined into one, and / or one step may be decomposed into multiple steps.

[0167] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the appended claims.

Claims

1. A terminal, comprising: Display panel; a control circuit connected to the display panel and configured to control the display panel to display an image according to initial display data and target display data generated based on the initial display data and a correction model when a correction instruction is received; The method for generating the correction model includes: Testing a test screen displayed on a display panel of a terminal without a protective film attached thereto to obtain standard display information; converting the standard display information into reference display information using a correction model; the reference display information is different from the standard display information; converting the reference display information into target display information using a degradation model; the target display information is different from the reference display information; The correction model is updated according to the difference between the target display information and the standard display information until the difference between the target display information and the standard display information reaches a specified condition, and then the correction model is output.

2. The terminal according to claim 1, wherein: The control circuit is also configured to control the display panel to display an image based on the initial display data and the target display data generated based on the initial display data and the correction model when receiving the correction instruction and the model instruction; the model instruction includes identification information matching the correction model, and the correction model matching the identification information is one of multiple different preset correction models.

3. The terminal according to claim 2, wherein: The control circuit comprises: a storage circuit storing a plurality of correction models; The processing circuit is configured to obtain the correction instruction and the model instruction, and select a correction model that matches the identification information. The terminal according to claim 2 , wherein: The control circuit is further configured to control the display panel to generate a setting interface when receiving a setting instruction, wherein the setting interface includes a first interactive control and a second interactive control; The control circuit is further configured to generate the correction instruction based on a user's specified operation on the first interactive control; and generate the model instruction based on a user's operation on the second interactive control.

5. The terminal according to any one of claims 1 to 4, wherein: The correction model is used to correct the display effect of the terminal after the protective film is applied to ensure that the display effect is consistent with that without the protective film.

6. A method for controlling a terminal, the terminal including a display panel; the method comprising: receiving a correction instruction and generating target display data according to the initial display data and a correction model; controlling the display panel to display an image according to the target display data; The control method further includes a method for generating the correction model, and the method for generating the correction model includes: Testing a test screen displayed on a display panel of a terminal without a protective film attached thereto to obtain standard display information; converting the standard display information into reference display information using a correction model; the reference display information is different from the standard display information; converting the reference display information into target display information using a degradation model; the target display information is different from the reference display information; The correction model is updated according to the difference between the target display information and the standard display information until the difference between the target display information and the standard display information reaches a specified condition, and then the correction model is output.

7. The control method according to claim 6, wherein: Receiving a correction instruction and generating target display data according to initial display data and a correction model; including: receiving the correction instruction and the model instruction, and selecting, according to the identification information of the model instruction, one of a plurality of different preset correction models that matches the identification information as a target correction model; Target display data is generated according to the initial display data and the target correction model.

8. The control method according to claim 7, wherein: Receiving the correction instruction and the model instruction; including: receiving a setting instruction, and controlling the display panel to generate a setting interface, wherein the setting interface includes a first interactive control and a second interactive control; generating the correction instruction in response to a user operation on the first interactive control; The model instruction is generated in response to a user operation on the second interactive control.

9. The control method according to claim 8, wherein: When the correction instruction is not generated, the second interactive control is locked.

10. The control method according to claim 6, wherein: The control method further includes a method for generating the correction model, and the method for generating the correction model includes: Testing a standard test screen displayed on a display panel of a terminal without a protective film attached thereto to obtain standard display information; converting the standard display information into reference display information using a correction model; the reference display information is different from the standard display information; Controlling the display panel to display a reference detection screen according to the reference display information, and detecting the reference detection screen when the display panel of the terminal is in a state where a protective film is attached, to obtain comparative display information; The correction model is updated according to the difference between the standard display information and the comparative display information until the difference between the comparative display information and the standard display information reaches a specified condition, and then the correction model is output.

11. The control method according to claim 6, wherein: Updating the correction model according to the difference between the target display information and the standard display information; comprising: determining correction adjustment information according to the target display information, the standard display information and a correction loss function; The correction model is updated according to the correction adjustment information.

12. The control method according to claim 11, wherein: The standard display information includes at least one of brightness information and color information.

13. The control method according to claim 6, wherein: The control method further includes a method for generating the degradation model, and the method for generating the degradation model includes: Testing a test image displayed on a display panel of a terminal without a protective film attached thereto to obtain reference display information; detecting a detection screen displayed on a display panel of the terminal in a state where the protective film is attached, to obtain degradation display information; converting the reference display information into simulated display information using a degradation model; wherein the simulated display information is different from the reference information; The degradation model is updated according to the difference between the simulation display information and the degradation display information until the difference between the simulation display information and the degradation display information reaches a specified condition, and then the degradation model is output.

14. The control method according to claim 13, wherein: Updating the degradation model according to the difference between the simulation display information and the degradation display information; comprising: determining degradation adjustment information according to the simulation display information, the degradation display information, and a degradation loss function; The degradation model is updated according to the degradation adjustment information.

15. The control method according to claim 14, wherein: At least one of the reference display information, the degraded display information, and the simulated display information includes at least one of brightness information and color information.

16. A computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the control method according to any one of claims 6 to 15 when executed by a processor.

Images