Screen display color adjustment method and electronic device

Abstract

The present application provides a screen display color adjustment method and an electronic device; it relates to the field of terminal technology and can pre-configure the mapping relationship between input color parameters and output color parameters of the screen at different display angles in the electronic device. Subsequently, the electronic device obtains the required input color parameters according to the mapping relationship by identifying the screen display angle, thereby realizing adaptive adjustment of the screen display color and improving the user experience. The method includes: obtaining the angle between the plane where the first face is located and the plane where the electronic device is located, the angle being the display angle. Obtaining the preset color parameters of the first pixel point, using the display angle and the preset color parameters to determine the target color parameters, and then displaying using the target color parameters at the first pixel point.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of terminal technology, and in particular to a screen display color adjustment method and an electronic device. Background Art

[0002] With the development of electronic device screen display technology, electronic devices (such as mobile phones, tablets, etc.) can provide users with better display effects. However, due to the limitations of screen luminous materials and microcavity structures, the color of the same screen will deviate at different viewing angles. For example, the same image is displayed on a mobile phone, such as Figure 1 The angle shown in (a) is tilted to Figure 1 At the angle shown in (b), the image's color differs due to the screen's display angle. In scenarios where color accuracy is critical, such as shopping and design, color difference can affect user choices and reduce the user experience.

[0003] In existing technology, the consistency of the same color displayed on a screen at different viewing angles is generally improved by changing the screen's luminescent materials and microcavity structure. However, changing the luminescent materials and microcavity structure is difficult. Furthermore, due to the inherent limitations of the luminescent materials and microcavity structure, it is difficult to achieve completely consistent screen color at all viewing angles. Summary of the Invention

[0004] The screen display color adjustment method and electronic device provided in the embodiments of the present application can pre-configure the mapping relationship between input color parameters and output color parameters at different screen display angles in the electronic device. Subsequently, the electronic device identifies the screen display angle and obtains the required input color parameters based on the mapping relationship, thereby achieving adaptive adjustment of the screen display color and improving the user experience.

[0005] To achieve the above objectives, the present invention adopts the following technical solutions:

[0006] In a first aspect, embodiments of the present application provide a screen display color adjustment method, applied to a first electronic device. The method may include: determining a first display angle corresponding to a first face; the first display angle being the angle between a plane containing the first face and a plane containing the first electronic device; determining a first color parameter for a first pixel; determining a second color parameter for the first pixel based on the first display angle and the first color parameter; and displaying at the first pixel based on the second color parameter.

[0007] The first color parameter is a preset color parameter corresponding to the pixel, and the second color parameter is a target color parameter corresponding to the pixel. The electronic device displays the color using the target color parameter, and the color parameter identified as the color is the preset color parameter. The preset color parameter is a standard color parameter, or an output color parameter at a preset display angle. For example, if the preset color parameter is a standard color parameter and the electronic device needs to display red, the corresponding preset color parameter is the standard color parameter for red (255, 0, 0). The electronic device searches the input color parameters for the target color parameter that can make the output color parameter (255, 0, 0) based on the display angle and the standard color parameter.

[0008] In this way, when a user is using an electronic device, the device can detect the user's face and determine the display angle. Based on the change in display angle, the device adaptively adjusts color parameters. This ensures that the same color displayed on the screen does not exhibit color deviation at different display angles, improving the user experience.

[0009] In one possible implementation, before determining the first display angle corresponding to the first face, the method further includes: obtaining a three-dimensional color lookup table 3D LUT, the 3D LUT containing a mapping relationship between the first color parameter and the second color parameter at a preset display angle; the preset display angle includes the first display angle.

[0010] Exemplarily, the calibration device measures the output color parameters of the electronic device at different display angles, and then establishes a mapping relationship between the input color parameters (i.e., the second color parameters) and the output color parameters (i.e., the first color parameters) at different display angles, and establishes a 3D LUT containing the mapping relationship.

[0011] The calibration device then sends the 3D LUT to the electronic device, allowing it to use the 3D LUT to determine target color parameters at different display angles. This ensures consistent color at all display angles.

[0012] In one possible implementation, determining the first display angle corresponding to the first face includes: capturing a first image according to a preset period, determining the first image to be a first face image, and determining the first display angle based on the first face image.

[0013] Exemplarily, an electronic device captures an image and uses facial recognition technology to determine the facial image contained therein (i.e., treating the captured image as a facial image). The image then identifies the positions of the user's eyes and mouth, and determines information such as the proportions of the facial features. The device then determines the similarity between the facial features and the proportions of facial features in a learning library (or training set), and the corresponding display angle is determined. For example, the ratio of the forehead to the chin can be used to determine whether the user is looking up or down, which will correspond to different display angles. Alternatively, the image captured by the electronic device may not contain a recognized facial image (i.e., the user's face is not captured), and the image cannot be used as a facial image, in which case the current color parameters remain unchanged. For another example, if the image captured by the electronic device contains a facial image and the image is determined to be a facial image, the corresponding display angle can be determined directly based on the facial image. Furthermore, the recognized facial image may be a complete facial image (i.e., a complete facial image that includes the facial contours and all facial features), or an incomplete facial image (e.g., one that does not include the user's chin). If a facial image includes the user's eyes and mouth, the corresponding display angle can be determined using the above method. Furthermore, the more complete the facial image, the more accurate the display angle. If the corresponding display angle cannot be determined for the captured image, the current color parameters remain unchanged. For another example, if an image captured by an electronic device contains multiple facial images, and the image is determined to be a facial image, the owner's face is identified and the corresponding display angle is determined based on the owner's face. Alternatively, if the owner's face is not identified among multiple faces, the user can be prompted to make a selection, and the corresponding display angle is determined based on the face selected by the user.

[0014] In some embodiments, the electronic device captures a facial image, obtains a display angle, and determines that the display angle has changed, then the color parameters need to be changed. For example, the electronic device captures facial images in real time, and when it is determined that the display angles corresponding to two consecutive facial images are different, it is necessary to determine a new target mapping relationship to obtain the target color parameters for displaying the color. For another example, a shooting cycle is preset, and the electronic device periodically captures the user's facial image to determine whether the display angle has changed, and then determines whether the target color parameters need to be re-determined. For another example, when the user's posture and / or the position of the mobile phone changes, causing the distance between the electronic device screen plane and the user's face plane to change, the display angle will change. Then, after the electronic device determines in a preset manner that the distance between the user's face and the electronic device has changed by more than a preset distance threshold, it captures the user's facial image again, determines the display angle, and determines whether the color parameters need to be updated, thereby reducing the number of times the camera module is started to reduce power consumption.

[0015] In a possible implementation, determining the first display angle according to the first face image includes: determining Euler angles corresponding to the first face according to the first face image, and determining the first display angle corresponding to the Euler angles.

[0016] In some embodiments, an electronic device captures a facial image and uses an artificial intelligence (AI) algorithm to calculate a display angle based on the facial image. For example, different facial images and their corresponding display angles are pre-collected as a training set, a neural network is trained, and the trained neural network is pre-installed in the electronic device. Subsequently, during application, the captured facial image is input into the trained neural network to output the display angle corresponding to the facial image. In another example, based on a facial pose estimation method, the display angles corresponding to the Euler angles of different facial images are pre-determined. After capturing a facial image, image recognition technology is used to analyze facial feature points to determine the Euler angles corresponding to the face, and the corresponding display angle is directly obtained based on these Euler angles. In another example, different facial images and their corresponding display angles are pre-collected as a learning library, and a similarity threshold is preset. After capturing a facial image, the rotation angles of the facial image are compared with those of the facial images in the learning library. If the similarity is greater than or equal to the similarity threshold, the corresponding display angle is obtained. In another example, a frontal facial image of the user is pre-collected. Subsequently, while the electronic device is in use, an image of the user's face is captured and compared with a frontal face image to determine the display angle. A frontal face image is one where the plane of the user's eyes and mouth is parallel to the plane of the phone screen.

[0017] In one possible implementation, the method further includes: displaying a first interface; and, in response to a first operation of a user on the first interface, turning on or off a first function for determining a first display angle.

[0018] In this way, the electronic device can turn on or off the automatic screen color adjustment function according to user needs, further meeting the function requirements. Moreover, when the automatic screen color adjustment function is not needed, it can be turned off to reduce the power consumption of the electronic device and save electricity.

[0019] In a second aspect, an embodiment of the present application provides an electronic device comprising: a processor, a memory, and a display screen; the memory and the display screen are coupled to the processor, the memory being used to store computer program code, the computer program code comprising computer instructions, and when the processor reads the computer instructions from the memory, the electronic device performs the following operations: determining a first display angle corresponding to a first face; the first display angle being the angle between the plane where the first face is located and the plane where the electronic device is located. Determining a first color parameter of a first pixel. Determining a second color parameter of the first pixel based on the first display angle and the first color parameter. Displaying at the first pixel based on the second color parameter.

[0020] In one possible implementation, when the processor reads computer instructions from the memory, it also causes the electronic device to perform the following operations: obtain a three-dimensional color lookup table 3D LUT, where the 3D LUT contains a mapping relationship between a first color parameter and a second color parameter at a preset display angle; the preset display angle includes the first display angle.

[0021] In one possible implementation, determining the first display angle corresponding to the first face includes: capturing a first image according to a preset period, determining the first image to be a first face image, and determining the first display angle based on the first face image.

[0022] In a possible implementation, determining the first display angle according to the first face image includes: determining Euler angles corresponding to the first face according to the first face image, and determining the first display angle corresponding to the Euler angles.

[0023] In one possible implementation, when the processor reads the computer instructions from the memory, the processor further causes the electronic device to perform the following operations: displaying a first interface; in response to a first operation of a user on the first interface, enabling or disabling a first function for determining a first display angle.

[0024] In addition, the technical effects of the electronic device described in the second aspect can refer to the technical effects of the screen display color adjustment method described in the first aspect, and will not be repeated here.

[0025] In a third aspect, embodiments of the present application provide an electronic device that implements the screen display color adjustment method described in the first aspect and any possible implementation thereof. This function can be implemented in hardware or by hardware executing corresponding software. The hardware or software includes one or more modules corresponding to the above-mentioned functions.

[0026] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium comprising computer instructions. When the computer instructions are executed on an electronic device, the electronic device executes a screen display color adjustment method as described in the first aspect and any possible implementation thereof.

[0027] In a fifth aspect, an embodiment of the present application provides a computer program product. When the computer program product is run on an electronic device, the electronic device executes the screen display color adjustment method as described in any one of the first aspect and any possible implementation methods thereof.

[0028] In a sixth aspect, a circuit system is provided, the circuit system including a processing circuit, the processing circuit being configured to execute the screen display color adjustment method as described in the first aspect and any possible implementation thereof.

[0029] In the seventh aspect, an embodiment of the present application provides a chip system comprising at least one processor and at least one interface circuit, wherein the at least one interface circuit is used to perform transceiver functions and send instructions to the at least one processor. When the at least one processor executes the instructions, the at least one processor executes the screen display color adjustment method as described in the first aspect above and any possible implementation method thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 A schematic diagram of a tilted mobile phone screen scenario provided in an embodiment of the present application;

[0031] Figure 2 A schematic diagram of the angle between the screen and the face provided in an embodiment of the present application;

[0032] Figure 3 A schematic diagram of a communication system provided in an embodiment of the present application;

[0033] Figure 4A A schematic diagram of the structure of the first electronic device provided in the embodiment of the present application Figure 1 ;

[0034] Figure 4B A schematic diagram of a horizontal or vertical tilting scenario of a display screen provided in an embodiment of the present application;

[0035] Figure 4C A schematic diagram of facial posture changes provided in an embodiment of the present application;

[0036] Figure 5 A schematic diagram of a software structure block diagram of a first electronic device provided in an embodiment of the present application;

[0037] Figure 6 A schematic diagram of the system architecture provided in an embodiment of the present application;

[0038] Figure 7A Schematic diagram of the screen tilt angle provided in the embodiment of the present application Figure 1 ;

[0039] Figure 7B Schematic diagram of the screen tilt angle provided in the embodiment of the present application Figure 2 ;

[0040] Figure 8 A schematic diagram of screen measurement points provided in an embodiment of the present application;

[0041] Figure 9 A schematic diagram of the tilt angle of a human face provided in an embodiment of the present application;

[0042] Figure 10A A set of interface diagrams provided for the embodiments of this application Figure 1 ;

[0043] Figure 10B A set of interface diagrams provided for the embodiments of this application Figure 2 ;

[0044] Figure 10C A set of interface diagrams provided for the embodiments of this application Figure 3 ;

[0045] Figure 11A A fourth set of interface diagrams provided for an embodiment of the present application;

[0046] Figure 11B A set of interface diagrams provided for the embodiments of this application Figure 5 ;

[0047] Figure 12 Screen display color adjustment method process provided in the embodiment of this application Figure 1 ;

[0048] Figure 13 Screen display color adjustment method process provided in the embodiment of the present application Figure 2 ;

[0049] Figure 14 Screen display color adjustment method process provided in the embodiment of the present application Figure 3 ;

[0050] Figure 15 Flowchart 4 of the screen display color adjustment method provided in an embodiment of the present application;

[0051] Figure 16 A schematic diagram of the structure of a screen display color adjustment device provided in an embodiment of the present application;

[0052] Figure 17 A schematic diagram of the structure of the chip system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0053] The screen display color adjustment method and electronic device provided in the embodiments of the present application are described in detail below with reference to the accompanying drawings.

[0054] The terms "including," "having," and any variations thereof mentioned in the description of the embodiments of the present application are intended to cover non-exclusive inclusions. For example, a process, method, system, product, or apparatus comprising a series of steps or units is not limited to the listed steps or units, but may optionally include other steps or units not listed, or may optionally include other steps or units inherent to the process, method, product, or apparatus.

[0055] It should be noted that in the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being more preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0056] In the description of the embodiments of this application, unless otherwise specified, "plurality" means two or more. "And / or" in this document is merely a description of the association relationship between associated objects, indicating that three relationships can exist. For example, "A and / or B" can mean: A exists alone, A and B exist simultaneously, or B exists alone.

[0057] First, to facilitate understanding, relevant terms and concepts that may be involved in the embodiments of the present application are introduced below.

[0058] (1) 3D look up table (3D LUT)

[0059] 3D LUT refers to a mathematical method that maps the RGB values ​​of a source image to another set of new RGB values ​​by modifying the hue, saturation, and brightness values. For example, due to screen performance limitations, the colors displayed by electronic devices may deviate from standard colors. For example, if a white grayscale of 64 is required, ideally, the grayscale of white displayed on the screen should also be 64. However, due to screen performance limitations, the grayscale of white is only 60, resulting in a deviation of 4 grayscale levels. 3D LUT is a lookup table that contains the mapping relationship between input signals and output signals based on the deviation of screen display colors. 3D LUT contains the mapping relationship of all colors, and when a color needs to be displayed, the required color parameters (i.e., RGB values) are searched in the 3D LUT for display, so that the actual display effect is the same as the effect that needs to be displayed.

[0060] For example, a 3D LUT has RGB channels for each coordinate direction. As shown in Table 1 below, the input R, G, and B signals are transformed by the 3D LUT into R1, G1, and B1. R1, G1, and B1 are still RGB signals, but their values ​​are different from the input signals. After transformation, the R1, G1, and B1 values ​​are the actual display effect on the screen.

[0061] Table 1

[0062]

[0063] (2) Color parameters

[0064] In some embodiments, color parameters are used to represent the color of the light. For example, when an electronic device displays an image, the color parameters are used to represent the displayed color of the image. Optionally, the color parameters include, for example, RGB values. The displayed color is the color perceived by the user or recognized by other electronic devices.

[0065] In some embodiments, when an electronic device needs to display color, it uses input color parameters (such as the input signal in Table 1 above) for display. The color parameters used to identify the color displayed on the screen are output color parameters (such as the output signal in Table 1 above). Due to limitations in screen display performance, the identified color may deviate from the color to be displayed, i.e., the output color parameters differ from the input color parameters. The output color parameters can also be described as display color parameters, measured color parameters, etc.

[0066] For example, the standard color parameters of red are (255, 0, 0). When an electronic device displays red using (255, 0, 0), the output color parameters recognized after display are (255, 1, 1). When viewed by a user, the displayed color differs from the standard red. The standard color parameters are the color parameters of a standard color.

[0067] (3) Display angle

[0068] In some embodiments, the display angle of an electronic device is the angle between the plane of the electronic device's display screen (i.e., screen) and the user's facial plane. The plane where the user's eyes and mouth are located is defined as the user's facial plane. The electronic device uses facial recognition technology to identify the positions of the user's eyes and mouth to determine the user's facial plane.

[0069] For example, Figure 2 As shown in (a), the user holds the phone to view the content displayed on the phone. The plane where the phone display is located is plane A, and the plane where the user's face is located is plane B. The display angle is the angle between plane A and plane B, such as θ1. The user's posture and / or phone position changes, such as Figure 2 As shown in (b), the angle between plane A where the mobile phone display screen is located and plane B where the user's face is located changes to θ2, that is, the mobile phone display angle is θ2 at this time.

[0070] Figure 3 (a) is a schematic diagram of a communication system to which a screen display color adjustment method according to an embodiment of the present application is applied. Figure 3 As shown in (a), the communication system includes a first electronic device 100.

[0071] Optionally, the first electronic device 100 refers to a client device, which can be a terminal device used by a user (also described as a consumer). The first electronic device 100 is a device for which the screen display color consistency at different display angles is to be adjusted. Before the first electronic device 100 leaves the factory, it is necessary to determine the target color parameters of the screen of the first electronic device 100 at different display angles. This ensures that after leaving the factory, the first electronic device 100 can adaptively adjust the color parameters at different screen display angles, so that there will be no color difference when providing the same display content to the user. Among them, the first electronic device 100 leaving the factory means that the first electronic device 100 passes the inspection and leaves the factory. Before leaving the factory can also be described as before the first electronic device 100 is used by the consumer, that is, before the consumer uses the first electronic device 100, it is necessary to adjust the consistency of the screen display color at different display angles of the first electronic device 100 to improve the user experience during use. Optionally, the mapping relationship between the input color parameters and the output color parameters is packaged, for example, as a software upgrade package. The screen display colors of electronic devices of the same model have little difference. During use, the function of adaptive adjustment of screen display color can be obtained by downloading the software upgrade package. Among them, the small difference in screen display color includes, for example, when the electronic device performs color parameter measurement before leaving the factory, the difference in color parameter measurement values ​​is less than a preset threshold.

[0072] Exemplarily, the first electronic device 100 includes, for example, a mobile phone, a tablet computer, a wearable device, a vehicle-mounted device, a laptop computer, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), a desktop computer, a laptop computer, a handheld computer, a notebook computer, an artificial intelligence device, and other terminal devices with a display function. The embodiments of the present application do not impose any restrictions on the specific type of the first electronic device 100.

[0073] In some scenarios, such as Figure 3 As shown in (b), the communication system further includes a second electronic device 200. The first electronic device 100 and the second electronic device 200 can be connected via a wired network or a wireless network. The embodiment of the present application does not specifically limit the connection method between devices.

[0074] Optionally, the second electronic device 200 is a calibration device (also described as a test device) that can be used by developers or technicians. The second electronic device 200 is used to measure the output color parameters of each color displayed by the first electronic device 100 at different screen display angles.

[0075] Exemplarily, the second electronic device 200 includes a desktop, laptop, notebook computer, or other electronic device with color parameter measurement and calculation functions, such as a CS 2000. This embodiment of the application does not impose any limitation on the specific type of the second electronic device 200.

[0076] In some embodiments, before the first electronic device 100 leaves the factory, it is necessary to measure the screen display color, and use the second electronic device 200 to measure the output color parameters of the display color of the first electronic device 100 at different display angles (for example, 0°, 15°, 30°, 45°, 60°, etc.). In addition, the second electronic device 200 establishes a mapping relationship between the input color parameters and the output color parameters of the current first electronic device 100 screen at different display angles, and sends the mapping relationship to the first electronic device 100. Subsequently, when the screen display angle of the first electronic device 100 changes, it can automatically determine the target color parameters in the input color parameters based on the current display angle and the mapping relationship. The target color parameters can make the color parameters recognized by the display color of the first electronic device 100 a preset color parameter, realize adaptive adjustment of the screen color, and ensure the consistency of the screen display color at different display angles. Among them, the preset color parameters are standard color parameters, or output color parameters at a preset display angle. For example, the preset color parameters are standard color parameters, the first electronic device 100 needs to display red, and the corresponding preset color parameters are (255, 0, 0). The first electronic device 100 searches for the target color parameters in the input color parameters based on the mapping relationship so that the output color parameters are (255, 0, 0).

[0077] In some other scenarios, such as Figure 3 As shown in (c) in FIG, the communication system further includes a server 300.

[0078] Optionally, the server 300 may be a device or server with computing capabilities such as a cloud server or a network server. The server 300 may be a single server, a server cluster consisting of multiple servers, or a cloud computing service center.

[0079] In some embodiments, after the second electronic device 200 measures the current output color parameters of the screen of the first electronic device 100, the output color parameters can be sent to the server 300. The server 300 then establishes a mapping relationship between the input color parameters and the output color parameters at various display angles. The first electronic device 100 then obtains the mapping relationship from the server 300.

[0080] In some embodiments, the current display angle of the screen is obtained by calculating the angle between the screen plane of the first electronic device 100 and the user's face plane. Optionally, the first electronic device 100 captures the user's face image, analyzes the user's face posture in the user's face image, and determines the display angle. Then, the target color parameters are determined based on the display angle using a mapping relationship. Optionally, the server 300 is connected to the first electronic device 100. The first electronic device 100 captures the user's face image and sends the user's face image to the server 300, which determines the current screen display angle based on the user's face posture in the photo. Afterwards, the first electronic device 100 receives the display angle sent by the server 300 and determines the corresponding target color parameters. Among them, the first electronic device 100 can capture the user's face image in real time, or the first electronic device 100 captures the user's face image according to a preset period, etc.

[0081] Figure 4A A schematic structural diagram of the first electronic device 100 is shown.

[0082] The first electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display 194, and a subscriber identification module (SIM) card interface 195. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an ambient light sensor 180C, an ambient color temperature sensor 180D, an acceleration sensor 180E, a touch sensor 180F, and the like.

[0083] It should be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0084] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). The different processing units may be independent devices or integrated into one or more processors.

[0085] The controller can generate operation control signals according to the instruction operation code and timing signal to complete the control of instruction fetching and execution.

[0086] Processor 110 may also include a memory for storing instructions and data. In some embodiments, the memory in processor 110 is a cache memory. This memory can store instructions or data that have just been used or are being recycled by processor 110. If processor 110 needs to use the same instruction or data again, it can directly access the memory. This avoids duplicate accesses, reduces processor 110 latency, and thus improves system efficiency.

[0087] In some embodiments, the processor 110 may include one or more interfaces. The interfaces may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface.

[0088] The MIPI interface can be used to connect the processor 110 to peripheral devices such as the display screen 194 and the camera 193. MIPI interfaces include the camera serial interface (CSI) and the display serial interface (DSI). In some embodiments, the processor 110 and the camera 193 communicate via the CSI interface to implement the camera function of the first electronic device 100. The processor 110 and the display screen 194 communicate via the DSI interface to implement the display function of the first electronic device 100.

[0089] The USB interface 130 is an interface that complies with USB standards and specifications, and may be a Mini USB interface, a Micro USB interface, a USB Type-C interface, or the like. The USB interface 130 can be used to connect a charger to charge the first electronic device 100, or to transfer data between the first electronic device 100 and peripheral devices. It can also be used to connect headphones to play audio. This interface can also be used to connect other electronic devices, such as AR devices.

[0090] It is understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is merely an illustrative description and does not constitute a structural limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may also adopt a different interface connection method from the above embodiments, or a combination of multiple interface connection methods.

[0091] The charging management module 140 is configured to receive charging input from a charger. The charger can be either a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 can receive charging input from the wired charger via the USB interface 130. In some wireless charging embodiments, the charging management module 140 can receive wireless charging input via the wireless charging coil of the first electronic device 100. While charging the battery 142, the charging management module 140 can also provide power to the electronic device via the power management module 141.

[0092] The power management module 141 is used to connect the battery 142, the charging management module 140, and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140 to provide power to the processor 110, the internal memory 121, the display 194, the camera 193, and the wireless communication module 160.

[0093] The wireless communication function of the first electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem processor and the baseband processor.

[0094] Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in first electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network. In other embodiments, the antennas can be used in conjunction with a tuning switch.

[0095] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the first electronic device 100. The mobile communication module 150 may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0096] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., applied on the first electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0097] The first electronic device 100 implements display functionality through a GPU, display screen 194, and an application processor. The GPU is a microprocessor for image processing that connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or modify display information.

[0098] The display screen 194 can also be described as a screen for displaying images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), a MiniLED, a MicroLed, a Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the first electronic device 100 may include one or N display screens 194, where N is a positive integer greater than one.

[0099] In some embodiments, when the display screen 194 is displaying content such as images or videos, the display angle of the display screen 194 changes, which may cause color deviation.

[0100] For example, Figure 4B As shown in (a), the first electronic device 100 is displayed in portrait mode, with the center point of the display screen 194 as the origin, the x-axis parallel to the bottom edge of the display screen 194 (i.e., the lower edge of the first electronic device 100), and the y-axis perpendicular to the x-axis to construct a coordinate system, and the current coordinate system is parallel to the display screen 194. Assuming that the user's viewing angle remains unchanged, as shown in Figure 4B As shown in (a), for example, if the first electronic device 100 is rotated or tilted in the direction indicated by arrow 41 with the x-axis as the reference edge, the display screen 194 will tilt up and down, and the display angle will change. For another example, if the first electronic device 100 is rotated or tilted in the direction indicated by arrow 42 with the y-axis as the reference edge, the display screen 194 will tilt left and right, and the display angle will change.

[0101] Correspondingly, such as Figure 4B As shown in (b), the first electronic device 100 is displayed in landscape mode, and the display screen 194 is tilted up and down or left and right, which also causes the display angle to change.

[0102] The first electronic device 100 can implement a shooting function through an ISP, a camera 193, a video codec, a GPU, a display screen 194, and an application processor.

[0103] The ISP processes data fed back by camera 193. For example, when taking a photo, the shutter is opened, and light is transmitted through the lens to the camera's photosensitive element. The light signal is converted into an electrical signal, which is then passed to the ISP for processing and converted into a visible image. The ISP can also perform algorithmic optimization on image noise, brightness, and skin tone. It can also optimize parameters such as exposure and color temperature of the captured scene. In some embodiments, the ISP can be located within camera 193.

[0104] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the light signal into an electrical signal, and then passes the electrical signal to the ISP for conversion into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the first electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0105] The NPU is a neural network (NN) computing processor that rapidly processes input information by drawing on the structure of biological neural networks, such as the transmission mode between neurons in the human brain, and can also continuously self-learn. The NPU can realize applications such as intelligent cognition of the first electronic device 100, such as image classification, object recognition, action recognition, pose estimation, neural style transfer and other computer vision applications, as well as natural language processing (NLP) applications.

[0106] In some embodiments, the angle of the display screen 194 does not change, but the user moves, causing the user's perspective to change, and the angle between the user's face plane and the plane of the display screen 194 changes, resulting in a deviation in the displayed color. Alternatively, in other embodiments, the user does not move, but the first electronic device 100 moves, which also causes the angle between the user's face plane and the plane of the display screen 194 to change, causing a deviation in the displayed color. Alternatively, in yet other embodiments, both the user and the first electronic device 100 move, causing the angle between the user's face plane and the plane of the display screen 194 to change, resulting in a deviation in the displayed color.

[0107] Therefore, the current display angle can be obtained by calculating the angle between the user's face plane and the plane of the display screen 194. Furthermore, the face image can be captured by the camera 193, and the face image recognition can be performed by the NPU to determine the current user's face posture and then identify the display angle.

[0108] Optionally, facial image recognition technology can identify facial images in images captured by camera 193. During the capture process, the user may make head movements such as looking up, looking down, turning left, or turning right. Consequently, the captured facial image may be at a certain angle to the frontal facial image; this angle is referred to as the facial rotation angle. Furthermore, facial recognition technology can identify the current facial rotation angle.

[0109] In some embodiments, a face pose estimation method is used to project a face in a three-dimensional world coordinate system into a two-dimensional coordinate matrix by taking a photo and analyzing the result to obtain the face rotation angle.

[0110] For example, face rotation will cause the angle between the face plane and the display screen 194 to change. The face rotation angle can be determined by using a face posture estimation method. Specifically, the face rotation angle can be represented by a rotation matrix or Euler angles. The Euler angles include pitch, yaw, and roll. Figure 4C The pitch angle change shown in (a) is used to indicate that the face is flipped upside down. Figure 4C The yaw angle change shown in (b) is used to indicate that the face is flipped left and right. Figure 4C The roll angle variation shown in (c) is used to represent the in-plane rotation of the face.

[0111] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the first electronic device 100. The external memory card communicates with the processor 110 via the external memory interface 120 to implement data storage functions. For example, files such as music and videos can be stored in the external memory card.

[0112] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the first electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the first electronic device 100 by running instructions stored in the internal memory 121 and / or instructions stored in a memory provided in the processor.

[0113] The first electronic device 100 can implement audio functions such as music playing and recording through the audio module 170 and the application processor.

[0114] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be provided in the processor 110, or some functional modules of the audio module 170 can be provided in the processor 110.

[0115] The pressure sensor 180A is used to sense pressure signals and convert them into electrical signals. In some embodiments, the pressure sensor 180A can be provided on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. A capacitive pressure sensor can be a device comprising at least two parallel plates having a conductive material. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The first electronic device 100 determines the intensity of the pressure based on the change in capacitance. When a touch operation is applied to the display screen 194, the first electronic device 100 detects the intensity of the touch operation based on the pressure sensor 180A. The first electronic device 100 can also calculate the position of the touch based on the detection signal of the pressure sensor 180A.

[0116] The gyroscope sensor 180B can be used to determine the motion posture of the first electronic device 100. In some embodiments, the angular velocity of the first electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyroscope sensor 180B. The gyroscope sensor 180B can be used for shooting anti-shake. For example, when the shutter is pressed, the gyroscope sensor 180B detects the angle of the first electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the first electronic device 100 through reverse movement to achieve anti-shake. The gyroscope sensor 180B can also be used for navigation and somatosensory game scenes.

[0117] The ambient light sensor 180C is used to sense the brightness of the ambient light. The first electronic device 100 can adaptively adjust the brightness of the display screen 194 based on the sensed ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures.

[0118] In some embodiments, the colors displayed by the first electronic device 100 may exhibit color shift under different brightness conditions. For example, at the same display angle, the output color parameters of the same color under different brightness conditions may differ. Therefore, the first electronic device 100 needs to establish a mapping relationship under different brightness conditions.

[0119] Ambient color temperature sensor 180D is used to detect ambient color temperature. In some embodiments, the ambient color temperature sensor 180D is used to detect the ambient color temperature when taking photos, resulting in more accurate colors in the captured images. In other embodiments, the first electronic device 100 can also adaptively change the color temperature of the screen display of the first electronic device 100 based on the color temperature of the ambient light, providing users with a better screen display experience.

[0120] In some embodiments, changes in ambient light and / or ambient color temperature may also cause changes in the color of the image displayed on display screen 194. Therefore, when measuring the current output color parameters, the influencing factors of ambient light and / or ambient color temperature can be added. For example, under different ambient color temperatures, the mapping relationship between input color parameters and output color parameters at different display angles can be determined.

[0121] The accelerometer 180E can detect the magnitude of the acceleration of the first electronic device 100 in all directions (generally three axes). When the first electronic device 100 is stationary, it can detect the magnitude and direction of gravity. It can also be used to identify the electronic device's posture, enabling applications such as switching between landscape and portrait modes and pedometers.

[0122] The touch sensor 180F is also referred to as a "touch device." The touch sensor 180F can be disposed on the display screen 194. The touch sensor 180F and the display screen 194 form a touch screen, also referred to as a "touch screen." The touch sensor 180F is used to detect touch operations applied thereto or in the vicinity thereof. The touch sensor 180F can transmit the detected touch operations to the application processor to determine the type of touch event. Visual output related to the touch operations can be provided via the display screen 194. In other embodiments, the touch sensor 180F can also be disposed on the surface of the first electronic device 100, at a location different from that of the display screen 194.

[0123] In some embodiments, the first electronic device 100 detects a control command input by the user through the touch sensor 180F, such as a command to turn on or off a screen color automatic adjustment function.

[0124] The buttons 190 include a power button, a volume button, etc. The buttons 190 may be mechanical buttons or touch buttons. The first electronic device 100 may receive key inputs and generate key signal inputs related to user settings and function control of the first electronic device 100.

[0125] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts and can also be used for touch vibration feedback.

[0126] The indicator 192 may be an indicator light, which may be used to indicate the charging status, power level changes, messages, missed calls, notifications, etc.

[0127] The SIM card interface 195 is used to connect a SIM card. The SIM card can be connected to and disconnected from the first electronic device 100 by inserting or removing the SIM card into or from the SIM card interface 195. The first electronic device 100 may support one or N SIM card interfaces, where N is a positive integer greater than one.

[0128] The software system of the first electronic device 100 can adopt a layered architecture, an event-driven architecture, a micro-kernel architecture, a micro-service architecture, or a cloud architecture. The embodiment of the present application takes the Android system of the layered architecture as an example to exemplify the software structure of the first electronic device 100.

[0129] Figure 5 It is a software structure block diagram of the first electronic device 100 according to an embodiment of the present application.

[0130] A layered architecture divides software into several layers, each with distinct roles and responsibilities. Layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers: from top to bottom: the application layer, the application framework layer, the Android runtime system libraries, and the kernel layer.

[0131] The application layer can include a series of application packages.

[0132] like Figure 5 As shown, the application package may include applications such as camera, gallery, calendar, call, map, navigation, WLAN, Bluetooth, music, video, short message, etc.

[0133] The application framework layer provides an application programming interface (API) and programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0134] like Figure 5 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0135] The window manager is used to manage window programs. The window manager can obtain the display size, determine whether there is a status bar, lock the screen, take screenshots, etc.

[0136] Content providers are used to store and retrieve data and make it accessible to applications. The data may include video, images, audio, etc.

[0137] The view system includes visual controls, such as controls for displaying text and images. The view system is used to build applications. A display interface can consist of one or more views.

[0138] The phone manager is used to provide communication functions of the first electronic device 100, such as management of call status (including answering, hanging up, etc.).

[0139] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0140] The notification manager enables applications to display notification information in the status bar, which can be used to convey informational messages and disappear automatically after a short stay without user interaction.

[0141] Android Runtime includes core libraries and a virtual machine. Android runtime is responsible for scheduling and management of the Android system.

[0142] The core library consists of two parts: one is the function that needs to be called by the Java language, and the other is the Android core library.

[0143] The application layer and application framework layer run in a virtual machine. The virtual machine executes Java files in the application layer and application framework layer as binary files. The virtual machine manages object lifecycles, stack management, thread management, security and exception management, and garbage collection.

[0144] The system library can include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0145] The surface manager is used to manage the display subsystem and provide fusion of 2D and 3D layers for multiple applications. Optionally, the surface manager can also be described as a user interface (UI) manager.

[0146] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0147] A 2D graphics engine is a drawing engine for 2D drawings.

[0148] In some embodiments, the 3D graphics processing library and the 2D graphics engine may be combined into a graphics processing library to implement 2D and 3D graphics drawing.

[0149] The media library supports playback and recording of a variety of common audio and video formats, as well as static image files. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0150] The kernel layer is the layer between hardware and software. The kernel layer includes at least display driver, camera driver, audio driver, and sensor driver.

[0151] The following illustrates the software and hardware workflow of the first electronic device 100 in conjunction with the screen display color adjustment scenario. The camera application in the application layer calls the interface of the application framework layer to start the camera application, which then calls the kernel layer to start the camera driver and capture a facial image through camera 193. Camera 193 sends the captured facial image to processor 110 for processing and determines the display angle of display screen 194. The kernel layer then calls the display driver to obtain the 3D LUT preset in processor 110. Using the 3D LUT and the display angle, the target color parameters are determined. The target color parameters are then displayed on display screen 194.

[0152] The following will take the first electronic device 100 as an example. Figure 4A and Figure 5 Taking the mobile phone with the structure shown as an example, the screen display color adjustment method provided in the embodiment of the present application is explained.

[0153] In some scenarios, such as Figure 2 As shown in (a), the display angle of the mobile phone screen is θ1, the screen uses the input color parameter 1 to display the color, and the recognized color parameter is the output color parameter 2. Figure 2 As shown in (b), the display angle of the mobile phone screen changes to θ2, θ2>θ1. If the screen still uses the input color parameter 1 to display the color, the recognized color parameter is the output color parameter 3, and the output color 3 is different from the output color 2, that is, the problem of color deviation caused by the change in the screen display angle will occur. If the user is currently processing a scene with high requirements for color accuracy, it will cause trouble to the user and reduce the user experience. Therefore, it is necessary to confirm the target color parameter when the display angle is θ2, so that the screen display color when the display angle is θ2 is the same as the screen display color when the display angle is θ1.

[0154] It should be noted that in the embodiments of the present application, the same color means that when the mobile phone displays the same color at different display angles, the color parameters presented are the same, such as all preset color parameters. For example, the mobile phone displays Image 1, which is a pure white card. The color parameter of the white at display angle 1 is output color parameter A, and the color parameter identified at display angle 2 is still output color parameter A. It is determined that the mobile phone displays the same color at the two angles. In other words, to determine the consistency of the color displayed by the mobile phone at different angles, it is necessary to measure the corresponding output color parameters based on the same color, which will not be elaborated below.

[0155] It can be seen from this that before the mobile phone leaves the factory, it is necessary to establish a mapping relationship between the input color parameters and the output color parameters at different display angles. Furthermore, after the mobile phone leaves the factory, it can automatically determine the required target color parameters according to the display angle, so that the mobile phone presents the same display effect at each display angle, providing the user with the same sensory experience and avoiding problems caused by color deviation. Among them, the mapping relationship can include a mapping relationship corresponding to all colors, or it can include a mapping relationship corresponding to some colors. When the mapping relationship includes a mapping relationship corresponding to some colors, the similarity of colors can be used to establish a mapping relationship between some input color parameters with similar color parameters and the same output color parameter without affecting the user's visual experience.

[0156] In some scenarios, a calibration device is used to measure the output color parameters of a mobile phone at different display angles, and a mapping relationship between the input color parameters and the output color parameters is established to create a 3D LUT. For example, Figure 6 As shown, the calibration device includes a measurement module 601 and a calibration module 602. The measurement module 601 is used to measure the output color parameters of each color of the mobile phone at different display angles, and send the measurement results (i.e., output color parameters 61) to the calibration module 602. The calibration module 602 establishes a mapping relationship based on the measurement results. Among them, the process of the calibration device establishing a mapping relationship can also be described as a calibration process of the mobile phone screen display color, that is, the mobile phone can subsequently use the 3D LUT established by the calibration device to obtain the target color parameters, calibrate the display color, and ensure the consistency of the display color at each display angle. Optionally, images of different colors are preset in the mobile phone. During the color parameter calibration process, the mobile phone displays a preset image at each display angle, and the calibration device detects the corresponding output color parameters.

[0157] For example, as shown in Table 2 below, a calibration device is used to obtain the mapping relationship between the input color parameters and the output color parameters of a mobile phone at different display angles to create a 3D LUT. For example, when the mobile phone is at a display angle of 15 degrees, color A is displayed using color parameter 1. The calibration device measures the color display effect of the mobile phone, and the measured output color parameter is color parameter 5, which has a deviation.

[0158] Table 2

[0159]

[0160]

[0161] It is understandable that Table 2 above may not include a color column, that is, the 3D LUT only needs to include the corresponding relationship between the display angle, the input color parameters, and the output color parameters.

[0162] Furthermore, in Table 2 above, the calibration device first measures the output color parameters of the colors displayed by the phone at a display angle of 0 degrees. Optionally, the output color parameters of the colors displayed by the phone at a display angle of 0 degrees are set as preset color parameters, and the calibration device is used to sequentially measure the output color parameters of each color at a display angle of 0 degrees to obtain the preset color parameters for each color. As shown in Table 2 above, when the display angle is 0 degrees, the input color parameters and output color parameters of each color are the same. Here, color A is, for example, black, color B is, for example, white, and color C is, for example, gray.

[0163] After that, change the display angle (for example, change the display angle to 15 degrees), repeat the color parameter measurement method at 0 degrees, measure the output color parameters of each color at each display angle, and establish a mapping relationship between the input color parameters and the output color parameters of each color. In this way, subsequent mobile phones can use the established 3D LUT to determine the target color parameters at different display angles. In other words, when the mobile phone displays colors, the colors displayed at each display angle are the same as the colors displayed when the display angle is 0 degrees, ensuring the consistency of the displayed colors.

[0164] It is understood that Table 2 above is only an example. The calibration device should measure the output color parameters of more colors to determine the mapping relationship corresponding to each color. This ensures that the corresponding target color parameters can be obtained when the mobile phone displays each color at different display angles, ensuring the consistency of color display. Optionally, the standard color parameters corresponding to the standard color can be set as the preset color parameters corresponding to each color, or the output color parameters corresponding to other display angles can be preset as the preset color parameters.

[0165] In other scenarios, such as Figure 6 In the schematic diagram shown, the calibration device may not include the calibration module 602. After the measurement module 601 measures the output color parameter 61, the output color parameter 61 is sent to the server ( Figure 6 The server establishes a mapping relationship and sends it to the mobile phone.

[0166] In some embodiments, the calibration device fixes the measurement plane, and the mobile phone changes the plane where the screen is located, and measures the output color parameters of some or all colors at different display angles. Alternatively, the mobile phone fixes the plane where the screen is located, and the calibration device changes the measurement plane, and measures the output color parameters of some or all colors at different display angles. The calibration device thus obtains a mapping relationship and establishes a 3D LUT. Optionally, the measurement plane of the calibration device is used to represent the face plane, and then the angle between the measurement plane and the mobile phone screen plane can be used as the display angle. It is understandable that the calibration device can also use other methods to determine the display angle of the current mobile phone screen, which will not be repeated here.

[0167] For example, the calibration device is fixed on the measurement plane, the mobile phone changes the screen plane, and the output color parameters of the measured color are described as an example. Figure 7A The front of the phone is the plane where the screen is located, and the phone is along the Figure 7A Rotate counterclockwise in the direction of the arrow, and the calibration device measures the output color parameters of the screen at different display angles to create a 3D LUT. Figure 7B As shown in (a)-(e), different rotation angles of the mobile phone screen are schematically listed. Among them, the dotted line a is used to represent the vertical reference line, the dotted line b is used to represent the tilt direction of the screen, and the angle α between the dotted line a and the dotted line b is used to represent the tilt angle of the screen relative to the vertical direction. That is, assuming that during the calibration process, the face is a frontal face, the dotted line a is used to represent the face plane (or the dotted line a is used to represent the measurement plane), and the angle α is the angle between the screen plane and the face plane, which represents the display angle of the current screen. Figure 7B As shown in (a), the angle α is 0 degrees. Figure 7B As shown in (b), the angle α is 15 degrees. Figure 7B As shown in (c), the angle α is 30 degrees. Figure 7B As shown in (d), the angle α is 45 degrees. Figure 7B As shown in (e), the angle α is 60 degrees. In this way, the calibration device measures the output color parameters of the color at the above five display angles and establishes a mapping relationship between the input color parameters and the output color parameters.

[0168] Furthermore, the above five display angles are only exemplary, and the calibration device can also measure the screen output color parameters at more display angles. For example, a more fine-grained angle cutting method is used to determine the display angle, such as measuring the screen output color parameters at each degree to establish a mapping relationship corresponding to each degree. Or, Figure 7B As shown, the output color parameters at a limited display angle are measured, and then the display angle threshold corresponding to the mapping relationship is determined based on the angle difference between the measured display angles. For example, the mapping relationship corresponding to a display angle of [15±7.5) degrees is the mapping relationship corresponding to an angle α of 15 degrees. For another example, the mapping relationship corresponding to a display angle of [30±7.5) degrees is the mapping relationship corresponding to an angle α of 30 degrees. In this way, by measuring the output color parameters at a limited number of display angles, the mapping relationship between the input color parameters and the output color parameters at all display angles can be obtained, thereby improving calibration efficiency.

[0169] In some embodiments, measurement points are preset on the screen. During the calibration process, the calibration device measures the output color parameters of the measurement points at different display angles to obtain the output color parameters of the screen. Figure 8As shown in (a), the center point of the screen is defined as the measurement point, and the calibration device measures the output color parameters of the color at the measurement point at different display angles to represent the output color parameters of the screen at the current display angle. As shown in Table 2 above, when the mobile phone displays color A at a display angle of 15 degrees, the calibration device measures the output color parameter at the center point of the screen as color parameter 5, and uses color parameter 5 as the output color parameter of color A when the display angle is 15 degrees. Afterwards, the mobile phone keeps the display angle at 15 degrees unchanged and displays color B. The calibration device measures the output color parameter at the center point of the screen as color parameter 6, and uses color parameter 6 as the output color parameter of color B when the display angle is 15 degrees. In this way, based on the above steps, the calibration device measures the output color parameters of each color displayed by the mobile phone at each display angle.

[0170] For example, since users may not only tilt the screen up and down but also left and right when using their phones, a single measurement point may not guarantee the accuracy of the output color parameters measured by the calibration device. Figure 8 As shown in (b), the mobile phone screen is divided into four areas, a measurement point is set at the center of each area, and the center of the screen is set as the measurement point. During the measurement process, the average value of the output color parameters measured at these five measurement points is used as the output color parameter of the mobile phone screen display color at that display angle. For another example, since mobile phone screens are generally large nowadays, screen uniformity is difficult to ensure, so the accuracy of output color parameter measurement can be improved by increasing the number of measurement points. Figure 8 As shown in (c), the phone screen is divided into nine areas, with the center of each area set as a measurement point. During the measurement process, the calibration device uses the average of the output color parameters measured at these nine measurement points as the output color parameter of the phone screen at that display angle.

[0171] It will be understood that the above number and location of measurement points are merely exemplary, and the embodiments of the present application do not impose any specific restrictions on the number and location of measurement points. Furthermore, there is no restriction on the number of pixels measured at each measurement point. For example, each measurement point can measure the output color parameters of a corresponding pixel; alternatively, the measurement point coverage area can be preset, and the output color parameters of all corresponding pixels can be measured, and the corresponding output color parameters can be averaged to obtain the corresponding output color parameters. For another example, the output color parameters of each pixel position can be measured to determine the output color parameters of the final screen display color, thereby improving the accuracy of output color parameter measurement.

[0172] In some embodiments, because ambient light and / or ambient color temperature can affect the output color parameters of the colors displayed on the screen, during the calibration process, different ambient light and / or ambient color temperature measurement conditions can be preset. The calibration device measures the screen output color parameters under different measurement conditions and establishes multiple sets of mapping relationships. For example, as shown in Table 3 below, when the display angle is all at angle 1, four sets of mapping relationships are obtained under different measurement conditions.

[0173] Table 3

[0174] Display angle Ambient Light Ambient color temperature Enter color parameters Output color parameters Angle 1 Brightness 1 Color Temperature 1 Input color parameter a Output color parameter A Angle 1 Brightness 1 Color Temperature 2 Input color parameter b Output color parameter B Angle 1 Brightness 2 Color Temperature 1 Input color parameter c Output color parameter C Angle 1 Brightness 2 Color Temperature 2 Input color parameter d Output color parameter D

[0175] In some embodiments, before each mobile phone leaves the factory, the screen is subjected to the above-mentioned color calibration process using a calibration device, so that each mobile phone obtains its own corresponding color parameter mapping relationship under different display angles, thereby reducing the impact of mobile phone screen differences on the measurement of screen output color parameters. This ensures that the mobile phone can provide a better screen color display effect during subsequent user use. Alternatively, the screens of mobile phones of the same model have small differences. Therefore, before the mobile phones leave the factory, color parameter mapping relationships can be established only for different models of mobile phones, that is, mobile phones of the same model share a set of color parameter mapping relationships, thereby improving calibration efficiency.

[0176] In some scenarios, after the calibration device determines the mapping relationship between the input color parameters and the output color parameters at each display angle, it sends the mapping relationship to the mobile phone. The mobile phone stores the mapping relationship and calls it when needed. For example, after the mobile phone receives the mapping relationship, it stores the mapping relationship in the 3D LUT module in the processor. Subsequently, during the mobile phone display process, when it is detected that the angle between the face and the screen has changed, the corresponding mapping relationship is directly called from the 3D LUT module according to the current display angle to obtain the target color parameters, and the target color parameters are used for color display.

[0177] For example, Figure 6 As shown, after the calibration module 602 in the calibration device establishes a mapping relationship 62 between the input color parameters and the output color parameters using the above method, the mapping relationship 62 is sent to the mobile phone. The central processing unit (CPU) 603 in the mobile phone stores the received mapping relationship 62. For example, a 3DLUT module is set in the CPU 603 to include the mapping relationship 62.

[0178] In some embodiments, the mobile phone captures a facial image and obtains a display angle based on the facial image. Specifically, when the user's face rotates and / or the angle of the mobile phone screen changes, the angle between the user's face plane and the screen plane changes, which in turn causes the display angle of the mobile phone screen to change.

[0179] In some embodiments, a mobile phone captures a facial image and uses an artificial intelligence (AI) algorithm to calculate the display angle based on the facial image. For example, different facial images and corresponding display angles are collected in advance as a training set, a neural network is trained, and the trained neural network is preset in the mobile phone. Afterwards, during the application process, the captured facial image is input into the trained neural network, and the display angle corresponding to the facial image can be output. For another example, based on the facial posture estimation method, the display angle corresponding to the Euler angle of different facial images is predetermined. Afterwards, after capturing the facial image, the facial image feature point analysis is performed using image recognition technology to determine the Euler angle corresponding to the face, and the corresponding display angle is directly obtained based on the Euler angle. For another example, different facial images and corresponding display angles are collected in advance as a learning library, and a similarity threshold is preset. After collecting the facial image, the rotation angle of the facial image is compared with the facial image in the learning library. If the similarity is greater than or equal to the similarity threshold, the corresponding display angle is obtained. Among them, the rotation angle of the facial image can be used Figure 4C The facial pose estimation method described in [1] is used to determine the face pose. For another example, a frontal face image of the user is captured in advance. Subsequently, the user's face image is captured while the phone is in use, and the display angle is determined by comparing the user's face image with the frontal face image. A frontal face image is a face image where the plane of the user's eyes and mouth is parallel to the plane of the phone screen.

[0180] For example, a mobile phone captures an image and uses facial recognition technology to determine the facial image contained therein (i.e., treating the captured image as a facial image). The positions of the user's eyes and mouth are identified, and information such as the proportions of facial features is determined. The similarity between the facial features and the proportions of facial features in a learning library (or training set) is then determined, and the corresponding display angle is determined. For example, the ratio of the forehead length to the chin length can be used to determine whether the user is looking up or down, and different display angles are then applied accordingly. Alternatively, the image captured by the mobile phone may not contain a recognized facial image (i.e., the user's face is not captured), and the image cannot be used as a facial image, in which case the current color parameters remain unchanged. For another example, if the image captured by the mobile phone contains a facial image, and this image is determined to be a facial image, the corresponding display angle can be determined directly based on the facial image. Furthermore, the recognized facial image may be a complete facial image (i.e., a complete facial image that includes the facial contours and all facial features), or an incomplete facial image (e.g., one that does not include the user's chin). Among them, if the facial image contains the user's eyes and mouth, the corresponding display angle can be determined by the above method, and the more complete the facial image, the more accurate the determined display angle. If the corresponding display angle cannot be determined in the end for the captured image, the current color parameters remain unchanged. For another example, if the image captured by a mobile phone contains multiple facial images, the image is determined to be a facial image, the owner's face is identified, and the corresponding display angle is determined using the owner's face. Alternatively, if the owner's face is not identified among multiple faces, the user can be prompted to make a selection, and the corresponding display angle is determined based on the face selected by the user. It should be noted that the following description takes the image captured by a mobile phone as an example of a facial image containing one face.

[0181] For example, the display angle is the relative angle between the phone screen plane and the user's face plane. For ease of explanation, the following example uses the case where the phone is placed vertically (i.e., the phone screen plane is the vertical plane) and the tilt angle of the user's face plane changes, resulting in a change in the display angle. It is understandable that in actual use, the tilt angle of the phone and / or the user's face may change, and the phone needs to determine the corresponding relative angle. Figure 9 As shown in (a)-(e), the user's side face images corresponding to different display angles are schematically listed. Among them, the dotted line a is used to represent the vertical reference line, that is, the plane of the mobile phone screen (which can also be described as the front face image plane), and the dotted line b is used to represent the tilt direction of the face image, that is, the plane where the user's face is located (that is, the plane where the user's eyes and mouth are located). The angle β between the dotted line a and the dotted line b is used to represent the display angle. That is, the tilt angle β represents the angle between the face image and the front face image. As Figure 9 As shown in (a), the angle β is 0 degrees, that is, the mobile phone can calculate the display angle of 0 degrees through the face image. Figure 9As shown in (b), the angle β is 15 degrees, that is, the mobile phone can calculate the display angle of 15 degrees through the face image. Figure 9 As shown in (c), the angle β is 30 degrees, that is, the mobile phone can calculate the display angle of 30 degrees through the face image. Figure 9 As shown in (d), the angle β is 45 degrees, that is, the mobile phone can calculate the display angle of 45 degrees through the face image. Figure 9 As shown in (e), the angle β is 60 degrees, that is, the mobile phone can calculate the display angle of 60 degrees through the face image. It can be understood that for the convenience of description, Figure 9 The corresponding display angle is represented by the side face of the user. The face photographed by the mobile phone should be the front face of the user corresponding to the side face to obtain the corresponding face image.

[0182] In other embodiments, the mobile phone captures a facial image and sends the captured facial image to a server, which then calculates the current display angle of the mobile phone based on the facial image. Alternatively, the server can calculate the display angle using the method described above for calculating the local display angle of the mobile phone, which will not be further described here.

[0183] In some embodiments, after obtaining the display angle, the mobile phone searches for the target color parameters of each pixel in the 3D LUT according to the display angle, and displays the color using the target color parameters, thereby ensuring color consistency.

[0184] For example, Figure 6 As shown, the camera module 604 in the mobile phone captures the user's face, generates a user face image 63, and sends the user face image 63 to the neural network processor (NPU) 605. The NPU 605 uses an AI algorithm to determine the display angle 64 and sends the display angle 64 to the CPU 603. The CPU 603 determines the target mapping relationship 65 corresponding to the display angle 64 based on the display angle 64 and the stored mapping relationship 62, and sends the target mapping relationship 65 to the display driver chip (DDIC) 606. The DDIC 606 determines the target color parameters 66 of the color to be displayed for each pixel based on the target mapping relationship 65, and sends the target color parameters 66 to the screen (panel) 607 for display, so as to provide the user with the target display effect.

[0185] For example, Figure 6As shown, assuming that the NPU 605 determines that the display angle 64 is 15 degrees, as shown in Table 2 above, the CPU 603 determines that the target mapping relationship 65 is the mapping relationship corresponding to the display angle of 15 degrees. The DDIC 606 obtains the target mapping relationship 65 and determines that the pixel point M is now required to display color A. As shown in Table 2 above, the preset color parameter of color A is color parameter 1 (that is, the output color parameter corresponding to color A when the display angle is 0 degrees). When the display angle is 15 degrees, the input color parameter corresponding to the output color parameter of color parameter 1 is color parameter 3. Therefore, according to the target mapping relationship 65, when the pixel point M is required to display color A, the DDIC 606 adjusts the input color parameter to color parameter 3. That is, the target color parameter 66 is color parameter 3, and the screen 607 uses color parameter 3 to display color A at the pixel point M. As a result, when the display angle of the mobile phone is 15 degrees, the pixel point M can provide the same color display effect as when the display angle is 0 degrees.

[0186] Another example is Figure 6 As shown, DDIC 606 can directly obtain the mapping relationship 62 stored in CPU 603 and the display angle 64 determined by NPU 605, and can directly obtain target color parameters 66. That is, CPU 603 does not need to determine target mapping relationship 65, thereby reducing the power consumption of CPU 603.

[0187] In some embodiments, the mobile phone captures a facial image, obtains a display angle, and determines that the display angle has changed, then the color parameters need to be changed. For example, the mobile phone captures facial images in real time. When it is determined that the display angles corresponding to two consecutive facial images are different, a new target mapping relationship needs to be determined to obtain the target color parameters for displaying the color. For another example, a preset shooting cycle is set, and the mobile phone periodically captures the user's facial image to determine whether the display angle has changed, and then determines whether the target color parameters need to be re-determined. For another example, the user's posture and / or the position of the mobile phone change, resulting in a change in the distance between the mobile phone screen plane and the user's face plane, and the display angle will change. Then, after the mobile phone determines that the distance between the user's face and the mobile phone has changed by a preset method and exceeds a preset distance threshold, it captures the user's facial image again, determines the display angle, and determines whether the color parameters need to be updated, thereby reducing the number of times the camera module is started to reduce power consumption. Among them, the preset method for determining the distance between the user's face and the mobile phone includes, for example, measuring the distance between the user's face and the mobile phone using structured light technology, time of flight (TOF) technology, and / or detecting the distance between the user's face and the mobile phone using laser ranging or infrared ranging. This embodiment of the present application does not specifically limit this.

[0188] In some embodiments, the screen color automatic adjustment function is automatically activated after the mobile phone is turned on. When a change in the screen display angle is detected, the display module directly calls the mapping relationship stored in the 3D LUT module and displays the color using the target color parameters. The display module includes, for example, DDIC.

[0189] In other embodiments, the camera module in the mobile phone needs to remain on to capture the user's facial image in real time, determine the user's facial posture, and then determine the display angle. This results in high power consumption. To address this issue, a low-power camera module can be configured in the mobile phone to capture facial images, thereby reducing the power consumption of the automatic screen color adjustment function. Alternatively, the user can choose whether to enable the automatic screen color adjustment function.

[0190] For example, Figure 10A As shown, after the phone is turned on, the interface 1001 is displayed to prompt the user whether to turn on the automatic screen color adjustment function. If it is detected that the user clicks to confirm the operation of turning on the control 101, the function is turned on. If it is detected that the user clicks to not turn on the control 102 for the time being, the function remains turned off to reduce power consumption. Furthermore, during the use of the phone, the user is also provided with a way to turn on or off the function. Figure 10B In the main interface 1002 shown in (a), the mobile phone detects that the user clicks the setting icon 103 and displays the following Figure 10B In the setting interface 1003 shown in (b), the mobile phone detects that the user clicks the on or off control 104 corresponding to the automatic color adjustment function, and can turn the automatic color adjustment function on or off. Alternatively, when the battery level is low, the mobile phone can display the following information: Figure 10C The interface 1004 is shown to prompt the user to turn off the automatic color adjustment function, thereby reducing power consumption. If it is detected that the user clicks to confirm the operation of turning off the control 105, the automatic screen color adjustment function is turned off.

[0191] In some embodiments, when the mobile phone camera module is occupied, the automatic screen color adjustment function can be automatically disabled, and automatically enabled after the occupation ends. Alternatively, when the mobile phone camera module is occupied, the corresponding display angle is directly determined based on the images captured during the occupation process, and then the target color parameters are determined.

[0192] For example, during a video call, the camera module of the mobile phone is occupied by the call function, such as Figure 6 As shown, NPU 605 can directly obtain the image captured by the camera module 604 during the call, analyze and obtain the display angle 64, and perform adaptive adjustment of the screen display color.

[0193] Another example is Figure 11AIn the main interface 1101 shown in (a), the mobile phone responds to the user clicking the camera icon 111, starts the camera, and displays Figure 11A The shooting preview interface 1102 shown in (b). In the shooting preview interface 1102, the mobile phone needs to use the captured preview stream to determine the target color parameters corresponding to each pixel in real time and display it. In response to the user clicking the shooting control 112, the mobile phone sends the captured original image data to the processor for processing. After processing the original image data, the processor generates an image visible to the user, determines the preset color parameters corresponding to the image, and stores them in the memory. Among them, the preset color parameters are standard color parameters, or output color parameters under a preset display angle. The mobile phone displays as shown Figure 11A The interface 1103 shown in (c) shows thumbnails of previously captured images, such as the thumbnails indicated by display number 113. Figure 11A In the main interface 1101 shown in (a), the mobile phone responds to the user clicking the gallery icon 114, starts the gallery, and displays Figure 11B The gallery interface 1104 shown in (a) of FIG. 1104 displays a preview of the captured image or video stored in the memory. During the display process, the target color parameters corresponding to each pixel can be determined based on the display angle and the preset color parameters for display. Alternatively, in response to the user clicking the preview image indicated by the label 115, the mobile phone uses the processor to call the corresponding image data and preset color parameters stored in the memory, and determines the corresponding target color parameters based on the display angle to display the image. Figure 11B (b) shown in the interface 1105. It is understandable that the above Figure 11A and Figure 11B In the scenario shown, the color parameters stored in the phone are preset color parameters. The color parameters displayed in real time by the phone are target color parameters determined based on the preset color parameters and display angle, and may differ from the preset color parameters.

[0194] In other scenarios, the method for automatically adjusting the color of the mobile phone screen introduced above is also applicable to scenarios where other parameters of the mobile phone screen are automatically adjusted according to changes in the display angle. For example, the brightness parameters of the mobile phone screen are automatically adjusted. During the debugging phase before the user officially uses the mobile phone, the brightness of the mobile phone screen is measured at different display angles, and a mapping relationship between the input brightness parameter and the output brightness parameter of the mobile phone is established, and the brightness parameter mapping relationship is stored in the mobile phone. Subsequently, during the user use phase, after the mobile phone detects that the angle between the mobile phone screen and the face has changed, it can determine the corresponding mapping relationship based on the current display angle and map the current brightness parameter to the target brightness parameter. In this way, the display brightness of the screen is guaranteed to be the same at all display angles, providing users with a better user experience in some scenarios with high requirements for screen brightness.

[0195] For example, Figure 12 This is a flow chart of the screen display color adjustment method provided in the embodiment of the present application. Figure 12 , the method includes S1201-S1208.

[0196] S1201: A first electronic device displays a first color at a first display angle.

[0197] S1202: The second electronic device measures a first output color parameter of a first color at a first display angle.

[0198] The first electronic device is an electronic device whose screen color parameters are to be calibrated. The first color is all or part of the colors that can be displayed on the screen of the first electronic device. The second electronic device is a calibration device.

[0199] In some embodiments, it is necessary to predetermine preset color parameters in order to subsequently establish a color parameter mapping relationship. The second electronic device measures the output color parameters of the first color at a preset display angle as the preset color parameters. Alternatively, the second electronic device obtains standard color parameters corresponding to the first color and uses the standard color parameters as the preset color parameters. For example, if the RGB value of red is (255, 0, 0), then the preset color parameters for red are (255, 0, 0).

[0200] For example, the preset display angle is 0 degrees, that is, the preset color parameters are the output color parameters when the display angle is 0 degrees. The second electronic device measures the output color parameters of the first electronic device displaying the first color when the display angle is 0 degrees to obtain the preset color parameters.

[0201] In some embodiments, preset display angles to be measured are pre-set. The first display angle is any one of the preset display angles. The screen of the first electronic device displays various colors at the first display angle, and the calibration device measures the output color parameters of each color at the first display angle. For example, the preset display angles include 0 degrees, 15 degrees, 30 degrees, 45 degrees, and 60 degrees. Starting from 0 degrees, the output color parameters of the first color displayed on the screen are measured in sequence at the above five display angles.

[0202] For example, Figure 6 As shown, the measuring module 601 measures a first output color parameter of a color displayed by a first electronic device at a first display angle.

[0203] S1203: The second electronic device obtains an input color parameter of the first color, and establishes a first mapping relationship between a first output color parameter and the input color parameter at a first display angle.

[0204] The input color parameters of the first color include, for example, standard color parameters of the first color. For example, the first electronic device displays the first color using the standard color of the first color, and sets the output color when the display angle is 0 degrees to the preset color parameter. For another example, the first electronic device displays the first color using the standard color of the first color, and directly determines the standard color of the first color as the preset color parameter.

[0205] For example, Figure 6 As shown, the calibration module 602 receives the first output color parameter sent by the measurement module 601, determines the input color parameter of the first color, and establishes a first mapping relationship between the input color parameter and the first output color parameter at a first display angle.

[0206] S1204: The first electronic device determines whether the measurement of all preset display angles has been completed. If not, that is, the measurement of all preset display angles has not been completed, then step S1205 is executed. If yes, that is, the measurement of all preset display angles has been completed, then step S1208 is executed.

[0207] S1205: The first electronic device displays the first color at a second display angle.

[0208] S1206: The second electronic device measures a second output color parameter of the first color at a second display angle.

[0209] S1207: The second electronic device establishes a second mapping relationship between the second output color parameter and the input color parameter at a second display angle.

[0210] Specifically, in step S1204, the first electronic device determines whether measurements have been completed for all preset display angles. If all measurements have been completed, calibration of the current screen color parameters has been completed. If not, the display angle is changed, and steps S1204 through S1207 are executed to continue measuring the output color parameters at the next display angle, establishing a mapping relationship between the output color parameters and the input color parameters at the next display angle. In other words, steps S1204 through S1207 are repeated until color parameter measurements are completed for all preset display angles.

[0211] It should be noted that the input color parameters at each preset display angle are the same, that is, they are all standard color parameters of the first color.

[0212] S1208: The second electronic device sends the mapping relationship corresponding to each display angle to the first electronic device.

[0213] In some embodiments, the second electronic device determines that the measurement of the output color parameters at all preset display angles has been completed, and then generates 3D LUT configuration information, such as the mapping relationship between the input color parameters and the output color parameters of each color at all preset display angles. For example, after the first electronic device determines that the measurement of the output color parameters at all preset display angles has been completed, it sends a measurement completion signal to the second electronic device to notify the second electronic device that the current measurement process is complete. For another example, the second electronic device presets the preset display angles and / or the number of preset display angles that need to be measured, and the second electronic device can directly confirm whether the measurement process is completed.

[0214] The mapping relationships corresponding to the display angles may include, for example, mapping relationships corresponding to various display angles, or mapping relationships corresponding to display angle thresholds. For example, if the preset display angles include all angles, mapping relationships corresponding to various display angles may be obtained. Alternatively, if the preset display angles include some angles, mapping relationships corresponding to display angle thresholds may be obtained, such as if a display angle of [15±7.5) degrees corresponds to the same mapping relationship.

[0215] Afterwards, the second electronic device sends the generated 3D LUT configuration information to the first electronic device. Correspondingly, after receiving the 3D LUT configuration information sent by the second electronic device, the first electronic device stores the 3D LUT configuration information, for example, in a 3D LUT module or in a flash memory device (such as flash).

[0216] For example, Figure 6 As shown, the calibration module 602 sends the mapping relationship 62 to the CPU 603 , and the CPU 603 stores the mapping relationship 62 .

[0217] In other scenarios, after the second electronic device establishes a mapping relationship under each display angle, it sends the mapping relationship to the first electronic device. After the first electronic device receives the mapping relationships under all preset display angles, the first electronic device directly establishes a 3D LUT.

[0218] For example, Figure 13 As shown, in Figure 12 After step S1203, step S1301 may be further included.

[0219] S1301: The second electronic device sends a first mapping relationship corresponding to a first display angle to the first electronic device.

[0220] In some embodiments, after the second electronic device establishes a first mapping relationship between the first output color parameter and the input color parameter at the first display angle, it transmits the first mapping relationship to the first electronic device. In response, the first electronic device receives the first mapping relationship sent by the second electronic device and stores the first mapping relationship.

[0221] For example, Figure 13 As shown, in Figure 12 After step S1207, step S1302 may be further included.

[0222] S1302: The second electronic device sends a second mapping relationship corresponding to the second display angle to the first electronic device.

[0223] In some embodiments, after the second electronic device changes the display angle, it receives the mapping relationship between the input color parameters and the output color parameters after the display angle is changed. After receiving the mapping relationships under all preset display angles, the 3D LUT can be established.

[0224] thus, Figure 13 The flowchart of the screen display color adjustment method shown does not include step S1208 , that is, there is no need for the second electronic device to create a 3D LUT.

[0225] In this way, the second electronic device measures the output color parameters of the first electronic device at different display angles, and then establishes a mapping relationship between the input color parameters and the output color parameters at different display angles. Consequently, when the user subsequently uses the first electronic device, the first electronic device can adaptively adjust the color parameters based on changes in the display angle. This ensures that the same color is displayed without color deviation at different display angles, improving the user experience.

[0226] Furthermore, the first electronic device may also execute the steps and functions executed by the mobile phone in the above embodiment, and the second electronic device may also execute the steps and functions executed by the calibration device in the above embodiment, thereby realizing the screen display color adjustment method provided in the above embodiment.

[0227] For example, Figure 14 This is a flow chart of another method for adjusting screen display color provided in an embodiment of the present application. Figure 14 , the method includes S1401-S1408.

[0228] S1401: A first electronic device captures a first image and determines that the first image is a first face image.

[0229] The first electronic device is a device whose screen color parameters have been calibrated.

[0230] For example, after detecting a power-on or unlocking operation, the first electronic device needs to determine the color parameters currently required to implement color display. Therefore, an image is captured and the user's face is identified using facial recognition technology. If the user's face is recognized, the captured image is determined to be an image of the user's face, and the angle between the user's face and the screen is determined, that is, the display angle of the first electronic device is determined.

[0231] S1402: The first electronic device determines a first display angle according to the first facial image.

[0232] For example, Figure 6 As shown, the NPU 605 receives the user face image 63 sent by the camera module 604, and uses the AI ​​algorithm to determine the current display angle 64 of the first electronic device based on the user face image 63. Figure 9 The relevant content shown will not be repeated here.

[0233] S1403: The first electronic device determines a first mapping relationship according to the first display angle.

[0234] For example, Figure 6 As shown, after receiving the display angle 64 sent by the NPU 605, the CPU 603 searches the 3D LUT for the target mapping relationship 65 corresponding to the display angle 64 according to the display angle, that is, searches for the first mapping relationship corresponding to the first display angle.

[0235] S1404: The first electronic device displays a first color using the first mapping relationship.

[0236] For example, Figure 6 As shown, after DDIC 606 receives the target mapping relationship 65 sent by CPU 603, it uses the target mapping relationship 65 to call screen 607 to display the first color. For example, it is determined that the first display angle is 15 degrees. As shown in Table 2 above, when the first display angle is 15 degrees, the first mapping relationship corresponding to 15 degrees is obtained. When pixel N is required to display color E, according to the preset color parameter of color E, which is color parameter 5 (that is, the output color parameter corresponding to color E when the display angle is 0 degrees), the target color parameter is searched for in the input color parameter corresponding to 15 degrees, which is color parameter 1. Pixel N uses color parameter 1 to display color E, so that the output color is color parameter 5. This ensures that when the display angle is 15 degrees, the display effect of pixel N displaying color E is the same as the display effect of pixel N displaying color E when the display angle is 0 degrees, that is, the output color parameters are the same.

[0237] S1405: The first electronic device captures a second image and determines that the second image is a second facial image.

[0238] S1406: The first electronic device determines a second display angle according to the second facial image, where the second display angle is different from the first display angle.

[0239] S1407: The first electronic device determines a second mapping relationship according to the second display angle.

[0240] S1408: The first electronic device displays the first color using the second mapping relationship.

[0241] Exemplarily, the first electronic device determines that the display angle has changed based on the user's face image, and it is necessary to re-determine the mapping relationship under the current display angle based on the 3D LUT, update the color parameters, and ensure the consistency of the displayed color. For example, if the second display angle is determined to be 30 degrees, as shown in Table 2 above, when the second display angle is 30 degrees, the second mapping relationship corresponding to 30 degrees is obtained. When pixel N needs to display color E, the preset color parameter of color E is color parameter 5 (that is, the output color parameter corresponding to color E when the display angle is 0 degrees), and the target color parameter is searched for in the input color parameter corresponding to 30 degrees as color parameter 3. Pixel N uses color parameter 3 to display color E, so that the output color is color parameter 5. This ensures that when the display angle of pixel N is 30 degrees, the display effect of color E is the same as the display effect of pixel N displaying color E at 15 degrees in the above step S1404, that is, the output color parameters are the same. In other words, even if the display angle changes, it can be guaranteed that the output color parameters at each display angle are the same.

[0242] Afterwards, while the user is using the first electronic device, steps S1405 to S1408 are repeated to ensure that the screen of the first electronic device can adaptively adjust the color parameters when the display angle changes, thereby ensuring that the color displayed by the first electronic device does not deviate at different display angles.

[0243] In other scenarios, after the first electronic device captures an image and determines that the image is a face image, it sends the face image to the server, which determines the display angle. Figure 15 A flowchart of another method for adjusting screen display color is provided in an embodiment of the present application.

[0244] The above step S1402 can be implemented as steps S1501 to S1503.

[0245] S1501. A first electronic device sends a first facial image to a server.

[0246] S1502. The server determines a first display angle based on the first face image.

[0247] S1503. The server sends a first display angle to the first electronic device.

[0248] The above step S1406 can be implemented as steps S1504 and S1505.

[0249] S1504: The first electronic device sends a second facial image to the server.

[0250] S1505. The server determines a second display angle based on the second facial image.

[0251] S1506. The server sends the second display angle to the first electronic device.

[0252] The server, for example, includes a cloud server. After the first electronic device captures a user's facial image, it sends the facial image to the cloud server. The cloud server uses facial recognition technology to identify the user's posture in the facial image, determine the angle between the current user's face and the screen of the first electronic device, and thus determine the display angle corresponding to the facial image. The display angle is then sent to the first electronic device. The first electronic device can then determine the target mapping relationship based on the display angle.

[0253] Furthermore, the first electronic device may also execute the steps and functions executed by the mobile phone in the above embodiment, and the server may also execute the steps and functions executed by the server in the above embodiment, thereby realizing the screen display color adjustment method provided in the above embodiment.

[0254] Combination of the above Figure 12 、 Figure 13 、 Figure 14 and Figure 15 The screen display color adjustment method provided by the embodiment of the present application is described in detail. Figure 16 The screen display color adjustment device provided in the embodiment of the present application is described in detail.

[0255] In one possible design, Figure 16 This is a schematic diagram of the structure of the screen display color adjustment device provided in the embodiment of the present application. Figure 16 As shown, screen display color adjustment device 1600 includes: a processing unit 1601 and a display unit 1602. Screen display color adjustment device 1600 can be used to implement the functions of the device involved in the above-mentioned method embodiment. Screen display color adjustment device 1600 can be the device itself, a functional unit or chip in the device, or a device used in conjunction with a communication device.

[0256] Optionally, the processing unit 1601 is used to support the screen display color adjustment device 1600 to execute Figure 12 or Figure 13and / or, supporting the screen display color adjustment device 1600 to perform step S1204; Figure 14 or Figure 15 Step S1401, step S1402, step S1403, step S1405, step S1406 and step S1407 in; and / or other processes for the technology described in this document.

[0257] Optionally, the display unit 1602 is used to support the screen display color adjustment device 1600 to perform Figure 12 or Figure 13 Steps S1201 and S1205 in the embodiment; and / or, supporting the screen display color adjustment device 1600 to perform Figure 14 or Figure 15 Steps S1404 and S1408 in ; and / or other processes for the technology described herein.

[0258] Among them, all relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional module and will not be repeated here.

[0259] Optional, Figure 16 The screen display color adjustment device 1600 may further include a storage unit ( Figure 16 (not shown), the storage unit stores a program or instruction. When the processing unit 1601 and the display unit 1602 execute the program or instruction, Figure 16 The screen display color adjustment device 1600 shown can execute the screen display color adjustment method involved in the above method embodiment.

[0260] Optional, Figure 16 The screen display color adjustment device 1600 shown may further include a transceiver unit ( Figure 16 (not shown) can be implemented by a transceiver or transceiver-related circuit components, which can be a transceiver or transceiver module. The transceiver unit may include a receiving unit and a transmitting unit. The receiving unit is used to receive data sent by the calibration device or server. The transmitting unit is used to send data to the calibration device or server. The embodiments of the present application do not specifically limit the specific implementation of the transceiver unit.

[0261] Figure 16 The technical effects of the screen display color adjustment device 1600 shown can refer to the technical effects of the screen display color adjustment method involved in the above method embodiment, and will not be repeated here.

[0262] The present application also provides a chip system. Figure 17As shown, the chip system includes at least one processor 1701 and at least one interface circuit 1702. The processor 1701 and the interface circuit 1702 can be interconnected via lines. For example, the interface circuit 1702 can be used to receive signals from other devices. For another example, the interface circuit 1702 can be used to send signals to other devices (such as the processor 1701). Exemplarily, the interface circuit 1702 can read instructions stored in the memory and send the instructions to the processor 1701. When the instructions are executed by the processor 1701, the screen display color adjustment device can perform the various steps of the screen display color adjustment method in the above embodiment. Of course, the chip system can also include other discrete components, which are not specifically limited in the embodiments of the present application.

[0263] Optionally, there may be one or more processors in the chip system. The processor may be implemented in hardware or software. When implemented in hardware, the processor may be a logic circuit, an integrated circuit, etc. When implemented in software, the processor may be a general-purpose processor implemented by reading software code stored in a memory.

[0264] Optionally, the memory in the chip system may be one or more. The memory may be integrated with the processor or may be provided separately from the processor, which is not limited in the embodiments of the present application. For example, the memory may be a non-transient processor, such as a read-only memory (ROM), which may be integrated with the processor on the same chip or provided on different chips. The embodiments of the present application do not specifically limit the type of memory or the configuration of the memory and the processor.

[0265] Exemplarily, the chip system can be a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a system on chip (SoC), a central processor unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD) or other integrated chips.

[0266] It should be understood that each step in the above method embodiment can be completed by hardware integrated logic circuits in a processor or by software instructions. The method steps disclosed in the embodiments of the present application can be directly embodied as being executed by a hardware processor, or by a combination of hardware and software modules in a processor.

[0267] An embodiment of the present application further provides a storage medium for storing instructions used by the above-mentioned communication device.

[0268] An embodiment of the present application also provides a computer-readable storage medium, which stores computer instructions. When the computer instructions are executed on a server, the server executes the above-mentioned related method steps to implement the screen display color adjustment method in the above-mentioned embodiment.

[0269] An embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, it enables the computer to execute the above-mentioned related steps to implement the screen display color adjustment method in the above-mentioned embodiment.

[0270] In addition, embodiments of the present application further provide a device, which may be a component or module, and may include one or more processors and a memory connected to each other; wherein the memory is used to store computer programs, and the one or more computer programs include instructions. When the instructions are executed by the one or more processors, the device performs the screen display color adjustment method described in each of the above method embodiments.

[0271] Among them, the device, computer-readable storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0272] The steps of the method or algorithm described in conjunction with the disclosure of the embodiments of the present application can be implemented in a hardware manner or can be implemented by a processor executing software instructions. The software instructions can be composed of corresponding software modules, and the software modules can be stored in a random access memory (RAM), a flash memory, a read-only memory (ROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a register, a hard disk, a mobile hard disk, a read-only compact disc (CD-ROM) or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and can write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC).

[0273] Through the description of the above embodiments, those skilled in the art will clearly understand that for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The specific working processes of the above-described systems, devices, and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0274] In the several embodiments provided in this application, it should be understood that the disclosed methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the modules or units is merely a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of modules or units, which can be electrical, mechanical or other forms.

[0275] The units described as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected to achieve the purpose of this embodiment according to actual needs.

[0276] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0277] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which can be a personal computer, server, or network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program code, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk. The above is only a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or replacements within the technical scope disclosed in the present application should be included within the scope of protection of the present application. Therefore, the scope of protection of the present application should be based on the scope of protection of the claims.

Claims

1. A method for adjusting screen display color, characterized in that: Applied to a first electronic device, the method includes: Determine a first display angle corresponding to a first face; the first display angle is the angle between a plane where the first face is located and a plane where the first electronic device is located; Determining a first color parameter of a first pixel; determining a second color parameter of the first pixel according to the first display angle and the first color parameter; Displaying at the first pixel based on the second color parameter; The determining of the first display angle corresponding to the first face includes: capturing a first image according to a preset period, and determining that the first image is a first face image; determining, based on the first facial image, Euler angles corresponding to the first face; The first display angle corresponding to the Euler angle is determined.

2. The method according to claim 1, characterized in that Before determining the first display angle corresponding to the first face, the method further includes: A three-dimensional color lookup table (3D LUT) is obtained, where the 3D LUT includes a mapping relationship between the first color parameter and the second color parameter at a preset display angle; the preset display angle includes the first display angle.

3. The method according to claim 1 or 2, characterized in that The method further comprises: Display the first interface; In response to a first operation performed by a user on the first interface, a first function is turned on or off; the first function is used to determine the first display angle.

4. An electronic device, characterized in that: include: A processor, a memory, and a display screen, wherein the memory and the display screen are coupled to the processor, the memory is used to store computer program code, and the computer program code includes computer instructions. When the processor reads the computer instructions from the memory, the electronic device performs the following operations: Determine a first display angle corresponding to a first face; the first display angle is an angle between a plane where the first face is located and a plane where the electronic device is located; Determining a first color parameter of a first pixel; determining a second color parameter of the first pixel according to the first display angle and the first color parameter; Displaying at the first pixel based on the second color parameter; The determining of the first display angle corresponding to the first face includes: capturing a first image according to a preset period, and determining that the first image is a first face image; determining, based on the first facial image, Euler angles corresponding to the first face; The first display angle corresponding to the Euler angle is determined.

5. The electronic device according to claim 4, characterized in that When the processor reads the computer instructions from the memory, the electronic device is further caused to perform the following operations: A three-dimensional color lookup table (3D LUT) is obtained, where the 3D LUT includes a mapping relationship between the first color parameter and the second color parameter at a preset display angle; the preset display angle includes the first display angle.

6. The electronic device according to claim 4 or 5, characterized in that: When the processor reads the computer instructions from the memory, the electronic device is further caused to perform the following operations: Display the first interface; In response to a first operation performed by a user on the first interface, a first function is turned on or off; the first function is used to determine the first display angle.

7. A computer-readable storage medium, characterized in that The method comprises a program or an instruction, and when the program or the instruction is executed, the method according to any one of claims 1 to 3 is implemented.

Images