Backlight control method and device, display apparatus, and storage medium

Abstract

Embodiments of the present application provide a backlight control method and device, a display device and a storage medium. The method comprises: acquiring an eye image of a user; analyzing the eye image; selecting a focus area of the user from a plurality of eye movement partitions according to the analysis result; determining a first to-be-adjusted backlight partition corresponding to the focus area according to a correspondence between the eye movement partitions and backlight partitions; and adjusting the first to-be-adjusted backlight partition to a first target brightness according to a first preset rule. Embodiments of the present application determine the focus area of the user by using eye movement analysis, and adjust the backlight of the focus area, thereby enriching the backlight brightness adjustment mode, improving the intelligent level of the backlight brightness adjustment, and thus improving the user viewing experience and avoiding resource waste caused by overall improvement of the backlight brightness.

Description

Technical Field

[0001] This application relates to the field of display technology, and in particular to a backlight control method, device, display apparatus, and storage medium. Background Technology

[0002] With the development of technology, users have increasingly higher demands for the level of intelligence in home appliances. As an important member of the home appliance family, the intelligence of the television's display control is a crucial factor in determining the user's viewing experience.

[0003] In existing technologies, the focus is on improving the uniformity of backlight brightness provided by the backlight components of a display screen. When the display screen is displaying an image, the backlight brightness provided by each backlight component is usually adjusted uniformly and the brightness value is the same.

[0004] However, in the process of realizing this application, the inventors discovered that the prior art has at least the following problems: the existing backlight brightness adjustment methods are relatively simple and have a low level of intelligence, and uniformly increasing the brightness of each backlight component will cause a waste of resources. Summary of the Invention

[0005] This application provides a backlight control method, device, display apparatus, and storage medium to enrich the ways of adjusting backlight brightness, improve the intelligence level of backlight brightness adjustment, and avoid resource waste caused by increasing the overall backlight brightness.

[0006] In a first aspect, embodiments of this application provide a backlight control method, including:

[0007] The system acquires an image of the user's eyes, analyzes the image, and selects the user's area of ​​interest from multiple eye-tracking regions based on the analysis results.

[0008] Based on the correspondence between eye-tracking zones and backlight zones, the first backlight zone to be adjusted corresponding to the area of ​​interest is determined;

[0009] According to the first preset rule, the first backlight zone to be adjusted is adjusted to the first target brightness.

[0010] In one possible design, adjusting the first backlight zone to be adjusted to a first target brightness according to a first preset rule includes:

[0011] Obtain ambient light intensity and screen size;

[0012] The first target brightness is determined based on the ambient light intensity and the screen size;

[0013] Adjust the backlight intensity of the first backlight zone to be adjusted to the first target brightness.

[0014] In one possible design, after determining the first backlight zone to be adjusted corresponding to the area of ​​interest based on the correspondence between eye-tracking zones and backlight zones, the method further includes:

[0015] Based on the correspondence between eye-tracking zones and backlight zones, determine the second backlight zone to be adjusted corresponding to the non-focused area;

[0016] According to the second preset rule, the second backlight zone to be adjusted is adjusted to the second target brightness.

[0017] In one possible design, adjusting the second backlight zone to the second target brightness according to the second preset rule includes:

[0018] For each target backlight zone in the second backlight zone to be adjusted, determine the average brightness ratio between the first backlight zone to be adjusted and the target backlight zone, as well as the distance between the first backlight zone to be adjusted and the target backlight zone;

[0019] The second target brightness of the target backlight zone is determined based on the average brightness ratio, the distance, and the first target brightness;

[0020] Adjust each target backlight zone in the second backlight zone to be adjusted to the corresponding second target brightness.

[0021] In one possible design, after selecting the user's area of ​​focus from multiple eye-tracking partitions based on the analysis results, the process further includes:

[0022] Obtain the display image of the region of interest;

[0023] The displayed image is analyzed to obtain the elements of interest to the user;

[0024] Increase the contrast of the element of interest by a preset factor.

[0025] In one possible design, before determining the first backlight zone to be adjusted corresponding to the area of ​​interest based on the correspondence between eye-tracking zones and backlight zones, the method further includes:

[0026] For each eye-tracking region, obtain the first boundary coordinates of the eye-tracking region;

[0027] For each backlight zone, obtain the second boundary coordinates of the backlight zone; based on the first boundary coordinates and the second boundary coordinates, determine whether the backlight zone is within the area of ​​the eye-tracking zone; if the backlight zone is within the area of ​​the eye-tracking zone, then associate and match the backlight zone with the eye-tracking zone.

[0028] Obtain the correspondence between eye-tracking zones and backlight zones.

[0029] In one possible design, after determining whether the backlight partition is within the area of ​​the eye-tracking partition based on the first boundary coordinates and the second boundary coordinates, the method further includes:

[0030] Obtain the overlapping area of ​​the backlight zone and the eye-tracking zone;

[0031] If the ratio between the overlapping area and the total area of ​​the backlight partition is greater than a preset ratio, then the backlight partition and the eye-tracking partition will be associated and matched.

[0032] Secondly, embodiments of this application provide a backlight control device, comprising:

[0033] The selected module is used to acquire the user's eye image, parse the eye image, and select the user's attention area from multiple eye movement partitions based on the parsing results;

[0034] The determination module is used to determine the first backlight zone to be adjusted corresponding to the attention area based on the correspondence between eye-tracking zones and backlight zones;

[0035] The adjustment module is used to adjust the first backlight zone to be adjusted to the first target brightness according to the first preset rule.

[0036] Thirdly, embodiments of this application provide a backlight control device, including: a camera, a processor, and a memory;

[0037] The memory stores computer-executed instructions; the camera is connected to the processor and is used to capture images of the user's eyes.

[0038] The processor executes computer execution instructions stored in the memory, causing the processor to perform the method described in the first aspect above and various possible designs of the first aspect.

[0039] Fourthly, embodiments of this application provide a computer-readable storage medium storing computer-executable instructions, which, when executed by a processor, implement the method described in the first aspect and various possible designs of the first aspect.

[0040] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the method described in the first aspect and various possible designs of the first aspect.

[0041] The backlight control method, device, display apparatus, and storage medium provided in this embodiment acquire a user's eye image, analyze the image, select the user's area of ​​interest from multiple eye-tracking partitions based on the analysis results, determine a first backlight partition to be adjusted corresponding to the area of ​​interest based on the correspondence between eye-tracking partitions and backlight partitions, and adjust the first backlight partition to be adjusted to a first target brightness according to a first preset rule. The backlight control method provided in this embodiment, by employing eye-tracking analysis to determine the user's area of ​​interest and adjusting the backlight in that area, enriches the methods of backlight brightness adjustment, improves the intelligence level of backlight brightness adjustment, thereby enhancing the user's viewing experience and avoiding resource waste caused by increasing the overall backlight brightness. Attached Figure Description

[0042] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0043] Figure 1 This is an application scenario diagram of the backlight control method provided in the embodiments of this application;

[0044] Figure 2 Flowchart of the backlight control method provided in the embodiments of this application Figure 1 ;

[0045] Figure 3 A schematic diagram illustrating the principle of determining the correspondence between eye-tracking zones and backlight zones provided in the embodiments of this application;

[0046] Figure 4 Flowchart of the backlight control method provided in the embodiments of this application Figure 2 ;

[0047] Figure 5 Flowchart of the backlight control method provided in the embodiments of this application Figure 3 ;

[0048] Figure 6 This is a schematic diagram of the backlight control device provided in the embodiments of this application;

[0049] Figure 7 This is a structural block diagram of a backlight control device provided in an embodiment of this application. Detailed Implementation

[0050] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0051] With the development of technology, users have increasingly higher demands for the level of intelligence in home appliances. As an important member of the home appliance family, the intelligence of the television's display control is a crucial factor in determining the user's viewing experience.

[0052] In existing technologies, the focus is on improving the uniformity of backlight brightness provided by the backlight components of a display screen. When displaying an image, the backlight brightness provided by each backlight component is typically adjusted uniformly to the same value. However, existing backlight brightness adjustment methods are relatively simple and lack a high level of intelligence, failing to meet user needs. Furthermore, uniformly increasing the brightness of each backlight component leads to resource waste.

[0053] To address the aforementioned technical problems, the inventors of this application have discovered through research that eye-tracking analysis can be performed on users to determine the area of ​​focus on the screen. This allows for backlight adjustment of the focused area to highlight the image displayed therein. Based on this, embodiments of this application provide a backlight control method that enriches the methods for adjusting backlight brightness and improves the intelligence level of backlight brightness adjustment, thereby enhancing the user's viewing experience and avoiding resource waste caused by increasing overall backlight brightness.

[0054] Figure 1 This diagram illustrates an application scenario of the backlight control method provided in the embodiments of this application. Figure 1 As shown, in this scenario, the display device includes a camera 101, a display 102, and a controller (not shown). The display 102 is used to display images for the user to view, and the display interface of the display 102 can be divided into multiple eye-tracking zones, for example, such as... Figure 1 As shown, the eye-tracking area is divided into six zones: S1, S2, S3, S4, S5, and S6. Camera 101 captures images of the user's eyes and sends them to the controller. The controller analyzes the eye images and selects the user's area of ​​interest from the multiple eye-tracking zones based on the analysis results.

[0055] In the specific implementation, when a user is watching the screen displayed on the TV 102, assuming the user is focusing on eye-tracking zone 2, the camera 101 captures images of the user's eyes in real time, obtains eye images, and sends these images to the controller. The controller analyzes the eye images and selects eye-tracking zone 2 as the focus area from the six eye-tracking zones based on the analysis results. It then adjusts the backlight of the corresponding backlight zone for the focus area, for example, by brightening the overall backlight of that focus area.

[0056] The backlight control method provided in this embodiment uses eye-tracking analysis to determine the user's area of ​​focus and adjusts the backlight in that area, highlighting the content the user is interested in and improving the user's viewing experience. It also enriches the ways to adjust backlight brightness and improves the intelligence level of backlight brightness adjustment, avoiding resource waste caused by increasing the overall backlight brightness.

[0057] The technical solutions of this application will be described in detail below with specific embodiments. These specific embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments.

[0058] Figure 2 Flowchart of the backlight control method provided in the embodiments of this application Figure 1 .like Figure 2 As shown, the method includes:

[0059] 201. Obtain the user's eye image, parse the eye image, and select the user's attention area from multiple eye movement partitions based on the parsing results.

[0060] The execution subject of this embodiment can be a display device with a camera, such as a television, computer, mobile phone, tablet, etc.

[0061] In practical applications, a user's eye image can be captured by a camera and sent to a controller. The controller analyzes the eye image and selects at least one eye movement partition as the region of interest from a pre-divided set of eye movement partitions.

[0062] 202. Based on the correspondence between eye-tracking zones and backlight zones, determine the first backlight zone to be adjusted corresponding to the area of ​​interest.

[0063] In this embodiment, the number of eye-tracking zones divided in the display is typically less than the number of backlight zones; that is, one eye-tracking zone can usually correspond to multiple backlight zones. After knowing the eye-tracking zone corresponding to the area of ​​interest, multiple backlight zones corresponding to that area of ​​interest can be determined based on the correspondence between the eye-tracking zones and the backlight zones, serving as the first backlight zones to be adjusted.

[0064] For example, a monitor has 6 eye-tracking zones and 120 backlight zones, with each eye-tracking zone corresponding to 20 backlight zones. If a user is viewing an image within the second eye-tracking zone, that zone is identified as the area of ​​interest, and the 20 backlight zones corresponding to that zone are designated as the first backlight zones to be adjusted.

[0065] 203. According to the first preset rule, adjust the first backlight zone to be adjusted to the first target brightness.

[0066] In this embodiment, the first preset rule can be set based on experience. In one possible implementation, some backlight zones within the first backlight zone to be adjusted can be brightened. In another possible implementation, all backlight zones within the first backlight zone to be adjusted can be brightened.

[0067] In some embodiments, the calculation method for the value of the first target brightness may include: obtaining the ambient light intensity and the screen size; determining the first target brightness based on the ambient light intensity and the screen size; and adjusting the backlight intensity of the first backlight zone to be adjusted to the first target brightness.

[0068] For example, the target brightness of the backlight in the area of ​​interest can be determined based on the ambient light and the screen size. Different screen sizes of display devices will result in different comfortable viewing brightness levels. Taking a 55-inch screen as an example, the suitable viewing brightness of the area of ​​interest under ambient light I can be calculated according to the following expression, which is the first target brightness.

[0069] (1)

[0070] Where I is the intensity of ambient light, and L is the brightness at a grayscale of 255.

[0071] The backlight control method provided in this embodiment acquires and analyzes a user's eye image. Based on the analysis results, it selects the user's area of ​​interest from multiple eye-tracking partitions. According to the correspondence between eye-tracking partitions and backlight partitions, it determines a first backlight partition to be adjusted corresponding to the area of ​​interest. Then, according to a first preset rule, it adjusts the first backlight partition to a first target brightness. This backlight control method, by employing eye-tracking analysis to determine the user's area of ​​interest and adjusting the backlight accordingly, enriches the methods for adjusting backlight brightness, improves the intelligence level of backlight brightness adjustment, thereby enhancing the user's viewing experience and avoiding resource waste caused by increasing the overall backlight brightness.

[0072] In some embodiments, based on the above embodiments, for example in Figure 2Based on the illustrated embodiment, this embodiment adds an introduction to the method for determining the correspondence between eye-tracking zones and backlight zones. In this embodiment, before step 202, it may further include: for each eye-tracking zone, obtaining the first boundary coordinates of the eye-tracking zone; for each backlight zone, obtaining the second boundary coordinates of the backlight zone; determining whether the backlight zone is within the area of ​​the eye-tracking zone based on the first boundary coordinates and the second boundary coordinates; if the backlight zone is within the area of ​​the eye-tracking zone, then associating and matching the backlight zone with the eye-tracking zone; obtaining the correspondence between the eye-tracking zone and the backlight zone.

[0073] Specifically, when each eye-tracking zone corresponds to multiple backlight zones, the association between the backlight zones and the eye-tracking zones can be determined based on the inclusion relationship between their respective area ranges. For example, ... Figure 3 As shown, the monitor interface is divided into six eye-tracking zones: S1, S2, S3, S4, S5, and S6. Taking S1 as an example, the backlight zones that overlap with S1 include at least Z1, Z2, Z3, Z4, ..., Z8, and Z9. Since Z1 to Z8 are all within the area of ​​S1, Z1 to Z8 can be associated with S1 to establish a correspondence between Z1 to Z8 and S1 respectively.

[0074] In some embodiments, after determining whether the backlight partition is within the area of ​​the eye-tracking partition based on the first boundary coordinates and the second boundary coordinates, the method may further include: obtaining the overlapping area of ​​the backlight partition and the eye-tracking partition; if the ratio between the overlapping area and the total area of ​​the backlight partition is greater than a preset ratio, then the backlight partition and the eye-tracking partition are associated and matched.

[0075] Specifically, such as Figure 3 As shown, the area of ​​backlight zone Z9 is not entirely within the area of ​​eye-tracking zone S1. Assuming the preset ratio is set to 50%, the ratio between the overlapping area of ​​Z9 and S1 and the total area of ​​Z9 is less than 50%, so Z9 is not associated with S1. Assuming the preset ratio is set to 10%, the ratio between the overlapping area of ​​Z9 and S1 and the total area of ​​Z9 is greater than 10%, therefore, a correspondence between Z9 and S1 can be established.

[0076] In some embodiments, the correspondence can be adjusted according to the actual display effect. For example, if the backlight zones that overlap with the boundary lines of two adjacent eye-tracking zones are not associated with or matched with the two adjacent eye-tracking zones, the display effect is better, and this method can be adopted.

[0077] Figure 4Flowchart of the backlight control method provided in the embodiments of this application Figure 2 .like Figure 4 As shown, based on the above embodiments, this embodiment adds an introduction to the method of adjusting the backlight in non-interested areas. This method includes:

[0078] 401. Obtain the user's eye image, parse the eye image, and select the user's attention area from multiple eye movement partitions based on the parsing results.

[0079] 402. Based on the correspondence between eye-tracking zones and backlight zones, determine the first backlight zone to be adjusted corresponding to the area of ​​interest and the second backlight zone to be adjusted corresponding to the area of ​​non-interest.

[0080] 403. According to the first preset rule, adjust the first backlight zone to be adjusted to the first target brightness.

[0081] Steps 401 to 403 in this embodiment are similar to steps 201 to 203 in the above embodiment, and will not be repeated here.

[0082] 404. According to the second preset rule, adjust the second backlight zone to be adjusted to the second target brightness.

[0083] In this embodiment, there are several ways to set the second target brightness. In one possible design, the second target brightness can be set to the brightness value of the lowest brightness backlight zone in the second backlight zone to be adjusted, so as to highlight the display screen of the area of ​​interest. In another possible design, the backlight zones of non-interesting areas can be left unadjusted, and their original brightness can be maintained. In yet another possible design, in order to improve the user's viewing comfort, the brightness can be adjusted to be lower as the distance between each backlight zone in the second backlight zone to be adjusted and the first backlight zone to be adjusted increases, so as to achieve a gradual change in brightness. The specific steps may include: for each target backlight zone in the second backlight zone to be adjusted, determining the average brightness ratio between the first backlight zone to be adjusted and the target backlight zone, and the distance between the first backlight zone to be adjusted and the target backlight zone; determining the second target brightness of the target backlight zone based on the average brightness ratio, the distance, and the first target brightness; and adjusting each target backlight zone in the second backlight zone to be adjusted to the corresponding second target brightness.

[0084] Specifically, assuming the second backlight zone to be adjusted includes multiple backlight zones, Z1 to Z10, and the first backlight zone to be adjusted includes multiple backlight zones, Z11 to Z20, and assuming the geometric centroid of the first backlight zone to be adjusted is O1, for each target backlight zone in the second backlight zone to be adjusted, taking Z1 as an example, calculate the distance D1 between the coordinates Q21 of the geometric centroid of Z1 and O1. Calculate the average brightness Y of the backlight of Z1. 1APL Calculate the average brightness of the backlight from Z11 to Z20, and use it as the average brightness Y of the first backlight zone to be adjusted. APL Calculate Y APL With Y 1APL The ratio between them. Then, based on the brightness of the first target, distance D1, and Y... APL With Y 1APL The ratio between them determines the second target brightness of the target backlight zone Z1.

[0085] For example, the second target brightness of each target backlight zone in the second backlight zone to be adjusted corresponding to the non-interested area can be calculated according to the following expression.

[0086] (2)

[0087] in, Let L be the second target brightness of the i-th target backlight zone in the second backlight zone to be adjusted, and let L be the first target brightness of the first backlight zone to be adjusted. The ratio of the average brightness of the first backlight zone to be adjusted to the target backlight zone is given. The distance between the first backlight zone to be adjusted and the target backlight zone, and the distance increases with the target backlight zone. Increase, Gradually decrease.

[0088] The backlight control method provided in this embodiment can highlight the display content in the area of ​​interest and improve the user's viewing experience by adjusting the brightness of the first backlight zone to be adjusted in the area of ​​interest and the brightness of the second backlight zone to be adjusted in the area of ​​non-interest, respectively. It also enriches the ways of adjusting backlight brightness, improves the level of intelligence of backlight brightness adjustment, and avoids the waste of resources caused by increasing the overall backlight brightness.

[0089] Figure 5 Flowchart of the backlight control method provided in the embodiments of this application Figure 3 .like Figure 5 As shown, based on the above embodiments, this embodiment adds a step of adjusting the contrast of user-focused elements in the area of ​​interest. This method includes:

[0090] 501. Obtain the user's eye image, parse the eye image, and select the user's attention area from multiple eye movement partitions based on the parsing results.

[0091] 502. Based on the correspondence between eye-tracking zones and backlight zones, determine the first backlight zone to be adjusted corresponding to the area of ​​interest.

[0092] 503. According to the first preset rule, adjust the first backlight zone to be adjusted to the first target brightness.

[0093] Steps 501 to 503 in this embodiment are similar to steps 201 to 203 in the above embodiment, and will not be repeated here.

[0094] 504. Obtain the display image of the area of ​​interest, and parse the display image to obtain the user's focus elements.

[0095] 505. Increase the contrast of the element of interest by a preset factor.

[0096] In this embodiment, the elements that the user focuses on can be people, scenery, animals, etc.

[0097] In practical applications, a contrast adjustment database can be established, pre-storing the correspondence between different elements of interest and preset multipliers. After extracting the user's element of interest from the displayed image of the area of ​​interest, the database can be accessed to obtain the preset multiplier corresponding to the contrast adjustment of that element of interest, thereby increasing the contrast of that element of interest by the preset multiplier.

[0098] For example, the display of a device is showing a nighttime scene where characters A and B are having a picnic by a river. If the element of interest extracted from the displayed image within the user's area of ​​focus is the heads of characters A and B, then the contrast can be adjusted based on a head contrast adjustment strategy, such as brightening the forehead and darkening the sides of the nose.

[0099] The backlight control method provided in this embodiment extracts the elements of interest from the displayed image within the user's area of ​​interest and adjusts the contrast of these elements, thereby making the image display clearer and improving the user experience. Furthermore, adjusting the contrast only within the area of ​​interest reduces the computational load and saves computing resources compared to adjusting the contrast of the entire display screen.

[0100] Figure 6 This is a schematic diagram of the backlight control device provided in an embodiment of this application. Figure 6 As shown, the backlight control device 60 includes:

[0101] The selection module 601 is used to acquire the user's eye image, parse the eye image, and select the user's attention area from multiple eye movement partitions based on the parsing result;

[0102] The determining module 602 is used to determine the first backlight partition to be adjusted corresponding to the attention area based on the correspondence between the eye-tracking partition and the backlight partition;

[0103] The adjustment module 603 is used to adjust the first backlight zone to be adjusted to the first target brightness according to the first preset rule.

[0104] The backlight control device provided in this application embodiment acquires the user's eye image through a selection module 601, analyzes the eye image, selects the user's attention area from multiple eye-tracking partitions based on the analysis result, determines the first backlight partition to be adjusted corresponding to the attention area based on the correspondence between the eye-tracking partitions and the backlight partitions, and adjusts the first backlight partition to be adjusted to a first target brightness according to a first preset rule. This enriches the backlight brightness adjustment methods and improves the intelligence level of backlight brightness adjustment, thereby enhancing the user's viewing experience and avoiding resource waste caused by increasing the overall backlight brightness.

[0105] The backlight control device provided in this application embodiment can be used to execute the above method embodiment. Its implementation principle and technical effect are similar, and will not be described again here.

[0106] Figure 7 This is a structural block diagram of a display device provided in an embodiment of this application. The display device may be a television set, a computer, a messaging device, a tablet computer, a medical device, etc.

[0107] The device 70 may include one or more of the following components: a processing component 701, a memory 702, a power supply component 703, a multimedia component 704, an audio component 705, an input / output (I / O) interface 706, a sensor component 707, and a communication component 708.

[0108] Processing component 701 typically controls the overall operation of device 70, such as operations associated with display, telephone calls, data communication, camera operation, and recording. Processing component 701 may include one or more processors 709 to execute instructions to complete all or part of the steps of the methods described above. Furthermore, processing component 701 may include one or more modules to facilitate interaction between processing component 701 and other components. For example, processing component 701 may include a multimedia module to facilitate interaction between multimedia component 704 and processing component 701.

[0109] Memory 702 is configured to store various types of data to support the operation of device 70. Examples of such data include instructions for any application or method operating on device 70, contact data, phonebook data, messages, pictures, videos, etc. Memory 702 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0110] Power supply assembly 703 provides power to the various components of device 70. Power supply assembly 703 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to device 70.

[0111] Multimedia component 704 includes a screen that provides an output interface between the device 70 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 704 includes a front-facing camera and / or a rear-facing camera. When the device 70 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0112] Audio component 705 is configured to output and / or input audio signals. For example, audio component 705 includes a microphone (MIC) configured to receive external audio signals when device 70 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 702 or transmitted via communication component 708. In some embodiments, audio component 705 also includes a speaker for outputting audio signals.

[0113] I / O interface 706 provides an interface between processing component 701 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0114] Sensor assembly 707 includes one or more sensors for providing state assessments of various aspects of device 70. For example, sensor assembly 707 can detect the on / off state of device 70, the relative positioning of components such as the display and keypad of device 70, changes in the position of device 70 or a component of device 70, the presence or absence of user contact with device 70, the orientation or acceleration / deceleration of device 70, and temperature changes of device 70. Sensor assembly 707 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 707 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 707 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0115] Communication component 708 is configured to facilitate wired or wireless communication between device 70 and other devices. Device 70 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 708 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 708 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0116] In an exemplary embodiment, the apparatus 70 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0117] This application also provides a display device, including: the backlight control device described in the above embodiments.

[0118] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 702 including instructions, which can be executed by a processor 709 of the device 70 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0119] The aforementioned computer-readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk. The readable storage medium can be any available medium accessible to a general-purpose or special-purpose computer.

[0120] An exemplary readable storage medium is coupled to a processor, enabling the processor to read information from and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can reside in an Application Specific Integrated Circuit (ASIC). Alternatively, the processor and the readable storage medium can exist as discrete components in the device.

[0121] Those skilled in the art will understand that all or part of the steps of the above-described method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When executed, the program performs the steps of the above-described method embodiments; and the aforementioned storage medium includes various media capable of storing program code, such as ROM, RAM, magnetic disks, or optical disks.

[0122] This application also provides a computer program product, including a computer program, which, when executed by a processor, implements the backlight control method executed by the backlight control device described above.

[0123] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

Claims

1. A backlight control method, characterized in that, include: The system acquires an image of the user's eyes, analyzes the image, and selects the user's area of ​​interest from multiple eye-tracking regions based on the analysis results. Based on the correspondence between eye-tracking zones and backlight zones, the first backlight zone to be adjusted corresponding to the area of ​​interest is determined; According to the first preset rule, the first backlight zone to be adjusted is adjusted to the first target brightness; After selecting the user's area of ​​interest from multiple eye-tracking partitions based on the analysis results, the process further includes: Obtain the display image of the region of interest; The displayed image is analyzed to obtain the elements of interest to the user; Increase the contrast of the element of interest by a preset factor.

2. The method according to claim 1, characterized in that, The step of adjusting the first backlight zone to the first target brightness according to the first preset rule includes: Obtain ambient light intensity and screen size; The first target brightness is determined based on the ambient light intensity and the screen size; Adjust the backlight intensity of the first backlight zone to be adjusted to the first target brightness.

3. The method according to claim 1, characterized in that, After determining the first backlight zone to be adjusted corresponding to the area of ​​interest based on the correspondence between eye-tracking zones and backlight zones, the method further includes: Based on the correspondence between eye-tracking zones and backlight zones, determine the second backlight zone to be adjusted corresponding to the non-focused area; According to the second preset rule, the second backlight zone to be adjusted is adjusted to the second target brightness.

4. The method according to claim 3, characterized in that, The step of adjusting the second backlight zone to the second target brightness according to the second preset rule includes: For each target backlight zone in the second backlight zone to be adjusted, determine the average brightness ratio between the first backlight zone to be adjusted and the target backlight zone, as well as the distance between the first backlight zone to be adjusted and the target backlight zone; The second target brightness of the target backlight zone is determined based on the average brightness ratio, the distance, and the first target brightness; Adjust each target backlight zone in the second backlight zone to be adjusted to the corresponding second target brightness.

5. The method according to any one of claims 1-4, characterized in that, Before determining the first backlight zone to be adjusted corresponding to the area of ​​interest based on the correspondence between eye-tracking zones and backlight zones, the method further includes: For each eye-tracking region, obtain the first boundary coordinates of the eye-tracking region; For each backlight zone, obtain the second boundary coordinates of the backlight zone; based on the first boundary coordinates and the second boundary coordinates, determine whether the backlight zone is within the area of ​​the eye-tracking zone; if the backlight zone is within the area of ​​the eye-tracking zone, then associate and match the backlight zone with the eye-tracking zone. Obtain the correspondence between eye-tracking zones and backlight zones.

6. The method according to claim 5, characterized in that, After determining whether the backlight zone is within the area of ​​the eye-tracking zone based on the first boundary coordinates and the second boundary coordinates, the method further includes: Obtain the overlapping area of ​​the backlight zone and the eye-tracking zone; If the ratio between the overlapping area and the total area of ​​the backlight partition is greater than a preset ratio, then the backlight partition and the eye-tracking partition will be associated and matched.

7. A backlight control device, characterized in that, include: The selected module is used to acquire the user's eye image, parse the eye image, and select the user's attention area from multiple eye movement partitions based on the parsing results; The determination module is used to determine the first backlight zone to be adjusted corresponding to the attention area based on the correspondence between eye-tracking zones and backlight zones; The adjustment module is used to adjust the first backlight zone to be adjusted to the first target brightness according to the first preset rule; The device further includes a module for selecting the user's area of ​​interest from multiple eye-tracking partitions based on the analysis results, acquiring a display image of the area of ​​interest, analyzing the display image to obtain the user's focus element, and increasing the contrast of the focus element by a preset multiple.

8. A display device, characterized in that, include: Camera, processor, and memory; The memory stores computer-executed instructions; the camera is connected to the processor and is used to capture images of the user's eyes. The processor executes computer execution instructions stored in the memory, causing the processor to perform the backlight control method as described in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores computer-executable instructions, which, when executed by the processor, implement the backlight control method as described in any one of claims 1 to 6.

Images