Multi-area brightness collaborative adjustment method based on user face position and touch point position

Abstract

The present invention relates to a method for collaboratively adjusting the brightness of multiple regions based on the user's face position and touch point position, and belongs to the field of display technology. The method includes capturing user face image data through a camera and obtaining user face position information through a Dlib library face detection algorithm, obtaining first adjustment region information through a first region limitation method based on the user face position information and the display screen size, capturing user display screen touch operations through a touch sensor and obtaining initial touch point position information through a touch point detection algorithm, obtaining touch point position information through a touch point position limitation condition based on the initial touch point position information, obtaining second adjustment region information through a dynamic adjustment strategy based on the touch point position information and the first adjustment region information, adjusting the brightness of each region according to user preferences through a brightness adjustment algorithm to obtain new brightness setting parameters, and dynamically adjusting the brightness of the display screen adjustment region according to the new brightness parameters.

Description

Technical Field

[0001] The present invention belongs to the field of display technology, and specifically relates to a method for collaboratively adjusting multi-area brightness based on user face position and touch point position. Background Art

[0002] Brightness adjustment is an intelligent display brightness optimization technology that adjusts the brightness of the display device based on specific environmental conditions or user behavior. It accurately determines the screen area where the user is looking by identifying the user's face position and determines the user's interaction area by monitoring the location of touch points, thereby achieving regional brightness adjustment. However, most display devices on the market mainly adjust brightness across the entire screen, failing to optimize local brightness based on the user's specific location and operating habits, resulting in a poor user experience. Summary of the Invention

[0003] In order to solve the above-mentioned problems existing in the prior art, the present invention proposes a multi-zone brightness collaborative adjustment method based on the user's face position and touch point position, which intelligently adjusts the local brightness of the display screen to enhance the user's visual experience and operating comfort.

[0004] The purpose of the present invention can be achieved through the following technical solutions:

[0005] The multi-area brightness coordinated adjustment method based on the user's face position and touch point position includes:

[0006] Capturing user face image data in real time through a camera, and obtaining user face position information based on the user face image data using a Dlib library face detection algorithm, wherein the user face position information includes a user face position coordinate set and a user face bounding box;

[0007] Obtaining first adjustment region information using a first region limitation method based on the user face position information and the display screen size, the first adjustment region information including a first adjustment region bounding box and a first adjustment region coordinate set. The first adjustment region bounding box is the region after an offset and an expansion amount are added to the user face bounding box, where the expansion amount is the width and height increased based on the original region.

[0008] Capturing a user's touch operation on the display screen with a touch sensor to obtain touch sensor data, obtaining initial touch point position information using a touch point detection algorithm based on the touch sensor data, and obtaining touch point position information based on the initial touch point position information using a touch point position determination condition, wherein the touch point position information is the coordinates of the touch point on the display screen;

[0009] Obtaining second adjustment region information through a dynamic adjustment strategy according to the touch point position information and the first adjustment region information, wherein the second adjustment region information includes a second adjustment region bounding box and a second adjustment region coordinate set;

[0010] New brightness setting parameters are obtained through a brightness adjustment algorithm based on the first adjustment area information and the second adjustment area information, and the brightness of the display adjustment area is dynamically adjusted in a coordinated manner based on the new brightness setting parameters. The new brightness setting parameters include new brightness setting parameters for the first adjustment area, new brightness setting parameters for the second adjustment area, and new brightness setting parameters for the overlapping area.

[0011] Preferably, obtaining the user face position information by using the Dlib library face detection algorithm according to the user face image data includes:

[0012] Initialize a face detector using a pre-trained classifier based on the user's face image data;

[0013] Scanning the user's facial image data using a sliding window technique to obtain a suspected facial area;

[0014] Extracting facial edge features and facial shape features from the suspected face area using the HOG algorithm;

[0015] The face detector is used to determine whether the suspected face area is a face area based on the face edge features and the face shape features. If not, the user's face image data is recaptured through the camera and face detection is performed again; if yes, the user's face position information is output.

[0016] Preferably, obtaining the first adjustment area information by a first area limitation method according to the user face position information and the display screen size includes:

[0017] Obtaining valid user face position information based on the user face position information through face position determination conditions, wherein the face position determination conditions include that the face region coordinate set is reasonable and the face region boundary frame is within the display screen boundary;

[0018] Initial first adjustment region information is obtained through offset calculation according to the valid user face position information, wherein the initial first adjustment region information includes an initial first adjustment region bounding box and an initial first adjustment region coordinate set. The offset calculation expression is:

[0019] (x adjust ,y adjust ) = (x-offset, y-offset)

[0020] (x adjust_end ,y adjust_end)=(x+w+extension,y+h+extension)

[0021] Wherein, offset is the offset of the first adjustment area relative to the user face bounding box, extension is the extension of the first adjustment area relative to the user face bounding box, (x adjust ,y adjust ) is the coordinate of the upper left corner of the first adjustment area, (x adjust_end ,y adjust_end ) is the coordinate of the lower right corner of the first adjustment area;

[0022] Obtaining the first adjustment area information according to the initial first adjustment area information through a first adjustment area determination condition, wherein the first adjustment area determination condition includes that the first adjustment area coordinate set is reasonable and the first adjustment area boundary frame is within the boundary of the display screen;

[0023] When the initial first adjustment region information does not meet the first adjustment region determination condition, obtaining the first adjustment region information by using an adjustment strategy according to the initial first adjustment region information;

[0024] When the initial first adjustment region information meets the first adjustment region determination condition, the initial first adjustment region information is the first adjustment region information.

[0025] Preferably, the mathematical expression of the face position determination condition is:

[0026] x+w≤display_width

[0027] y+h≤display_hheight

[0028] x≥0,y≥0

[0029] w>0,h>0

[0030] Among them, x is the horizontal coordinate of the pixel in the upper left corner of the user's face position information, y is the vertical coordinate of the pixel in the upper left corner of the user's face position information, w is the width of the face in the face bounding box, h is the height of the face in the face bounding box, display_width is the width of the display screen, and display_height is the height of the display screen.

[0031] Preferably, the mathematical expression of the first adjustment area determination condition is:

[0032] x adjust_end ≤display_width

[0033] y adjust_end ≤display_height

[0034] x adjust ≥0,y adjust ≥0

[0035] Among them, x adjust is the horizontal coordinate of the upper left corner of the first adjustment area, y adjust is the vertical coordinate of the upper left corner of the first adjustment area, x adjust_end is the horizontal coordinate of the lower right corner of the first adjustment area, y adjust_end is the vertical coordinate of the lower right corner of the first adjustment area, display_width is the width of the display screen, and display_hight is the height of the display screen.

[0036] Preferably, the adjustment strategy includes:

[0037] When the horizontal coordinate of the upper left corner of the initial first adjustment area is less than 0, setting the horizontal coordinate of the upper left corner of the initial first adjustment area to 0;

[0038] When the vertical coordinate of the upper left corner of the initial first adjustment area is less than 0, setting the vertical coordinate of the upper left corner of the initial first adjustment area to 0;

[0039] When the horizontal coordinate of the lower right corner of the initial first adjustment area is greater than the width of the display screen, setting the horizontal coordinate of the lower right corner of the initial first adjustment area to be equal to the width of the display screen;

[0040] When the vertical coordinate of the lower right corner of the initial first adjustment area is greater than the height of the display screen, the vertical coordinate of the lower right corner of the initial first adjustment area is set to be equal to the height of the display screen.

[0041] Preferably, obtaining the touch point position information according to the initial touch point position information through a touch point position determination condition includes:

[0042] When the initial touch point position information does not meet the touch point position determination condition, the system provides an error handling mechanism, which includes system calibration and maintenance;

[0043] When the initial touch point position information satisfies the touch point position determination condition, the initial touch point position information is the touch point position information.

[0044] Preferably, obtaining the second adjustment area information through a dynamic adjustment strategy according to the touch point position information and the first adjustment area information includes:

[0045] Obtaining initial second adjustment area information based on the touch point position information and the touch point judgment condition;

[0046] The second adjustment region information is obtained according to the initial second adjustment region information and the second adjustment region determination condition.

[0047] Preferably, the mathematical expression of the touch point judgment condition is:

[0048] x c ≥x adjust_1 -offset1

[0049] y c ≥y adjust_1 -offset1

[0050] x c +w1≤x adjust_1 +w adjust_1 +offset1

[0051] y c +h1≤y adjust_1 +h adjust_1 +offset1

[0052] Among them, x adjust_1 is the horizontal coordinate of the lower left corner of the first adjustment area, y adjust_1 is the lower left corner ordinate of the first adjustment area, x c is the horizontal coordinate of the touch point, y c is the vertical coordinate of the touch point, w1 is the width of the first adjustment area, h1 is the height of the first adjustment area, and offset1 is the offset of the touch point position relative to the first adjustment area.

[0053] Preferably, the obtaining of the initial second adjustment area information by judging the touch point position information through a touch point judgment condition includes:

[0054] When the touch point position information satisfies the touch point judgment condition, the coordinates of the upper left corner of the initial second adjustment area are the touch point coordinates, and the coordinates of the lower right corner of the initial second adjustment area are the coordinates of the lower right corner of the first adjustment area;

[0055] When the touch point position information does not meet the touch point judgment condition, the coordinates of the upper left corner of the initial second adjustment area are the touch point coordinates, and the coordinates of the lower right corner of the initial second adjustment area are the touch point coordinates plus the extension amount.

[0056] Preferably, the second adjustment region determination condition includes:

[0057] When the horizontal coordinate of the upper left corner of the initial second adjustment area is less than 0, the horizontal coordinate of the upper left corner of the second adjustment area is set to 0;

[0058] When the vertical coordinate of the upper left corner of the initial second adjustment area is less than 0, the vertical coordinate of the upper left corner of the second adjustment area is set to 0;

[0059] When the horizontal coordinate of the lower right corner of the initial second adjustment area is greater than the width of the display screen, the horizontal coordinate of the lower right corner of the second adjustment area is set to the width of the display screen;

[0060] When the vertical coordinate of the lower right corner of the initial second adjustment area is greater than the width of the display screen, the vertical coordinate of the lower right corner of the second adjustment area is set to the height of the display screen;

[0061] When the horizontal coordinate of the upper left corner of the initial second adjustment area and the vertical coordinate of the upper left corner of the initial second adjustment area are both greater than or equal to 0, the horizontal coordinate of the lower right corner of the initial second adjustment area is less than or equal to the width of the display screen, and the vertical coordinate of the lower right corner of the initial second adjustment area is less than or equal to the height of the display screen, the initial second adjustment area information is the second adjustment area information.

[0062] Preferably, obtaining a new brightness setting parameter by a brightness adjustment algorithm according to the first adjustment area information and the second adjustment area information includes:

[0063] According to user preferences, a brightness adjustment algorithm is used to customize and initialize the brightness adjustment parameters, wherein the brightness adjustment parameters include a brightness increase / decrease ratio and a brightness adjustment speed;

[0064] According to the brightness adjustment parameter, the first adjustment area information, and the second adjustment area information, the brightness adjustment amount of the first adjustment area and the brightness adjustment amount of the second adjustment area are respectively obtained by adjusting the amount. The expression for calculating the adjustment amount is:

[0065] A=B*Δ

[0066] Where A is the brightness adjustment amount of the area, B is the current brightness of the area, and Δ is the brightness increase or decrease ratio;

[0067] Obtaining overlapping area information by taking the intersection of the first adjustment area information and the second adjustment area information, and obtaining a brightness adjustment amount for the overlapping area by using a brightness balance method based on the overlapping area information, specifically including obtaining the brightness adjustment amount for the overlapping area by taking the average of the brightness adjustment amount for the first adjustment area and the brightness adjustment amount for the second adjustment area;

[0068] According to the brightness adjustment amount of the first adjustment area, the brightness adjustment amount of the second adjustment area, and the brightness adjustment amount of the overlapping area, new brightness setting parameters of the first adjustment area, the second adjustment area, and the overlapping area are obtained through brightness calculation, respectively. The expression for the brightness calculation is:

[0069] B new =B+A

[0070] Among them, A is the brightness adjustment amount of the area, B is the current brightness of the area, and B new Set the parameters for the new brightness of the area.

[0071] A multi-region brightness collaborative adjustment system based on user face position and touch point position, applying the above-mentioned multi-region brightness collaborative adjustment method based on user face position and touch point position, comprising a system initialization module, a real-time detection and response module, a brightness adjustment feedback module, and a user prompt and adjustment module;

[0072] The system initialization module is used when a user uses the device for the first time. The system prompts the user to enable the camera and touch permissions for initial settings, including camera calibration and touch sensitivity adjustment.

[0073] The real-time detection and response module is used to monitor the user's face position and the user's touch operation on the display screen in real time when the system is running in the background. When the user approaches the device, the camera automatically captures the user's face image data and detects the face area to obtain the user's face position information; when the user touches the display screen, the touch sensor automatically collects and detects the touch data to obtain the touch point location information;

[0074] The brightness adjustment feedback module is used when the user operates the device. The system automatically adjusts the display brightness based on the touch point location information and the user's face location information. The brightness change is immediately displayed on the screen, and the user can directly see the brightness adjustment result;

[0075] The user prompt and adjustment module is used to display prompt information on the screen to guide the user to make adjustments or repairs when the system detects an abnormal situation, such as a camera being blocked and a touch sensor failure.

[0076] An electronic device includes a memory, a processor, and a computer program stored in the memory and runnable on the processor. When the processor executes the program, the multi-area brightness coordinated adjustment method based on the user's face position and touch point position is implemented.

[0077] A storage medium containing computer-executable instructions, which, when executed by a computer processor, are used to perform the above-mentioned multi-area brightness coordinated adjustment method based on the user's face position and touch point position.

[0078] The beneficial effects of the present invention are:

[0079] (1) The user's face position and the user's display screen touch operation are monitored in real time through the camera and touch sensor. The brightness adjustment area is automatically determined through the first area limitation method, the touch point position judgment condition and the dynamic adjustment strategy. The user can adjust the brightness of different areas without manual operation, which simplifies the user operation process and improves the convenience of use.

[0080] (2) The brightness of a specific area of ​​the display screen is dynamically adjusted based on the touch point location information and the user's face location information through a brightness adjustment algorithm. This can quickly adjust to the brightness environment that is most comfortable for the user, improve the user experience, and at the same time reduce unnecessary energy consumption and improve the energy efficiency of the display device.

[0081] (3) Parameters are initialized according to user preferences and the brightness of each area is adjusted through the brightness adjustment algorithm, which improves user satisfaction and comfort and meets the personalized needs of different users. BRIEF DESCRIPTION OF THE DRAWINGS

[0082] To facilitate understanding by those skilled in the art, the present invention is further described below with reference to the accompanying drawings.

[0083] Figure 1 Schematic diagram of the process of the multi-zone brightness coordinated adjustment method based on the user's face position and touch point position of the present invention. DETAILED DESCRIPTION

[0084] In order to further illustrate the technical means and effects adopted by the present invention to achieve the predetermined purpose of the invention, the specific implementation methods, structures, features and effects of the present invention are described in detail below in conjunction with the accompanying drawings and preferred embodiments.

[0085] See also Figure 1 , a multi-area brightness coordinated adjustment method based on the user's face position and touch point position, including:

[0086] S1: Capturing user face image data in real time through a camera, and obtaining user face position information based on the user face image data using a Dlib library face detection algorithm, wherein the user face position information includes a user face position coordinate set and a user face bounding box;

[0087] S2: Obtaining first adjustment region information using a first region limitation method based on the user face position information and the display screen size. The first adjustment region information includes a first adjustment region bounding box and a first adjustment region coordinate set. The first adjustment region bounding box is the region after an offset and an expansion amount are added to the user face bounding box. The expansion amount is the width and height increased based on the original region.

[0088] S3: Capturing a user's touch operation on the display screen via a touch sensor to obtain touch sensor data, obtaining initial touch point position information using a touch point detection algorithm based on the touch sensor data, and obtaining touch point position information based on the initial touch point position information using a touch point position determination condition, where the touch point position information is the coordinates of the touch point on the display screen;

[0089] S4: obtaining second adjustment region information through a dynamic adjustment strategy according to the touch point position information and the first adjustment region information, where the second adjustment region information includes a second adjustment region bounding box and a second adjustment region coordinate set;

[0090] S5: Obtain new brightness setting parameters using a brightness adjustment algorithm based on the first adjustment area information and the second adjustment area information, and dynamically adjust the brightness of the adjustment areas of the display screen according to the new brightness setting parameters, where the new brightness setting parameters include new brightness setting parameters for the first adjustment area, new brightness setting parameters for the second adjustment area, and new brightness setting parameters for the overlapping area;

[0091] In step S1, obtaining the user's face position information by using the Dlib library face detection algorithm according to the user's face image data specifically includes the following steps:

[0092] S101: Initializing a face detector using a pre-trained classifier based on the user face image data;

[0093] S102: Scanning the user's facial image data using a sliding window technique to obtain a suspected facial region;

[0094] S103: extracting facial edge features and facial shape features from the suspected face region using the HOG algorithm;

[0095] S104: Determine whether the suspected face area is a face area through the face detector based on the face edge features and the face shape features; if not, recapture the user face image data through the camera and repeat steps S101 to S104; if yes, output the user face position information.

[0096] In step S2, obtaining first adjustment area information by a first area limitation method according to the user face position information and the display screen size specifically includes the following steps:

[0097] S201: Obtain valid user face position information based on the user face position information through a face position determination condition. The face position determination condition includes that the face region coordinate set is reasonable and the face region boundary frame is within the display screen boundary. The mathematical expression is:

[0098] x+w≤displaay_width

[0099] y+h≤display_hheight

[0100] x≥0,y≥0

[0101] w>0,h>0

[0102] Among them, x is the horizontal coordinate of the pixel in the upper left corner of the user's face position information, y is the vertical coordinate of the pixel in the upper left corner of the user's face position information, w is the width of the face in the face bounding box, h is the height of the face in the face bounding box, display_width is the width of the display screen, and display_height is the height of the display screen.

[0103] When the user face position information does not meet the face position determination condition, the valid user face position information is obtained by adjusting the user face bounding box through a border scaling method; when the user face position information meets the face position determination condition, the user face position information is the valid user face position information;

[0104] S202: Obtain initial first adjustment region information through offset calculation based on the valid user face position information, wherein the initial first adjustment region information includes an initial first adjustment region bounding box and an initial first adjustment region coordinate set. The offset calculation expression is:

[0105] (x adjust ,y adjust ) = (x-offset, y-offset)

[0106] (x adjust_end ,y adjust_end )=(x+w+extension, y+h+extension)

[0107] Wherein, offset is the offset of the first adjustment area relative to the user face bounding box, extension is the extension of the first adjustment area relative to the user face bounding box, (x adjust ,y adjust ) is the coordinate of the upper left corner of the first adjustment area, (x adjust_end ,y adjust_end ) is the coordinate of the lower right corner of the first adjustment area;

[0108] S203: Obtain the first adjustment area information according to the initial first adjustment area information through a first adjustment area determination condition. The first adjustment area determination condition includes that the first adjustment area coordinate set is reasonable and the first adjustment area boundary frame is within the display screen boundary. The mathematical expression is:

[0109] x adjust_end ≤display_width

[0110] y adjust_end ≤display_height

[0111] x adjust≥0,y adjust ≥0

[0112] Among them, x adjust is the horizontal coordinate of the upper left corner of the first adjustment area, y adjust is the vertical coordinate of the upper left corner of the first adjustment area, x adjust_end is the horizontal coordinate of the lower right corner of the first adjustment area, y adjust_end is the vertical coordinate of the lower right corner of the first adjustment area, display_width is the width of the display screen, and display_hight is the height of the display screen.

[0113] When the initial first adjustment region information does not meet the first adjustment region determination condition, the first adjustment region information is obtained by using an adjustment strategy according to the initial first adjustment region information, the adjustment strategy including:

[0114] When the horizontal coordinate of the upper left corner of the initial first adjustment area is less than 0, setting the horizontal coordinate of the upper left corner of the initial first adjustment area to 0;

[0115] When the vertical coordinate of the upper left corner of the initial first adjustment area is less than 0, setting the vertical coordinate of the upper left corner of the initial first adjustment area to 0;

[0116] When the horizontal coordinate of the lower right corner of the initial first adjustment area is greater than the width of the display screen, setting the horizontal coordinate of the lower right corner of the initial first adjustment area to be equal to the width of the display screen;

[0117] When the vertical coordinate of the lower right corner of the initial first adjustment area is greater than the height of the display screen, setting the vertical coordinate of the lower right corner of the initial first adjustment area to be equal to the height of the display screen;

[0118] When the initial first adjustment region information meets the first adjustment region determination condition, the initial first adjustment region information is the first adjustment region information;

[0119] It should be noted that the touch point detection algorithm in step S3 is the detection algorithm provided by the touch sensor;

[0120] In step S3, the touch point position information is obtained according to the initial touch point position information through the touch point position determination condition, specifically including: when the initial touch point position information does not meet the touch point position determination condition, the system provides an error handling mechanism, the error handling mechanism including system calibration and maintenance; when the initial touch point position information meets the touch point position determination condition, the initial touch point position information is the touch point position information;

[0121] In step S4, obtaining the second adjustment region information through a dynamic adjustment strategy according to the touch point position information and the first adjustment region information is specifically achieved by the following steps:

[0122] S401: Obtaining initial second adjustment area information according to the touch point position information and the touch point judgment condition. The mathematical expression of the touch point judgment condition is:

[0123] x c ≥x adjust_1 -offset1

[0124] y c ≥y adjust_1 -offset1

[0125] x c +w1≤x adjust_1 +w adjust_1 +offset1

[0126] y c +h1≤y adjust_1 +h adjust_1 +offset1

[0127] Among them, x adjust_1 is the horizontal coordinate of the lower left corner of the first adjustment area, y adjust_1 is the lower left corner ordinate of the first adjustment area, x c is the horizontal coordinate of the touch point, y c is the vertical coordinate of the touch point, w1 is the width of the first adjustment area, h1 is the height of the first adjustment area, and offset1 is the offset of the touch point position relative to the first adjustment area.

[0128] When the touch point position information satisfies the touch point judgment condition, the coordinates of the upper left corner of the initial second adjustment area are the touch point coordinates, and the coordinates of the lower right corner of the initial second adjustment area are the coordinates of the lower right corner of the first adjustment area;

[0129] When the touch point position information does not meet the touch point judgment condition, the coordinates of the upper left corner of the initial second adjustment area are the touch point coordinates, and the coordinates of the lower right corner of the initial second adjustment area are the touch point coordinates plus the extension amount.

[0130] S402: Obtaining the second adjustment region information according to the initial second adjustment region information through a second adjustment region determination condition, wherein the second adjustment region determination condition specifically includes setting the upper left corner horizontal coordinate of the second adjustment region to 0 when the upper left corner horizontal coordinate of the initial second adjustment region is less than 0;

[0131] When the vertical coordinate of the upper left corner of the initial second adjustment area is less than 0, the vertical coordinate of the upper left corner of the second adjustment area is set to 0;

[0132] When the horizontal coordinate of the lower right corner of the initial second adjustment area is greater than the width of the display screen, the horizontal coordinate of the lower right corner of the second adjustment area is set to the width of the display screen;

[0133] When the vertical coordinate of the lower right corner of the initial second adjustment area is greater than the width of the display screen, the vertical coordinate of the lower right corner of the second adjustment area is set to the height of the display screen;

[0134] When the horizontal coordinate of the upper left corner of the initial second adjustment area and the vertical coordinate of the upper left corner of the initial second adjustment area are both greater than or equal to 0, the horizontal coordinate of the lower right corner of the initial second adjustment area is less than or equal to the width of the display screen, and the vertical coordinate of the lower right corner of the initial second adjustment area is less than or equal to the height of the display screen, the initial second adjustment area information is the second adjustment area information.

[0135] In step S5, obtaining a new brightness setting parameter by using a brightness adjustment algorithm according to the first adjustment area information and the second adjustment area information is specifically achieved by the following steps:

[0136] S501: Obtaining brightness adjustment parameters through customized initialization of a brightness adjustment algorithm according to user preferences, wherein the brightness adjustment parameters include a brightness increase / decrease ratio and a brightness adjustment speed.

[0137] S502: Calculate the brightness adjustment amount of the first adjustment area and the brightness adjustment amount of the second adjustment area according to the brightness adjustment parameter, the first adjustment area information, and the second adjustment area information. The expression for calculating the adjustment amount is:

[0138] A=B*△

[0139] Where A is the brightness adjustment amount of the area, B is the current brightness of the area, and Δ is the brightness increase or decrease ratio;

[0140] S503: Obtaining overlapping area information by taking the intersection of the first adjustment area information and the second adjustment area information, and obtaining a brightness adjustment amount for the overlapping area by using a brightness balance method based on the overlapping area information, specifically including obtaining the brightness adjustment amount for the overlapping area by taking the average of the brightness adjustment amount for the first adjustment area and the brightness adjustment amount for the second adjustment area;

[0141] S504: Obtain new brightness setting parameters for the first adjustment area, new brightness setting parameters for the second adjustment area, and new brightness setting parameters for the overlapping area through brightness calculation according to the brightness adjustment amount of the first adjustment area, the brightness adjustment amount of the second adjustment area, and the brightness adjustment amount of the overlapping area, respectively. The brightness calculation expression is:

[0142] B new =B+A

[0143] Among them, A is the brightness adjustment amount of the area, B is the current brightness of the area, and B new Set the parameters for the new brightness of the area.

[0144] The multi-zone coordinated brightness adjustment system based on the user's face position and touch point position includes a system initialization module, a real-time detection and response module, a brightness adjustment feedback module, and a user prompt and adjustment module;

[0145] The system initialization module is used when a user uses the device for the first time. The system prompts the user to enable the camera and touch permissions for initial settings, including camera calibration and touch sensitivity adjustment.

[0146] The real-time detection and response module is used to monitor the user's face position and the user's touch operation on the display screen in real time when the system is running in the background. When the user approaches the device, the camera automatically captures the user's face image data and detects the face area to obtain the user's face position information; when the user touches the display screen, the touch sensor automatically collects and detects the touch data to obtain the touch point location information;

[0147] The brightness adjustment feedback module is used when the user operates the device. The system automatically adjusts the display brightness based on the touch point location information and the user's face location information. The brightness change is immediately displayed on the screen, and the user can directly see the brightness adjustment result;

[0148] The user prompt and adjustment module is used to display prompt information on the screen to guide the user to make adjustments or repairs when the system detects an abnormal situation, such as a camera being blocked and a touch sensor failure.

[0149] The computer storage medium of the embodiment of the present invention may adopt any combination of one or more computer-readable media. The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. The computer-readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or component, or any combination thereof. More specific examples (a non-exhaustive list) of computer-readable storage media include: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In this document, a computer-readable storage medium may be any tangible medium containing or storing a program that can be used by or in combination with an instruction execution system, device or device.

[0150] A computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, which carries computer-readable program code. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can transmit, propagate, or transport a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0151] The program code included in the computer-readable medium can be transmitted with any appropriate medium, including but not limited to wireless, electric wire, optical cable, RF or the like, or any suitable combination thereof. The computer program code for performing the operation of the present invention can be written in one or more programming languages ​​or a combination thereof, and the programming language includes an object-oriented programming language such as Java, Smalltalk, C++, and also includes a conventional procedural programming language such as "C" language or similar programming language. The program code can be executed completely on the user's computer, partially on the user's computer, as an independent software package, partially on the user's computer and partially on a remote computer, or completely on a remote computer or server. In the case of a remote computer, the remote computer can be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or can be connected to an external computer (for example, utilizing an Internet service provider to connect through the Internet).

[0152] The above description is merely a preferred embodiment of the present invention and does not constitute any form of limitation to the present invention. Although the present invention has been disclosed as a preferred embodiment as above, it is not intended to limit the present invention. Any person skilled in the art can make some changes or modifications to equivalent embodiments using the technical contents disclosed above without departing from the scope of the technical solution of the present invention. However, any simple modifications, equivalent changes and modifications made to the above embodiments based on the technical essence of the present invention without departing from the content of the technical solution of the present invention are still within the scope of the technical solution of the present invention.

Claims

1. A multi-area brightness collaborative adjustment method based on the user's face position and touch point position, characterized in that: include: Capturing user face image data in real time through a camera, and obtaining user face position information based on the user face image data using a Dlib library face detection algorithm, wherein the user face position information includes a user face position coordinate set and a user face bounding box; Obtaining first adjustment region information using a first region limitation method based on the user face position information and the display screen size, the first adjustment region information including a first adjustment region bounding box and a first adjustment region coordinate set. The first adjustment region bounding box is the region after an offset and an expansion amount are added to the user face bounding box, where the expansion amount is the width and height increased based on the original region. Capturing a user's touch operation on the display screen with a touch sensor to obtain touch sensor data, obtaining initial touch point position information using a touch point detection algorithm based on the touch sensor data, and obtaining touch point position information based on the initial touch point position information using a touch point position determination condition, wherein the touch point position information is the coordinates of the touch point on the display screen; Obtaining second adjustment region information through a dynamic adjustment strategy according to the touch point position information and the first adjustment region information, wherein the second adjustment region information includes a second adjustment region bounding box and a second adjustment region coordinate set; According to the first adjustment area information and the second adjustment area information, a new brightness setting parameter is obtained by a brightness adjustment algorithm, and the brightness of the adjustment area of ​​the display screen is dynamically adjusted according to the new brightness setting parameter, wherein the new brightness setting parameter includes a new brightness setting parameter for the first adjustment area, a new brightness setting parameter for the second adjustment area, and a new brightness setting parameter for the overlapping area; The obtaining of the first adjustment area information by the first area limitation method according to the user face position information and the display screen size includes: Obtaining valid user face position information based on the user face position information through face position determination conditions, wherein the face position determination conditions include that the face region coordinate set is reasonable and the face region boundary frame is within the display screen boundary; Initial first adjustment region information is obtained through offset calculation according to the valid user face position information, wherein the initial first adjustment region information includes an initial first adjustment region bounding box and an initial first adjustment region coordinate set. The offset calculation expression is: in, The horizontal coordinate of the pixel in the upper left corner of the user's face position information, y is the vertical coordinate of the pixel in the upper left corner of the user's face position information, w is the face width in the face bounding box, h is the face height in the face bounding box, offset is the offset of the first adjustment area relative to the user's face bounding box, and extension is the extension of the first adjustment area relative to the user's face bounding box. is the coordinate of the upper left corner of the first adjustment area, is the coordinate of the lower right corner of the first adjustment area; The first adjustment area information is obtained according to the initial first adjustment area information through a first adjustment area determination condition, where the first adjustment area determination condition includes that a first adjustment area coordinate set is reasonable and a first adjustment area boundary frame is within a display screen boundary.

2. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 1, characterized in that: The obtaining of user face position information by using the Dlib library face detection algorithm according to the user face image data includes: Initialize a face detector using a pre-trained classifier based on the user's face image data; Scanning the user's facial image data using a sliding window technique to obtain a suspected face area; Extracting facial edge features and facial shape features from the suspected face area using the HOG algorithm; The face detector is used to determine whether the suspected face area is a face area based on the face edge features and the face shape features. If not, the user's face image data is recaptured through the camera and face detection is performed again; if so, the user's face position information is output.

3. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 1, characterized in that: When the initial first adjustment region information does not meet the first adjustment region determination condition, obtaining the first adjustment region information through a dynamic adjustment strategy according to the initial first adjustment region information; When the initial first adjustment region information meets the first adjustment region determination condition, the initial first adjustment region information is the first adjustment region information.

4. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 3, characterized in that: The mathematical expression of the face position determination condition is: in, is the horizontal coordinate of the pixel in the upper left corner of the user's face position information, y is the vertical coordinate of the pixel in the upper left corner of the user's face position information, w is the face width in the face bounding box, and h is the face height in the face bounding box. is the display width, is the display height.

5. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 3, characterized in that: The mathematical expression of the first adjustment area determination condition is: in, is the horizontal coordinate of the upper left corner of the first adjustment area, is the upper left corner ordinate of the first adjustment area, is the horizontal coordinate of the lower right corner of the first adjustment area, is the vertical coordinate of the lower right corner of the first adjustment area, is the display width, is the display height.

6. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 3, characterized in that: The dynamic adjustment strategy includes: When the horizontal coordinate of the upper left corner of the initial first adjustment area is less than 0, setting the horizontal coordinate of the upper left corner of the initial first adjustment area to 0; When the vertical coordinate of the upper left corner of the initial first adjustment area is less than 0, setting the vertical coordinate of the upper left corner of the initial first adjustment area to 0; When the horizontal coordinate of the lower right corner of the initial first adjustment area is greater than the width of the display screen, setting the horizontal coordinate of the lower right corner of the initial first adjustment area to be equal to the width of the display screen; When the vertical coordinate of the lower right corner of the initial first adjustment area is greater than the height of the display screen, the vertical coordinate of the lower right corner of the initial first adjustment area is set to be equal to the height of the display screen.

7. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 1, characterized in that: The obtaining of the touch point position information according to the initial touch point position information by using a touch point position determination condition includes: When the initial touch point position information does not meet the touch point position determination condition, the system provides an error handling mechanism, which includes system calibration and maintenance; When the initial touch point position information satisfies the touch point position determination condition, the initial touch point position information is the touch point position information.

8. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 1, characterized in that: The obtaining of the second adjustment region information by a dynamic adjustment strategy according to the touch point position information and the first adjustment region information includes: Obtaining initial second adjustment area information based on the touch point position information and the touch point judgment condition; The second adjustment region information is obtained according to the initial second adjustment region information and the second adjustment region determination condition.

9. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 8, characterized in that: The mathematical expression of the touch point judgment condition is: in, is the horizontal coordinate of the lower left corner of the first adjustment area, is the lower left corner ordinate of the first adjustment area, is the horizontal coordinate of the touch point, is the vertical coordinate of the touch point, is the width of the first adjustment area, is the height of the first adjustment area, is the offset of the touch point position relative to the first adjustment area.

10. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 8, characterized in that: The obtaining of the initial second adjustment area information by judging the touch point position information through the touch point judgment condition includes: When the touch point position information satisfies the touch point judgment condition, the coordinates of the upper left corner of the initial second adjustment area are the touch point coordinates, and the coordinates of the lower right corner of the initial second adjustment area are the coordinates of the lower right corner of the first adjustment area; When the touch point position information does not meet the touch point judgment condition, the coordinates of the upper left corner of the initial second adjustment area are the touch point coordinates, and the coordinates of the lower right corner of the initial second adjustment area are the touch point coordinates plus the extension amount.

11. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 8, characterized in that: The second adjustment area determination condition includes: When the horizontal coordinate of the upper left corner of the initial second adjustment area is less than 0, the horizontal coordinate of the upper left corner of the second adjustment area is set to 0; When the vertical coordinate of the upper left corner of the initial second adjustment area is less than 0, the vertical coordinate of the upper left corner of the second adjustment area is set to 0; When the horizontal coordinate of the lower right corner of the initial second adjustment area is greater than the width of the display screen, the horizontal coordinate of the lower right corner of the second adjustment area is set to the width of the display screen; When the vertical coordinate of the lower right corner of the initial second adjustment area is greater than the width of the display screen, the vertical coordinate of the lower right corner of the second adjustment area is set to the height of the display screen; When the horizontal coordinate of the upper left corner of the initial second adjustment area and the vertical coordinate of the upper left corner of the initial second adjustment area are both greater than or equal to 0, the horizontal coordinate of the lower right corner of the initial second adjustment area is less than or equal to the width of the display screen, and the vertical coordinate of the lower right corner of the initial second adjustment area is less than or equal to the height of the display screen, the initial second adjustment area information is the second adjustment area information.

12. The method for collaboratively adjusting multi-area brightness based on user face position and touch point position according to claim 1, characterized in that: The obtaining of a new brightness setting parameter by a brightness adjustment algorithm according to the first adjustment area information and the second adjustment area information includes: According to user preferences, a brightness adjustment algorithm is used to customize and initialize the brightness adjustment parameters, wherein the brightness adjustment parameters include a brightness increase / decrease ratio and a brightness adjustment speed; According to the brightness adjustment parameter, the first adjustment area information, and the second adjustment area information, the brightness adjustment amount of the first adjustment area and the brightness adjustment amount of the second adjustment area are respectively obtained by adjusting the amount. The expression for calculating the adjustment amount is: in, is the brightness adjustment amount of the area, is the current brightness of the area, is the brightness increase / decrease ratio; Obtaining overlapping area information by taking an intersection of the first adjustment area information and the second adjustment area information, and obtaining a brightness adjustment amount for the overlapping area by using a brightness balance method based on the overlapping area information, specifically comprising: obtaining a brightness adjustment amount for the overlapping area by taking an average of the brightness adjustment amount for the first adjustment area and the brightness adjustment amount for the second adjustment area; According to the brightness adjustment amount of the first adjustment area, the brightness adjustment amount of the second adjustment area, and the brightness adjustment amount of the overlapping area, new brightness setting parameters of the first adjustment area, the second adjustment area, and the overlapping area are obtained through brightness calculation, respectively. The expression for the brightness calculation is: in, is the brightness adjustment amount of the area, is the current brightness of the area, Set the parameters for the new brightness of the area.

13. A system for collaboratively adjusting brightness in multiple areas based on user face position and touch point position, applying the method for collaboratively adjusting brightness in multiple areas based on user face position and touch point position according to claim 1, comprising a system initialization module, a real-time detection and response module, a brightness adjustment feedback module, and a user prompt and adjustment module, characterized in that: The system initialization module is used when a user uses the device for the first time. The system prompts the user to enable camera and touch permissions and perform initial settings, including camera calibration and touch sensitivity adjustment. The real-time detection and response module is used to monitor the user's face position and touch operation on the display screen in real time when the system is running in the background. When the user approaches the device, the camera automatically captures the user's face image data and detects the face area to obtain the user's face position information; When the user performs a touch operation on the display screen, the touch sensor automatically collects and detects the touch data to obtain the touch point location information; The brightness adjustment feedback module is used when the user operates the device. The system automatically adjusts the display brightness based on the touch point location information and the user's face location information. The brightness change is immediately displayed on the screen, and the user can directly see the brightness adjustment result; The user prompt and adjustment module is used to display prompt information on the screen to guide the user to make adjustments or repairs when the system detects an abnormal situation, such as a camera being blocked and a touch sensor failure.

14. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, it implements the multi-area brightness collaborative adjustment method based on the user's face position and touch point position as described in any one of claims 1-13.

15. A storage medium containing computer-executable instructions, characterized in that: When executed by a computer processor, the computer executable instructions are used to implement the multi-area brightness collaborative adjustment method based on the user's face position and touch point position as described in any one of claims 1 to 13.

Images