Photographing light-filling method and apparatus, and electronic device and computer-readable storage medium

Abstract

Disclosed in the embodiments of the present application are a photographing light-filling method and apparatus, and an electronic device and a computer-readable storage medium. In the method, a screen is divided into a plurality of sub-regions, and a different light emission brightness is provided for each sub-region, thereby improving the accuracy of brightness provision, realizing differentiated brightness compensation for each sub-region, and improving the overall visual effect and quality of imaging.

Description

Shooting fill light method, device, electronic device and computer-readable storage medium

[0001] This application claims priority to Chinese patent application filed on June 16, 2023, application number 202310713013.2, and application name “Shooting fill light method, device, electronic device and computer-readable storage medium”, all contents of which are incorporated by reference into this application. Technical Field

[0002] The embodiments of the present application relate to the field of computer technology, and specifically to a method and device for shooting fill light, an electronic device, and a computer-readable storage medium. Background Art

[0003] With the iterative updates of terminal devices, the shooting systems in the terminal devices have also been continuously upgraded, and clearer and clearer image capture has become a direction to pursue. Technical issues

[0004] However, image capture is not only affected by the performance of the capture system, but also by the capture environment, such as ambient brightness. Due to the special circumstances of the natural environment, it is difficult to ensure that every capture has a relatively good brightness environment.

[0005] Therefore, overcoming the influence of the brightness of the shooting environment has become the upgrade direction of the shooting system, especially for shooting with a front camera. In the absence of a front flash, how to capture good images is an urgent problem that needs to be solved.

[0006] Although there are currently ways to solve the ambient brightness problem when shooting with the front camera by providing a front flash or increasing the screen brightness, due to the single lighting provision method, the imaging effect is difficult to achieve the expected result and the user experience is poor. Technical Solutions

[0007] The embodiments of the present application provide a shooting fill light method, device, electronic device and computer-readable storage medium, which can improve the quality of imaging captured by the front camera and enhance the user experience.

[0008] The present invention provides a method for shooting fill light, which is applied to a terminal device. The method includes:

[0009] Displaying a real-time preview image on the screen of the terminal device, the real-time preview image being captured by the front camera of the terminal device;

[0010] Dividing the real-time preview image and the screen into at least two sub-areas respectively to obtain one-to-one corresponding image sub-areas and screen sub-areas;

[0011] For each image sub-region, determining brightness information to be filled in according to real-time brightness information of the image sub-region;

[0012] For each screen sub-region, the luminous brightness information of the screen sub-region is adjusted according to the brightness information to be filled in of the image sub-region corresponding to the screen sub-region.

[0013] Accordingly, an embodiment of the present application further provides a shooting fill light device, which is applied to a terminal device, and the device includes:

[0014] A display module, configured to display a real-time preview image on the screen of the terminal device, the real-time preview image being captured by a front-facing camera of the terminal device;

[0015] a division module, configured to divide the real-time preview image and the screen into at least two sub-areas respectively, to obtain one-to-one corresponding image sub-areas and screen sub-areas;

[0016] A fill light brightness determination module is used to determine the brightness information of the to-be-filled light according to the real-time brightness information of each image sub-region;

[0017] The fill light module is used to adjust the luminous brightness information of each screen sub-region according to the brightness information to be filled light of the image sub-region corresponding to the screen sub-region.

[0018] Optionally, in some embodiments of the present application, the fill light brightness determination module includes:

[0019] a first distance determining unit, configured to determine, for each image sub-region, a spatial distance between a real scene portion corresponding to the image sub-region and a corresponding screen sub-region according to a depth map corresponding to the real-time preview image;

[0020] The fill light brightness determination unit is used to determine the brightness information of the fill light according to the spatial distance and the real-time brightness information.

[0021] In some embodiments of the present application, the fill light module includes:

[0022] A first angle determination unit is configured to determine relative angle information between a target object in the real-time preview image and the screen according to a depth map corresponding to the real-time preview image and posture information of the terminal device;

[0023] a second distance determining unit, configured to determine, for each screen sub-region, a spatial distance between the screen sub-region and a corresponding image sub-region according to the depth map;

[0024] a fill light brightness determination unit, configured to determine the brightness information to be emitted from the screen sub-region according to the brightness information to be filled light of the image sub-region corresponding to the screen sub-region, the spatial distance, and the relative angle information;

[0025] A fill light unit is used to adjust the light emitting brightness information of the screen sub-area to the brightness information to be emitted.

[0026] In some embodiments of the present application, the first angle determination unit includes:

[0027] a subject plane determining subunit, configured to determine subject plane information of a subject of a target object in the real-time preview image according to a depth map corresponding to the real-time preview image;

[0028] a screen plane determining subunit, configured to determine screen plane information of the screen according to the posture information of the terminal device; a first angle determining subunit, configured to determine rotation angle information, pitch angle information, and roll angle information between the target object body and the screen according to the body plane information and the screen plane information;

[0029] The second angle determination subunit is configured to obtain relative angle information according to the rotation angle information, the pitch angle information, and the elevation angle information.

[0030] In some embodiments of the present application, the device also includes a real-time brightness determination module, which includes: a real-time brightness determination unit, which is used to determine the real-time brightness information of each image sub-region based on the image original data corresponding to the image sub-region, and the image original data is obtained by the image sensor converting the captured light source information into a data signal.

[0031] In some embodiments of the present application, the partitioning module includes:

[0032] a first dividing unit, configured to divide the screen into at least two screen sub-areas according to a distribution of backlight areas corresponding to the screen;

[0033] The second dividing unit is configured to divide the real-time preview image according to the distribution of the screen sub-regions to obtain image sub-regions corresponding to the screen sub-regions in a one-to-one manner.

[0034] In some embodiments of the present application, the real-time preview image includes a face image, and the face image is a part of the real-time preview image. The division module includes:

[0035] a third dividing unit, configured to divide the face image and the screen into at least two image sub-regions and at least two screen sub-regions respectively;

[0036] a second angle determination unit, configured to determine relative angle information between a face surface corresponding to the face image and the screen based on the depth map of the real-time preview image and the posture information of the terminal device;

[0037] a position determining unit, configured to determine relative position information between a face surface corresponding to the face image and the screen based on the depth map and the relative angle information;

[0038] The corresponding relationship determining unit is used to establish a one-to-one corresponding relationship between the image sub-area and the screen sub-area according to the relative angle information and the relative position information.

[0039] In a third aspect, an embodiment of the present application further provides an electronic device, which includes a memory, a processor, and a computer program stored in the memory and runnable on the processor. When the computer program is executed by the processor, the steps in the above-mentioned shooting fill light method are implemented.

[0040] In a fourth aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps in the above-mentioned shooting fill light method are implemented.

[0041] In a fifth aspect, embodiments of the present application further provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in the various optional implementations described in the embodiments of the present application. Beneficial effects

[0042] An embodiment of the present application is applied to a terminal device, which displays a real-time preview image on a screen. The real-time preview image is captured by a front-facing camera of the terminal device. The real-time preview image and the screen are each divided into at least two sub-regions, resulting in corresponding image sub-regions and screen sub-regions. For each image sub-region, the brightness information to be filled in is determined based on the real-time brightness information of the image sub-region. For each screen sub-region, the luminous brightness information of the screen sub-region is adjusted based on the luminous brightness information to be filled in of the image sub-region corresponding to the screen sub-region. The screen of the terminal device provides brightness for the front-facing camera of the device, thereby improving the quality of the front-facing camera image. By dividing the screen into multiple sub-regions and providing different luminous brightness for each sub-region, the accuracy of the brightness provision is improved, achieving differentiated brightness compensation for each sub-region, and improving the overall visual effect and quality of the image. Each screen sub-region performs luminous brightness compensation based on its corresponding image sub-region, and determines the luminous brightness information to be filled in based on the real-time brightness information of the corresponding image sub-region, thereby improving the accuracy of the fill light brightness of each screen sub-region. BRIEF DESCRIPTION OF THE DRAWINGS

[0043] In order to more clearly illustrate the technical solutions in this application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0044] FIG1 is a schematic diagram of a scene of a shooting fill light method provided by an embodiment of the present application;

[0045] FIG2 is a flow chart of a method for shooting fill light provided in an embodiment of the present application;

[0046] FIG3 is a schematic diagram of the result of dividing the screen and the real-time preview image provided by an embodiment of the present application;

[0047] FIG4 is a schematic diagram of the results of screen and face image segmentation provided by an embodiment of the present application;

[0048] FIG5 is a flow chart of a brightness compensation method for photographing a face using a front-facing camera according to an embodiment of the present application;

[0049] FIG6 is a schematic diagram of the relative positions of a screen and a human face surface provided in an embodiment of the present application;

[0050] FIG7 is a schematic diagram showing the effect of performing brightness compensation on a face surface based on screen brightness according to an embodiment of the present application;

[0051] FIG8 is a schematic structural diagram of a shooting fill light device provided in an embodiment of the present application;

[0052] FIG9 is a schematic structural diagram of an electronic device provided in an embodiment of the present application. Modes for Carrying Out the Invention

[0053] The following will be combined with the drawings in this application to clearly and completely describe the technical solutions in this application. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making any creative efforts shall fall within the scope of protection of the present invention.

[0054] The embodiments of the present application provide a method and apparatus for fill-in lighting for shooting, an electronic device, and a computer-readable storage medium. Specifically, the embodiments of the present application provide a fill-in lighting apparatus for shooting suitable for electronic devices, wherein the electronic devices include terminal devices, including but not limited to mobile phones, laptop computers, tablet computers, and other devices with front-facing camera functions.

[0055] Please refer to FIG1 , which is a schematic diagram of a scenario in which a terminal device according to an embodiment of the present application executes the method for filling in the light for shooting. The specific execution process of the method for filling in the light for shooting by the terminal device is as follows:

[0056] The terminal device 10 starts the front camera to shoot, obtains a real-time preview image, and displays the real-time preview image on the screen of the terminal device 10. Subsequently, the terminal device divides the real-time preview image and the corresponding area of ​​the screen respectively, and obtains multiple image sub-areas corresponding to the real-time preview image and multiple screen sub-areas corresponding to the screen, wherein the image sub-areas correspond to the screen sub-areas one-to-one.

[0057] Subsequently, the terminal device 10 determines the brightness information to be filled in for each image sub-area based on the real-time brightness information of the image sub-area, and adjusts the luminous brightness information of each screen sub-area based on the brightness information to be filled in of the image sub-area corresponding to the screen sub-area.

[0058] Among them, in the embodiment of the present application, the division size of the screen sub-area and the image sub-area can be predefined according to actual needs. It can be understood that as the division size decreases, the number of screen sub-areas and image sub-areas increases. Accordingly, the control of the screen brightness is more refined, and the fill light effect and imaging effect are improved, but there will be a certain computing resource cost accordingly.

[0059] It can be understood that the quality of front-facing camera imaging is improved by providing brightness for the device's screen through the terminal device. Specifically, by dividing the screen into multiple sub-areas and providing different luminous brightness for each sub-area, the accuracy of the brightness provided is improved, and differentiated brightness compensation is achieved for each sub-area, thereby improving the overall visual effect and quality of the imaging. Specifically, each screen sub-area performs luminous brightness compensation based on its corresponding image sub-area, and the brightness information to be filled in is determined based on the real-time brightness information of the corresponding image sub-area, thereby improving the accuracy of the fill light brightness of each screen sub-area.

[0060] It should be noted that the order of description of the following embodiments does not limit the priority order of the embodiments.

[0061] Please refer to Figure 2, which is a flow chart of the method for shooting and filling in light provided by an embodiment of the present application. The specific flow of the method for shooting and filling in light is as follows:

[0062] S101: Display a real-time preview image on a screen of the terminal device, where the real-time preview image is captured by a front camera of the terminal device.

[0063] It can be understood that in the embodiment of the present application, the real-time preview image is the preview image taken after the camera is started, and the content of the preview image changes with the change of the shooting angle, and is not an image with fixed content after the shooting is confirmed.

[0064] In an embodiment of the present application, the real-time preview image can be captured by a front camera or a rear camera. Specifically, if the terminal device is a single-screen device and the screen is located on the front of the terminal device, the real-time preview image is captured by the front camera; if the terminal device is a dual-screen device, for example, there is a screen on the front and back of the terminal device, then when the screen displaying the real-time preview image is the screen on the back of the terminal device, the camera that captures the real-time preview image is the rear camera.

[0065] That is, in the embodiment of the present application, it is expected to adjust the fill light for the captured scene by adjusting the brightness of the screen. Therefore, the scene corresponding to the screen lighting is the scene captured by the camera, that is, the selected camera is consistent with the direction of the screen fill light.

[0066] Accordingly, in the embodiment of the present application, taking the selected camera as the front camera and the real-time preview image captured by the front camera as an example, that is, the terminal device starts the front camera and displays the real-time preview image captured by the front camera on the front screen, and the screen provides a certain light brightness for the subject in the real-time preview image.

[0067] It is understandable that by acquiring a real-time preview image, it is convenient to adjust relevant shooting parameters through analysis of the real-time preview image to obtain an image with better imaging quality.

[0068] S102: Divide the real-time preview image and the screen into at least two sub-areas respectively, to obtain one-to-one corresponding image sub-areas and screen sub-areas.

[0069] It can be understood that the splicing of each image sub-area can obtain a real-time preview image, and the splicing of each screen sub-area can obtain the screen interface of the terminal device. Accordingly, in an embodiment of the present application, the area shapes corresponding to the image sub-area and the screen sub-area can be a rectangle, square, rhombus, parallelogram or triangle (such as a right triangle), etc.

[0070] Accordingly, in the embodiment of the present application, the size of each sub-area can be flexibly configured. The smaller the size, the smaller the area of ​​the sub-area. Accordingly, the adjustment of the screen brightness is more refined and the fill light effect is better.

[0071] Among them, by dividing the real-time preview image and the screen into sub-areas, it is convenient to make targeted adjustments to the screen brightness according to each sub-area, thereby achieving differentiated compensation processing of the screen brightness in each sub-area.

[0072] S103. For each image subregion, determine the brightness information to be filled in based on the real-time brightness information of the image subregion. It will be appreciated that the real-time brightness information of the image subregion can be determined based on the image brightness parameters corresponding to the image subregion. For example, the real-time brightness information of the image subregion can be determined based on the RAW data corresponding to the image subregion. The real-time brightness information of the image subregion reflects the brightness of the real scene corresponding to the image subregion. For example, if the real scene light is black, the image subregion captured will also be black.

[0073] It is understandable that different real-time brightness information corresponds to different fill light brightness requirements. Therefore, the accuracy of the fill light brightness information determined based on the real-time brightness information can be improved. At the same time, the fill light brightness information determined based on the actual brightness information can also meet the brightness compensation requirements of the corresponding image sub-region.

[0074] S104 . For each screen sub-region, adjust the luminous brightness information of the screen sub-region according to the brightness information to be filled in of the image sub-region corresponding to the screen sub-region.

[0075] Correspondingly, through the one-to-one correspondence between the image sub-area and the screen sub-area, the brightness of the corresponding image sub-area can be compensated by adjusting the brightness of the screen sub-area, achieving a one-to-one fill light effect, which helps to improve the accuracy of brightness and illumination compensation.

[0076] It is understandable that adjusting the luminous brightness information of the screen sub-area according to the brightness information to be filled light helps to improve the accuracy of brightness adjustment of the screen sub-area.

[0077] It can be understood that the quality of front-facing camera imaging is improved by providing brightness for the device's screen through the terminal device. Specifically, by dividing the screen into multiple sub-areas and providing different luminous brightness for each sub-area, the accuracy of the brightness provided is improved, and differentiated brightness compensation is achieved for each sub-area, thereby improving the overall visual effect and quality of the imaging. Specifically, each screen sub-area performs luminous brightness compensation based on its corresponding image sub-area, and the brightness information to be filled in is determined based on the real-time brightness information of the corresponding image sub-area, thereby improving the accuracy of the fill light brightness of each screen sub-area.

[0078] Since light propagation has certain losses, in order to ensure the accuracy of the light brightness provided, the brightness information of the to-be-filled light can be determined based on the spatial distance between the image sub-region and the corresponding screen sub-region. That is, optionally, in some embodiments of the present application, the step of "determining the brightness information of the to-be-filled light based on the real-time brightness information of each image sub-region" includes:

[0079] For each image sub-region, determining a spatial distance between a real scene portion corresponding to the image sub-region and a corresponding screen sub-region according to the depth map corresponding to the real-time preview image;

[0080] The brightness information of the light to be filled is determined according to the spatial distance and the real-time brightness information.

[0081] It can be understood that the real scene part is a part of the entity corresponding to the real-time preview image. For example, the real scene part can be a part of the user's face. Accordingly, the spatial distance is the distance between the real scene part and the corresponding screen sub-area, for example, the distance between the nose of the face and the center point of the screen.

[0082] Each pixel in the depth map represents the distance between a point in the scene and the camera. Therefore, based on the depth values ​​reflected in the depth map, the spatial distance between an image subregion and its corresponding screen subregion can be calculated. For example, the depth value of the nose in the image is the distance from the nose to the camera. This distance is used as the hypotenuse of a right triangle, and the distance between the center point of the screen subregion and the camera is used as one right-angled side to calculate the distance of the other right-angled side.

[0083] Among them, the brightness information of the light to be filled is determined by the spatial distance, and the accuracy of the brightness information of the light to be filled is improved, ensuring that the brightness of the screen light can effectively act on the corresponding real scene part. When the corresponding real scene part is illuminated by light and the surface brightness is increased, the imaging effect of the real scene part on the screen is improved, thereby improving the visual effect of the entire image.

[0084] Optionally, since the angle of the real scene relative to the screen affects the lighting effect of the screen light on the real scene, after determining the brightness information to be filled in the image sub-region, the relative angle information between the screen and the real scene subject can also be introduced to calculate the brightness information to be emitted from the screen sub-region based on the relative angle information. That is, optionally, in some embodiments of the present application, the step of "for each screen sub-region, adjusting the luminous brightness information of the screen sub-region based on the brightness information to be filled in of the image sub-region corresponding to the screen sub-region" includes:

[0085] Determine relative angle information between a target object in the real-time preview image and the screen according to the depth map corresponding to the real-time preview image and the posture information of the terminal device;

[0086] For each screen sub-region, determining a spatial distance between the screen sub-region and a corresponding image sub-region according to the depth map;

[0087] Determine the brightness information of the screen sub-region to be illuminated according to the brightness information of the image sub-region to be filled in, the spatial distance, and the relative angle information corresponding to the screen sub-region;

[0088] The light emitting brightness information of the screen sub-area is adjusted to the brightness information to be emitted.

[0089] It can be understood that the target object subject is the object subject in the real-time preview image. For example, the object subject can be an object or a person. When the real-time preview image is taken for a human face, the target object subject in the real-time preview image is a human face.

[0090] It is understandable that the main body of the target object may be horizontal or diagonal relative to the screen. Therefore, in order to avoid compromising the fill light effect, which may even have a counterproductive effect, the accuracy of the light brightness in the sub-area of ​​the screen can be improved by calculating the relative angle information between the main body of the target object and the screen.

[0091] Optionally, in an embodiment of the present application, the relative angle information includes angle information of the plane where the target object body is located relative to the screen. The angle information may include rotation angle information, pitch angle information, and elevation angle information, etc. That is, optionally, in some embodiments of the present application, the step of "determining the relative angle information between the target object body in the real-time preview image and the screen based on the depth map corresponding to the real-time preview image and the posture information of the terminal device" includes:

[0092] Determining the main plane information of the target object in the real-time preview image according to the depth map corresponding to the real-time preview image;

[0093] Determining screen plane information of the screen according to the posture information of the terminal device;

[0094] Determine the rotation angle information, pitch angle information, and roll angle information between the target object body and the screen according to the body plane information and the screen plane information;

[0095] Relative angle information is obtained according to the rotation angle information, the pitch angle information, and the elevation angle information.

[0096] It should be noted that the main plane information is the distribution information of the plane where the main body of the target object is located, which can be represented by point information and tilt angle information. Among them, when the main body of the target object is a three-dimensional structure, the plane information is the plane corresponding to the surface of the main body of the target object photographed. For example, if the main body of the target object is a human face, the plane is the surface of the human face. It can be understood that the posture information is the information of the posture of the terminal device, including information such as position and tilt angle. Since the structure of the terminal device is generally fixed, after knowing the posture information of the terminal device, the screen plane information of the screen can be determined based on the posture information, that is, the tilt angle information of the screen in space can be determined.

[0097] Among them, the rotation angle information, pitch angle information and roll angle information can be calculated through two planes. For example, the angle between the mobile phone plane and the face plane is calculated to obtain the rotation angle information, the angle between the longitudinal axis of the mobile phone and the longitudinal axis of the face is calculated to obtain the pitch angle information, and the angle between the horizontal axis of the mobile phone and the horizontal axis of the face is calculated to obtain the roll angle information.

[0098] In the embodiment of the present application, the rotation angle information, the pitch angle information and the elevation angle information are used as the relative angle information between the target object body and the screen.

[0099] It is understood that the brightness of an image subregion reflects the brightness of the corresponding real scene, and this brightness information can be obtained from the data signal corresponding to the image subregion. Specifically, in some embodiments of the present application, before the step of "determining the brightness information to be filled in for each image subregion based on the real-time brightness information of the image subregion," the method further includes: determining the real-time brightness information of each image subregion based on the raw image data corresponding to the image subregion, where the raw image data is obtained by converting light source information captured by the image sensor into a data signal. For example, after previewing an image, the converted data signal of the light source signal captured by the image sensor can be extracted, and the real-time brightness information of the image subregion can be obtained based on the data signal. The raw image data includes RAW data. Optionally, the screen can also be a screen with a backlight. Accordingly, the screen includes a foreground panel and a backlight panel. The backlight panel is formed by splicing multiple backlight regions to provide backlight. The foreground panel is used to display the image to be displayed, and the corresponding display effect is achieved under the backlight provided by the backlight panel. For example, in embodiments of the present application, the screen can include a display panel such as an LCD or LED. Among them, since the backlight panel is spliced ​​by multiple backlight areas, in order to facilitate the regional dimming of the screen, the screen can be divided based on the backlight area to obtain multiple screen sub-areas. That is, optionally, in some embodiments of the present application, the step of "dividing the real-time preview image and the screen into at least two sub-areas respectively to obtain one-to-one corresponding image sub-areas and screen sub-areas" includes:

[0100] Dividing the screen into at least two screen sub-areas according to the distribution of backlight areas corresponding to the screen;

[0101] The real-time preview image is divided according to the distribution of the screen sub-regions to obtain image sub-regions corresponding to the screen sub-regions one by one.

[0102] For example, the number of backlight areas corresponds to the number of screen sub-areas into which the screen is divided. Accordingly, based on a one-to-one correspondence with the screen sub-areas, the real-time preview image can be divided accordingly. For example, refer to FIG3 , which is a schematic diagram of the screen and real-time preview image division results provided by an embodiment of the present application. The screen and real-time preview image are divided one-to-one to obtain one-to-one corresponding screen sub-areas and image sub-areas. Subsequently, the brightness requirement for each screen sub-area can be determined based on the brightness requirement for fill light in its corresponding image sub-area.

[0103] Accordingly, in an embodiment of the present application, the subject photographed by the front camera may be a human face. Therefore, in order to improve the effect of face photography, the face image portion in the real-time preview image may be divided, and the brightness of the screen may be adjusted according to the three-dimensional structure of the face to improve the accuracy of brightness adjustment, thereby improving the quality of face photography. That is, optionally, in some embodiments of the present application, the real-time preview image includes a face image, and the face image is part of the real-time preview image. The step of "dividing the real-time preview image and the screen into at least two sub-areas respectively to obtain one-to-one corresponding image sub-areas and screen sub-areas" includes:

[0104] Dividing the facial image and the screen into at least two image sub-regions and at least two screen sub-regions respectively; determining relative angle information between a facial surface corresponding to the facial image and the screen based on the depth map of the real-time preview image and the posture information of the terminal device;

[0105] Determining relative position information between a face surface corresponding to the face image and the screen according to the depth map and the relative angle information;

[0106] A one-to-one correspondence between the image sub-area and the screen sub-area is established based on the relative angle information and the relative position information. It is understandable that dividing the face portion in the real-time preview image can improve the pertinence of brightness adjustment and help improve the adjustment effect.

[0107] It can be understood that the relative angle information between the face surface and the screen can be obtained through the depth map and the posture information of the terminal device. The angles between the face and the screen are different, such as horizontal, oblique, parallel to the screen, etc., and the light brightness requirements for the face are different. Therefore, the embodiment of the present application determines the screen sub-area corresponding to each image sub-area based on the relative angle information between the face surface and the screen, which helps to provide corresponding light brightness through different screen sub-areas based on the lighting requirements of different parts of the face, thereby improving the effectiveness and accuracy of facial lighting.

[0108] For example, refer to Figure 4, which is a schematic diagram of the screen and facial image segmentation results provided in an embodiment of the present application, wherein the facial image is derived from the facial portion in the real-time preview image. By segmenting the facial portion image and determining the screen sub-area corresponding to each image sub-area based on relative angle information, the screen sub-areas can be divided accordingly based on the different lighting requirements of different facial parts. This helps to achieve differentiated compensation for the lighting requirements of different facial parts through the different lighting provided by each screen sub-area.

[0109] It can be understood that the embodiment of the present application divides the screen into multiple sub-areas and provides different light brightness through each sub-area, thereby achieving differentiated brightness compensation for different parts of the subject, which helps to improve the imaging effect and image quality.

[0110] The brightness information of the light to be filled corresponding to the image sub-region is determined by the spatial distance between the image sub-region and the screen sub-region, thereby improving the accuracy of the brightness information of the light to be filled.

[0111] Among them, the screen sub-area corresponding to each image sub-area is determined through relative angle information, which improves the accuracy of the corresponding relationship determination, and at the same time as achieving differentiated brightness compensation, it can also ensure the effect of brightness compensation.

[0112] Please refer to FIG5 , which is a flow chart of a brightness compensation method for photographing a face using a front-facing camera according to an embodiment of the present application. The flow chart includes:

[0113] S201, obtaining a real-time face image through a front camera;

[0114] Among them, the real-time face image refers to the real-time image obtained by the front camera.

[0115] S202, constructing a three-dimensional structure model of the face surface in space according to the depth map corresponding to the face image;

[0116] Among them, the three-dimensional structural model of the face can be obtained through binocular cameras, structured light sensors, and TOF (time of flight) sensors.

[0117] S203, obtaining the current posture of the mobile phone;

[0118] The current posture of the mobile phone can be obtained by the gravity acceleration sensor and gyroscope sensor in the mobile phone.

[0119] S204. Calculate the angle between the plane of the phone and the plane of the face, the angle between the longitudinal axis of the phone and the longitudinal axis of the face, and the angle between the transverse axis of the phone and the transverse axis of the face based on the phone posture and the three-dimensional structure model of the face to obtain relative angles.

[0120] S205, dividing the mobile phone screen into a plurality of areas (S1, S2, ..., Sn), and dividing the face image into a plurality of areas (F1, F2, ..., Fn) of the same number;

[0121] Among them, there are several areas, the number of which is not limited, and depends on the accuracy of controlling the fill light and the real-time calculation speed. The more areas there are, the more detailed the face segmentation is, the more precise the fill light control is, and the more computing resources are consumed.

[0122] S206. Obtain the relative position of the mobile phone plane and the face plane according to the depth map and the relative angle information;

[0123] Please refer to Figure 6, which is a schematic diagram of the relative position of the screen and the face surface provided in an embodiment of the present application, wherein the front camera A, screen B, face C, and each sub-area S1, S2,…, Sn in the screen are shown, and each angle, such as the rotation angle, pitch angle, and roll angle, is identified.

[0124] S207. The sub-area Sn of the mobile phone screen is matched to the sub-area Fn of the face image one by one according to the relative positions and relative angles; as shown in FIG4 , S1 corresponds to F1, S2 corresponds to F2, ..., Sn corresponds to Fn.

[0125] S208, calculating the brightness value of the face sub-region Fn and the distance between the structural center position of the face sub-region Fn and the corresponding sub-region Sn on the screen;

[0126] The brightness value of the face sub-region Fn is calculated from the RAW data of the corresponding position. The structural center position of the face sub-region Fn is the center point of the three-dimensional structural surface of the current sub-region Fn.

[0127] S209: Determine the brightness value of the fill light required for the face sub-region Fn, i.e., the fill light brightness, based on the calculation result of S208;

[0128] Among them, the fill light brightness is within the screen luminous brightness range. According to the calculation result of step 7, the farther the distance, the greater the brightness, and the closer the distance, the smaller the brightness, that is, the fill light brightness is positively correlated with the distance.

[0129] S210 , performing fill light according to the calculation result of S209 , making the screen sub-area Sn present a corresponding fill light brightness.

[0130] In the embodiment of the present application, adjusting the brightness of the screen sub-region Sn according to the fill light brightness specifically includes:

[0131] By constructing the spatial relationship between the face sub-area Fn and the mobile phone screen sub-area Sn [Fn, Sn] = P(α, β, γ, Ln) (the three-axis angle between the face and the mobile phone: rotation angle α, pitch angle γ, roll angle β, and the spatial distance Ln between the face sub-area and the screen sub-area), we can finally obtain the corresponding relationship An = Q(En, Ln, [Fn, Sn]) between the screen sub-area brightness An and the exposure compensation En required for the face sub-area. The screen sub-area brightness An is obtained based on this corresponding relationship and the fill light brightness En.

[0132] It can be understood that after the above steps are processed, the screen displays the graph shown in FIG7 , wherein the darker the gray block, the lower the brightness of the screen sub-area, and the screen sub-areas S1-S9 correspond one-to-one to the face sub-areas F1-F9.

[0133] To facilitate better implementation of the shooting fill-in light method of the present application, the present application also provides a shooting fill-in light device based on the above shooting fill-in light method. The meanings of the terms are the same as those in the above shooting fill-in light method, and the specific implementation details can be referred to the description in the method embodiment.

[0134] Please refer to FIG8 , which is a schematic diagram of the structure of a shooting fill-in light device provided in an embodiment of the present application, wherein the shooting fill-in light device is applied to a terminal device, and specifically can be as follows:

[0135] A display module 301 is configured to display a real-time preview image on the screen of the terminal device, where the real-time preview image is captured by a front camera of the terminal device;

[0136] A division module 302 is configured to divide the real-time preview image and the screen into at least two sub-areas, respectively, to obtain one-to-one corresponding image sub-areas and screen sub-areas;

[0137] A fill light brightness determination module 303 is configured to determine, for each image sub-region, brightness information to be filled in based on the real-time brightness information of the image sub-region;

[0138] The fill light module 304 is configured to adjust the luminous brightness information of each screen sub-region according to the to-be-filled brightness information of the image sub-region corresponding to the screen sub-region.

[0139] Optionally, in some embodiments of the present application, the fill light brightness determination module 303 includes:

[0140] a first distance determining unit, configured to determine, for each image sub-region, a spatial distance between a real scene portion corresponding to the image sub-region and a corresponding screen sub-region according to a depth map corresponding to the real-time preview image;

[0141] The fill light brightness determination unit is used to determine the brightness information of the fill light according to the spatial distance and the real-time brightness information.

[0142] In some embodiments of the present application, the fill light module 304 includes:

[0143] A first angle determination unit is configured to determine relative angle information between a target object in the real-time preview image and the screen according to a depth map corresponding to the real-time preview image and posture information of the terminal device;

[0144] a second distance determining unit, configured to determine, for each screen sub-region, a spatial distance between the screen sub-region and a corresponding image sub-region according to the depth map;

[0145] a fill light brightness determination unit, configured to determine the brightness information to be emitted from the screen sub-region according to the brightness information to be filled light of the image sub-region corresponding to the screen sub-region, the spatial distance, and the relative angle information;

[0146] A fill light unit is used to adjust the light emitting brightness information of the screen sub-area to the brightness information to be emitted.

[0147] In some embodiments of the present application, the first angle determination unit includes:

[0148] a subject plane determining subunit, configured to determine subject plane information of a subject of a target object in the real-time preview image according to a depth map corresponding to the real-time preview image;

[0149] a screen plane determining subunit, configured to determine screen plane information of the screen according to the posture information of the terminal device; a first angle determining subunit, configured to determine rotation angle information, pitch angle information, and roll angle information between the target object body and the screen according to the body plane information and the screen plane information;

[0150] The second angle determination subunit is configured to obtain relative angle information according to the rotation angle information, the pitch angle information, and the elevation angle information.

[0151] In some embodiments of the present application, the device also includes a real-time brightness determination module, which includes: a real-time brightness determination unit, which is used to determine the real-time brightness information of each image sub-region based on the image original data corresponding to the image sub-region, and the image original data is obtained by the image sensor converting the captured light source information into a data signal.

[0152] In some embodiments of the present application, the partitioning module 302 includes:

[0153] a first dividing unit, configured to divide the screen into at least two screen sub-areas according to a distribution of backlight areas corresponding to the screen;

[0154] The second dividing unit is configured to divide the real-time preview image according to the distribution of the screen sub-regions to obtain image sub-regions corresponding to the screen sub-regions in a one-to-one manner.

[0155] In some embodiments of the present application, the real-time preview image includes a face image, which is a part of the real-time preview image. The segmentation module 302 includes:

[0156] a third dividing unit, configured to divide the face image and the screen into at least two image sub-regions and at least two screen sub-regions respectively;

[0157] a second angle determination unit, configured to determine relative angle information between a face surface corresponding to the face image and the screen based on the depth map of the real-time preview image and the posture information of the terminal device;

[0158] a position determining unit, configured to determine relative position information between a face surface corresponding to the face image and the screen based on the depth map and the relative angle information;

[0159] The corresponding relationship determining unit is used to establish a one-to-one corresponding relationship between the image sub-area and the screen sub-area according to the relative angle information and the relative position information.

[0160] In the embodiment of the present application, the display module 301 first displays a real-time preview image on the screen of the terminal device, where the real-time preview image is captured by the front camera of the terminal device. Then, the division module 302 divides the real-time preview image and the screen into at least two sub-areas, respectively, to obtain one-to-one corresponding image sub-areas and screen sub-areas. Subsequently, the fill light brightness determination module 303 determines the brightness information to be filled in for each image sub-area based on the real-time brightness information of the image sub-area. Then, the fill light module 304 adjusts the luminous brightness information of each screen sub-area based on the brightness information to be filled in for the image sub-area corresponding to the screen sub-area.

[0161] It can be understood that the quality of front-facing camera imaging is improved by providing brightness for the device's screen through the terminal device. Specifically, by dividing the screen into multiple sub-areas and providing different luminous brightness for each sub-area, the accuracy of the brightness provided is improved, and differentiated brightness compensation is achieved for each sub-area, thereby improving the overall visual effect and quality of the imaging. Specifically, each screen sub-area performs luminous brightness compensation based on its corresponding image sub-area, and the brightness information to be filled in is determined based on the real-time brightness information of the corresponding image sub-area, thereby improving the accuracy of the fill light brightness of each screen sub-area.

[0162] In addition, the present application also provides an electronic device, as shown in FIG9 , which shows a schematic structural diagram of the electronic device involved in the present application. Specifically:

[0163] The electronic device may include components such as a processor 401 with one or more processing cores, a memory 402 with one or more computer-readable storage media, a power supply 403, and an input unit 404. Those skilled in the art will appreciate that the electronic device structure shown in FIG9 does not limit the electronic device and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0164] Processor 401 is the control center of the electronic device, connecting the various parts of the entire electronic device using various interfaces and lines. By running or executing software programs and / or modules stored in memory 402 and accessing data stored in memory 402, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole. Optionally, processor 401 may include one or more processing cores; preferably, processor 401 may integrate an application processor and a modem processor, wherein the application processor primarily processes the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 401.

[0165] The memory 402 can be used to store software programs and modules. The processor 401 executes various functional applications and data processing by running the software programs and modules stored in the memory 402. The memory 402 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 402 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 402 may also include a memory controller to provide the processor 401 with access to the memory 402.

[0166] The electronic device also includes a power supply 403 for supplying power to various components. Preferably, the power supply 403 can be logically connected to the processor 401 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 403 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0167] The electronic device may also include an input unit 404, which can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control. Although not shown, the electronic device may also include a display unit, etc., which will not be described in detail here. Specifically in this embodiment, the processor 401 in the electronic device will load the executable files corresponding to one or more application processes into the memory 402 according to the following instructions, and the processor 401 will run the application stored in the memory 402, thereby implementing the steps of any of the shooting fill light methods provided in the embodiments of the present application.

[0168] An embodiment of the present application is applied to a terminal device, which displays a real-time preview image on a screen. The real-time preview image is captured by a front camera of the terminal device. The real-time preview image and the screen are respectively divided into at least two sub-areas to obtain one-to-one corresponding image sub-areas and screen sub-areas. For each image sub-area, the brightness information of the to-be-filled light is determined based on the real-time brightness information of the image sub-area. For each screen sub-area, the luminous brightness information of the screen sub-area is adjusted based on the brightness information of the to-be-filled light of the image sub-area corresponding to the screen sub-area.

[0169] The terminal device's screen provides brightness for the device's front-facing camera, improving the quality of the front-facing camera image. By dividing the screen into multiple sub-areas and providing different luminous brightness levels for each sub-area, the accuracy of the brightness provided is improved, achieving differentiated brightness compensation for each sub-area and improving the overall visual effect and quality of the image. Each screen sub-area performs luminous brightness compensation based on its corresponding image sub-area, and the brightness information to be filled in is determined based on the real-time brightness information of the corresponding image sub-area, improving the accuracy of the fill light brightness for each screen sub-area.

[0170] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0171] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by instructions, or by controlling related hardware through instructions. The instructions may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0172] To this end, the present application provides a computer-readable storage medium having a computer program stored thereon, which can be loaded by a processor to execute the steps of any of the methods for shooting fill light provided in the present application. The specific implementation of each of the above operations can be found in the previous embodiments and will not be repeated here.

[0173] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0174] Since the instructions stored in the computer-readable storage medium can execute the steps in any shooting fill-light method provided in this application, the beneficial effects that can be achieved by any shooting fill-light method provided in this application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0175] The above is a detailed introduction to a shooting fill light method, device, electronic device and computer-readable storage medium provided by the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present invention. The description of the above embodiments is only used to help understand the method of the present invention and its core idea. At the same time, for those skilled in the art, according to the idea of ​​the present invention, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as limiting the present invention.

[0176] It should be noted that in the specific implementation of this application, related data such as image content information (such as identifying subjects in images, such as faces, etc.), image pixel parameters (RAW data), image brightness data, screen brightness data, and posture information of terminal devices are involved. When the above embodiments of this application are applied to specific products or technologies, user permission or consent must be obtained, and the collection, use, and processing of relevant data must comply with relevant laws, regulations, and standards of relevant countries and regions.

Claims

1. A method for shooting fill light, wherein: Applied to a terminal device, the method comprises: Displaying a real-time preview image on a screen of the terminal device, the real-time preview image being captured by a front camera of the terminal device; Divide the real-time preview image and the screen into at least two sub-areas respectively, to obtain one-to-one corresponding image sub-areas and screen sub-areas; For each image sub-region, determining brightness information to be filled in according to real-time brightness information of the image sub-region; For each screen sub-region, the luminous brightness information of the screen sub-region is adjusted according to the brightness information to be filled in of the image sub-region corresponding to the screen sub-region.

2. The method for supplementary lighting in shooting according to claim 1, wherein: The step of determining the brightness information of the to-be-filled light according to the real-time brightness information of each image sub-region includes: For each image sub-region, determining a spatial distance between a real scene portion corresponding to the image sub-region and a corresponding screen sub-region according to a depth map corresponding to the real-time preview image; The brightness information of the light to be filled is determined according to the spatial distance and the real-time brightness information.

3. The method for supplementary lighting in shooting according to claim 1, wherein: The step of adjusting the luminous brightness information of each screen sub-region according to the brightness information of the image sub-region to be filled in corresponding to the screen sub-region comprises: Determine relative angle information between a target object body in the real-time preview image and the screen according to the depth map corresponding to the real-time preview image and the posture information of the terminal device; For each screen sub-region, determining a spatial distance between the screen sub-region and a corresponding image sub-region according to the depth map; Determine the brightness information to be emitted of the screen sub-area according to the brightness information to be filled in of the image sub-area corresponding to the screen sub-area, the spatial distance and the relative angle information; and adjust the brightness information to be emitted of the screen sub-area to the brightness information to be emitted.

4. The method for supplementary lighting in shooting according to claim 3, wherein: The determining, according to the depth map corresponding to the real-time preview image and the posture information of the terminal device, the relative angle information between the target object body in the real-time preview image and the screen includes: Determine the main plane information of the main body of the target object in the real-time preview image according to the depth map corresponding to the real-time preview image; Determining screen plane information of the screen according to the posture information of the terminal device; Determine the rotation angle information, the pitch angle information and the elevation angle information between the target object body and the screen according to the body plane information and the screen plane information; Relative angle information is obtained according to the rotation angle information, the pitch angle information and the elevation angle information.

5. The method for supplementary lighting in shooting according to claim 1, wherein: Before determining the brightness information to be filled in according to the real-time brightness information of each image sub-region, the method further includes: For each image sub-region, the real-time brightness information of the image sub-region is determined according to the original image data corresponding to the image sub-region, where the original image data is obtained by converting the captured light source information into a data signal by an image sensor.

6. The method for supplementary lighting for shooting according to any one of claims 1 to 5, wherein: The step of dividing the real-time preview image and the screen into at least two sub-areas respectively to obtain one-to-one corresponding image sub-areas and screen sub-areas comprises: Dividing the screen into at least two screen sub-areas according to the distribution of the backlight areas corresponding to the screen; The real-time preview image is divided according to the distribution of the screen sub-regions to obtain image sub-regions corresponding to the screen sub-regions one by one.

7. The method for supplementary lighting for shooting according to any one of claims 1 to 5, wherein: The real-time preview image includes a face image, and the face image is a part of the real-time preview image. The real-time preview image and the screen are divided into at least two sub-areas to obtain one-to-one corresponding image sub-areas and screen sub-areas, including: Dividing the face image and the screen respectively to obtain at least two image sub-regions and at least two screen sub-regions; Determine relative angle information between a face surface corresponding to the face image and the screen according to the depth map of the real-time preview image and the posture information of the terminal device; Determine relative position information between a face surface corresponding to the face image and the screen according to the depth map and the relative angle information; A one-to-one correspondence between the image sub-area and the screen sub-area is established according to the relative angle information and the relative position information.

8. The method for supplementary lighting in shooting according to claim 1, wherein: The method also includes: if the terminal device is a dual screen including a front side and a back side, and the screen displaying the real-time preview image is the screen on the back side of the terminal device, the real-time preview image is captured by a rear camera of the terminal device.

9. The method for supplementary lighting in shooting according to claim 1, wherein: The area shapes corresponding to the image sub-area and the screen sub-area include at least one of a rectangle, a square, a rhombus, a parallelogram or a triangle.

10. A shooting fill light device, wherein: Applied to a terminal device, the device comprises: A display module, used to display a real-time preview image on the screen of the terminal device, wherein the real-time preview image is captured by a front camera of the terminal device; A division module, used for dividing the real-time preview image and the screen into at least two sub-areas respectively, to obtain one-to-one corresponding image sub-areas and screen sub-areas; A fill light brightness determination module, used for determining the brightness information of the to-be-filled light according to the real-time brightness information of each image sub-region; The fill light module is used to adjust the luminous brightness information of each screen sub-region according to the brightness information to be filled light of the image sub-region corresponding to the screen sub-region.

11. The shooting fill light device according to claim 10, wherein: The fill light brightness determination module comprises: A first distance determination unit, configured to determine, for each image sub-region, a spatial distance between a real scene portion corresponding to the image sub-region and a corresponding screen sub-region according to a depth map corresponding to the real-time preview image; The fill light brightness determination unit is used to determine the brightness information of the fill light according to the spatial distance and the real-time brightness information.

12. The shooting fill light device according to claim 10, wherein: The fill light module comprises: The first angle determination unit is used to determine the angle between the target object body in the real-time preview image and the posture information of the terminal device according to the depth map corresponding to the real-time preview image. Relative angle information between screens; a second distance determining unit, configured to determine, for each screen sub-region, a spatial distance between the screen sub-region and a corresponding image sub-region according to the depth map; A fill light brightness determination unit, configured to determine the brightness information to be emitted from the screen sub-region according to the brightness information to be filled light of the image sub-region corresponding to the screen sub-region, the spatial distance and the relative angle information; A fill light unit is used to adjust the light emitting brightness information of the screen sub-area to the brightness information to be emitted.

13. The shooting fill-in light device according to claim 12, wherein: The first angle determination unit comprises: A subject plane determination subunit, configured to determine subject plane information of a subject of a target object in the real-time preview image according to a depth map corresponding to the real-time preview image; A screen plane determining subunit, configured to determine screen plane information of the screen according to the posture information of the terminal device; A first angle determination subunit, configured to determine rotation angle information, pitch angle information and elevation angle information between the target object body and the screen according to the body plane information and the screen plane information; The second angle determination subunit is used to obtain relative angle information according to the rotation angle information, the pitch angle information and the elevation angle information.

14. The shooting fill light device according to claim 10, wherein: The device also includes a real-time brightness determination module, which includes: A real-time brightness determination unit is used to determine the brightness of each image sub-region according to the image sub-region. The corresponding original image data determines the real-time brightness information of the image sub-area, and the original image data is obtained by converting the captured light source information into a data signal by the image sensor.

15. The shooting fill light device according to any one of claims 10 to 14, wherein: The division module comprises: A first division unit, configured to divide the screen into at least two screen sub-areas according to the distribution of backlight areas corresponding to the screen; The second division unit is used to divide the real-time preview image according to the distribution of the screen sub-regions to obtain image sub-regions corresponding to the screen sub-regions one by one.

16. The shooting fill-in light device according to any one of claims 10 to 14, wherein: The real-time preview image includes a face image, and the face image is a part of the real-time preview image. The division module includes: A third division unit, used for dividing the face image and the screen respectively to obtain at least two image sub-regions and at least two screen sub-regions; A second angle determination unit, configured to determine relative angle information between a face surface corresponding to the face image and the screen according to the depth map of the real-time preview image and the posture information of the terminal device; a position determination unit, configured to determine relative position information between a face surface corresponding to the face image and the screen according to the depth map and the relative angle information; A correspondence determination unit is used to establish a one-to-one correspondence between the image sub-area and the screen sub-area according to the relative angle information and the relative position information.

17. The shooting fill-in light device according to claim 10, wherein: The display module comprises: If the terminal device has a dual screen including a front and a back screen, and displays the real-time preview image When the image screen is the screen on the back of the terminal device, the real-time preview image is captured by a rear camera of the terminal device.

18. The shooting fill-in light device according to claim 10, wherein: The area shapes corresponding to the image sub-area and the screen sub-area include at least one of a rectangle, a square, a rhombus, a parallelogram or a triangle.

19. An electronic device, wherein: The invention comprises a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the following is achieved: Displaying a real-time preview image on a screen of the terminal device, the real-time preview image being captured by a front camera of the terminal device; Divide the real-time preview image and the screen into at least two sub-areas respectively, to obtain one-to-one corresponding image sub-areas and screen sub-areas; For each image sub-region, determining brightness information to be filled in according to real-time brightness information of the image sub-region; For each screen sub-region, the luminous brightness information of the screen sub-region is adjusted according to the brightness information to be filled in of the image sub-region corresponding to the screen sub-region.

20. A computer-readable storage medium, wherein: The computer readable storage medium stores a computer program, which, when executed by a processor, implements: Displaying a real-time preview image on a screen of the terminal device, the real-time preview image being captured by a front camera of the terminal device; Divide the real-time preview image and the screen into at least two sub-areas respectively, to obtain one-to-one corresponding image sub-areas and screen sub-areas; For each image sub-region, determining brightness information to be filled light according to real-time brightness information of the image sub-region; For each screen sub-region, the luminous brightness information of the screen sub-region is adjusted according to the brightness information to be filled in of the image sub-region corresponding to the screen sub-region.

Images