Screen light supplementing method and device, electronic equipment, storage medium and program product

Abstract

The invention discloses a screen light supplementing method and device, electronic equipment, a storage medium and a program product, and belongs to the technical field of electronics. The method comprises the following steps: acquiring a first picture through a camera of the electronic equipment, wherein the first picture comprises at least one character object; a light supplementing interface is displayed, the light supplementing interface comprises a background area and a screen area corresponding to the at least one character object, and the light supplementing interface is used for supplementing light to the character corresponding to the at least one character object.

Description

TECHNICAL FIELD

[0001] The present application belongs to the technical field of electronics, and particularly relates to a screen light supplementing method and device, electronic equipment, storage medium and program product. BACKGROUND

[0002] With the development of photography technology, more and more users like to take selfies through electronic equipment, such as using a selfie stick to take a selfie or a group photo. In the case of weak ambient light at night, in order to ensure the imaging quality, the front camera usually needs to rely on screen light supplementing. The common screen light supplementing method currently generally adopts the way of white light around the screen and keeping the preview area in the center, so as to provide a framing reference for the user to take a selfie while supplementing light.

[0003] However, the current screen light supplementing method has difficulty in fully illuminating the face of a person when taking a selfie, so that the overall effect of the image is poor, and thus the shooting effect of the existing screen light supplementing method is poor. SUMMARY

[0004] The purpose of the embodiments of the present application is to provide a screen light supplementing method, device, electronic equipment, storage medium and program product, which can improve the shooting effect of an image.

[0005] In a first aspect, the embodiments of the present application provide a screen light supplementing method, which comprises: collecting a first picture through a camera of an electronic equipment, the first picture containing at least one person object; displaying a light supplementing interface, the light supplementing interface comprising a background area and a screen area corresponding to the at least one person object, the light supplementing interface being used for light supplementing for a person corresponding to the at least one person object.

[0006] In a second aspect, the embodiments of the present application provide a screen light supplementing device, which comprises: a collecting module and a display module. The collecting module is configured to collect a first picture through a camera of an electronic equipment, the first picture containing at least one person object. The display module is configured to display a light supplementing interface, the light supplementing interface comprising a background area and a screen area corresponding to the at least one person object collected by the collecting module, the light supplementing interface being used for light supplementing for a person corresponding to the at least one person object.

[0007] In a third aspect, the embodiments of the present application provide an electronic equipment, which comprises a processor and a memory, the memory storing a program or instructions executable on the processor, and the program or instructions are executed by the processor to implement the steps of the method according to the first aspect.

[0008] In a fourth aspect, the embodiments of the present application provide a readable storage medium, the readable storage medium storing a program or instructions, and the program or instructions are executed by a processor to implement the steps of the method according to the first aspect.

[0009] In a fifth aspect, an embodiment of the present application provides a chip, which comprises a processor and a communication interface, the communication interface is coupled with the processor, and the processor is configured to run programs or instructions to implement the method in the first aspect.

[0010] In a sixth aspect, an embodiment of the present application provides a computer program product stored in a storage medium, which is executed by at least one processor to implement the method in the first aspect.

[0011] In the embodiment of the present application, the first image containing at least one person object can be captured by the camera of the electronic device, and then a light compensation interface can be displayed, the light compensation interface comprising a background region and a screen region corresponding to the at least one person object, and the light compensation interface is used for compensating light for the person corresponding to the at least one person object. In the present scheme, since the electronic device can display the background region and the screen region corresponding to the at least one person object in the light compensation interface, the electronic device can provide a strong light compensation effect through the background region when taking a selfie, and at the same time, the electronic device can compensate light for the photographer through the screen region corresponding to the person object, thereby improving the light compensation effect and making the photographed photo more in line with the user's demand. In this way, the image shooting effect is improved. BRIEF DESCRIPTION OF DRAWINGS

[0012] Figure 1 FIG. 1 is a flowchart of a screen light compensation method provided by an embodiment of the present application;

[0013] Figure 2 FIG. 2 is a schematic diagram of light rays of a screen provided by an embodiment of the present application;

[0014] Figure 3A FIG. 3 is a schematic diagram of a single person contour mark provided by an embodiment of the present application;

[0015] Figure 3B FIG. 4 is a schematic diagram of multiple person contour marks provided by an embodiment of the present application;

[0016] Figure 4 FIG. 5 is a flowchart of a screen light compensation method provided by an embodiment of the present application;

[0017] Figure 5 FIG. 6 is a flowchart of a screen light compensation method provided by an embodiment of the present application;

[0018] Figure 6 FIG. 7 is a flowchart of a screen light compensation method provided by an embodiment of the present application;

[0019] Figure 7 FIG. 8 is a schematic diagram of a face element provided by an embodiment of the present application;

[0020] Figure 8Fig. 2 is a schematic diagram of a face element according to an embodiment of the present application;

[0021] Figure 9 Fig. 3 is a schematic diagram of a face element according to an embodiment of the present application;

[0022] Figure 10 Fig. 4 is a schematic diagram of a face element according to an embodiment of the present application;

[0023] Figure 11 Fig. 5 is a flowchart of a screen light supplementing method according to an embodiment of the present application;

[0024] Figure 12 Fig. 6 is a flowchart of a screen light supplementing method according to an embodiment of the present application;

[0025] Figure 13 Fig. 7 is a flowchart of a screen light supplementing method according to an embodiment of the present application;

[0026] Figure 14 Fig. 8 is a schematic diagram of a feature color value according to an embodiment of the present application;

[0027] Figure 15 Fig. 9 is a schematic diagram of a feature color value according to an embodiment of the present application;

[0028] Figure 16 Fig. 10 is a flowchart of a screen light supplementing method according to an embodiment of the present application;

[0029] Figure 17 Fig. 11 is a flowchart of a screen light supplementing method according to an embodiment of the present application;

[0030] Figure 18 Fig. 12 is a schematic diagram of a screen light supplementing device according to an embodiment of the present application;

[0031] Figure 19 Fig. 13 is a schematic diagram of an electronic device according to an embodiment of the present application;

[0032] Figure 20 Fig. 14 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0033] The technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only some of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by a person of ordinary skill in the art belong to the scope of protection of the present application.

[0034] The terms "first", "second", and the like in the description and in the claims of the present application are used for distinguishing between similar objects and not necessarily for describing a specific sequential or chronological order. It is to be understood that the use of the terms so herein is merely intended to differentiate between two similarly-acting objects and not to require or imply a specific order of operation. It is to be understood that such terms as "first", "second", and the like can be understood to also encompass a quantity of more than one, unless the context clearly indicates otherwise. Furthermore, the term "and / or" means at least one of the connected objects, and the character " / " generally means a "or" relationship between the front and rear associated objects.

[0035] The terms "at least one", "at least one of", and the like in the present application refer to any one of, or any combination of, the listed objects. For example, the phrase "at least one of a, b, and c" can mean "a", "b", "c", "a and b", "a and c", "b and c", or "a, b, and c". Similarly, the phrase "at least two of a, b, and c" can mean "a, b, and c", "a and b", "a and c", "b and c", or "a, b, and c".

[0036] The terms used in the embodiments of the present application are used only to explain specific embodiments of the present application, and are not intended to limit the present application. The terms related to the embodiments of the present application are explained below.

[0037] Identification: The identification in the present application is a word, symbol, image, etc. for indicating information, which can use a control or other container as a carrier for displaying information, including but not limited to word identification, symbol identification, and image identification.

[0038] Control: refers to a graphical element that can be directly operated or perceived by a user in an interactive process, used to receive user input, trigger functions, or display real-time information. It is a bridge for user interaction with device or application functions, and realizes instruction transmission and state feedback through visual form.

[0039] Composition: refers to adjusting the position, size, and proportion of the subject in the picture during the shooting process, so that the presentation effect of the subject in the picture meets the preset, so that the shot picture not only meets the aesthetic standard, but also highlights the subject and improves the shooting quality.

[0040] Interface: refers to the graphical interaction layer seen by the user through the screen of the electronic device. That is, the "user interface (UI)", which is the medium interface for interaction and information exchange between the application or operating system and the user, which realizes the conversion between the internal form of information and the form that the user can accept. The user interface is the source code written by a specific computer language such as Java, XML, etc. The interface source code is parsed and rendered on the electronic device, and finally presented as content that the user can recognize. The commonly used form of user interface is the graphical user interface (GUI), which refers to the user interface related to computer operation displayed in a graphical manner. It can be a visual interface element such as text, icon, button, menu, tab, text box, dialog box, status bar, navigation bar, widget (Web widget, Widget) displayed in the display screen of the electronic device.

[0041] Shooting preview interface: the interface through which the user sees the real-time viewfinder picture before shooting, which is a visual interactive area rendered in real time after processing of the image data captured by the camera sensor. It can be a GUI, which can display visual interface elements such as buttons, navigation bars, and Widgets.

[0042] The screen light supplementing method, device, electronic device, storage medium and program product provided by the embodiments of the present application will be described in detail below in combination with the drawings and specific embodiments and their application scenarios.

[0043] The embodiments of the present application can be applied to the scene of taking a selfie in a weak light environment. Specifically, when a user takes a selfie in a weak light environment such as at night, the screen of the electronic device needs to be used for light supplementing in order to improve the shooting quality of the image.

[0044] The screen light supplementing method provided by the embodiments of the present application will be described exemplarily below taking some specific scenarios of the embodiments of the present application as examples.

[0045] Scenario 1: single-person selfie in a weak light environment: when taking a single-person selfie in a dark light environment such as a bedroom, living room, etc. indoors, or in outdoor places such as streets at night, parks, etc., the captured photo is prone to have phenomena such as blurred face and excessive noise due to insufficient light.

[0046] Scenario 2: group photo at night: in outdoor gatherings, parties or tourist attractions at night, the user wants to take a group photo with multiple friends, but due to the dim environment light, the faces of the people are prone to have problems such as insufficient exposure and excessive shadows, which affect the shooting effect.

[0047] It should be noted that the above scenario 1 and scenario 2 are only exemplary to list some scenarios in which the embodiments of the present application can be applied, and in actual implementation, the embodiments of the present application can also be applied to more scenarios in which screen light compensation is required, and the embodiments of the present application are not limited herein.

[0048] The embodiments of the present application provide a screen light compensation method and device, electronic equipment, storage medium and program product. Since the electronic equipment can display a background region in the light compensation interface and a screen region corresponding to at least one character object, the electronic equipment can provide a strong light compensation effect through the background region when taking a selfie, and at the same time, the electronic equipment can compensate light for the person taking a photo through the screen region corresponding to the at least one character object, thereby improving the light compensation effect and making the taken photo more meet the user's demand. In this way, the image shooting effect is improved.

[0049] The execution subject of the screen light compensation method provided by the embodiments of the present application can be a screen light compensation device, which can be an electronic equipment, or a functional module or functional entity in the electronic equipment. The technical solutions provided by the embodiments of the present application are described below taking the electronic equipment as an example.

[0050] Figure 1 A flowchart of a screen light compensation method provided by the embodiments of the present application is shown in FIG. 1. Figure 1 As shown in FIG. 1, the screen light compensation method provided by the embodiments of the present application can include the following steps 201 and 202.

[0051] In step 201, the electronic equipment collects a first picture through a camera of the electronic equipment.

[0052] In the embodiments of the present application, the first picture contains at least one character object.

[0053] Optionally, in the embodiments of the present application, the camera can be a front camera located on the front of the electronic equipment, which is mainly used in scenarios such as selfie and video call. It can also be a rear camera. When taking a selfie, since the front camera and the screen are located on the front of the electronic equipment, the user can preview the picture taken through the screen display preview interface while taking a picture through the front camera, so as to adjust the posture, expression, etc., so as to take a satisfactory photo. Unlike the rear camera with a flash, the front camera usually does not have a flash, so in a weak light environment, the front camera needs to rely on screen light compensation to improve the imaging quality.

[0054] In the embodiments of the present application, the character object refers to the person being photographed when taking a selfie, which can be the user himself or other people taking a selfie with the user.

[0055] In the embodiment of the present application, the first picture refers to an image captured by the camera and containing a shooting scene and a character object. In the embodiment of the present application, the picture contains at least one character object, that is, an image of the user himself or herself or the user taking a selfie with others. The first picture reflects the actual light condition and character state in the current selfie scene, and provides a basis for subsequent display of the light compensation interface and related operations.

[0056] Optionally, in the embodiment of the present application, the electronic device can capture a picture of the user and the scene in which the user is located through the camera, and obtain a first picture containing at least one character object.

[0057] In step 202, the electronic device displays a light compensation interface.

[0058] In the embodiment of the present application, the light compensation interface includes a background region and a screen region corresponding to at least one character object.

[0059] In the embodiment of the present application, the light compensation interface refers to a screen display interface used by the electronic device to assist light compensation when taking a selfie. The interface is used to illuminate the character object in the shooting scene by emitting light through the screen to improve the imaging quality.

[0060] In the embodiment of the present application, the background region is a background part in the light compensation interface, which is usually displayed in white. White has high reflectivity, can maximize the use of the brightness of the screen, and provide uniform and strong light compensation effect, so as to ensure that the character's face and the surrounding scene can be fully illuminated when shooting in the night or low-light environment.

[0061] Optionally, in the embodiment of the present application, the electronic device can display the light compensation interface using the maximum brightness of the screen of the electronic device.

[0062] In the embodiment of the present application, the maximum brightness of the screen of the electronic device refers to the maximum brightness that the screen of the electronic device can reach. When the light compensation interface is displayed, using the maximum brightness can ensure that the light compensation effect is maximized and the shooting scene and the character object are fully illuminated.

[0063] Optionally, in the embodiment of the present application, after the electronic device enters the selfie mode, that is, the front camera is used as the shooting camera, the electronic device can display the picture captured by the front camera in the shooting preview interface. The user can click the strong light compensation control in the shooting preview interface or use an external selfie stick in the screen soft light mode, so that the electronic device enters the strong light compensation mode and displays the light compensation interface. The screen soft light mode is an existing screen light compensation method, which is characterized by white light around the screen and a preview area reserved in the center.

[0064] In the embodiment of the present application, the electronic device can display a light compensation interface with a white background area after entering the strong light compensation mode, and display a screen area corresponding to at least one character object on the background, and at the same time, the electronic device adjusts the screen brightness to the maximum value, so that the white background area emits strong light to illuminate the shooting scene, especially the face of the character object, to ensure that a clear and bright selfie effect can be obtained in the night or low light environment, and at the same time, the user can adjust the light compensation effect according to the screen area corresponding to the character object.

[0065] In the embodiment of the present application, when the user clicks "night scene enhancement" on the selfie page or when the selfie stick is connected in the screen soft light mode, the electronic device can start the long-distance selfie, that is, the strong light compensation mode. At this time, the conventional preview interface is closed, the highest brightness white light is output full screen, and the light compensation intensity is increased to 200%-300% of the traditional mode, as shown in Figure 2 , which can fully illuminate the character. The arrow direction in the figure is the light direction of the screen light compensation. Since the preview interface is cancelled, the user cannot locate his / her position and facial expression state in the white screen, and a user interaction method is needed. The positioning method is as follows: as shown in Figure 3A , the contour of the character is generated in real time based on the camera image. In a multi-person scene, as shown in Figure 3B , the contours of different subjects can be displayed in different styles, such as thickening the contour of the main object and using different dashed line styles for different objects.

[0066] The embodiment of the present application provides a screen light compensation method. Since the electronic device can display a background area in the light compensation interface and a screen area corresponding to at least one character object, the electronic device can provide strong light compensation effect when taking a selfie through the background area, and at the same time, the electronic device can compensate the photographer through the screen area corresponding to the character object to improve the light compensation effect, so that the photographed photo is more in line with the user's needs. In this way, the image shooting effect is improved.

[0067] Optionally, in the embodiment of the present application, the screen light compensation method is combined with Figure 1 , as shown in Figure 4 , the screen light compensation method provided by the embodiment of the present application further includes the following step 301 before the above step 202.

[0068] Step 301: When the light compensation interface is displayed, a contour mark of the light compensation interface is displayed.

[0069] In the embodiments of the present application, the contour mark is a mark of a contour of a human object in the light supplement interface. The contour mark can be a dashed line or a solid line identical to the contour of the human object, and the thickness, color, density and transparency of the dashed line or the solid line can be adjusted according to the needs of the user. The contour mark can help the user to understand the approximate position and posture of himself or others without real-time preview, thereby assisting the user to adjust the composition and ensuring that the photographed photo meets the user's expectation.

[0070] Optionally, in the embodiments of the present application, the electronic device can obtain the depth information of each pixel point in the first picture based on the parallax between the at least two cameras of the electronic device, and then the electronic device can generate the contour mark of the at least one human object based on the depth information.

[0071] In the embodiments of the present application, the parallax is the difference in position of an object relative to a background when the object is observed from different positions or angles. In the embodiments of the present application, the parallax is generated based on the at least two cameras of the electronic device. Since the positions of the cameras are different, the angles of view of the cameras when photographing the same scene are different, which causes the positions of the same object in the images photographed by different cameras to be different. The parallax is a key basis for calculating the depth information, and by analyzing the parallax, the distance of each object in the scene from the camera, i.e., the depth information, can be inferred.

[0072] In the embodiments of the present application, the depth information is information for describing the distance of each pixel point in a scene from a camera. In a selfie scene, the depth information can help to distinguish a human object usually close to the camera from a background usually far from the camera, thereby achieving accurate recognition and contour marking of the human object.

[0073] Optionally, in the embodiments of the present application, the electronic device can photograph the same scene from different angles through the two cameras to obtain two or more images of the same scene, and then the electronic device can analyze the parallax between the images. By detailed calculation of the position difference of corresponding pixel points in the images, the electronic device can infer the distance of each pixel point in the scene from the camera, i.e., the depth information.

[0074] Optionally, in the embodiments of the present application, the electronic device can identify the human object from the first picture based on the depth information. Since a human object is usually close to the camera and a background is usually far from the camera, there is a significant depth difference between the human object close to the camera and the background far from the camera, and therefore the boundary can be determined and the human object and the background can be distinguished based on the depth difference, thereby generating the contour mark of the human object.

[0075] Optionally, in the embodiments of the present application, the electronic device can also perform semantic segmentation on the image based on AI deep learning, using a deep learning model such as U-Net, DeepLab, HRNet, etc., to perform pixel-level division on the "person" and "non-person" regions, so that the trained model can also distinguish the outline of the person.

[0076] Optionally, in the embodiments of the present application, based on the particularity of the scene of the person being lighted in the night scene, the electronic device can also use a simpler method to generate the outline mark. Since the person is lighted with high brightness and the background is dark, an edge detection algorithm based on brightness gradient can be used to achieve this. Gradient operators such as Sobel, Canny, and Laplacian are used to extract the strong edge region of the image, and then edge closure and contour searching are used to obtain the outline of the person. This way, the Central Processing Unit (CPU) resources are saved and the efficiency is higher.

[0077] In this way, the electronic device can obtain the depth information of each pixel point in the first picture through the parallax between at least two cameras, and generate the outline mark of at least one person object based on the depth information, so as to help the user to accurately compose and shoot without real-time preview, and improve the shooting effect of the image.

[0078] Optionally, in the embodiments of the present application, the screen area corresponding to the person object includes the outline mark. Figure 1 As shown in Figure 5 After the step 202, the screen light compensation method provided by the embodiments of the present application further includes the following steps 401 and 402.

[0079] Step 401, the electronic device receives a first input.

[0080] In the embodiments of the present application, the first input is used to adjust the outline style of the person object in the light compensation interface.

[0081] Optionally, in the embodiments of the present application, the first input includes but is not limited to: touch input of the user to the electronic device through a touch device such as a finger or a stylus, or a voice command input by the user, or a specific gesture input by the user, or other feasible inputs. The specific can be determined according to the actual use requirement, and the embodiments of the present application are not limited.

[0082] Optionally, in the embodiments of the present application, the touch input can be single-click input, double-click input, or any number of click inputs, or can also be long-press input or short-press input, etc.

[0083] Optionally, in the embodiments of the present application, the specific gesture can be any one of a single-click gesture, a sliding gesture, a dragging gesture, a pressure recognition gesture, a long-press gesture, an area change gesture, a double-press gesture, and a double-click gesture.

[0084] Optionally, in the embodiments of the present application, the first input can be an instruction or operation issued by the user to the electronic device in the form of voice.

[0085] For example, the user can input a voice instruction of "see where I am", to require the electronic device to adjust the display style of the contour mark to be thicker and denser, so as to better locate himself.

[0086] For another example, the user can input a voice instruction of "change the contour color to red", to require the electronic device to adjust the color of the contour mark to red, to improve the recognition degree.

[0087] For another example, the user can input a voice instruction of "make the contour more transparent", to require the electronic device to increase the transparency of the contour mark, to improve the light supplement effect of the light supplement interface.

[0088] In step 402, the electronic device adjusts the contour style of at least one person object based on the content of the first input in response to the first input.

[0089] In the embodiments of the present application, the contour style is the style of the contour mark.

[0090] In the embodiments of the present application, the contour style refers to the visual features of the contour mark when displayed, including the thickness, density, shape, color, etc. of the contour. For example, the contour can be a thin dotted line, a thick solid line, a line of different colors, etc.

[0091] In the embodiments of the present application, after the electronic device receives the voice input of the user, the content of the voice input can be subjected to voice recognition and instruction analysis, the intention of the user is analyzed, and then the contour style of the person object is adjusted according to the intention of the user.

[0092] For example, when the user feels that the current contour mark is not prominent enough and wants to strengthen the display effect in order to better locate himself, he can say "make the contour thicker", and the electronic device can accordingly make the line of the contour mark thicker, so that it is more eye-catching.

[0093] For another example, when the user is in a complex shooting environment and needs a more eye-catching prompt way to quickly find his own position, he can say "make the contour mark flash to remind", and the electronic device can display the contour mark in a flashing manner.

[0094] In this embodiment, the style of the dashed line outline can be adjusted via voice. If the dashed lines are too sparse or too thin, the photographer will have difficulty seeing them clearly on a brightly lit screen. If the dashed lines are too dense or too thick, they will affect the screen's light-emitting area and reduce the intensity of the supplementary light. Therefore, the user can adjust the outline style via voice commands. For example, if the electronic device detects "Look where I am," it will adjust the outline to be thicker and denser. This adjustment can be temporary and immediately reverted after the change, or it can be maintained continuously.

[0095] In this way, electronic devices can respond to the user's voice input and adjust the thickness, density, or color of the outline markers. This allows users to easily personalize the outline markers through voice input, enabling the electronic devices to effectively prompt the user's position and posture even in complex shooting environments. This makes it easier for users to adjust the shooting angle and improve the success rate and satisfaction of selfies.

[0096] Optionally, in this embodiment, the screen area corresponding to the aforementioned person object includes outline markers. The outline markers of the person object include markers for facial elements. Combined with... Figure 1 ,like Figure 6 As shown, after step 202 above, the screen supplementary lighting method provided in this application embodiment further includes the following steps 501 and 502.

[0097] Step 501: The electronic device outputs a prompt message based on the marking of facial elements.

[0098] In this embodiment of the application, the above-mentioned output prompt information is used to prompt the user to adjust the shooting angle, adjust the state of facial elements, or perform a shooting operation.

[0099] In this embodiment of the application, the above-mentioned facial element markings are markings of various facial features, such as eyes, nose, mouth, etc.

[0100] In this embodiment of the application, the above-mentioned prompt information is generated by the electronic device based on the marking of facial elements, and is used to guide the user to adjust the shooting angle or perform shooting operations.

[0101] Optionally, in this embodiment of the application, the above-mentioned prompt information can be prompted to the user via voice.

[0102] Optionally, in this embodiment, the shooting angle refers to the relative positional relationship between the camera and the subject. Adjusting the shooting angle can be adjusting the angle of the user relative to the electronic device. For example, the prompt message could be "Please look directly at the lens and adjust your position." Alternatively, adjusting the shooting angle can also be adjusting the shooting angle of the electronic device. For example, the prompt message could be "Please adjust the shooting angle slightly upwards."

[0103] Optionally, in the embodiments of the present application, the "adjusting the state of the facial element" refers to adjusting the facial element of the user to improve the shooting effect, such as wide eyes, relaxed expression, smile, adjustment of head posture, etc. The electronic device can detect the state of the facial element and prompt the user to adjust through prompt information, such as "please smile" or "eyes looking at the lens".

[0104] Optionally, in the embodiments of the present application, the electronic device can capture the first picture through the camera, recognize the facial elements of the person, such as eyes, nose, mouth, etc., and mark them at the same time, and then the electronic device can analyze the state of these facial elements to determine whether the user is in the best shooting state. For example, check whether the eyes are looking at the lens, whether the mouth is in a natural state, etc. Then, the electronic device can generate corresponding voice prompts according to the analysis result, and play through the loudspeaker. For example, if it is detected that the eyes are not looking at the lens, the electronic device can play the voice "please look at the lens and adjust your shooting angle"; if the composition is good and the facial state is natural, the electronic device can play the voice "you can take a picture".

[0105] Step 502, in the case that the first picture changes, the electronic device updates the contour mark of the person object in the light supplement interface according to the changed first picture.

[0106] In the embodiments of the present application, the above-mentioned change of the first picture refers to the change of the original image content captured by the camera due to the movement of the user, the scene or the electronic device. For example, the user may have adjusted the position and posture, or a new person has entered the picture, or the background environment has changed, or the user has adjusted the position and direction of the electronic device, etc.

[0107] Optionally, in the embodiments of the present application, after updating the contour mark of the person object in the light supplement interface, the electronic device can play voice prompts according to the mark of the facial element, for prompting the user to adjust the shooting angle or take a picture.

[0108] Optionally, in the embodiments of the present application, the electronic device can continuously monitor the first picture captured by the camera, and when it is detected that the picture content changes, it can perform depth information calculation and / or facial element recognition again based on the new picture content, update the contour mark of the person object to match the position and posture of the person in the current picture. Then the electronic device can generate and play voice prompts according to the updated contour mark and the state of the person. For example, if the shooting angle of the person in the new picture is not good, the electronic device can prompt "please adjust the shooting angle and turn the face to the left"; if the composition is good and the facial state is natural, the electronic device can play the voice "you can take a picture".

[0109] In the embodiments of the present application, after the approximate position of the shooting subject is determined, the facial expression control of the shooting subject also needs to realize interaction. The electronic device can give corresponding display and voice prompts according to the features of facial elements such as eyes, nose, and lips, for example, when the eyes are not staring at the camera, the voice prompt is to stare at the camera, and the approximate area of the eyes is displayed to provide the state of the eyes, as shown in Figure 7 For example, as shown in Figure 8 , the approximate area of the mouth is displayed to show the state of the mouth. In addition, as shown in Figure 9 , the electronic device can adjust the display position of the eyes and mouth on the face to prompt the shooting subject to turn the face, for example, when the eyes and mouth are on the left side of the face, the face is prompted to turn right, and when the eyes and mouth are above the face, the face is prompted to turn down. The lighting condition of the face of the shooter also needs to interact with the user, if the face lighting is weak, the transparency of the outline is increased, as shown in Figure 10 , if the face lighting condition is good, the electronic device reduces the transparency of the outline.

[0110] Optionally, in the embodiments of the present application, in order to enhance the interest of the selfie, the electronic device can comprehensively score all the above conditions for the current selfie state and display it in the screen shooting key. It can be a specific score, such as 70 points, 85 points, 90 points, etc., or other prompts such as poor, good, perfect, etc. When the score is high or full score, the key is added with highlight or other obvious special effects.

[0111] Optionally, in the embodiments of the present application, the electronic device can score each dimension of the user's selfie state. For example, assuming that the facial expression is full score 30 points, the body posture is full score 30 points, the gesture is full score 20 points, and the eye contact is full score 20 points, the electronic device scores the current selfie state of the user and gets facial expression 25 points, body posture 25 points, gesture 20 points, and eye contact 20 points, and the total score of the user is 90 points.

[0112] Optionally, in the embodiments of the present application, the above interaction and scoring mechanism can also be applied to the multi-person selfie scene, and in the case of being applied to the multi-person selfie scene, the electronic device can score each person respectively.

[0113] In this way, the electronic device can play voice prompts based on the marking of facial elements, help users adjust the shooting angle or perform shooting operations, and at the same time update the outline marking and provide voice guidance again when the picture changes, so as to ensure that the user can always shoot in the best state, thereby effectively improving the accuracy and success rate of the user's shooting through real-time feedback, and improving the shooting effect of the image.

[0114] Optionally, in the embodiments of the present application, in combination withFigure 1 As shown in Figure 11 After step 202, the screen light compensation method provided by the embodiment of the present application further includes steps 601 and 602.

[0115] In step 601, the electronic device detects the brightness of each person object in the first picture.

[0116] In the embodiment of the present application, the brightness of the person object refers to the light and shade degree of the person object in the image, which is affected by various factors such as environmental light, skin color of the person, and clothing color.

[0117] Optionally, in the embodiment of the present application, the electronic device can calculate the average brightness of the pixel values in the region where each person object is located. The electronic device can obtain the brightness value of each pixel point by traversing the pixel points in the region corresponding to the person object, and calculate the average value of these brightness values. For example, for each pixel point, its brightness value can be calculated by the formula Y = 0.299R + 0.587G + 0.114B, where Y is the brightness value, R, G, and B represent the values of the red, green, and blue color channels respectively, and the electronic device can then average the brightness values of all pixel points to obtain the brightness of the person object.

[0118] In step 602, the electronic device determines the light compensation brightness of the region where each person object is located based on the brightness of at least one person object.

[0119] In the embodiment of the present application, the light compensation brightness of the region where the person object is located is associated with the brightness of the person object.

[0120] In the embodiment of the present application, the light compensation brightness is the illumination intensity provided by the electronic device for a specific region in the light compensation interface. The determination of the light compensation brightness is to ensure that each person object is uniformly and sufficiently illuminated to achieve the ideal shooting effect.

[0121] Optionally, in the embodiment of the present application, the light compensation brightness of the region where the person object is located and the brightness of the person object can be negatively correlated. Generally, the lower the brightness of the person object, the higher the light compensation brightness required by the region where the person object is located; conversely, the higher the brightness of the person object, the lower the required light compensation brightness. Therefore, the electronic device can calculate the light compensation brightness required by the region where each person object is located according to the brightness of each person object. For example, the electronic device can use a simple linear model to substitute the brightness of the person object to calculate the light compensation brightness required by the person object, where the light compensation brightness and the person brightness are negatively correlated.

[0122] Optionally, in the embodiment of the present application, the electronic device can adjust the brightness of the region where the corresponding person object is located in the light compensation interface based on the light compensation brightness of the region where each person object is located.

[0123] In the embodiments of the present application, the brightness of the area corresponding to the character object in the light supplementing interface refers to the display brightness of the screen area corresponding to the position of each character object in the light supplementing interface.

[0124] Optionally, in the embodiments of the present application, the electronic device can divide the area corresponding to the position of each character object in the light supplementing interface according to the position and size of the character object in the first picture, and then the electronic device can adjust the brightness of the corresponding area in the light supplementing interface according to the light supplementing brightness of the area where each character object is located. For the area where the light supplementing brightness needs to be increased, the screen brightness of the area is increased; for the area where the light supplementing brightness needs to be reduced, the screen brightness of the area is reduced. For example, if the brightness of a certain character object is low and it is calculated that the area where the character object is located needs a higher light supplementing brightness, the device will increase the brightness of the area in the light supplementing interface corresponding to the character object to enhance the light supplementing effect on the character.

[0125] In the embodiments of the present application, in the multi-person selfie scene, different objects have different light supplementing needs in different ambient light, at this time the mobile phone screen can be used as a bar-shaped light supplementing lamp, and the light intensity of different object areas is different to achieve the balance of light supplementing for each object. For example, in the street lamp scene, there is a street lamp light source on the left side, and the light supplementing demand of the object on the left side is small, so the light intensity of the left side of the mobile phone screen is reduced to enhance the light supplementing on the right side.

[0126] In this way, the electronic device can realize personalized light supplementing for different characters by respectively adjusting the light supplementing brightness of the area where each character is located, ensure that each character can obtain appropriate lighting effect, and avoid the problem that some characters are too bright or too dark due to uneven ambient light, thereby improving the quality of image shooting.

[0127] Optionally, in the embodiments of the present application, the electronic device can adjust the brightness of the area corresponding to each character object in the light supplementing interface according to the face color temperature value of each character object in the first picture. Figure 1 For example, as shown in FIG. 7, the electronic device can adjust the brightness of the area corresponding to each character object in the light supplementing interface according to the face color temperature value of each character object in the first picture. Figure 12 After the step 202, the screen light supplementing method provided by the embodiments of the present application further includes the following step 701.

[0128] In step 701, the electronic device displays a pixel block in the contour mark corresponding to the character object in the light supplementing interface based on the face color temperature value of each character object in the first picture.

[0129] In the embodiments of the present application, the face color temperature value refers to the color temperature presented by the face of the character, which is related to factors such as the skin color of the character and the color of the ambient light. Color temperature is a measure of the color of light, expressed in absolute temperature (K). Different light sources have different color temperatures and will present different color tendencies, such as low color temperature with yellow bias, i.e. warm color tone, and high color temperature with blue bias, i.e. cold color tone.

[0130] In this embodiment of the application, display pixel blocks refer to filling the pixels in the area corresponding to the outline mark in the supplementary lighting interface according to certain rules and colors to achieve specific visual effects, such as marking the position of a person or providing supplementary lighting assistance.

[0131] In this embodiment, the electronic device can use image processing algorithms to analyze the facial area of ​​each person, calculate the color temperature value of the face, and then determine the color of the pixel blocks based on the facial color temperature value. For example, if the facial color temperature is warm (i.e., low color temperature), pixel blocks with cooler tones can be displayed to balance it; if the facial color temperature is cool (i.e., high color temperature), pixel blocks with warmer tones can be displayed.

[0132] In this way, electronic devices can fill pixel blocks according to the color temperature value of the face, which can improve the lighting effect in a targeted manner, so that the face receives more suitable lighting and effectively avoids the visual abruptness caused by the mismatch between the lighting color and the skin tone.

[0133] Optionally, in the embodiments of this application, combined with Figure 1 ,like Figure 13 As shown, after step 202 above, the screen fill light method provided in this application embodiment further includes the following step 702.

[0134] Step 702: The electronic device displays the pixel blocks in the outline markers of the corresponding human objects in the fill light interface based on the characteristic color values ​​of each human object in the first screen.

[0135] In this embodiment, the aforementioned characteristic color values ​​refer to colors that can significantly reflect the characteristics of a person, such as clothing color, hair color, eye iris color, skin color temperature, and accessory color. These colors have a certain degree of uniqueness and recognizability, which can help distinguish different people.

[0136] Optionally, in this embodiment of the application, the electronic device can utilize image recognition and processing technology to identify the main characteristic colors of each person. For example, a color detection algorithm can be used to identify that the person's clothing is red and their hair is blonde.

[0137] Optionally, in this embodiment, the electronic device can determine the color to be used to display the pixel block based on the identified feature color value. The electronic device can directly use the feature color value as the display color to enhance the recognizability of the outline marker and its association with the person. Then, the electronic device can display the pixel block of the determined color in the outline marker area corresponding to the person object in the fill light interface.

[0138] In this way, the electronic device can mark the contour of each person object with a pixel block consistent with the feature color value of the person object, so that in a multi-person selfie scene, the contour marks of different persons exhibit their respective feature colors, such as a red contour for a person wearing a red dress and a gold contour for a person with golden hair, which enables the photographed person to quickly distinguish himself or herself from others and easily locate the position of himself or herself or a specific person in the picture, so as to facilitate the photographed person to adjust the pose and expression, and the like, thereby improving the shooting effect of the image.

[0139] Optionally, in the embodiment of the present application, the contour of the person can be not only outlined with a dashed line, but also filled with different colors in the person area. The color of the filled color block can be in multiple ways, such as according to the color temperature analysis of the face of the person, as shown in Figure 14 The color of the filled color block can be in multiple ways, such as according to the color temperature analysis of the face of the person, as shown in Figure 15 The color of the filled color block can be in multiple ways, such as according to the color temperature analysis of the face of the person, as shown in

[0140] In the embodiment of the present application, the electronic device can significantly enhance the brightness of the portrait in a long-distance selfie, avoiding the problem of facial shadow or insufficient exposure. The electronic device can use a thin dashed line contour mark or a color block fill and feature mark to mark the subject, so that even without real-time preview, the user can still accurately locate the position of himself or herself and others. The electronic device can provide real-time adjustment suggestions according to the facial expression, head angle, eye direction, and the like of the subject, avoiding the waste of shots due to unnatural expressions, incorrect poses, and the like, and improving the success rate of shooting.

[0141] Optionally, in the embodiment of the present application, the above light compensation interface further includes a switching control. In combination with Figure 1 As shown in Figure 16 After the above step 202, the screen light compensation method provided by the embodiment of the present application further includes the following steps 801 and 802.

[0142] Step 801, the electronic device receives a second input to the switching control.

[0143] In the embodiment of the present application, the above switching control is a control in the light compensation interface for triggering the electronic device to display the picture captured by the camera.

[0144] In the embodiment of the present application, the second input is used to trigger the electronic device to display the picture captured by the camera.

[0145] Optionally, in embodiments of the present application, the second input includes, but is not limited to, a touch input of the first control by a user through a touch device such as a finger or a stylus, or a voice instruction input by the user, or a specific gesture input by the user, or other feasible inputs. The specific implementation can be determined according to actual use requirements, and the embodiments of the present application are not limited.

[0146] Optionally, in embodiments of the present application, the second input can be a click input of the switching control by the user.

[0147] Optionally, in embodiments of the present application, the second input can also be a long press input of the shooting control. Thus, in the case that the user uses the selfie stick to take a selfie and is not convenient to operate the switching control displayed in the light supplement interface, the user can also trigger the electronic device to display the picture captured by the camera through the shooting control of the selfie stick.

[0148] Step 802, the electronic device displays a second picture in response to the second input.

[0149] In embodiments of the present application, the second picture is a picture captured by the camera at a preset time in a light supplement state, or a dynamic picture captured by the camera within a preset time period.

[0150] In embodiments of the present application, the preset time refers to a specific time point before the first input by the user.

[0151] Optionally, in embodiments of the present application, the preset time can be default or pre-set by the user. For example, the preset time can be 1 second, 2 seconds, 3 seconds, etc. before the first input by the user. The specific implementation can be determined according to actual use requirements, and the embodiments of the present application are not limited.

[0152] In embodiments of the present application, the preset time period refers to a specific length of time period before the first input by the user.

[0153] Optionally, in embodiments of the present application, the preset time period can be default or pre-set by the user. For example, the preset time period can be 3 seconds, 4 seconds, 5 seconds, etc. before the first input by the user. The specific implementation can be determined according to actual use requirements, and the embodiments of the present application are not limited.

[0154] In embodiments of the present application, the light supplement state refers to a state when the electronic device displays the light supplement interface.

[0155] Optionally, in the embodiment of the present application, the electronic device can continuously cache the pictures taken by the camera in the light supplement state. After the user performs the first input, the electronic device can display the picture taken by the camera in the light supplement state at the preset time or display the dynamic picture taken by the camera within the preset time length.

[0156] For example, the user can long press the shooting control to trigger the electronic device to display the previous second selfie state. After the user releases the long press, the electronic device displays the light supplement interface again.

[0157] Optionally, in the embodiment of the present application, in the long-distance selfie mode, since the real-time preview is cancelled, the user can have difficulty confirming whether the composition is appropriate. Therefore, the present embodiment provides a preview optimization and picture backtracking function, which allows the user to view the picture of the previous several seconds before shooting, for example, a “preview” button is set on the screen, which can be switched to the preview interface when clicked to display the picture in the previous second light supplement state or dynamically review the action of the previous three seconds. The button can also reuse the shooting control, for example, when the user long presses the shooting control, the screen displays the previous second selfie state, and after the user releases the long press, the light supplement mode is restored, so that the user can easily realize preview when using the selfie stick to shoot.

[0158] In this way, the user can flexibly switch between the light supplement interface and the second picture through the first input. The user can view the previous selfie state at any time in the light supplement mode, which facilitates the user to intuitively understand the current shooting effect before shooting, and timely adjusts the shooting angle, posture or expression according to the actual needs to ensure the reasonable composition, thereby improving the shooting effect of the image.

[0159] Optionally, in the embodiment of the present application, the light supplement interface further includes an adjustment control. In combination with Figure 1 As shown in Figure 17 After the step 202, the screen light supplement method provided by the embodiment of the present application further includes the following steps 901 and 902.

[0160] Step 901, the electronic device accepts the third input to the adjustment control.

[0161] In the embodiment of the present application, the adjustment control is used to adjust the brightness of at least one person object.

[0162] Optionally, in the embodiment of the present application, at least one adjustment control can be displayed in the light supplement interface, and the at least one adjustment control corresponds to at least one person object one by one. Each adjustment control is used to adjust the brightness of the corresponding person object. Alternatively, one adjustment control can be displayed in the light supplement interface. When the control is clicked, the brightness bar corresponding to each person appears. Each brightness bar includes a sub-control. The user can adjust the brightness of the person corresponding to the sub-control by inputting the sub-control.

[0163] In the embodiments of this application, the third input is used to trigger the electronic device to adjust the brightness of the at least one character object.

[0164] Optionally, in the embodiments of this application, the three inputs include but are not limited to: touch input of the user on the adjustment control through a touch device such as a finger or a stylus, or a voice instruction input by the user, or a specific gesture input by the user, or other feasible inputs. The specific can be determined according to the actual use requirement, and the embodiments of this application are not limited.

[0165] Optionally, in the embodiments of this application, the third input can be a drag input of the user on the adjustment control.

[0166] Step 902, the electronic device adjusts the brightness of the at least one character object in response to the third input.

[0167] Optionally, in the embodiments of this application, the user can input the adjustment control according to the actual requirement of the brightness adjustment to trigger the electronic device to adjust the brightness of the at least one character object.

[0168] Illustratively, assuming that user A and user B use a mobile phone to take a selfie, a screen display light compensation interface is displayed, including user A and user B, and two adjustment controls are displayed respectively for adjusting the light compensation intensity of user A and user B. At this time, the light at the position of user B is weak, resulting in that user B in the shooting preview interface is dark, and the user drags the adjustment control on the top of user B in the shooting preview interface, so that the electronic device increases the brightness of the area where user B is located, compensates light for user B, and makes the light at the position of user B moderate, thereby achieving a good light compensation effect.

[0169] In this way, the electronic device can accurately adjust the brightness of different character objects according to the user's requirement, ensure that each character can obtain the light effect required by the user when shooting, and make the shooting effect more meet the user's requirement.

[0170] The embodiments of this application provide a screen light compensation method, which cancels the preview area of the traditional screen light compensation method, maximizes the screen light compensation capability, and is suitable for a night scene selfie scene at a farther distance. The position of the character is guided by a dotted outline or other RGB light compensation method, information such as expression, head angle, and eye direction is analyzed by AI, and real-time adjustment suggestions are provided, or the preview is performed by clicking the picture, thereby improving the night scene selfie experience and shooting quality at a farther distance.

[0171] The screen light compensation method provided by the embodiments of this application is schematically described through specific examples as follows.

[0172] Exemplarily, it is assumed that user A and his friends are at a dimly lit outdoor party venue on a weekend night, and they decide to take a group photo together. User A takes out his mobile phone, opens the self-timer application, the front camera is started, and the screen displays a shooting preview interface including user A and his friends. User A notices that the light is very dim, so he clicks the "night scene enhancement" button in the shooting preview interface, triggering the mobile phone to enter the strong fill light mode, and the screen displays the background area full screen, while the screen appears the screen area corresponding to each person and the adjustment control. These screen areas include the contour markers corresponding to the persons, the contour markers contain the expressions of user A and his friends, and the electronic device uses the clothes color of the person as the color of the pixel block filling the contour marker corresponding to the person. User A finds that the contour marker is a little thin and not easy to see, so he says to the mobile phone, "Make the contour thicker", and the mobile phone adjusts the contour marker to a thicker and denser style after recognition. User B, a friend of user A, is standing on the side in a red dress and is in a relatively biased position. The mobile phone detects that the shooting angle of user B in the red dress is not good through face element analysis, and plays a voice prompt: "Red dress user, please adjust the shooting angle, turn the face to the left". User A finds that his face is a little dark, so he clicks on the adjustment control, and a brightness bar appears on the contour marker of each person. User A drags the sub-control in the brightness bar of his own contour marker, so that the face of user A is brighter. After user A and his friends adjust their positions and brightness, the mobile phone detects that everyone is in the best shooting state, and plays a voice prompt: "You can take a photo". User A clicks the "preview" button on the screen, checks the picture of the previous second, confirms that the composition is reasonable, and then releases the button, and the screen returns to the fill light mode. Then user A presses the shutter, and successfully takes a clear and bright night scene group photo.

[0173] Each of the above method embodiments, or various possible implementations of each method embodiment, can be executed alone or in combination with any two or more of them, and can be determined according to actual use requirements, which is not limited in the embodiments of the present application.

[0174] The execution subject of the screen fill light method provided in the embodiments of the present application can be a screen fill light device. In the embodiments of the present application, the screen fill light method is executed by the screen fill light device, and the screen fill light device provided in the embodiments of the present application is described.

[0175] Figure 18 A possible structural schematic diagram of a screen fill light device involved in some embodiments of the present application is shown. As shown in Figure 18 The screen fill light device 70 can include a collection module 71 and a display module 72.

[0176] The collection module 71 is configured to collect a first picture containing at least one person object through a camera of the electronic device.

[0177] The display module 72 is configured to display a light supplement interface, the light supplement interface including a background region and a screen region corresponding to the at least one person object collected by the collection module 71, and the light supplement interface is used for light supplement of the person corresponding to the at least one person object.

[0178] In a possible implementation, when the light supplement interface is displayed, the display module 72 is further configured to display a contour mark of the light supplement interface.

[0179] In a possible implementation, the screen region corresponding to the person object includes the contour mark. The screen light supplement device provided in the embodiments of the present application further includes a receiving module 73. The receiving module 73 is configured to receive a first input after the display module 72 displays the light supplement interface. The display module 72 is further configured to adjust a contour style of the at least one person object based on a content of the first input received by the receiving module 73, the contour style being a style of the contour mark.

[0180] In a possible implementation, the screen region corresponding to the person object includes the contour mark. The contour mark of the person object includes a mark of a face element. The screen light supplement device provided in the embodiments of the present application further includes a playing module 74. The playing module 74 is configured to output prompt information based on the mark of the face element after the display module 72 displays the light supplement interface, the prompt information being used for prompting the user to perform any one of the following operations: adjusting a shooting angle, adjusting a state of the face element, and performing a shooting operation. The display module 72 is further configured to update the contour mark of the person object in the light supplement interface according to a changed first picture in a case where the first picture collected by the collection module 71 is changed.

[0181] In a possible implementation, the screen light supplement device provided in the embodiments of the present application further includes a detection module 75 and a determination module 76. The detection module 75 is configured to detect a brightness of each person object in the first picture after the display module 72 displays the light supplement interface. The determination module 76 is configured to determine a light supplement brightness of a region where each person object is located based on the brightness of the at least one person object detected by the detection module 75, the light supplement brightness of the region where the person object is located being associated with the brightness of the person object.

[0182] In a possible implementation, the display module 72 is further configured to: display, after displaying the light supplement interface, a pixel block in the contour mark of the corresponding person object in the light supplement interface based on the face color temperature value of each person object in the first image; or display, after displaying the light supplement interface, a pixel block in the contour mark of the corresponding person object in the light supplement interface based on the feature color value of each person object in the first image.

[0183] In a possible implementation, the light supplement interface further includes a switching control. The screen light supplement device provided in the embodiments of the present application further includes a receiving module 73. The receiving module 73 is configured to receive a second input to the switching control after the display module 72 displays the light supplement interface. The display module 72 is further configured to display a second image in response to the second input received by the receiving module 73, the second image being an image captured by the camera at a preset time in the light supplement state or a dynamic image captured by the camera within a preset time length.

[0184] In a possible implementation, the light supplement interface further includes an adjusting control. The screen light supplement device provided in the embodiments of the present application further includes a receiving module 73. The receiving module 73 is configured to receive a third input to the adjusting control after the display module 72 displays the light supplement interface. The display module 72 is further configured to adjust the brightness of the at least one person object in response to the third input.

[0185] In the embodiments of the present application, a screen light supplement device is provided. Since the screen light supplement device can display a background region in the light supplement interface and a screen region corresponding to the at least one person object, the screen light supplement device can provide a strong light supplement effect through the background region when taking a selfie, and the screen light supplement device can supplement light to the photographer through the screen region corresponding to the at least one person object, thereby improving the light supplement effect and making the photographed photo more meet the needs of the user. In this way, the image shooting effect is improved.

[0186] The screen light supplementing apparatus in the embodiments of the present applicationapplicationbe an electronic device or a component in an electronic device, such as an integrated circuit or a chip. The electronic deviceapplicationbe a terminal or other device than a terminal. For example, the electronic deviceapplicationbe a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, a personal digital assistant (PDA), and the like, andapplicationbe a server, a Network Attached Storage (NAS), a personal computer (PC), a television (TV), a teller machine, a self-service machine, and the like. The embodiments of the present application do not make a specific limitation.

[0187] The screen light supplementing apparatus in the embodiments of the present applicationapplicationbe a device having an operating system. The operating systemapplicationbe an Android operating system, an iOS operating system, or other possible operating system. The embodiments of the present application do not make a specific limitation.

[0188] The screen light supplementing apparatus provided in the embodiments of the present applicationapplicationimplement each process achieved by the method embodiments. To avoid repetition, the details are not described herein.

[0189] Optionally, as shown in Figure 19 The embodiments of the present application further provide an electronic device 1000, whichapplicationinclude a processor 1001 and a memory 1002. The memory 1002applicationstore a program or instruction, whichapplicationbe run on the processor 1001. The program or instructionapplicationbe executed by the processor 1001 to implement each step of the above screen light supplementing method embodiments and achieve the same technical effects. To avoid repetition, the details are not described herein.

[0190] It should be noted that the electronic device in the embodiments of the present applicationapplicationinclude the above-mentioned mobile electronic device and non-mobile electronic device.

[0191] Figure 20 A hardware structure schematic diagram of an electronic device for implementing the embodiments of the present application.

[0192] The electronic device 100 includes, but is not limited to, a radio frequency unit 101, a network module 102, an audio output unit 103, an input unit 104, a sensor 105, a display unit 106, a user input unit 107, an interface unit 108, a memory 109, and a processor 110, etc.

[0193] Those skilled in the art can understand that the electronic device 100 can also include a power supply (such as a battery) for powering various components, which can be logically connected to the processor 110 through a power management system, so as to realize functions such as management of charging, discharging, and power consumption management through the power management system. Figure 20 The electronic device structure shown in the figure is not a limitation on the electronic device, and the electronic device can include more or fewer components than shown, or combine certain components, or different component arrangements, which will not be described here.

[0194] The sensor 105 is configured to capture a first picture through a camera of the electronic device, the first picture containing at least one person object.

[0195] The display unit 106 is configured to display a light supplement interface, the light supplement interface including a background area and a screen area corresponding to the at least one person object, the light supplement interface being used to supplement light for the person corresponding to the at least one person object.

[0196] Optionally, the display unit 106 is further configured to display an outline mark of the light supplement interface when displaying the light supplement interface.

[0197] Optionally, the screen area corresponding to the person object includes an outline mark. The user input unit 107 is configured to receive a first input after displaying the light supplement interface. The display unit 106 is further configured to adjust an outline style of the at least one person object based on a content of the first input in response to the first input.

[0198] Optionally, the screen area corresponding to the person object includes an outline mark. The outline mark of the person object includes a mark of a facial element. The audio output unit 103 is configured to output a prompt information based on the mark of the facial element after displaying the light supplement interface, the prompt information being used to prompt the user to perform any one of the following operations: adjusting a shooting angle, adjusting a state of the facial element, and performing a shooting operation. The display unit 106 is further configured to update the outline mark of the person object in the light supplement interface according to a changed first picture in a case where the first picture changes.

[0199] Optionally, the processor 110 is configured to detect a brightness of each person object in the first picture after displaying the light supplement interface. The processor 110 is configured to determine a light supplement brightness of a region where each person object is located based on the brightness of the at least one person object, the light supplement brightness of the region where the person object is located being associated with the brightness of the person object.

[0200] Optionally, the display unit 106 is further configured to display, after displaying the light compensation interface, a pixel block in the contour mark of the corresponding person object in the light compensation interface based on the face color temperature value of each person object in the first picture, or display, after displaying the light compensation interface, a pixel block in the contour mark of the corresponding person object in the light compensation interface based on the feature color value of each person object in the first picture.

[0201] Optionally, the light compensation interface further includes a switching control. The user input unit 107 is configured to receive a second input on the switching control after displaying the light compensation interface. The display unit 106 is further configured to display, in response to the second input of the user, a second picture, which is a picture captured by the camera at a preset time in a light compensation state, or a dynamic picture captured by the camera within a preset time length.

[0202] Optionally, the light compensation interface further includes an adjusting control. The user input unit 107 is configured to receive a third input on the adjusting control after displaying the light compensation interface. The display unit 106 is further configured to adjust the brightness of at least one person object in response to the third input.

[0203] The electronic device provided in the embodiments of the present application can display the background region in the light compensation interface and the screen region corresponding to the at least one person object, so that the electronic device can provide a stronger light compensation effect through the background region when taking a selfie, and the electronic device can respectively compensate the light for the photographer through the screen region corresponding to the at least one person object, thereby improving the light compensation effect and making the photographed picture more meet the needs of the user. In this way, the image shooting effect is improved.

[0204] The electronic device provided in the embodiments of the present application can realize each process realized by the method embodiments and achieve the same technical effects. To avoid repetition, details are not described here. The beneficial effects of various implementation manners in the embodiments can refer to the beneficial effects of the corresponding implementation manners in the method embodiments, and details are not described here to avoid repetition.

[0205] It should be understood that in the embodiments of the present application, the input unit 104 can include a graphics processing unit (GPU) 1041 and a microphone 1042. The graphics processing unit 1041 processes image data of a still picture or a video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The display unit 106 can include a display panel 1061, which can be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 can include two parts of a touch detection device and a touch controller. The other input devices 1072 can include, but are not limited to, a physical keyboard, function keys (such as volume control keys, on-off keys, etc.), a trackball, a mouse, a joystick, and the like, which will not be described here.

[0206] The memory 109 can be used to store software programs and various data. The memory 109 can mainly include a first storage area storing programs or instructions and a second storage area storing data, wherein the first storage area can store an operating system, application programs or instructions required by at least one function (such as a sound playing function, an image playing function, etc.), and the like. In addition, the memory 109 can include a volatile memory or a non-volatile memory, or the memory 109 can include both volatile and non-volatile memories. The non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM), a static random access memory (SRAM), a dynamic random access memory (DRAM), a synchronous dynamic random access memory (SDRAM), a double data rate synchronous dynamic random access memory (DDR SDRAM), an enhanced synchronous dynamic random access memory (ESDRAM), a synch link DRAM (SLDRAM), and a direct memory bus random access memory (Direct Rambus RAM, DRRAM). The memory 109 in the embodiments of the present application includes but is not limited to these and any other suitable types of memory.

[0207] The processor 110 can include one or more processing units; optionally, the processor 110 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and an application program, and the modem processor mainly processes a wireless communication signal, such as a baseband processor. It can be understood that the above-mentioned modem processor can also not be integrated into the processor 110.

[0208] The embodiment of the present application further provides a readable storage medium, and the readable storage medium stores a program or instructions, which are executed by a processor to realize the processes of the above-mentioned screen light compensation method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0209] The processor is the processor in the electronic device in the above-mentioned embodiments. The readable storage medium includes a computer readable storage medium, such as a computer readable only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0210] The embodiment of the present application further provides a chip, and the chip includes a processor and a communication interface. The communication interface is coupled with the processor, and the processor is used to run a program or instructions to realize the processes of the above-mentioned screen light compensation method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0211] It should be understood that the chip mentioned in the embodiment of the present application can also be referred to as a system level chip, a system chip, a chip system, or a system on chip, etc.

[0212] The embodiment of the present application provides a computer program product, which is stored in a storage medium. The program product is executed by at least one processor to realize the processes of the above-mentioned screen light compensation method embodiments and achieve the same technical effects. To avoid repetition, details are not described herein.

[0213] It should be noted that, in the present document, the terms "comprises", "comprising", or any other variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but can include other elements not expressly listed or inherent to such process, method, article, or apparatus. An element proceeded by "comprises... a" does not, without more constraints, exclude the presence of additional identical elements in the process, method, article, or apparatus that comprises the element. Furthermore, it is to be understood that the method and apparatus of the present application can be carried out by more than one process, method, article, or apparatus either simultaneously, concurrently, or with intervening action that are carried out at the same time, either in a simultaneous fashion or in a fashion that is interleaved in time. For example, the described methods can be performed in a different order from that described, and / or various steps can be combined or omitted, and / or additional steps can be added, without departing from the scope of the present application. Also, features described with respect to certain examples can be combined in other examples.

[0214] From the above description of the embodiments, it is apparent that the above-mentioned method can be realized by means of software and necessary universal hardware platform, of course, it can also be realized by hardware, but in many cases, the former is a better embodiment. Based on such understanding, the technical solution of the present application can be embodied in the form of computer software product, which is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk), and includes a plurality of instructions for making a terminal (which can be a mobile phone, computer, server, or network equipment, etc.) execute the method described in various embodiments of the present application.

[0215] The embodiments of the present application are described above in conjunction with the accompanying drawings, but the present application is not limited to the above-described specific embodiments, and the above-described specific embodiments are merely illustrative, rather than limiting, and those skilled in the art can make many forms under the inspiration of the present application without departing from the scope of the present application and the scope protected by the claims.

Claims

1. A screen supplementary lighting method, characterized in that, include: A first image is captured by the camera of an electronic device, and the first image contains at least one human figure. The display fill light interface includes a background area and a screen area corresponding to the at least one character object. The fill light interface is used to provide fill light to the character corresponding to the at least one character object.

2. The method according to claim 1, characterized in that, Before the display fill light interface is defined, the method further includes: When displaying the fill light interface, the outline markers of the fill light interface are displayed.

3. The method according to claim 1, characterized in that, The screen area corresponding to the character object includes outline markers; After the display fill light interface is described, the method further includes: Receive the first input; In response to the first input, the outline style of the at least one character object is adjusted based on the content of the first input, the outline style being the style of the outline mark.

4. The method according to claim 1, characterized in that, The screen area corresponding to the character object includes outline markers; The outline markers of the character object include markers for facial elements; After the display fill light interface is described, the method further includes: Based on the markings of the facial elements, a prompt message is output, which prompts the user to adjust the shooting angle, adjust the state of the facial elements, or perform a shooting operation. If the first screen changes, the outline markers of the character objects in the fill light interface are updated according to the changed first screen.

5. The method according to any one of claims 1 to 4, characterized in that, After the display fill light interface is described, the method further includes: Detect the brightness of each character object in the first frame; Based on the brightness of the at least one human object, the fill light brightness of the area where each human object is located is determined, wherein the fill light brightness of the area where the human object is located is related to the brightness of the human object.

6. The method according to claim 1, characterized in that, The display fill light interface includes: Based on the facial color temperature value of each person in the first image, the pixel blocks in the outline markers of the corresponding person in the fill light interface are displayed. or, Based on the characteristic color value of each character object in the first image, the pixel blocks in the outline marker of the corresponding character object are displayed in the fill light interface.

7. The method according to claim 1, characterized in that, The supplemental lighting interface also includes a switching control; After the display fill light interface is described, the method further includes: Receive a second input to the switching control; In response to the second input, a second screen is displayed. The second screen is either a screen captured by the camera at a preset time under supplemental lighting conditions, or a dynamic screen captured by the camera within a preset duration.

8. The method according to claim 1, characterized in that, The supplemental lighting interface also includes adjustment controls; After the display fill light interface is described, the method further includes: Accept a third input to the adjustment control; In response to the third input, the brightness of the at least one character object is adjusted.

9. A screen fill light device, characterized in that, include: Acquisition module and display module; The acquisition module is used to acquire a first image through the camera of an electronic device, wherein the first image contains at least one human object; The display module is used to display a fill light interface, which includes a background area and a screen area corresponding to the at least one human object captured by the acquisition module. The fill light interface is used to provide fill light to the human object corresponding to the at least one human object.

10. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the screen illumination method as described in any one of claims 1 to 7.

Images