Light supplementing method and device, electronic equipment and medium

Abstract

The invention relates to a light supplementing method and device, electronic equipment and a medium. The light supplementing method comprises the steps of performing scene segmentation processing on a first target image to obtain at least one segmentation region; the first target image is an image shot by the camera module; determining a target segmentation region in the at least one segmentation region; the target segmented area is a segmented area to be supplemented with light; and supplementing light to the target object included in the target segmentation area. According to the method and the device, the objects in the partial region can be supplemented with light in a targeted manner, light pollution caused by global light supplement is avoided, an image with a good display effect is obtained, and the user experience is improved.

Description

Technical Field

[0001] This disclosure relates to the field of supplemental lighting technology, and in particular to a supplemental lighting method, apparatus, electronic device and medium. Background Technology

[0002] In current image capture processes, when a fill light module needs to be activated, it typically provides global fill light to obtain a sufficiently bright image. However, global fill light generates additional light pollution, and it can negatively impact the display quality of areas that don't require fill light, resulting in poor image display and a subpar user experience. Summary of the Invention

[0003] To overcome the problems existing in related technologies, this disclosure provides a supplementary lighting method, apparatus, electronic device, and medium.

[0004] According to a first aspect of the present disclosure, a supplementary lighting method is provided, comprising:

[0005] The first target image is subjected to scene segmentation processing to obtain at least one segmented region; the first target image is an image captured by a camera module.

[0006] Determine a target segmentation region within the at least one segmentation region; the target segmentation region is the segmentation region to be supplemented with light.

[0007] Fill light on the target objects contained in the target segmentation region.

[0008] In some embodiments, determining the target segmentation region within the at least one segmentation region includes:

[0009] Determine the grayscale parameter of each segmentation region in the at least one segmentation region, wherein the grayscale parameter of the segmentation region is used to characterize the grayscale value of the pixel corresponding to the segmentation region;

[0010] The target segmentation region is determined based on the grayscale parameters of each segmented region.

[0011] In some embodiments, applying supplemental lighting to the target object contained in the target segmentation region includes:

[0012] Based on the target grayscale parameters of the target segmentation region, supplementary lighting is applied to the target objects contained in the target segmentation region.

[0013] In some embodiments, the step of applying supplemental lighting to the target object contained in the target segmentation region based on the target grayscale parameters of the target segmentation region includes:

[0014] Based on the target grayscale parameters and target adjustment parameters, a target brightness parameter is determined; the target adjustment parameter includes a target scene and / or ambient light brightness parameter, the target scene is used to characterize the supplementary lighting scene corresponding to the first target image, and the target brightness parameter is used to indicate the supplementary lighting intensity of the target segmentation region;

[0015] Based on the target brightness parameters, supplementary lighting is applied to the target objects contained in the target segmentation region.

[0016] In some embodiments, determining the target brightness parameter based on the target grayscale parameter and the target adjustment parameter includes:

[0017] Based on the target grayscale parameter and the preset correlation, a reference brightness parameter is determined; the preset correlation is used to characterize the correlation between the grayscale parameter and the brightness parameter.

[0018] Based on the target adjustment parameters, the reference brightness parameters are adjusted to obtain the target brightness parameters.

[0019] In some embodiments, the target brightness parameter includes brightness parameters of a plurality of first pixels, wherein the first pixels are pixels corresponding to the target segmentation region in the first target image, and the step of supplementing illumination on the target object contained in the target segmentation region based on the target brightness parameter includes:

[0020] Determine the second pixel corresponding to each first pixel; the second pixel is a pixel in the second target image, the second target image is the image corresponding to the liquid crystal pixel layer in the supplementary light module, the liquid crystal pixel layer includes light-emitting pixels corresponding to the pixels in the second target image;

[0021] Based on the target brightness parameter, adjust the brightness of the light-emitting pixel corresponding to each second pixel point;

[0022] Based on the adjusted brightness of each luminous pixel, supplemental lighting is applied to the target object contained in the target segmentation region.

[0023] In some embodiments, determining the second pixel corresponding to each first pixel includes:

[0024] Determine the first position parameter of each first pixel;

[0025] Based on each first position parameter and position offset parameter, a second position parameter corresponding to each first position parameter is determined; the position offset parameter is used to characterize the position offset between the pixel corresponding to the image captured by the camera module and the pixel corresponding to the image of the liquid crystal pixel layer at the same position in the shooting environment.

[0026] Each pixel corresponding to a second position parameter in the second target image is determined as a second pixel.

[0027] In some embodiments, supplementing the target object contained in the target segmentation region with illumination based on the target brightness parameter includes:

[0028] The target color temperature parameter is determined based on the reference color temperature parameter of ambient light; the target color temperature parameter is used to characterize the color temperature of the light source in the supplementary lighting module.

[0029] Based on the target color temperature parameters and the target brightness parameters, supplementary lighting is applied to the target objects contained in the target segmentation region.

[0030] In some embodiments, the scene segmentation processing of the first target image to obtain at least one segmented region includes:

[0031] When capturing the first target image, multiple reference images are acquired based on the event camera, and the reference images include at least one object;

[0032] Based on the multi-frame reference images, determine the motion of each object and / or the brightness change of pixels located at the same position in the multi-frame reference images;

[0033] Based on the motion of each object and / or the brightness variation of pixels at the same position in the multi-frame reference images, the first target image is segmented to obtain at least one segmented region, wherein the segmented region includes at least one object.

[0034] In some embodiments, when the target segmentation region includes the human eye region, the step of providing supplemental lighting to the target object contained in the target segmentation region includes:

[0035] Determine the human eye region within the target segmentation region;

[0036] Supplemental lighting is applied to the target objects within the target segmentation region, excluding the human eye region.

[0037] In some embodiments, the method further includes:

[0038] Obtain the first zoom parameter of the camera module;

[0039] Based on the first zoom parameter, a second zoom parameter is determined; the second zoom parameter is used to characterize the zoom coefficient of the driving unit in the supplementary lighting module, and the second zoom parameter is used to drive the driving unit to move;

[0040] The first target image is obtained based on the first zoom parameter and the second zoom parameter.

[0041] According to a second aspect of the present disclosure, a supplementary lighting device is provided, comprising:

[0042] The processing module is configured to perform scene segmentation processing on the first target image to obtain at least one segmented region; the first target image is an image captured by the camera module.

[0043] The determining module is configured to determine a target segmentation region within the at least one segmentation region; the target segmentation region is the segmentation region to be supplemented with light.

[0044] The supplementary lighting module is configured to provide supplementary lighting for the target object contained in the target segmentation region.

[0045] According to a third aspect of the present disclosure, an electronic device is provided, comprising:

[0046] processor;

[0047] Memory used to store processor-executable instructions;

[0048] The processor is configured to perform the supplemental lighting method as described in the first aspect of this disclosure.

[0049] According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium is provided, wherein when instructions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the supplementary lighting method as described in the first aspect of the present disclosure.

[0050] The method described in this disclosure has the following advantages: This disclosure can segment a captured image into at least one segmented region, identify the segmented region within the at least one segmented region that requires supplemental lighting, and provide supplemental lighting to the target objects contained within the segmented region requiring supplemental lighting. In this way, supplemental lighting can be applied selectively to objects in certain areas, avoiding light pollution caused by global supplemental lighting, resulting in an image with good display quality, thereby improving the user experience.

[0051] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0052] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.

[0053] Figure 1 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment.

[0054] Figure 2This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment.

[0055] Figure 3 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment.

[0056] Figure 4 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment.

[0057] Figure 5 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment.

[0058] Figure 6 This is a schematic diagram of a supplementary lighting module according to an exemplary embodiment.

[0059] Figure 7 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment.

[0060] Figure 8 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment.

[0061] Figure 9 This is a schematic diagram illustrating a supplemental lighting method according to an exemplary embodiment.

[0062] Figure 10 This is a block diagram illustrating a supplementary lighting device according to an exemplary embodiment.

[0063] Figure 11 This is a block diagram of an electronic device according to an exemplary embodiment. Detailed Implementation

[0064] Exemplary embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numerals in different drawings denote the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0065] In current image capture processes, when a fill light module needs to be activated, it typically provides global fill light to obtain a sufficiently bright image. However, global fill light generates additional light pollution, and it can negatively impact the display quality of areas that don't require fill light, resulting in poor image display and a subpar user experience.

[0066] To address the aforementioned problems, this disclosure provides a supplementary lighting method. This method involves performing scene segmentation processing on a first target image to obtain at least one segmented region; the first target image is an image captured by a camera module; a target segmented region is determined within the at least one segmented region; the target segmented region is the segmented region to be supplemented with lighting; and supplementary lighting is applied to the target objects contained within the target segmented region. This disclosure can segment the captured image into at least one segmented region, determine the segmented region within the at least one segmented region that requires supplementary lighting, and apply supplementary lighting to the target objects contained within the segmented region requiring supplementary lighting. In this way, supplementary lighting can be applied selectively to objects in certain areas, avoiding light pollution caused by global supplementary lighting, resulting in an image with good display quality, thereby improving the user experience.

[0067] The supplementary lighting method provided in this embodiment is executed by an electronic device, which may specifically be a mobile phone, tablet computer, laptop, smart robot, smart wearable device, or other smart device. The electronic device also includes various hardware resources and an energy storage device that provides power for the operation of these hardware resources. Furthermore, the electronic device includes a camera module and a supplementary lighting module, wherein the camera module is used to capture images, and the supplementary lighting module is used to provide supplementary lighting to the images.

[0068] Figure 1 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment, performed by an electronic device, see [link to flowchart]. Figure 1 The method includes the following steps:

[0069] Step S101: Perform scene segmentation processing on the first target image to obtain at least one segmented region; the first target image is an image captured by the camera module.

[0070] The electronic device can be configured with multiple camera modules; for example, it can be configured with a wide-angle camera module or a telephoto camera module. In one example, the electronic device can use any of the camera modules to capture an image of the first target.

[0071] In some embodiments, the first target image can be segmented using a preset scene segmentation algorithm. It should be noted that this embodiment does not limit the type of preset scene segmentation algorithm; for example, the preset scene segmentation algorithm can be an algorithm based on high-resolution semantic feature maps, an algorithm based on multi-scale segmentation, a panoramic segmentation algorithm, etc. Furthermore, the process of segmenting the first target image using the preset scene segmentation algorithm will not be described in detail in this embodiment.

[0072] It should be noted that different segmented regions can correspond to different identifiers, which can refer to category labels, colors, or bounding boxes. For example, after scene segmentation processing of the first target image, two segmented regions (the first segmented region and the second segmented region) are obtained. Accordingly, identifier 1 can be used to mark the first segmented region, and identifier 2 can be used to mark the second segmented region. For example, bounding boxes can be used to mark the first and second segmented regions, or different colors can be used to mark the first and second segmented regions, etc. In this way, by using different identifiers to mark different segmented regions, different segmented regions can be distinguished, which facilitates the subsequent illumination process.

[0073] Step S102: Determine the target segmentation region within at least one segmentation region; the target segmentation region is the segmentation region to be supplemented with light.

[0074] In some embodiments, at least one segmentation region may contain areas with dim lighting / low brightness. In this case, such areas can be identified as target segmentation regions and subsequent steps can be performed. It should be noted that this embodiment does not limit the number of target segmentation regions; there can be one or more target segmentation regions.

[0075] Step S103: Apply supplemental lighting to the target object contained in the target segmentation region.

[0076] The target object refers to any object within the target segmentation region of the shooting environment. The target object may include human figures such as men, women, and children; animals such as cats and dogs; grass; buildings; and human eyes. In some embodiments, a fill light module may be used to provide fill light to the target objects within the target segmentation region.

[0077] In one example, when there are multiple target segmentation regions, fill light can be applied to the target objects contained in each of the multiple target segmentation regions until fill light is applied to all the target objects contained in all the target segmentation regions.

[0078] The target segmentation region includes multiple pixels. In some embodiments, supplemental lighting can be applied to the location corresponding to each pixel within the target segmentation region in the shooting environment. It should be noted that the supplemental lighting intensity for each pixel within the target segmentation region can be different. Correspondingly, the supplemental lighting intensity for pixels at different locations of the target object within the target segmentation region can be different. This allows for targeted supplemental lighting, resulting in an image with better display quality.

[0079] In some embodiments, an image of the target object included in the target segmentation region after illumination is completed can be determined and displayed on the display screen of an electronic device for the user to view.

[0080] This embodiment of the disclosure can segment a captured image into at least one segmented region, identify the segmented regions within the at least one segmented region that require supplemental lighting, and apply supplemental lighting to the target objects contained in the segmented regions that require supplemental lighting. In this way, objects in certain regions can be targeted, avoiding light pollution caused by global supplemental lighting, resulting in an image with good display effect, thereby improving the user experience.

[0081] In some embodiments, during the scene segmentation processing of the first target image using a preset scene segmentation algorithm, an event camera can be used to assist in the scene segmentation process. An event camera is a visual sensor that records changes in pixel brightness and outputs these changes as an event stream. Each event in the event stream includes a timestamp, pixel coordinates, and polarity (indicating an increase or decrease in brightness). In specific applications of scene segmentation, the event camera can capture changes in the scene in real time and identify and segment different scene elements by analyzing these changes. For example, when objects in the scene move or lighting conditions change, the event camera can quickly capture the changes and segment them into independent event streams. Subsequently, through further processing and analysis of the event streams, different objects or regions can be identified, thereby achieving scene segmentation.

[0082] In some embodiments, when capturing a first target image, multiple reference images are acquired based on an event camera; based on the multiple reference images, the motion of each object and / or the brightness changes of pixels at the same position in the multiple reference images are determined; based on the motion of each object and / or the brightness changes of pixels at the same position in the multiple reference images, scene segmentation processing is performed on the first target image to obtain at least one segmented region. The reference images include at least one object, and the segmented regions include at least one object, which can be any object in the shooting environment. Specifically, the changing objects or pixels can be determined based on the event camera, and the changing objects or pixels can be segmented into independent event streams. By analyzing the segmentation of the changing objects or pixels into independent event streams, at least one segmented region is obtained.

[0083] It should be noted that using an event camera-assisted scene segmentation algorithm for scene segmentation can improve the speed of scene segmentation, save time, and improve the accuracy of scene segmentation.

[0084] The following is through Figure 2 The illustrated embodiment explains the process of determining the target segmentation region and applying supplemental lighting to the target objects contained within the target segmentation region.

[0085] Figure 2 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment, performed by an electronic device, see [link to flowchart]. Figure 2The method includes the following steps:

[0086] Step S201: Determine the grayscale parameter of each segmentation region in at least one segmentation region. The grayscale parameter of the segmentation region is used to characterize the grayscale value of the pixel corresponding to the segmentation region.

[0087] In some embodiments, a grayscale image of the first target image can be obtained, and grayscale parameters for each segmented region can be determined based on the grayscale image of the first target image. In one example, the first target image can be converted into a grayscale image using an image conversion function.

[0088] In some embodiments, grayscale parameters for each pixel in each segmented region can be determined. In one example, the grayscale parameter may include a grayscale value. It should be noted that the grayscale value can be used to determine the brightness of a pixel; the larger the grayscale value, the brighter the pixel; conversely, the smaller the grayscale value, the darker the pixel.

[0089] Step S202: Determine the target segmentation region based on the grayscale parameters of each segmentation region.

[0090] In some embodiments, the brightness of each segmented region can be determined based on the grayscale parameters of each pixel in each segmented region. When the brightness of a segmented region is characterized as dark, that segmented region can be identified as the target segmented region. In one example, the average grayscale value of all pixels in each segmented region can be calculated. The average grayscale value is used to characterize the overall brightness of the segmented region. When the average grayscale value of a segmented region is less than a preset threshold, that segmented region is identified as the target segmented region.

[0091] Furthermore, it should be noted that besides determining the target segmentation region based on the grayscale parameters of each segmentation region, other methods can be used to determine the target segmentation region in at least one segmentation region. In one example, a preset recognition model can be invoked to determine the target segmentation region in at least one segmentation region. The training data of the preset recognition model includes at least one segmentation region corresponding to multiple images, and the target segmentation region within at least one segmentation region corresponding to each image. Thus, the target segmentation region can be directly determined through the preset recognition module, thereby saving the time spent on determining the target segmentation region.

[0092] Step S203: Based on the target grayscale parameters of the target segmentation region, supplementary lighting is applied to the target objects contained in the target segmentation region.

[0093] Fill-in lighting scenarios can include portrait lighting scenarios, night scene portrait lighting scenarios, portrait video lighting scenarios, and other scenarios. Different lighting scenarios may target different lighting areas and have different intensity levels. For example, when the lighting scenario is a portrait lighting scenario, it may provide light fill-in lighting to the portrait objects in the shooting environment. Conversely, when the lighting scenario is a night scene portrait lighting scenario, it may provide strong fill-in lighting to the portrait objects in the shooting environment. Therefore, to improve the accuracy of fill-in lighting and obtain better-displayed images, in some embodiments, fill-in lighting can be applied to the target objects within the target segmentation region based on the target grayscale parameters and the current lighting scenario.

[0094] In some embodiments, the supplementary lighting scene of the first target image can be identified using a preset scene recognition algorithm. This embodiment does not limit the type of preset scene recognition algorithm. For example, the preset scene recognition algorithm can be a feature-based scene recognition algorithm, such as identifying scenes based on color, texture, shape, etc. in the image; it can also be a deep learning-based algorithm, such as scene recognition based on a convolutional neural network. It should be noted that the supplementary lighting scene corresponding to the first target image can be automatically identified by the electronic device. For example, when the electronic device is in automatic mode, it can automatically identify the supplementary lighting scene corresponding to the first target image. Alternatively, the first target image can also be identified by the electronic device after manual user operation, such as when the user manually activates the recognition function, and then the electronic device performs scene recognition.

[0095] Similarly, ambient light intensity parameters can also affect the intensity of supplementary lighting. Therefore, supplementary lighting can be applied to the target objects within the segmented target area by combining ambient light intensity parameters. In some embodiments, the electronic device is equipped with an ambient light sensor. Thus, ambient light intensity parameters can be obtained based on the ambient light sensor.

[0096] Therefore, in some embodiments, a target brightness parameter can be determined based on a target grayscale parameter and a target adjustment parameter, and supplementary lighting can be applied to the target object contained in the target segmentation region based on the target brightness parameter. The target adjustment parameter includes a target scene and / or ambient light brightness parameter, where the target scene characterizes the supplementary lighting scene corresponding to the first target image, and the target brightness parameter indicates the supplementary lighting intensity of the target segmentation region.

[0097] In some embodiments, a reference brightness parameter can be determined based on a target grayscale parameter and a preset correlation. The reference brightness parameter is then adjusted based on a target adjustment parameter to obtain the target brightness parameter. The preset correlation is used to characterize the relationship between the grayscale parameter and the brightness parameter. For example, the preset correlation includes the correlation between grayscale parameter A and brightness parameter a, and grayscale parameter B and brightness parameter b. When the target grayscale parameter is grayscale parameter A, the reference brightness parameter can be determined to be brightness parameter a.

[0098] The embodiments disclosed herein can simultaneously determine the target brightness parameter based on the target grayscale parameter and the target adjustment parameter, thereby obtaining a more accurate target brightness parameter to supplement the lighting of the target object contained in the target segmentation region.

[0099] The target brightness parameters can include the brightness parameters of multiple first pixels, where each first pixel is the pixel corresponding to the target segmentation region in the first target image. The following will demonstrate... Figure 3 The illustrated embodiment explains the process of supplementing light to the target object contained in the target segmentation region from the perspective of pixels.

[0100] Figure 3 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment, performed by an electronic device, see [link to flowchart]. Figure 3 The method includes the following steps:

[0101] Step S301: Determine the second pixel corresponding to each first pixel.

[0102] Wherein, the second pixel is a pixel in the second target image, and the second target image is the image corresponding to the liquid crystal pixel layer in the supplementary light module. The liquid crystal pixel layer includes light-emitting pixels corresponding to the pixels in the second target image.

[0103] It's important to note that the light-emitting pixels on an LCD screen refer to the smallest units that make up the image on the display. Each pixel consists of three sub-pixels: red, green, and blue. These sub-pixels display different colors and images through different combinations and brightness levels. In an LCD screen, the pixels themselves do not emit light; instead, they illuminate the entire screen uniformly through the scattering and reflection of light sources. In one example, the brightness of each light-emitting pixel can be controlled by changing the amount of light emitted by the pixels.

[0104] In some embodiments, determining a second pixel corresponding to each first pixel includes: determining a first position parameter for each first pixel; determining a second position parameter corresponding to each first position parameter based on each first position parameter and a position offset parameter, and determining each pixel corresponding to each second position parameter in the second target image as a second pixel. The position offset parameter is used to characterize the position offset between pixels at the same location in the shooting environment corresponding to the image captured by the camera module and pixels corresponding to the image captured by the liquid crystal pixel layer.

[0105] In some embodiments, the position offset parameter can be determined before supplemental lighting. In some embodiments, multiple positions can be pre-selected in the shooting environment, and the position offset between the pixel corresponding to the image captured by the camera module and the pixel corresponding to the image of the liquid crystal pixel layer at each position in the shooting environment can be calculated. Then, the position offset parameter is determined based on the multiple position offsets. For example, if the position offset between the pixel corresponding to the image captured by the camera module and the pixel corresponding to the image of the liquid crystal pixel layer at each of the first, second, and third positions in the shooting environment is determined, and the position offsets of the three positions are (X1, Y1), (X2, Y2), and (X3, Y3) respectively, then the average value of the three position offsets can be determined as the position offset parameter.

[0106] In some embodiments, the displacement offset parameter is related to the field of view of the camera module and the field of view of the supplementary lighting module. For example, when the field of view of the camera module is FOV1 and the field of view of the supplementary lighting module is FOV2, the position displacement parameter is (X, Y). In some embodiments, the field of view of the camera module and the field of view of the supplementary lighting module, along with their corresponding position offset parameters, can be stored, allowing direct retrieval of the corresponding position offset parameters. It should be noted that when the field of view of the camera module and / or the field of view of the supplementary lighting module changes, the position offset parameter must be redefined.

[0107] Step S302: Based on the target brightness parameter, adjust the brightness of the light-emitting pixel corresponding to each second pixel point.

[0108] In some embodiments, the amount of light emitted by the light-emitting pixel corresponding to each second pixel can be adjusted based on the target brightness parameter, thereby adjusting the brightness of the light-emitting pixel corresponding to each second pixel.

[0109] Step S303: Based on the adjusted brightness of each luminous pixel, supplementary lighting is applied to the target object contained in the target segmentation region.

[0110] In some embodiments, light can be emitted based on the adjusted brightness of each luminous pixel to provide supplemental lighting for the target object contained in the target segmentation region.

[0111] This embodiment of the disclosure achieves supplemental lighting for the target object included in the target segmentation area by determining the second pixel corresponding to the first pixel and then adjusting the brightness of the light-emitting pixel in the liquid crystal pixel layer corresponding to the second pixel. By determining the second pixel and the light-emitting pixel corresponding to the second pixel, precise supplemental lighting can be achieved, restoring a realistic scene atmosphere.

[0112] Currently, supplementary lighting modules typically consist of two LEDs (Light Emitting Diodes) with different color temperatures. The color temperature of the supplementary lighting module can be adjusted by changing the brightness of these two LEDs. For example, the two LEDs with different color temperatures might be a warm-light LED and a cool-light LED. When the brightness of the warm-light LED is greater, the color temperature of the supplementary lighting module is warmer; conversely, when the brightness of the cool-light LED is greater, the color temperature is cooler; and when the brightness of the warm-light and cool-light LEDs is similar, the color temperature of the supplementary lighting module is neutral. Therefore, the color temperature range of existing supplementary lighting modules is relatively small, and the light emitted by the module may not meet actual needs, resulting in poor image display. In some embodiments, this embodiment adds a color temperature parameter and applies supplementary lighting to the target object contained in the target segmentation region based on this parameter. The following describes... Figure 4 The illustrated embodiment explains the process of applying supplemental lighting to the target object contained in the target segmentation region based on color temperature parameters.

[0113] Figure 4 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment, performed by an electronic device, see [link to flowchart]. Figure 4 The method includes the following steps:

[0114] Step S401: Determine the target color temperature parameter based on the reference color temperature parameter of the ambient light; the target color temperature parameter is used to characterize the color temperature of the light source in the supplementary lighting module.

[0115] The color temperature parameter can include a variety of color parameters, and these color parameters are related to the color temperature.

[0116] In some embodiments, an ambient light sensor can be used to determine the reference color temperature parameter of the ambient light. The process of determining the reference color temperature parameter of the ambient light using an ambient light sensor will not be described in detail here.

[0117] In some embodiments, the target color temperature parameter may be similar to or the same as the reference color temperature parameter.

[0118] Step S402: Based on the target color temperature parameters and target brightness parameters, supplementary lighting is applied to the target objects contained in the target segmentation region.

[0119] In some embodiments, the RGB ratio of the supplementary lighting module can be adjusted based on a target color temperature parameter, so that the color temperature of the light emitted by the supplementary lighting module is similar to or the same as that of the ambient light. In one example, the color temperature of the light source of the supplementary lighting module can be adjusted to adjust the RGB ratio of the supplementary lighting module. In another example, the RGB ratio of the light-emitting pixels in the liquid crystal pixel layer can be adjusted to adjust the RGB ratio of the supplementary lighting module.

[0120] It should be noted that the process of supplementing the illumination of the target object contained in the target segmentation region based on the target brightness parameter will not be described in detail here.

[0121] In this embodiment of the disclosure, supplementary lighting is applied to the target object contained in the target segmentation area based on the target color temperature parameters and the target brightness parameters. The color temperature parameters of the supplementary lighting module can be dynamically adjusted in combination with the ambient view to ensure that the color temperature of the supplementary lighting module is in a suitable state, neither too cold nor too warm, thereby meeting user needs and improving the user experience.

[0122] Currently, when using a fill light module for supplemental lighting during shooting, the area around the eyes may reflect light, leading to overexposure or unnatural appearance in that area. Alternatively, the light emitted by the fill light module may dazzle the user's eyes. Therefore, to ensure proper display in the eye area, special processing can be applied to that area. The following will demonstrate... Figure 5 The illustrated embodiment explains the processing procedure for the human eye region.

[0123] Figure 5 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment, performed by an electronic device, see [link to flowchart]. Figure 5 The method includes the following steps:

[0124] Step S501: Determine the human eye region within the target segmentation region.

[0125] The target segmentation region includes the human eye region. In some embodiments, the human eye region within the target segmentation region can be determined using an event camera. The specific determination process can be referred to step S101 above, and will not be repeated here.

[0126] Step S502: Apply supplemental lighting to the target object contained in the target segmentation region, excluding the human eye region.

[0127] In some embodiments, supplemental lighting can be applied to target objects within the target segmentation region, excluding the human eye region. For example, if the target segmentation region includes both the human eye region and the human figure region, supplemental lighting can be applied to the human figure object within the human figure region.

[0128] Alternatively, in some embodiments, the state of the human eye in the eye region can be detected, and based on the state of the human eye, it can be determined whether to provide supplemental lighting to the human eye objects included in the eye region. For example, if the state of the human eye indicates that the current brightness of the eye region is relatively dark, then slight supplemental lighting can be provided to the human eye objects in the eye region based on actual needs.

[0129] This embodiment of the invention removes the human eye area, thereby avoiding the need for supplemental lighting on the human eye and effectively solving the problems caused by the supplemental lighting module flashing light or the eye reflecting light.

[0130] The fill light module includes a drive unit and a lens. The drive unit can drive the lens to move, thereby changing the field of view of the fill light module. In one example, reference... Figure 6 The schematic diagram shown illustrates a supplementary lighting module, which also includes a light source and a liquid crystal pixel layer. It should be noted that the field of view of the supplementary lighting module can be determined based on the distance between the lens and the light-emitting pixels. The smaller the distance between the lens and the light-emitting pixels on the liquid crystal display, the larger the field of view; conversely, the larger the distance, the smaller the field of view. Furthermore, it should be noted that the maximum field of view of the supplementary lighting module is greater than that of a wide-angle camera module, and the minimum field of view of the supplementary lighting module is greater than that of a telephoto camera module.

[0131] When electronic devices photograph distant targets, the lighting module may not provide sufficient brightness due to the distance and potentially large field of view. Therefore, the zoom parameters of the camera module and the zoom coefficient of the drive unit can be correlated. When the zoom coefficient of the camera module is greater than 1, the drive unit moves the lens away from the light-emitting pixels, thereby reducing the field of view of the lighting module and focusing the light. In this way, by focusing the light, the lighting module can provide sufficient brightness for distant targets. The following will explain... Figure 7 The illustrated embodiment describes the process of acquiring the first target image.

[0132] Figure 7 This is a flowchart illustrating a supplemental lighting method according to an exemplary embodiment, performed by an electronic device, see [link to flowchart]. Figure 7 The method includes the following steps:

[0133] Step S701: Obtain the first zoom parameters of the camera module.

[0134] In some embodiments, the first zoom parameter of the camera module can be obtained through a monitoring program. The monitoring program can be used to monitor / obtain parameters such as the running status and running information of the application.

[0135] It should be noted that the first zoom parameter can refer to the zoom magnification of the camera module. Increasing the zoom magnification will increase the focal length, and decreasing the zoom magnification will decrease the focal length. Furthermore, focal length and field of view are inversely proportional. That is, the longer the focal length, the smaller the field of view; conversely, the shorter the focal length, the larger the field of view. Therefore, increasing the zoom magnification will decrease the field of view, and vice versa. In some embodiments, a correlation can be established between the first zoom parameter and the field of view of the camera module, and the field of view corresponding to the first zoom parameter can be determined based on the first zoom parameter and the correlation. The field of view corresponding to the first zoom parameter can be used in the process of determining the position offset parameter.

[0136] Step S702: Based on the first zoom parameter, determine the second zoom parameter; the second zoom parameter is used to characterize the zoom coefficient of the driving unit in the supplementary light module, and the second zoom parameter is used to drive the driving unit to move.

[0137] In some embodiments, a correspondence between the first zoom parameter and the second zoom parameter can be preset, and based on this correspondence, the second zoom parameter corresponding to the first zoom parameter can be determined.

[0138] In some embodiments, referring to the process described above for determining the field of view corresponding to the first zoom parameter, the field of view corresponding to the second zoom parameter can be determined based on the above process. The field of view corresponding to the second zoom parameter can be applied to the process of determining the position offset parameter.

[0139] Step S703: Obtain the first target image based on the first zoom parameter and the second zoom parameter.

[0140] In some embodiments, the movement of the drive unit can be controlled by a second zoom parameter, thereby increasing the distance between the lens and the light-emitting pixels to reduce the field of view of the fill light module.

[0141] In some embodiments, a camera module can be used to acquire a first target image under the conditions of a first zoom parameter and a second zoom parameter, thereby achieving zoom focusing.

[0142] In this embodiment, the zoom parameters of the camera module and the fill light module can be linked to solve the problem of insufficient light focus when shooting with a telephoto lens or at a distance, realize the zoom focusing of the fill light module, improve the robustness of the fill light module, and make the fill light module usable at both near and far distances.

[0143] When capturing images using current exposure strategies, the exposure time is set based on ambient light parameters. A longer exposure time results in greater luminous flux, potentially leading to a brighter overall image. However, this strategy sacrifices brightness in areas surrounding the focus point. For example, when photographing windows and curtains, the area around the curtains will be relatively dark if the focus is on the window. When shooting darker areas using current exposure strategies, the exposure time is typically increased to improve brightness in these areas and achieve a clear image. However, this increase can lead to overexposure in brighter areas compared to darker ones. For instance, when photographing curtains using current exposure strategies, the increased exposure time makes the area around the window brighter, resulting in overexposure. In this embodiment, the exposure strategy can be dynamically adjusted using a supplemental lighting strategy. For example, when shooting darker areas, there is no need to increase the exposure time, thus avoiding overexposure in brighter areas.

[0144] like Figure 8 As shown, a complete embodiment is given below:

[0145] Step S801: Obtain the first zoom parameters of the camera module.

[0146] Step S802: Determine the second zoom parameter based on the first zoom parameter.

[0147] Step S803: Obtain the first target image based on the first zoom parameter and the second zoom parameter.

[0148] Step S804: When capturing the first target image, acquire multiple reference images based on the event camera.

[0149] Step S805: Based on the multi-frame reference images, determine the motion of each object and / or the brightness change of pixels located at the same position in the multi-frame reference images.

[0150] Step S806: Based on the motion of each object and / or the brightness change of pixels at the same position in multiple reference images, perform scene segmentation processing on the first target image to obtain at least one segmented region.

[0151] Step S807: Determine the grayscale parameters of each segmented region in at least one segmented region.

[0152] Step S808: Determine the target segmentation region based on the grayscale parameters of each segmentation region.

[0153] Step S809: Determine reference brightness parameters based on the target grayscale parameters of the target segmentation region and the preset correlation relationship.

[0154] Step S810: Based on the target adjustment parameters, the reference brightness parameters are adjusted to obtain the target brightness parameters.

[0155] Step S811: Determine the target color temperature parameters based on the reference color temperature parameters of ambient light.

[0156] Step S812: Based on the target color temperature parameters and target brightness parameters, supplementary lighting is applied to the target objects contained in the target segmentation region.

[0157] like Figure 9 As shown, the implementation process of this disclosure will be described below in conjunction with multiple processing units:

[0158] Figure 9The system includes a camera module, an event camera, a supplementary lighting unit, and a display screen. The camera module corresponds to an image processing unit, the event camera to an event processing unit, the supplementary lighting unit to a supplementary lighting drive unit, and the display screen to a display processing engine. The camera module captures a first target image, and the event camera acquires multiple frames during the capture process. The image processing unit processes the first target image (e.g., preliminary image processing, filtering), and the event processing unit quickly captures objects or pixels that change between multiple frames and segments them into independent event streams. Further processing and analysis of the event streams identify different objects or regions. The image processing unit and the event processing unit then input their processing results into an image processing system. Based on the input processing results and a preset scene segmentation algorithm, the image processing system performs scene segmentation on the first target image to determine the target segmentation region. In addition, the image processing system can identify the lighting scene of the first target image, determine the lighting intensity based on the identified lighting scene and target segmentation region, and send the lighting intensity to the lighting driving unit. The lighting driving unit will then control the lighting module to apply lighting to the target object contained in the target segmentation region based on the lighting intensity. The display processing engine can send the image after lighting is completed to the display screen, which can then display the image.

[0159] Figure 10 This is a block diagram illustrating a supplementary lighting device according to an exemplary embodiment, configured in an electronic device, see [link to relevant documentation]. Figure 10 The device includes:

[0160] Processing module 1001 is configured to perform scene segmentation processing on the first target image to obtain at least one segmented region; the first target image is an image captured by the camera module;

[0161] The determining module 1002 is configured to determine a target segmentation region within at least one segmentation region; the target segmentation region is the segmentation region to be supplemented with light.

[0162] The supplementary lighting module 1003 is configured to provide supplementary lighting for the target object contained in the target segmentation region.

[0163] In some embodiments, the determining module 1002 is configured to:

[0164] Determine the grayscale parameter of each segmentation region in at least one segmentation region. The grayscale parameter of the segmentation region is used to characterize the grayscale value of the pixel corresponding to the segmentation region.

[0165] The target segmentation region is determined based on the grayscale parameters of each segmentation region.

[0166] In some embodiments, the supplementary lighting module 1003 is configured as follows:

[0167] Based on the target grayscale parameters of the target segmentation region, supplementary lighting is applied to the target objects contained in the target segmentation region.

[0168] In some embodiments, the supplementary lighting module 1003 is configured as follows:

[0169] The target brightness parameter is determined based on the target grayscale parameter and the target adjustment parameter; the target adjustment parameter includes the target scene and / or ambient light brightness parameter, the target scene is used to characterize the supplementary lighting scene corresponding to the first target image, and the target brightness parameter is used to indicate the supplementary lighting intensity of the target segmentation region;

[0170] Based on the target brightness parameters, supplementary lighting is applied to the target objects contained in the target segmentation region.

[0171] In some embodiments, the supplementary lighting module 1003 is configured as follows:

[0172] Based on the target grayscale parameters and the preset correlation, the reference brightness parameters are determined; the preset correlation is used to characterize the correlation between the grayscale parameters and the brightness parameters.

[0173] Based on the target adjustment parameters, the reference brightness parameters are adjusted to obtain the target brightness parameters.

[0174] In some embodiments, the target brightness parameters include brightness parameters of a plurality of first pixels, wherein the first pixels are pixels corresponding to the target segmentation region in the first target image, and the supplementary lighting module 1003 is configured to:

[0175] Determine the second pixel corresponding to each first pixel; the second pixel is a pixel in the second target image, the second target image is the image corresponding to the liquid crystal pixel layer in the supplementary light module, and the liquid crystal pixel layer includes light-emitting pixels corresponding to the pixels in the second target image;

[0176] Based on the target brightness parameters, adjust the brightness of the light-emitting pixel corresponding to each second pixel point;

[0177] Based on the adjusted brightness of each luminous pixel, supplemental lighting is applied to the target object contained in the target segmentation region.

[0178] In some embodiments, the supplementary lighting module 1003 is configured as follows:

[0179] Determine the first position parameter for each first pixel;

[0180] Based on each first position parameter and position offset parameter, a second position parameter corresponding to each first position parameter is determined; the position offset parameter is used to characterize the position offset between the pixel corresponding to the image captured by the camera module and the pixel corresponding to the image of the liquid crystal pixel layer at the same position in the shooting environment.

[0181] Each pixel corresponding to a second position parameter in the second target image is determined as a second pixel.

[0182] In some embodiments, the supplementary lighting module 1003 is configured as follows:

[0183] Based on the reference color temperature parameters of ambient light, the target color temperature parameters are determined; the target color temperature parameters are used to characterize the color temperature of the light source in the supplementary lighting module.

[0184] Based on the target color temperature parameters and target brightness parameters, supplementary lighting is applied to the target objects contained in the target segmentation region.

[0185] In some embodiments, the processing module 1001 is configured to:

[0186] While capturing the first target image, multiple reference images are acquired based on the event camera, and the reference images include at least one object;

[0187] Based on multiple reference images, determine the motion of each object and / or the brightness change of pixels at the same position in the multiple reference images;

[0188] Based on the motion of each object and / or the brightness changes of pixels at the same position in multiple reference images, scene segmentation processing is performed on the first target image to obtain at least one segmented region, and the segmented region includes at least one object.

[0189] In some embodiments, when the target segmentation region includes the human eye region, the supplementary lighting module 1003 is configured to:

[0190] Determine the human eye region within the target segmentation region;

[0191] Fill light on the target object in the segmented region excluding the human eye region.

[0192] In some embodiments, the processing module 1001 is configured to:

[0193] Obtain the first zoom parameter of the camera module;

[0194] Based on the first zoom parameter, the second zoom parameter is determined; the second zoom parameter is used to characterize the zoom coefficient of the driving unit in the supplementary light module, and the second zoom parameter is used to drive the movement of the driving unit.

[0195] The first target image is acquired based on the first zoom parameter and the second zoom parameter.

[0196] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0197] This disclosure also provides an electronic device, including: a processor; a memory for storing processor-executable instructions; a camera module and a lighting module; the camera module is configured to capture images; the lighting module is configured to provide lighting for objects contained in segmented regions of the images captured by the camera module; wherein the processor is configured to execute the lighting method in the above embodiments.

[0198] In some embodiments, the supplementary lighting module includes a light source, a liquid crystal pixel layer, a driving unit, and a lens; the light source is configured to emit illumination light; the liquid crystal pixel layer is configured to provide pixel-level illumination conditions; the lens is configured to focus the illumination light; and the driving unit is configured to drive the lens to change the field of view of the illumination light.

[0199] Figure 11 This is a block diagram of an electronic device 1100 according to an exemplary embodiment.

[0200] Reference Figure 11 The electronic device 1100 may include one or more of the following components: a processing component 1102, a memory 1104, a power supply component 1106, a multimedia component 1108, an audio component 1110, an input / output (I / O) interface 1112, a sensor component 1114, and a communication component 1116.

[0201] Processing component 1102 typically controls the overall operation of electronic device 1100, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 1102 may include one or more processors 1120 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 1102 may include one or more modules to facilitate interaction between processing component 1102 and other components. For example, processing component 1102 may include a multimedia module to facilitate interaction between multimedia component 1108 and processing component 1102.

[0202] Memory 1104 is configured to store various types of data to support the operation of electronic device 1100. Examples of such data include instructions for any application or method operating on electronic device 1100, contact data, phonebook data, messages, pictures, videos, etc. Memory 1104 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, or optical disk.

[0203] Power supply component 1106 provides power to various components of electronic device 1100. Power supply component 1106 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 1100.

[0204] Multimedia component 1108 includes a screen that provides an output interface between the electronic device 1100 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 1108 includes a front-facing camera and / or a rear-facing camera. When the electronic device 1100 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0205] Audio component 1110 is configured to output and / or input audio signals. For example, audio component 1110 includes a microphone (MIC) configured to receive external audio signals when electronic device 1100 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 1104 or transmitted via communication component 1116. In some embodiments, audio component 1110 also includes a speaker for outputting audio signals.

[0206] I / O interface 1112 provides an interface between processing component 1102 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0207] Sensor assembly 1114 includes one or more sensors for providing state assessments of various aspects of electronic device 1100. For example, sensor assembly 1114 may detect the on / off state of electronic device 1100, the relative positioning of components such as the display and keypad of electronic device 1100, changes in position of electronic device 1100 or a component of electronic device 1100, the presence or absence of user contact with electronic device 1100, the orientation or acceleration / deceleration of electronic device 1100, and temperature changes of electronic device 1100. Sensor assembly 1114 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1114 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 1114 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0208] Communication component 1116 is configured to facilitate wired or wireless communication between electronic device 1100 and other devices. Electronic device 1100 can access wireless networks based on communication standards, such as WiFi, 2G, or 3G, or combinations thereof. In one exemplary embodiment, communication component 1116 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 1116 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0209] In an exemplary embodiment, the electronic device 1100 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0210] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 1104 including instructions, which can be executed by a processor 1120 of an electronic device 1100 to perform the above-described method. For example, the non-transitory computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0211] A non-transitory computer-readable storage medium, when the instructions in the storage medium are executed by a processor of an electronic device, enables the electronic device to perform the supplementary lighting method provided in exemplary embodiments of this disclosure.

[0212] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0213] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A method of light supplementation, characterized in that, The method comprises the following steps: performing scene segmentation on a first target image to obtain at least one segmentation region; the first target image is an image captured by a camera module; determining a target segmentation region in the at least one segmentation region; the target segmentation region is a segmentation region to be lighted; lighting a target object contained in the target segmentation region.

2. The light supplementing method according to claim 1, wherein, The method further comprises the following steps: determining a gray parameter of each segmentation region in the at least one segmentation region; the gray parameter of the segmentation region is used to represent a gray value of a pixel corresponding to the segmentation region; determining the target segmentation region based on the gray parameter of each segmentation region.

3. The light supplementing method according to claim 2, wherein, The method further comprises the following steps: lighting the target object contained in the target segmentation region based on a target gray parameter of the target segmentation region.

4. The light supplementing method according to claim 3, wherein, The method further comprises the following steps: determining a target brightness parameter based on the target gray parameter and a target adjustment parameter; the target adjustment parameter comprises a target scene and / or an ambient light brightness parameter; the target scene is used to represent a lighting scene corresponding to the first target image; the target brightness parameter is used to indicate a lighting intensity of the target segmentation region; lighting the target object contained in the target segmentation region based on the target brightness parameter.

5. The light supplementing method according to claim 4, wherein, The method further comprises the following steps: determining a reference brightness parameter based on the target gray parameter and a preset correlation; the preset correlation is used to represent a correlation between a gray parameter and a brightness parameter; adjusting the reference brightness parameter based on the target adjustment parameter to obtain the target brightness parameter.

6. The light supplementing method according to claim 4, wherein, The target brightness parameter comprises brightness parameters of a plurality of first pixels; the first pixels are pixels corresponding to the target segmentation region in the first target image; the method further comprises the following steps: determining a second pixel corresponding to each first pixel; the second pixel is a pixel in a second target image; the second target image is an image corresponding to a liquid crystal pixel layer in a lighting module; the liquid crystal pixel layer comprises a light-emitting pixel corresponding to the pixel in the second target image; adjusting a brightness of the light-emitting pixel corresponding to each second pixel based on the target brightness parameter; lighting the target object contained in the target segmentation region based on the brightness of each adjusted light-emitting pixel.

7. The light supplementing method according to claim 6, wherein, The method further comprises the following steps: determining a first position parameter of each first pixel; determining a second position parameter corresponding to each first position parameter based on each first position parameter and a position offset parameter; the position offset parameter is used to represent a position offset between a pixel corresponding to an image captured by the camera module and a pixel corresponding to an image corresponding to the liquid crystal pixel layer in a same position in a shooting environment. Determine each second pixel point in the second target image corresponding to each second position parameter as a second pixel point.

8. The light supplementing method according to claim 4, wherein, The light compensation module is configured to compensate light for a target object contained in the target segmentation region based on the target brightness parameter. Determine a target color temperature parameter based on a reference color temperature parameter of ambient light; the target color temperature parameter is used to represent the color temperature of a light source in the light compensation module; Compensate light for a target object contained in the target segmentation region based on the target color temperature parameter and the target brightness parameter.

9. The light supplementing method of claim 1, wherein, The scene segmentation processing of the first target image comprises: When the target segmentation region comprises an eye region, the light compensation for the target object contained in the target segmentation region comprises: Determine the eye region in the target segmentation region; Compensate light for a target object contained in the target segmentation region except the eye region.

10. The light supplementing method of claim 1, wherein, The method further comprises: Obtain a first zoom parameter of the camera module; Determine a second zoom parameter based on the first zoom parameter; the second zoom parameter is used to represent the zoom coefficient of a driving unit in the light compensation module, and the second zoom parameter is used to drive the driving unit to move; 11. The light supplementing method of claim 1, wherein, Obtain the first target image based on the first zoom parameter and the second zoom parameter. Comprise: A processing module configured to perform scene segmentation processing on a first target image to obtain at least one segmentation region; The first target image is an image captured by a camera module; 12. A light supplementing device, characterized in that A determination module configured to determine a target segmentation region in the at least one segmentation region; the target segmentation region is a segmentation region to be compensated for light; A light compensation module configured to compensate light for a target object contained in the target segmentation region. Comprise: A processor; A memory for storing processor-executable instructions; 13. An electronic device, comprising: A camera module and a light compensation module; The camera module is configured to capture images; The light compensation module is configured to compensate light for an object contained in a segmentation region in the image captured by the camera module; The processor is configured to execute the light compensation method according to any one of claims 1-11. The light compensation module comprises a light source, a liquid crystal pixel layer, a driving unit and a lens; The light source is configured to emit illuminating light; The liquid crystal pixel layer is configured to provide pixel-level light conditions; 14. The electronic device of claim 13, wherein, The lens is configured to focus the illuminating light; The driving unit is configured to drive the lens to change the field of view angle of the illuminating light. ​ ​ ​ 15. A non-transitory computer-readable storage medium, comprising: When the instructions in the storage medium are executed by the processor of the electronic device, the electronic device is enabled to perform the light supplementing method as claimed in any one of claims 1-11.

Images