Determination of an illumination portion

Abstract

According to one embodiment, an apparatus includes an optical camera sensor, an event camera sensor, and a computing unit. The optical camera sensor can capture an image of a target region, the event camera sensor can detect one or more events in the target region. Each event can correspond to a temporal change in illumination at a certain location within the target region. The computing unit can segment the image into two or more parts according to a spatial distribution of one or more flicker frequencies within the target region. An apparatus, method, and computer program are described.

Description

Technical Field

[0001] This invention relates to a device, and more specifically, to a device including an optical camera sensor. Furthermore, this invention relates to corresponding methods and computer programs. Background Technology

[0002] In image color correction processing, understanding illumination and determining multiple illuminations can be an important and challenging task. Knowing the illumination and true color of an object can improve image quality. Summary of the Invention

[0003] The present invention is provided to introduce, in a simplified form, some concepts further described in the following detailed description. The summary is not intended to identify key or essential features of the claimed subject matter, nor is it intended to limit the scope of the claimed subject matter.

[0004] The object of this invention is to provide a method for determining a device and a lighting component. This object is achieved through the features of the independent claims. Further implementation methods are provided in the dependent claims, the specification, and the drawings.

[0005] According to a first aspect, an apparatus includes: an optical camera sensor for: capturing an image of a target region; an event camera sensor for: detecting one or more events in the target region, wherein each of the one or more events corresponds to a temporal change in illuminance at a location within the target region; and a computing unit coupled to the optical camera sensor and the event camera sensor for: determining a spatial distribution of one or more flicker frequencies in the target region based on the one or more events detected by the event sensor; and segmenting the image into two or more parts based on the spatial distribution of the one or more flicker frequencies in the target region. For example, the apparatus can segment the image based on the illumination type in different parts of the image.

[0006] In one implementation of the first aspect, the event camera sensor is used to asynchronously detect the one or more events in the target area. For example, the device can detect the one or more flicker frequencies with higher bandwidth.

[0007] In another implementation of the first aspect, the event camera sensor is used to detect an event among the one or more events in response to a temporal change in illuminance at the location of the event exceeding a pre-configured temporal contrast threshold. For example, the device can efficiently determine the one or more flicker frequencies.

[0008] In another implementation of the first aspect, the computing unit is further configured to: determine one or more lighting sources in the target area and the positions of the one or more lighting sources based on the one or more flicker frequencies; and segment the image into the two or more parts based on the determined one or more lighting sources. For example, the device can determine the type of lighting source in the area and use the information to perform image segmentation.

[0009] In another implementation of the first aspect, the computing unit is configured to determine the one or more lighting sources in the target area based on the one or more flashing frequencies by comparing the one or more flashing frequencies with one or more pre-configured frequency values. For example, the device can determine the type of lighting source with higher precision.

[0010] In another implementation of the first aspect, the device further includes a memory coupled to the computing unit, the computing unit being configured to store the image and information indicating the segmentation of the image in the memory. For example, the device can use the image and the information to perform color correction on the image.

[0011] According to a second aspect, a method includes: capturing an image of a target region; detecting one or more events in the target region, wherein each of the one or more events corresponds to a temporal change in illuminance at a location within the target region; determining a spatial distribution of one or more flicker frequencies in the target region based on the detected one or more events; and segmenting the image into two or more parts based on the spatial distribution of the one or more flicker frequencies in the target region. For example, the method can segment the image based on the type of illumination in different parts of the image.

[0012] In one implementation of the second aspect, the one or more events in the target region are detected asynchronously. For example, the method can detect the one or more flicker frequencies with higher bandwidth.

[0013] In another implementation of the second aspect, an event among the one or more events is detected in response to a temporal change in illuminance at the location of the event exceeding a pre-configured temporal contrast threshold. For example, the method can efficiently determine the one or more flicker frequencies.

[0014] In another implementation of the second aspect, the method further includes: determining one or more lighting sources in the target area and their positions based on the one or more flicker frequencies; and segmenting the image into the two or more parts based on the determined one or more lighting sources. For example, the method can determine the type of lighting source in the area and use the information to perform image segmentation.

[0015] In another implementation of the second aspect, determining the one or more lighting sources in the target area based on the one or more flicker frequencies includes comparing the one or more flicker frequencies with one or more pre-configured frequency values. For example, this method can determine the type of lighting source with higher accuracy.

[0016] In another implementation of the second aspect, the method further includes storing the image and information indicating the segmentation of the image in a memory. For example, the method can use the image and the information to perform color correction on the image.

[0017] According to a third aspect, a computer program is provided, the computer program including program code, which, when executed on a computer, is used to perform the method according to the second aspect.

[0018] Many of the accompanying features will become more readily understood, and thus more readily comprehended, with reference to the following detailed description taken in conjunction with the accompanying drawings. Attached Figure Description

[0019] This specification will be better understood by referring to the following detailed embodiments with reference to the accompanying drawings, wherein:

[0020] Figure 1 A schematic diagram of a device provided in one embodiment is shown;

[0021] Figure 2 A schematic diagram of a computing unit provided in one embodiment is shown;

[0022] Figure 3 A schematic diagram of a DAVIS pixel provided in one embodiment is shown;

[0023] Figure 4 A schematic diagram of an image and a blinking pattern provided in one embodiment is shown;

[0024] Figure 5 A schematic diagram of a segmented image provided in one embodiment is shown;

[0025] Figure 6 A schematic diagram of a photocurrent signal provided in one embodiment is shown;

[0026] Figure 7 A schematic diagram of a luminance signal provided in one embodiment is shown;

[0027] Figure 8 A schematic diagram of an event signal provided in one embodiment is shown;

[0028] Figure 9 A schematic diagram of an event differential signal provided in one embodiment is shown;

[0029] Figure 10 A schematic diagram of a noisy photocurrent signal and corresponding event provided in one embodiment is shown;

[0030] Figure 11 A flowchart of a method provided in one embodiment is shown.

[0031] In the accompanying drawings, the same reference numerals are used to denote the same parts. Detailed Implementation

[0032] The specific embodiments provided below with reference to the accompanying drawings are intended to illustrate various examples and are not intended to represent the only ways in which the embodiments can be constructed or used. However, the same or equivalent functions and structures can be implemented through different embodiments.

[0033] Figure 1 A schematic diagram of a device 100 provided in one embodiment is shown.

[0034] According to one embodiment, the device 100 includes an optical camera sensor 102. The optical camera sensor 102 can be used to capture images of a target area.

[0035] The optical camera sensor 102 can also be referred to as an optical camera, camera, camera sensor, etc.

[0036] The optical camera sensor 102 may include multiple pixels.

[0037] The device 100 may further include an event camera sensor 103. The event camera 103 may be used to detect one or more events in the target area. Each of the one or more events may correspond to a temporal change in illuminance at a certain location within the target area.

[0038] The event camera sensor 103 can also be referred to as an event camera, neuromorphic camera, silicon retina, dynamic vision sensor (DVS), etc.

[0039] The event camera sensor 103 may include an imaging sensor that responds to local brightness / illuminance changes. The event camera sensor 103 may include multiple pixels. Each pixel of the event camera sensor 103 can operate independently and asynchronously.

[0040] The event camera sensor 103 may include a temporal contrast sensor. The temporal contrast sensor can generate events indicating polarity (increase or decrease in brightness). Alternatively or additionally, the event camera sensor 103 may include a temporal image sensor. The temporal image sensor can indicate the instantaneous intensity of each event. Alternatively or additionally, the event camera sensor 103 may include a dynamic and active-pixel vision sensor (DAVIS). In addition to a dynamic vision sensor sharing the same light sensor array, the DAVIS may also include a global shutter active pixel sensor (APS).

[0041] The event camera sensor 103 can be used to asynchronously detect one or more events in the target area.

[0042] The device 100 may further include a computing unit 101. The computing unit 101 may be configured to determine the spatial distribution of one or more flicker frequencies in the target area based on the one or more events detected by the event sensor. The computing unit 101 may also be configured to segment the image into two or more parts based on the spatial distribution of the one or more flicker frequencies in the target area.

[0043] The computing unit 101 can use various algorithms to analyze the event. For example, the computing unit 101 can use machine learning / deep learning or any other method (e.g., the method disclosed herein) to detect the flickering frequency.

[0044] For example, the optical camera sensor 102 and / or the event camera sensor 103 may be electrically coupled to the computing unit 101. For example, the components 101 to 103 may be connected via a data bus. For example, the optical camera sensor 102 may provide images to the computing unit 101 via the data bus; and / or the event camera sensor 103 may provide the one or more events to the computing unit 101 via the data bus. Alternatively, the components 101 to 103 may be coupled in other ways (e.g., wirelessly).

[0045] The device 100 may also include Figure 1 Other components and / or parts not shown in the embodiments.

[0046] The device 100 can be used to capture video. The images can correspond to frames of the video. The device 100 can be used to perform any of the operations disclosed herein for each frame of the video.

[0047] For example, the device 100 may be located in a camera, mobile phone, tablet computer, or computer (e.g., laptop computer).

[0048] Figure 2 A schematic diagram of a computing unit 101 provided in one embodiment is shown.

[0049] The computing unit 101 may include a processor 201. The computing unit 101 may also include a memory 202.

[0050] In some embodiments, at least some components of the device 100 may be implemented as a system on a chip (SoC). For example, the processor 201, the memory 202, and / or other components of the computing unit 101 may be implemented using a field-programmable gate array (FPGA).

[0051] The components of the device 100 (e.g., the processor 201 and the memory 202) may not be discrete components. For example, if the device 100 is implemented using a SoC, the components may correspond to different units of the SoC.

[0052] For example, the processor 201 may include one or more of various processing devices (e.g., coprocessor, microprocessor, controller, digital signal processor (DSP), processing circuitry with or without an accompanying DSP) or various other processing devices including integrated circuits (e.g., application-specific integrated circuit (ASIC), field-programmable gate array (FPGA), microcontroller unit (MCU), hardware accelerator, dedicated computer chip, etc.).

[0053] For example, the memory 202 can be used to store computer programs, etc. The memory 202 may include one or more volatile memory devices, one or more non-volatile memory devices, and / or a combination of one or more volatile memory devices and non-volatile memory devices. For example, the memory 202 can be implemented as a magnetic storage device (e.g., hard disk drive, floppy disk, magnetic tape, etc.), an optical-magnetic storage device, and a semiconductor memory (e.g., mask ROM, programmable ROM (PROM), erasable PROM (EPROM), flash memory ROM, random access memory (RAM), etc.).

[0054] The functions described herein can be implemented by various components of the device 100. For example, the memory 202 may include program code for performing any of the functions disclosed herein; the processor 201 may be used to perform the functions according to the program code included in the memory 202.

[0055] When the device 100 is used to implement a certain function, one and / or some components of the device 100 (e.g., the one or more processors 201 and / or the memory 202) can be used to implement that function. Furthermore, when the one or more processors 201 are used to implement a certain function, that function can be implemented using program code included in the memory 202, etc. For example, if the device 100 is used to perform an operation, the one or more memories 202 and the computer program code can be used together with the one or more processors 201 to enable the device 100 to perform that operation.

[0056] Figure 3 A schematic diagram of a DAVIS pixel 300 provided in one embodiment is shown.

[0057] For example, the event camera sensor 103 may include a plurality of DAVIS pixels 300. Alternatively, the pixels of the event camera sensor 103 may be implemented in other ways.

[0058] The output of the event camera sensor 103 may include a variable data rate sequence of digital events. For example, these events may be provided by a comparator 301 of the DAVIS pixel 300. Each event may represent a change in brightness (logarithm of intensity) of a pixel at a predefined size at a specific time.

[0059] Each pixel in the event camera sensor 103 can record brightness each time an event is sent. Then, each pixel can continuously monitor changes of a sufficiently large size.

[0060] In this document, "brightness" can refer to the logarithm of light intensity. For example, the light intensity can be measured as illuminance, radiant intensity, luminous intensity, or irradiance. When the brightness change exceeds a threshold, the event camera sensor 103 can send an event. The event may include the event's... Location, time of the event and the polarity of the event The polarity can be represented by a single bit value. For example, if the change corresponds to an increase in brightness, the bit can be 1; if the change corresponds to a decrease in brightness, the bit can be 0, and vice versa.

[0061] The event camera sensor 103 can be used to detect an event in one or more events in response to a time change in illuminance at the location of the event that is greater than a pre-configured time contrast threshold.

[0062] Figure 4 A schematic diagram of image 401 and blinking image 402 provided in one embodiment is shown.

[0063] The flicker pattern 402 can correspond to the target area of ​​the image 401. The image can be acquired from the optical camera sensor 102. The flicker pattern 402 can be acquired based on events from the event camera sensor 103.

[0064] Artificial light sources such as LEDs and fluorescent lamps produce light as a periodic signal. Therefore, when this light is observed using the event camera sensor 103, the intensity of the light exhibits a certain periodicity, meaning that the light has a flicker frequency. Different light sources can have different flicker frequencies. Therefore, by determining the flicker frequency, the type of light source can be determined. Sunlight does not have a periodic signal and therefore does not flicker.

[0065] The calculation unit 101 can determine the various lighting sources in the area of ​​the image 401 based on the flicker frequency of the various lighting sources.

[0066] For example, in Figure 4 In this embodiment, artificial light in the region of image 401 can be observed as flickering in the flicker pattern 402. The flicker pattern 402 can indicate which parts of the target region are under flickering / artificial illumination.

[0067] Figure 4 The image 401 shown in the embodiment includes multiple illumination sources, such as sunlight and artificial light. For example, the artificial light may originate from an LED. Positions in the image 401 under specific illumination can be detected based on the flicker pattern 402.

[0068] Figure 5 A schematic diagram of a segmented image 500 provided in one embodiment is shown.

[0069] Figure 5 The segmented image 500 shown in the embodiment can correspond to Figure 4 Image 401 is shown in the embodiment.

[0070] exist Figure 5 In this embodiment, the image has been segmented into three parts. Two parts 501 correspond to natural light illumination, and one part 502 corresponds to artificial light illumination. By comparing the segmented image 500 with... Figure 4 A comparison of the flicker patterns 402 in the embodiments shows that the portion 502 under the artificial light illumination corresponds to the flickering portion in the flicker pattern 402.

[0071] The calculation unit 101 can also be used to: determine one or more lighting sources in the target area and the positions of the one or more lighting sources according to the one or more flashing frequencies; and segment the image into the two or more parts according to the determined one or more lighting sources.

[0072] The calculation unit 101 can be used to: determine the one or more lighting sources in the target area based on the one or more flashing frequencies by comparing the one or more flashing frequencies with one or more pre-configured frequency values.

[0073] For example, the memory 202 may include one or more pre-configured frequency values. For example, the one or more pre-configured frequency values ​​may include one or more known flicker frequencies of a specific type of lighting source (e.g., LED or fluorescent lamp) among various lighting sources.

[0074] The device 100 may further include a memory 202 coupled to the computing unit 101. The computing unit 101 may also be used to store the image and information indicating the segmentation of the image in the memory 202. For example, the image and the information indicating the segmentation of the image may be stored in a single file. For example, the file may later be used for color correction of the image.

[0075] Figure 6 A schematic diagram of a photocurrent signal provided in one embodiment is shown.

[0076] Figure 6The embodiment illustrates a first photocurrent signal 601 and a second photocurrent signal 602. The photocurrent signals (601, 602) may correspond to the photocurrent in a pixel of the event camera sensor 103. The photocurrent signals may be proportional to the intensity of light incident on the photodetector.

[0077] exist Figure 6 In an exemplary embodiment, the flicker frequency of the first photocurrent signal 601 is greater than the flicker frequency of the second photocurrent signal 602.

[0078] The first photocurrent signal 601 and the second photocurrent signal 602 can be generally sinusoidal. For example, the photocurrent signals (601, 602) can correspond to artificial lighting such as fluorescent lamps or LED lamps.

[0079] Fluorescent lamps can flicker at a frequency of approximately 120 Hz. LED lights may flicker more noticeably, as they may flicker between 10% and 100% of their maximum brightness, while fluorescent lights may dim to about 35% before returning to 100%.

[0080] The pixels of the event camera sensor 103 can have a limited bandwidth. If the incident light intensity changes too rapidly, the front-end photosensitive circuitry can filter out these changes. The rise and fall times, similar to the exposure time of a standard image sensor, are the reciprocals of this bandwidth. Above a certain cutoff frequency, these changes can be filtered out by photosensitive dynamics, and the number of events per cycle may be reduced. The cutoff frequency can be a monotonically increasing function of light intensity. At brighter light intensities, the DVS pixel bandwidth can be approximately 3 kHz, equivalent to an exposure time of approximately 300 microseconds (µs). At a 1000-fold reduction in intensity, the DVS bandwidth can be reduced to approximately 300 Hz.

[0081] Figure 7 A schematic diagram of a luminance signal provided in one embodiment is shown.

[0082] Figure 7 The embodiment illustrates a first luminance signal 701 and a second luminance signal 702. The first luminance signal 701 may correspond to... Figure 6 The embodiment shows a first photocurrent signal 601. The second luminance signal 702 can correspond to... Figure 6 The second photocurrent signal 602 is shown in the embodiment. The brightness can be proportional to the logarithm of the photocurrent / light intensity.

[0083] Since the light intensity and photocurrent of the light source are positive periodic functions, the logarithm of these functions is also a positive periodic function:

[0084]

[0085] Figure 8 A schematic diagram of an event signal provided in one embodiment is shown.

[0086] Figure 8 The embodiment illustrates a first event signal 801 and a second event signal 802. The first event signal 801 may correspond to... Figure 7 The embodiment shows a first luminance signal 701. The second event signal 802 may correspond to... Figure 7 The second luminance signal 702 is shown in the embodiment.

[0087] In the absence of noise, it can be done at the pixel level. and time Triggered event In response to the last event since the pixel reached the temporal contrast threshold, Brightness increment since . It can be a positive or negative value. Alternatively, it can be... absolute value and Compare them. Indicates the polarity of the event. It is from the same pixel The time elapsed since the last event.

[0088] The first event signal 801 and the second event signal 802 include event 803. Each event 803 may correspond to a brightness change in the corresponding brightness signal (701, 702) reaching the time contrast threshold. The time interval.

[0089] According to one embodiment, the computing unit 101 is configured to determine the one or more flashing frequencies based on event signals acquired from the event camera sensor 103. The event signals may include the one or more events.

[0090] Since the time distribution of event 803 can be proportional to the flashing frequency of the brightness signals (701, 702), the flashing frequency of the brightness signals (701, 702) can be derived from the event signals (801, 802).

[0091] Figure 9 A schematic diagram of an event differential signal provided in one embodiment is shown.

[0092] Figure 9 The embodiment illustrates a first event differential signal 901 and a second event differential signal 902. The first event differential signal 901 may correspond to... Figure 8 The embodiment illustrates a first event signal 801. The second event differential signal 902 can correspond to... Figure 8 The embodiment illustrates a second event signal 802. The first event differential signal 901 can be obtained by differentially analyzing the first event signal 801. The second event differential signal 902 can be obtained by differentially analyzing the second event signal 802.

[0093] The event differential signals (901, 902) include a peak value 903. One or more of the peak values ​​903 may correspond to event 803. Therefore, the calculation unit 101 can calculate the flicker frequency of the brightness signals (701, 702) based on the time distribution of the peak values ​​903 in the event differential signals (901, 902).

[0094] According to one embodiment, the calculation unit 101 is configured to obtain an event differential signal by differentially analyzing the event signal. The calculation unit 101 can then determine the one or more flashing frequencies based on the event differential signal.

[0095] Figure 10 A schematic diagram of a noisy photocurrent signal and corresponding event provided in one embodiment is shown.

[0096] Compared with the disclosed embodiments above, Figure 10 The embodiment can be adapted to noisier conditions. Due to noise, multiple events can be triggered in the event camera sensor 103 within a single cycle of the photocurrent signal 1001.

[0097] For example, from Figure 10 As can be seen from the embodiments, when the photocurrent signal 1001 gradually increases, multiple positive events 1002 are triggered. Similarly, when the photocurrent signal 1001 gradually decreases, multiple negative events 1003 are triggered. Positive events may correspond to an increase in brightness and / or event polarity, and negative events may correspond to a decrease in brightness and / or event polarity.

[0098] Due to noise, events can also be triggered even when brightness remains constant. For example, in Figure 10 In this embodiment, an event is triggered even if the photocurrent signal 1001 remains unchanged. When the photocurrent signal 1001 is substantially zero, in Figure 10 In the embodiments, positive noise event 1004 and negative noise event 1005 can be observed. Furthermore, when the signal 1001 increases, negative noise event 1005 can be observed; when the signal 1001 decreases, positive noise event 1004 can be observed.

[0099] The computing unit 101 can be used to filter the events to remove noise events. Alternatively, the computing unit 101 can use other processes (e.g., machine learning) to reduce the impact of the noise events when determining the one or more flicker frequencies.

[0100] Figure 11 A flowchart of a method 1100 provided in one embodiment is shown.

[0101] According to one embodiment, the method 1100 includes capturing (1101) an image of the target region.

[0102] The method 1100 may further include: detecting (1102) one or more events in the target area, wherein each of the one or more events corresponds to a time change in illuminance at a location within the target area.

[0103] The method 1100 may further include: determining (1103) the spatial distribution of one or more flicker frequencies in the target region based on the detected one or more events.

[0104] The method 1100 may further include: segmenting (1104) the image into two or more parts according to the spatial distribution of one or more flicker frequencies in the target area.

[0105] According to one embodiment, one or more events in the target region are detected asynchronously.

[0106] According to one embodiment, an event among the one or more events is detected in response to a time change in illuminance at the location of the event being greater than a pre-configured time contrast threshold.

[0107] According to one embodiment, the method 1100 further includes: determining one or more lighting sources in the target area and the positions of the one or more lighting sources according to the one or more flicker frequencies; and segmenting the image into the two or more parts according to the determined one or more lighting sources.

[0108] According to one embodiment, determining the one or more lighting sources in the target area based on the one or more flashing frequencies includes: comparing the one or more flashing frequencies with one or more pre-configured frequency values.

[0109] According to one embodiment, the method 1100 further includes storing the image and information indicating the segmentation of the image in a memory.

[0110] The method 1100 can be performed by the device 100. For example, the optical camera sensor 102 can be used to perform the operation 1101. Additionally or alternatively, the event camera sensor 103 can be used to perform the operation 1102. Additionally or alternatively, the computing unit 101 can be used to perform the operations (1103, 1104).

[0111] When the computer program product is executed on a computer, at least some of the operations of the method 1100 can be performed by the computer program product.

[0112] Although the subject matter of the invention has been described in language specific to structural features and / or methodological actions, it should be understood that the subject matter defined in the claims is not necessarily limited to the specific features or actions described above. Rather, the specific features and actions described above are disclosed as embodiments of the claims, and other equivalent features and actions are intended to be included within the scope of the claims.

[0113] The functions described herein may be performed at least in part by one or more computer program product components (e.g., software components). Alternatively or additionally, the functions described herein may be performed at least in part by one or more hardware logic components. For example, but not limited to, exemplary types of hardware logic components that may be used include Field-programmable Gate Arrays (FPGAs), Application-specific Integrated Circuits (ASICs), Application-specific Standard Products (ASSPs), System-on-a-chip Systems (SOCs), Complex Programmable Logic Devices (CPLDs), and Graphics Processing Units (GPUs).

[0114] It should be understood that the above advantages and benefits may relate to one embodiment or several embodiments. The embodiments are not limited to embodiments that solve any or all of the described problems, nor are they limited to embodiments that have any or all of the described advantages and benefits. Furthermore, it should be understood that a reference to "a" item may refer to one or more of these items. The term "and / or" may be used to indicate that one or more associated situations may occur, two or more associated situations may occur, or only one associated situation may occur.

[0115] The operations of the methods described herein can be performed in any suitable order, or simultaneously where appropriate. Additionally, individual blocks can be removed from any of the methods without departing from the purpose and scope of the subject matter described herein. Aspects of any of the above embodiments can be combined with aspects of any other described embodiments to form further embodiments without loss of the desired effects.

[0116] The term “comprising” is used herein to mean including identified methods, blocks or elements, but such blocks or elements do not include an exclusive list, and methods or devices may include additional blocks or elements.

[0117] It should be understood that the above description is provided by way of example only, and various modifications can be made by those skilled in the art. The foregoing specification, embodiments, and data provide a complete description of the structure and application of exemplary embodiments. Although various embodiments have been described above with a degree of specificity or in combination with one or more individual embodiments, those skilled in the art can make numerous modifications to the disclosed embodiments without departing from the spirit or scope of this specification.

Claims

1. A device (100) for determining a lighting section, characterized in that, include: Optical camera sensor (102), used for: Capture an image of the target region (401); Event camera sensor (103), used for: Detect one or more events in the target area, wherein each of the one or more events corresponds to a time change in illuminance at a certain location within the target area that is greater than a pre-configured time contrast threshold; The computing unit (101), coupled to the optical camera sensor and the event camera sensor, is used for: The one or more light sources in the target area are determined by comparing one or more flashing frequencies with one or more pre-configured frequency values, and the positions of the one or more light sources are determined by the one or more flashing frequencies, wherein the one or more flashing frequencies are proportional to the time distribution of the one or more events; The image is segmented into two or more parts (501, 502) according to the determined one or more illumination sources, the parts corresponding to the positions of the determined one or more illumination sources; and A memory, coupled to the computing unit, the computing unit also being used to store the image and information indicating the segmentation of the image in the memory.

2. The device (100) according to claim 1, characterized in that, The event camera sensor is used to asynchronously detect one or more events in the target area.

3. A method for determining an illumination component (1100), characterized in that, include: Capture an image of the target region (1101); Detect (1102) one or more events in the target area, wherein each of the one or more events corresponds to a time change in illuminance at a certain location in the target area that is greater than a pre-configured time contrast threshold; By comparing one or more flashing frequencies with one or more pre-configured frequency values, the one or more lighting sources in the target area are determined (1103) based on the one or more flashing frequencies, and the positions of the one or more lighting sources are determined (1103) based on the one or more flashing frequencies, wherein the one or more flashing frequencies are proportional to the time distribution of the one or more events; The image is segmented (1104) into two or more parts according to the determined one or more illumination sources, the parts corresponding to the positions of the determined one or more illumination sources; and The image and the information indicating the segmentation of the image are stored in the memory.

4. The method (1100) according to claim 3, characterized in that, Asynchronously detect one or more events in the target region.

5. A computer program product, characterized in that, Includes program code, which, when executed on a computer, is used to perform the method according to claim 3 or 4.

Images