A snapshot camera and a snapshot system

Abstract

The present application relates to a snapshot camera and a snapshot system. The snapshot camera includes: a control module, a fill light module, a SPAD detector module and a data processing module; the control module is used to generate a fill light timing command and send it to the fill light module, the SPAD data detector module and the data processing module synchronously; the fill light module is used to emit a fill light signal to the target area in response to the received fill light timing command; the SPAD detector module is used to obtain multiple shooting distances for the target area based on the reflection signal of the received fill light signal and the emission time of the fill light signal; the data processing module is used to obtain a data source based on multiple shooting distances and the number of photons reflected back at different shooting distances; and based on the data source, multiple color images are generated for output. The use of this application can solve the problem of poor capture effect inside the car of the existing snapshot camera when the energy reflected from the car window is much higher than the energy reflected from the car.

Description

Technical Field

[0001] The present application relates to the field of snapshot technology, and in particular to a snapshot camera and a snapshot system. Background Art

[0002] With the development of electronic technology, snapshot technology has gradually gained attention. In intelligent transportation, it is necessary to capture the situation inside the car to identify illegal behaviors inside the car. For example, at checkpoints, entrances and exits, it is necessary to capture the face of the people in the car, capture the seat belt, capture the phone call or capture the overload. The existing snapshot method mainly uses a snapshot camera to capture the situation inside the car.

[0003] Existing snapshot cameras mainly use CMOS (Complementary Metal Oxide Semiconductor) cameras. CMOS cameras are cameras based on CMOS image sensors, which can convert received light into electronic signals. When using CMOS cameras to capture images, a certain amount of charge needs to be accumulated before the image can be captured.

[0004] However, when using a CMOS camera to capture images, the vehicle windows often reflect fill light and other light from the surrounding environment (such as sunlight), resulting in the energy reflected by the windows being much higher than the energy reflected from the interior of the vehicle. In this case, the capture effect inside the vehicle is poor.

[0005] However, for existing snapshot cameras, when the energy reflected by the car windows is much higher than the energy reflected by the car interior, the problem of poor snapshot effect inside the car has not yet been effectively solved. Summary of the invention

[0006] Based on this, it is necessary to provide a snapshot camera and a snapshot system to address the above technical issues.

[0007] In a first aspect, the present application provides a snapshot camera. The snapshot camera comprises: a control module, a fill light module, a SPAD detector module and a data processing module;

[0008] The control module is used to generate a fill light timing command in response to the received snapshot command, and synchronously send the generated fill light timing command to the fill light module, the SPAD data detector module and the data processing module; the fill light timing command includes the emission time of the fill light signal;

[0009] The fill light module is configured to transmit a fill light signal to a target area in response to the received fill light timing command according to the emission time of the fill light signal in the fill light timing command;

[0010] The SPAD detector module is used to receive a reflection signal of the fill light signal in response to the received fill light timing command; and obtain multiple shooting distances for the target area based on the received reflection signal of the fill light signal and the emission time of the fill light signal;

[0011] The data processing module is used to obtain a data source combining shooting distance and photon number based on multiple shooting distances for the target area obtained by the SPAD detector module and the number of photons reflected back at different shooting distances read from the SPAD detector module; and based on the data source, generate multiple color images corresponding to different shooting distances for output.

[0012] In one embodiment, the data processing module is further used for:

[0013] Before generating a plurality of color images corresponding to different shooting distances for output based on the data source, data whose shooting distance is less than a preset distance threshold and whose photon number is greater than a preset threshold number are eliminated from the data source.

[0014] In one embodiment, the snapshot camera further includes a lens module; the lens module includes a filter switch; the filter switch includes a first filter and a second filter; the first filter is a filter suitable for daytime; the second filter is a filter suitable for nighttime;

[0015] The data processing module is also used to determine the current environment brightness information based on the multiple color images acquired; when the current environment brightness information is greater than a preset brightness threshold, control the filter switch to switch to the first filter; when the current environment brightness information is less than the preset brightness threshold, control the filter switch to switch to the second filter.

[0016] In one of the embodiments, the SPAD detector module includes a microlens unit, a filter unit and a SPAD unit;

[0017] The microlens unit is used to adjust the reflected signal of the received fill light signal to match the main light angle of the receiving lens of the snapshot camera, and transmit the adjusted reflected signal to the filtering unit;

[0018] The filtering unit is used to perform spectral filtering on the adjusted reflected signal, and then transmit it to the SPAD unit;

[0019] The SPAD unit is used to determine the number of photons counted by each pixel in the reflection signal at different times based on the received reflection signal after spectral filtering; based on the number of photons counted by each pixel in the reflection signal at different times and the emission time of the fill light signal, obtain multiple shooting distances for the target area and the number of photons counted by each pixel at different shooting distances.

[0020] In one embodiment, the microlens unit is located at the uppermost layer of the SPAD detector module, the filter unit is located at the middle layer of the SPAD detector module, and the SPAD unit is located at the lowermost layer of the SPAD detector module;

[0021] The microlens unit includes a microlens array; the filter unit includes a filter array; the SPAD unit includes a SPAD array;

[0022] The filter array is covered on each of the SPAD arrays with RGB according to a preset ratio; wherein each R corresponds to a SPAD pixel of the SPAD array; each G corresponds to a SPAD pixel of the SPAD array; each B corresponds to a SPAD pixel of the SPAD array; and each of the filter arrays is covered with a microlens array.

[0023] In one embodiment, the filter array includes a preset number of narrowband filters; each of the narrowband filters corresponds to a SPAD pixel of the SPAD array; the narrowband filter is used to perform spectral filtering on each pixel of the adjusted reflection signal to obtain a reflection signal after spectral filtering of each pixel.

[0024] In one of the embodiments, the control module is further used to determine the number of fill lights in response to the received snapshot command according to a preset coding rule, and determine the time intervals between two adjacent fill lights according to a random principle; and determine the emission time of each fill light signal based on the number of fill lights, the time intervals between two adjacent fill lights, and the emission time of the initial fill light signal; and generate the fill light timing command based on the emission time of each fill light signal.

[0025] In one of the embodiments, the SPAD detector module is further used to filter out light signals that are different from the fill light times or different from the time intervals between two adjacent fill lights from the received light signals based on the received fill light timing command.

[0026] In one of the embodiments, the lens module further includes a transmitting lens and the receiving lens;

[0027] The transmitting lens is used to shape the fill light signal emitted by the fill light module and then transmit it to the target area;

[0028] The receiving lens is used to collect the reflection signal of the fill light signal at the target area, and focus the collected reflection signal of the fill light signal to obtain a focusing signal that matches the target surface size of the SPAD detector module, and send it to the filter switch;

[0029] The filter switch is used to perform band filtering on the received focusing signal and then transmit it to the SPAD detector module.

[0030] In a second aspect, the present application further provides a snapshot system. The snapshot system comprises a snapshot trigger unit, an analysis unit and the snapshot camera described in the first aspect above;

[0031] The snapshot trigger unit is used to generate a snapshot command when the snapshot condition is met, and send the snapshot command to the control module of the snapshot camera;

[0032] The snapshot camera is used to snapshot the target area in response to the received snapshot command, generate a plurality of color images corresponding to different shooting distances of the captured target area, and send the images to the analysis unit;

[0033] The analysis unit is used to perform data analysis on the received multiple color images corresponding to different shooting distances of the target area.

[0034] The above-mentioned snapshot camera and snapshot system determine multiple shooting distances for the target area and the number of photons reflected at different shooting distances by obtaining the reflection signal of the fill light signal and the emission time of the fill light signal. It generates multiple color images corresponding to different shooting distances through a data source that combines the distance and the number of photons at different shooting distances. The images are divided according to different shooting distances, and the images of the car windows with a shorter shooting distance can be eliminated, while the images of the car interior with a longer shooting distance are retained, thereby solving the problem of poor capture effect of the existing snapshot camera inside the car when the energy reflected by the car windows is much higher than the energy reflected by the car interior.

[0035] Details of one or more embodiments of the present application are set forth in the following drawings and description to make other features, objects, and advantages of the present application more readily apparent. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] The drawings described herein are used to provide a further understanding of the present application and constitute a part of the present application. The illustrative embodiments of the present application and their descriptions are used to explain the present application and do not constitute an improper limitation on the present application. In the drawings:

[0037] Figure 1 A structural block diagram of a snapshot camera provided in an embodiment of the present application;

[0038] Figure 2 A structural block diagram of a SPAD detector module according to an embodiment of the present application;

[0039] Figure 3 A schematic structural diagram of a SPAD detector module according to an embodiment of the present application;

[0040] Figure 4A This is a schematic diagram of the structure of a SPAD detector module when filtering red light according to an embodiment of the present application;

[0041] Figure 4B This is a schematic diagram of the structure of a SPAD detector module when filtering green light according to an embodiment of the present application;

[0042] Figure 4C This is a schematic diagram of the structure of a SPAD detector module when filtering blue light according to an embodiment of the present application;

[0043] Figure 5 This is a structural block diagram of a capture system provided in one embodiment of the present application. DETAILED DESCRIPTION

[0044] In order to more clearly understand the purpose, technical solutions and advantages of the present application, the present application is described and illustrated below in conjunction with the accompanying drawings and embodiments.

[0045] Unless otherwise defined, the technical terms or scientific terms involved in this application shall have the general meaning understood by people with general skills in the technical field to which this application belongs. The words "one", "a", "the", "these" and the like in this application do not indicate a quantitative limitation, and they may be singular or plural. The terms "include", "comprise", "have" and any variants thereof involved in this application are intended to cover non-exclusive inclusions; for example, a process, method and system, product or device comprising a series of steps or modules (units) is not limited to the listed steps or modules (units), but may include unlisted steps or modules (units), or may include other steps or modules (units) inherent to these processes, methods, products or devices. The words "connect", "connected", "coupled" and the like involved in this application are not limited to physical or mechanical connections, but may include electrical connections, whether direct or indirect. The "multiple" involved in this application refers to two or more. "And / or" describes the association relationship of associated objects, indicating that there may be three relationships, for example, "A and / or B" may mean: A exists alone, A and B exist at the same time, and B exists alone. Generally, the character " / " indicates that the objects associated with each other are in an "or" relationship. The terms "first", "second", "third", etc. in this application are only used to distinguish similar objects and do not represent a specific ordering of the objects.

[0046] In this embodiment, a snapshot camera is provided. Figure 1 : is a structural block diagram of the snapshot camera of this embodiment. Figure 1 As shown, the snapshot camera includes: a control module 110, a fill light module 120, a SPAD detector module 130 and a data processing module 140; the control module 110 is used to generate a fill light timing command in response to a received snapshot command, and synchronously send the generated fill light timing command to the fill light module 120, the SPAD data detector module and the data processing module 140; the fill light timing command includes the emission time of the fill light signal; the fill light module 120 is used to respond to the received fill light timing command and emit a fill light signal to the target area according to the emission time of the fill light signal in the fill light timing command; the SPAD The detector module 130 is used to receive the reflection signal of the fill light signal in response to the received fill light timing command; and obtain multiple shooting distances for the target area based on the received reflection signal of the fill light signal and the emission time of the fill light signal; the data processing module 140 is used to obtain a data source combining the shooting distance and the number of photons according to the multiple shooting distances for the target area obtained by the SPAD detector module 130 and the number of photons reflected back at different shooting distances read from the SPAD detector module 130; and based on the data source, generate multiple color images corresponding to different shooting distances for output.

[0047] The snapshot command may include the snapshot time. The fill light timing command may include the fill light signal emission time, the fill light signal emission duration, and the time interval between two adjacent fill lights. It should be noted that the emission time of the fill light signal needs to correspond to the snapshot time so that the required information can be accurately captured. The target area may be the area that needs to be captured.

[0048] The above-mentioned control module 110 is respectively connected to the fill light module 120, the SPAD (Single-Photon Avalanche Diode) detector module 130 and the data processing module 140, and is mainly used to generate a fill light timing command in response to the received snapshot command after receiving the snapshot command, and synchronously send the generated fill light timing command to the fill light module 120, the SPAD detector module 130 and the data processing module 140.

[0049] Furthermore, after receiving the fill light timing command, the fill light module 120 reads the emission time of each fill light signal in the fill light timing command, and emits the fill light signal according to the emission time of the fill light signal in the fill light timing command.

[0050] Among them, the above-mentioned SPAD detector module 130 is connected to the data processing module 140, and after receiving the fill light timing command, it will obtain the emission time of the fill light signal in the fill light timing command, so as to facilitate the subsequent calculation of multiple shooting distances for the target area according to the emission time of the fill light signal. Although the emission time of the fill light signal is the same, because the target area is a three-dimensional stereoscopic area, there will be multiple shooting distances based on the reflection of the fill light signal at different positions in the target area. For example, if the target area is a vehicle, the fill light signal will have a reflection signal on the window and a reflection signal inside the vehicle, and the shooting distances of the picture taken of the window and the picture taken inside the vehicle are different. Therefore, based on the reflection signal of the received fill light signal, different return times for different positions of the target area in the reflection signal can be determined, and different shooting distances for the target area can be calculated according to the emission time of the fill light signal and the different return times for different positions of the target area.

[0051] For example, the emission time of the fill light signal is T1, and the receiving time of a certain pixel of the fill light signal is T2, then the calculation formula of the shooting distance L of this pixel is:

[0052]

[0053] Where c is the speed of light.

[0054] Preferably, the SPAD detector module 130 can also determine the start time of the SPAD detector module 130 according to the emission time of the fill light signal. The SPAD detector module is turned on to count the number of photons only when the fill light signal is used for fill light, so as to avoid turning on the SPAD detector module 130 in advance and obtaining too many interference photons, resulting in inaccurate photon counting during fill light.

[0055] Furthermore, after the data processing module 140 receives the fill light timing command, it is equivalent to that after the data processing module 140 obtains the emission time of the fill light signal, the data processing module 140 can calculate the end time of the SPAD detector module 130 obtaining the number of photons according to the farthest distance, and read the data of the SPAD detector module 130 according to the calculated time. For example, if the farthest shooting distance is 100m, then after the data processing module 140 receives the fill light timing command and determines that the emission time of the fill light signal is T1, it will wait for 0.66ns (the time required for the light signal to run the two farthest shooting distances) after T1 before reading the data of the SPAD detector module 130, so as to ensure that the number of photons reflected back from the SPAD detector module 130 at all shooting distances of this fill light can be read.

[0056] Preferably, after receiving the fill light timing command, the data processing module 140 will clear the number of photons previously recorded by the SPAD detector module 130 according to the emission time of each fill light signal in the fill light timing command to ensure the accuracy of the number of photons recorded in this fill light. By clearing the number of photons before this fill light, it is possible to avoid interference with the statistics of the number of photons in this fill light due to the number of photons previously recorded by sunlight or other light sources.

[0057] In addition, the data processing module 140 can determine the number of photons corresponding to each pixel at different shooting distances based on the multiple shooting distances for the target area obtained by the SPAD detector module 130 and the number of photons reflected back from the SPAD detector module 130 at different shooting distances, and then obtain a combined data source of shooting distance and photon number based on the number of photons corresponding to each pixel at different distances, and then generate multiple color images corresponding to different shooting distances based on the data source. Among them, the above data source can be a data set of the corresponding relationship between different shooting distances and the number of photons of each pixel. The construction of the data source facilitates the subsequent analysis and processing of the data.

[0058] This embodiment determines multiple shooting distances for the target area and the number of photons reflected at different shooting distances by acquiring the reflection signal of the fill light signal and the emission time of the fill light signal. It generates multiple color images corresponding to different shooting distances through a data source that combines the distance and the number of photons at different shooting distances. The images are divided according to different shooting distances, and the images of the car windows with a shorter shooting distance can be eliminated, while the images of the car interior with a longer shooting distance are retained. This solves the problem of poor capture effect of the existing snapshot cameras when the energy reflected from the car windows is much higher than the energy reflected from the car interior.

[0059] Specifically, in one embodiment, the data processing module 140, before generating and outputting a plurality of color images corresponding to different shooting distances based on the data source, removes data whose shooting distance is less than a preset distance threshold and whose photon number is greater than a preset threshold number from the data source.

[0060] The above-mentioned preset distance threshold can be set according to the specific situation, or it can be calculated. For example, the average value of all shooting distances can be calculated, and the average value of all shooting distances can be set as the preset distance threshold. The above-mentioned preset threshold number can be set according to the specific situation, or it can be calculated. For example, the average value of the number of photons of all pixels at different shooting distances can be calculated, and the average value of the number of photons of all pixels at different shooting distances can be used as the preset threshold number. At this time, the data in which the number of photons recorded by the pixels in the data source at different shooting distances is greater than or equal to the preset threshold number is eliminated.

[0061] In addition, in one embodiment, the snapshot camera also includes a lens module; the lens module includes a filter switch; the filter switch includes a first filter and a second filter; the first filter is a filter suitable for daytime; the second filter is a filter suitable for night; the data processing module 140 is also used to determine the current environment brightness information based on the multiple color images acquired; when the current environment brightness information is greater than a preset brightness threshold, the filter switch is controlled to switch to the first filter; when the current environment brightness information is less than the preset brightness threshold, the filter switch is controlled to switch to the second filter.

[0062] The filter switch is a dual filter switch, which is used to optimize the imaging effect of the camera under different light conditions by switching different filters. The first filter can be an infrared cut-off low-pass filter to restore the true color when there is sufficient light during the day and avoid the interference of infrared light on color restoration. The second filter can be a full-spectrum filter to enable the camera to sense the infrared light of the infrared lamp through the full-spectrum filter when there is insufficient visible light at night, thereby improving night vision performance.

[0063] Furthermore, the data processing module 140 determines the brightness information of the current environment based on the acquired multiple color images. This may be to convert the acquired color image into a grayscale image, count the number of pixels in the grayscale image whose brightness exceeds a preset brightness value, calculate the proportion of the number of pixels whose brightness exceeds the preset brightness value, and determine the brightness information of the current environment according to the proportion; it may be to use a neural network model, input the color image into a trained neural network model, and output the brightness information of the current environment; it may be to estimate the brightness information of the current environment by analyzing the illumination components in the color image. The preset brightness value may be set according to specific circumstances, and this embodiment does not make specific restrictions here. As long as the preset brightness value can be set, the brightness information of the current environment can be determined according to the proportion of pixels exceeding the preset brightness value. The preset brightness threshold may be set according to specific circumstances. This embodiment does not make specific restrictions here. As long as the preset brightness threshold can be used to distinguish between day and night, the filter can be switched immediately.

[0064] Furthermore, in one embodiment, Figure 2 is a structural block diagram of a SPAD detector module according to an embodiment of the present application. Figure 2 As shown, the SPAD detector module 130 includes a microlens unit 132, a filtering unit 134 and a SPAD unit 136; the microlens unit 132 is used to adjust the reflection signal of the received fill light signal to match the main light angle of the receiving lens of the snapshot camera, and transmit the adjusted reflection signal to the filtering unit 134; the filtering unit 134 is used to perform spectral filtering on the adjusted reflection signal, and then transmit it to the SPAD unit 136; the SPAD unit 136 is used to determine the number of photons counted for each pixel in the reflection signal at different times based on the received spectrally filtered reflection signal; based on the number of photons counted for each pixel in the reflection signal at different times, and the emission time of the fill light signal, multiple shooting distances for the target area and the number of photons counted for each pixel at different shooting distances are obtained.

[0065] The SPAD detector module 130 includes a SPAD detector for detecting the number of photons of the reflection signal of the fill light signal in the target area, and the SPAD detector includes a microlens unit 132, a filter unit 134 and a SPAD unit 136. The filter unit 134 performs spectral filtering on the adjusted reflection signal, and its purpose is to obtain RGB (Red Green Blue, red, green and blue) information, that is, filtering to obtain color information.

[0066] Further, Figure 3 FIG. 1 is a schematic diagram of the structure of a SPAD detector module 130 according to an embodiment of the present application. Figure 3As shown, the microlens unit 132 is located at the top layer of the SPAD detector module 130, the filtering unit 134 is located at the middle layer of the SPAD detector module 130, and the SPAD unit 136 is located at the bottom layer of the SPAD detector module 130; the microlens unit 132 includes a microlens array; the filtering unit 134 includes a filtering array; the SPAD unit 136 includes a SPAD array; the filtering array is covered on each SPAD array with RGB according to a preset proportional relationship; wherein each R corresponds to a SPAD pixel of the SPAD array; each G corresponds to a SPAD pixel of the SPAD array; each B corresponds to a SPAD pixel of the SPAD array; and each filtering array is covered with a microlens array.

[0067] The above-mentioned SPAD array is a single-photon avalanche diode array. A single-photon avalanche diode (SPAD) is a sensor that can detect a single photon. Therefore, each pixel of the SPAD has a built-in photon counter. When a photon arrives, the SPAD will produce an avalanche effect, which can be detected by the circuit. Each SPAD array is covered with a filter array, and a microlens array is attached to each filter array. Each filter array includes an R filter (abbreviated as R), a G filter (abbreviated as G), and a B filter (abbreviated as B). Each filter in the filter array corresponds to a SPAD pixel; each SPAD array can include multiple SPAD pixels. For example, each SPAD array can include 4 SPAD pixels. The filter array can be covered on each SPAD array according to the GRB ratio of 1:2:1. That is, among the 4 SPAD pixels, one is covered by a red filter, two are covered by green filters, and one is covered by a blue filter. Four SPAD pixels share a time-to-digital converter circuit to form a macro-pixel, in which each SPAD pixel is covered by a filter of a different color, allowing each macro-pixel to produce color images. Figure 4A , Figure 4B , Figure 4C , is a schematic diagram of the structure of a SPAD detector module according to an embodiment of the present application when filtering light of different colors, Figure 4A This is a schematic diagram of the structure when filtering red light. Figure 4A As shown, an R filter is covered on the SPAD pixel, and a microlens is attached to the R filter. Figure 4B It is a schematic diagram of the structure when filtering green light, such as Figure 4B As shown, a G filter is covered on the SPAD pixel, and a microlens is attached to the G filter. Figure 4C It is a schematic diagram of the structure when filtering blue light, such as Figure 4C As shown, a B filter is covered on the SPAD pixel, and a microlens is attached to the B filter.

[0068] In one embodiment, the filter array includes a preset number of narrowband filters; each narrowband filter corresponds to a SPAD pixel of the SPAD array; the narrowband filter is used to perform spectral filtering on each pixel of the adjusted reflection signal to obtain a reflection signal after spectral filtering of each pixel.

[0069] In this embodiment, the above filters are all narrow-band filters. Through the design of narrow-band filters, light within a specific wavelength range is allowed to pass through by spectral filtering. The R filter can only pass red light, the G filter can only pass green light, and the B filter can only pass blue light, so that three colors of light can pass through, and then the color image is reconstructed through methods such as mosaic algorithms, so that multiple color images corresponding to different shooting distances can be generated.

[0070] In addition, in one embodiment, the control module 110 is also used to respond to the received snapshot command, determine the number of fill lights according to a preset coding rule, and determine the time intervals between two adjacent fill lights according to a random principle; and determine the emission time of each fill light signal based on the number of fill lights, the time intervals between two adjacent fill lights, and the emission time of the initial fill light signal; and generate a fill light timing command based on the emission time of each fill light signal.

[0071] The above-mentioned coding rule may be the number of fill-in lights and the duration of each fill-in light, which are used to generate a timing rule together with each time interval between two adjacent fill-in lights, so that the SPAD detector module 130 will only determine that the detected data is valid detection data if the timing rule of the received reflection signal is the same as that of the emitted fill-in light signal. The above-mentioned determination of each time interval between two adjacent fill-in lights according to the random principle may be to determine each time interval between two adjacent fill-in lights using a preset random event generation function.

[0072] In one embodiment, the SPAD detector module 130 is further used to filter out light signals having different fill light times or different time intervals between two adjacent fill lights from the received light signals based on the received fill light timing command.

[0073] Because the number of fill lights and the time intervals between two adjacent fill lights are fixed, when the light signal received by the SPAD detector module 130 is different from the number of fill lights or the time intervals between two adjacent fill lights, it means that the number of photons detected by the SPAD detector module is not a reflected signal of the fill light signal, that is, an invalid signal. This invalid signal needs to be eliminated to reduce the impact of the invalid signal on the accuracy of photon detection.

[0074] In one embodiment, the lens module also includes a transmitting lens and a receiving lens; the transmitting lens is used to shape the fill light signal emitted by the fill light module 120, and then transmit it to the target area; the receiving lens is used to collect the reflection signal of the fill light signal at the target area, and focus the collected reflection signal of the fill light signal to obtain a focusing signal matching the target surface size of the SPAD detector module 130, and send it to the filter switch; the filter switch is used to band filter the received focusing signal and then transmit it to the SPAD detector module 130.

[0075] In the present embodiment, the above-mentioned shaping of the fill light signal emitted by the fill light module 120 may be to shape the fill light signal emitted by the fill light module 120 into a specific angle or form according to a preset shaping angle or form. By shaping the fill light signal emitted by the fill light module 120 into a specific angle or form, the receiving lens can be designed so that the receiving lens only receives light of a specific angle or form, thereby achieving accurate reception of the reflected signal of the fill light signal and reducing the reception of invalid signals.

[0076] Because when using the SPAD detector to detect the number of photons of the reflected signal of the fill light signal, in order to ensure the effective detection of photons, it is necessary to ensure that the focused signal can accurately fall on the target surface of the SPAD detector. Therefore, this embodiment uses a receiving lens to collect the reflected signal of the fill light signal in the target area, and focuses the collected reflected signal of the fill light signal to obtain a focused signal that matches the target surface size of the SPAD detector module 130.

[0077] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0078] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0079] Based on the same inventive concept, a snapshot system is also provided in this embodiment, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. The terms "module", "unit", "subunit", etc. used below can implement a combination of software and / or hardware of predetermined functions. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.

[0080] In one embodiment, Figure 5 is a structural block diagram of a capture system provided in an embodiment of the present application, such as Figure 5 As shown, the capture system includes a capture trigger unit 520, an analysis unit 540 and a capture camera 560 in an embodiment of the present application; the capture trigger unit 520 is used to generate a capture command when the capture conditions are met, and send the capture command to the capture camera 560; the capture camera 560 is used to respond to the received capture command to capture the target area, generate multiple color images corresponding to different shooting distances of the captured target area, and send them to the analysis unit 540; the analysis unit 540 is used to perform data analysis on the received multiple color images corresponding to different shooting distances of the target area.

[0081] The above-mentioned capture system monitors whether the target area meets the capture condition through the capture trigger unit 520. When the target area meets the capture condition, a capture command is generated and sent to the capture camera 560. The capture camera 560 captures the target area in response to the received capture command, and generates multiple images corresponding to different shooting distances of the captured target area. According to the multiple captured images, the required images can be screened out and sent to the analysis unit 540 for data analysis. By dividing the images according to different shooting distances, the images of the car windows with a shorter shooting distance can be eliminated, and the images of the car interior with a longer shooting distance can be retained, which solves the problem of the existing capture camera 560 that the capture effect of the car interior is poor when the energy reflected by the car windows is much higher than the energy reflected by the car interior.

[0082] It should be noted that the above modules can be functional modules or program modules, and can be implemented by software or hardware. For modules implemented by hardware, the above modules can be located in the same processor; or the above modules can be located in different processors in any combination.

[0083] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.

[0084] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0085] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A snapshot camera, characterized in that: The snapshot camera includes: a control module, a fill light module, a SPAD detector module and a data processing module; The control module is used to generate a fill light timing command in response to the received snapshot command, and synchronously send the generated fill light timing command to the fill light module, the SPAD detector module and the data processing module; the fill light timing command includes the emission time of the fill light signal; The fill light module is configured to transmit a fill light signal to a target area in response to the received fill light timing command according to the emission time of the fill light signal in the fill light timing command; The SPAD detector module is used to receive the reflection signal of the fill light signal in response to the received fill light timing command; and based on the received reflection signal of the fill light signal and the emission time of the fill light signal, obtain multiple shooting distances for the target area; wherein the SPAD detector module includes a microlens unit, a filter unit and a SPAD unit; the microlens unit is used to adjust the received reflection signal of the fill light signal to match the main light angle of the receiving lens of the snapshot camera, and transmit the adjusted reflection signal to the filter unit; the filter unit is used to perform spectral filtering on the adjusted reflection signal, and then transmit it to the SPAD unit; the SPAD unit is used to determine the number of photons counted by each pixel in the reflection signal at different times based on the received reflection signal after spectral filtering; based on the number of photons counted by each pixel in the reflection signal at different times and the emission time of the fill light signal, obtain multiple shooting distances for the target area and the number of photons reflected back at different shooting distances; The data processing module is used to obtain a data source combining shooting distance and photon number based on multiple shooting distances for the target area obtained by the SPAD detector module and the number of photons reflected back at different shooting distances read from the SPAD detector module; and based on the data source, generate multiple color images corresponding to different shooting distances for output.

2. The snapshot camera according to claim 1, characterized in that: The data processing module is further used for: Before generating a plurality of color images corresponding to different shooting distances for output based on the data source, data whose shooting distance is less than a preset distance threshold and whose photon number is greater than a preset threshold number are eliminated from the data source.

3. The snapshot camera according to claim 1, characterized in that: The snapshot camera further includes a lens module; the lens module includes a filter switch; the filter switch includes a first filter and a second filter; the first filter is a filter suitable for daytime; the second filter is a filter suitable for nighttime; The data processing module is further used to determine the current environment brightness information based on the multiple color images obtained; when the current environment brightness information is greater than a preset brightness threshold, control the filter switch to switch to the first filter; When the current environment brightness information is less than the preset brightness threshold, the filter switch is controlled to switch to the second filter.

4. The snapshot camera according to claim 1, characterized in that: The microlens unit is located at the uppermost layer of the SPAD detector module, the filter unit is located at the middle layer of the SPAD detector module, and the SPAD unit is located at the lowermost layer of the SPAD detector module; The microlens unit includes a microlens array; the filter unit includes a filter array; the SPAD unit includes a SPAD array; The filter array is covered on each of the SPAD arrays with RGB according to a preset ratio; wherein each R corresponds to a SPAD pixel of the SPAD array; each G corresponds to a SPAD pixel of the SPAD array; each B corresponds to a SPAD pixel of the SPAD array; and each of the filter arrays is covered with a microlens array.

5. The snapshot camera according to claim 4, characterized in that: The filter array includes a preset number of narrowband filters; each of the narrowband filters corresponds to a SPAD pixel of the SPAD array; The narrowband filter is used to perform spectral filtering on each pixel of the adjusted reflection signal to obtain a reflection signal after spectral filtering of each pixel.

6. The snapshot camera according to claim 1, characterized in that: The control module is also used to respond to the received snapshot command, determine the number of fill lights according to a preset coding rule, and determine the time intervals between two adjacent fill lights according to a random principle; and determine the emission time of each fill light signal based on the number of fill lights, the time intervals between two adjacent fill lights, and the emission time of the initial fill light signal; and generate the fill light timing command based on the emission time of each fill light signal.

7. The snapshot camera according to claim 6, characterized in that: The SPAD detector module is further used to filter out light signals that are different from the fill light times or different from the time intervals between two adjacent fill lights from the received light signals based on the received fill light timing command.

8. The snapshot camera according to claim 1, characterized in that: The lens module also includes a transmitting lens and the receiving lens; The transmitting lens is used to shape the fill light signal emitted by the fill light module and then transmit it to the target area; The receiving lens is used to collect the reflection signal of the fill light signal at the target area, and focus the collected reflection signal of the fill light signal to obtain a focusing signal that matches the target surface size of the SPAD detector module, and send it to the filter switch; The filter switch is used to perform band filtering on the received focusing signal and then transmit it to the SPAD detector module.

9. A snapshot system, characterized in that: The capture system comprises a capture trigger unit, an analysis unit and a capture camera as described in any one of claims 1 to 8; The snapshot trigger unit is used to generate a snapshot command when the snapshot condition is met, and send the snapshot command to the snapshot camera; The snapshot camera is used to snapshot the target area in response to the received snapshot command, generate a plurality of color images corresponding to different shooting distances of the captured target area, and send the images to the analysis unit; The analysis unit is used to perform data analysis on the received multiple color images corresponding to different shooting distances of the target area.

Images