Detection method, detection device and detection system for light supplement area of light supplement lamp
By acquiring images of unused and used fill lights in the target shooting scene, and using image processing technology to determine the spot area, the problem of inaccurate confirmation of fill light positions is solved, and efficient fill light debugging and image recognition effects are achieved.
Patent Information
- Application Number
- CN202410236110.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-02-29
- Publication Date
- 2025-08-29
AI Technical Summary
In the prior art, the fill light position confirmation of the fill light lamp is inaccurate, resulting in poor imaging effects, affecting the accuracy of image recognition, and low debugging efficiency.
By obtaining images not taken with and with fill lights in the target shooting scene, the spot area is determined using the double-frame subtraction and image processing model, and combining exposure and gamma correction processing, the current fill light area of the fill light is accurately determined, and debugging information is generated to guide the installation angle adjustment.
It improves the accuracy and efficiency of fill light debugging, ensures that the spot accurately covers the shooting target, and improves the accuracy of image recognition.
Smart Images

Figure CN120568209A_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to the field of image processing technology, and in particular to a method, a detection device, and a detection system for a fill light area of a fill light. Background Art
[0002] Shooting scenarios such as traffic monitoring scenarios generally include shooting equipment and fill lights. The fill light is mainly used to cooperate with the shooting equipment to achieve the purpose of capturing clear images. For example, in traffic monitoring scenarios, as an auxiliary light source for traffic monitoring, the shooting equipment can capture clear and complete images of vehicles and drivers in the absence of light or in poor lighting conditions, which are used to identify traffic behavior and target attributes. Because the intensity of ambient light is much greater than the intensity of the light emitted by the fill light, and the fill light cannot continuously emit high-intensity light, the current fill light position of the fill light is not accurately confirmed, so the light spot emitted by the fill light cannot accurately fill in the light for the shooting target, resulting in poor imaging effect during shooting, which affects the accurate identification of traffic behavior and target attributes based on the captured image. Therefore, it is usually necessary to detect the current fill light area of the fill light, and then adjust the installation angle of the fill light so that the light spot emitted by the fill light can accurately fill in the light for the shooting target.
[0003] In the related art, technicians usually rely on experience or manual work to determine the actual fill light area of the fill light, and then manually adjust the installation angle of the fill light. This method has the problems of poor accuracy and low debugging efficiency. Summary of the Invention
[0004] The embodiments of the present application provide a fill light area detection method, detection equipment and detection system for a fill light, which can detect the current fill light area of the fill light and improve the fill light debugging efficiency.
[0005] In a first aspect, a method for detecting a fill light area of a fill light is provided. The method comprises: obtaining N sets of first and second images captured within the same shooting range in a target shooting scene; the first images being images captured without the fill light, and the second images being images captured with the fill light; and N being an integer greater than or equal to 1. For each set of images, a light spot area is determined based on the first and second images, resulting in N light spot areas; the light spot area is used to indicate the light spot area corresponding to the fill light in the second image; and a current fill light area of the fill light is determined based on the N light spot areas, where the current fill light area includes an overlapping area of the N light spot areas.
[0006] It is understood that by acquiring at least one set of first and second images captured within the same shooting range under the target shooting scene, and obtaining at least one set of light spot areas based on the first and second images, the current fill light area of the fill light can be determined based on the at least one set of light spot areas. Determining the current fill light area of the fill light based on at least one set of first images without fill light and second images with fill light not only prevents interference with the current fill light area of the fill light from other factors but also improves the accuracy of detecting the current fill light area of the fill light. Since the fill light is debugged based on the current fill light area during debugging, the efficiency of debugging the fill light can be further improved.
[0007] In a possible implementation, debugging information is generated according to the current fill light area and the target fill light area; the debugging information is used to be displayed on a display device, and the debugging information is used to instruct adjustment of the installation angle of the fill light.
[0008] It is understood that by visually outputting debugging information based on the current fill light area and the target fill light area, the debugging information can be used to guide relevant technical personnel in debugging the installation angle of the fill light. This can more intuitively display the debugging information and improve the efficiency of fill light debugging.
[0009] In a possible implementation, for each group of images, a double-frame subtraction operation is performed on the first image and the second image to obtain a light spot area corresponding to the second image.
[0010] It can be understood that by performing a double-frame subtraction operation on the first image and the second image and subtracting the corresponding pixel values, the change area between the two images can be found, thereby obtaining the light spot area corresponding to the second image.
[0011] In one possible implementation, a fill light detection image and an ambient light detection image captured within a target shooting scene and within a shooting range are obtained; the fill light detection image is an image captured using a fill light for fill lighting, and the ambient light detection image is an image captured without using a fill light for fill lighting. An exposure difference between the fill light detection image and the ambient light detection image is determined based on the exposure values of the fill light detection image and the ambient light detection image; if the exposure difference is greater than or equal to a preset difference threshold, N is determined to be a first value; if the exposure difference is less than the preset difference threshold, N is determined to be a second value; the second value is greater than the first value.
[0012] It can be understood that before obtaining N groups of first images and second images, by obtaining the fill light detection image and the ambient light detection image taken for the shooting range in the target shooting scene, and determining the value of N based on the relationship between the exposure difference between the fill light detection image and the ambient light detection image and the preset difference threshold, that is, based on the strength relationship between the brightness of the ambient light and the brightness of the fill light, the influence of the ambient light on the detection of the current fill light area of the fill light can be eliminated, thereby improving the accuracy of the detection of the current fill light area of the fill light.
[0013] In one possible implementation, if the exposure value of the first image is greater than a preset exposure threshold, exposure adjustment processing is performed on the first image and the second image according to the preset exposure adjustment value; if the grayscale value of the first image is greater than the preset grayscale threshold, gamma correction processing is performed on the first image and the second image according to the preset gamma value.
[0014] It can be understood that before determining the light spot area based on the first image and the second image, the relationship between the first image and the second image and the preset exposure value and the preset grayscale value are judged, and the exposure and grayscale adjustments are performed on N groups of first images and second images respectively. This can stabilize the exposure of the first image and the second image, ensure that other factors of the first image and the second image remain unchanged, and make the display of the light spot area clearer.
[0015] In one possible implementation, debugging information is displayed based on the current fill light area and the target fill light area. This includes determining a degree of overlap based on the range information of the current fill light area and the target fill light area, where the degree of overlap indicates the size of the overlap between the actual fill light area and the target fill light area relative to the target fill light area. If the degree of overlap is less than a preset overlap threshold, debugging information is displayed based on the position information of the current fill light area and the target fill light area.
[0016] It's understood that after obtaining the current fill light area, the overlap between the current fill light area and the target fill light area, plus the size of the area occupied by the target fill light area, can be calculated. If the overlap is less than a preset threshold, the fill light needs to be debugged. Visually displaying debugging information indicating the fill light's installation angle can guide relevant personnel in debugging the fill light and improve debugging efficiency. Furthermore, indicating whether the fill light needs debugging based on the relationship between the overlap and the preset threshold can be flexibly applied to users' actual business operations, making its application more extensive and flexible.
[0017] In one possible implementation, information about a target shooting scene is obtained; based on the information about the target shooting scene, a three-dimensional model corresponding to the target shooting scene is constructed; the three-dimensional model is used to be displayed on a display device, and the three-dimensional model is used to show the target shooting scene to a user.
[0018] It can be understood that by obtaining information about the target shooting scene, a three-dimensional model corresponding to the target shooting scene is constructed, and displayed on a display device, not only human-computer interaction can be achieved and the target shooting scene can be determined more accurately, but the target shooting scene can also be displayed to the user more intuitively.
[0019] In one possible implementation, a debugging strategy for the installation angle of the fill light; and / or area information, where the area information indicates the relative positional relationship between the target fill light area and the current fill light area. The area information is displayed in a 3D model corresponding to the target shooting scene.
[0020] It is understandable that the displayed debugging information may include the debugging strategy of the installation angle of the fill light; and / or, at least one of the debugging preview images can more flexibly and conveniently guide relevant technical personnel to debug the fill light, thereby improving the debugging efficiency of the fill light.
[0021] In one possible implementation, information of a target shooting scene input by a user is received, the information of the target shooting scene including at least relative position information between a fill light and a desired shooting range; and a target fill light area is determined according to the information of the target shooting scene.
[0022] It can be understood that by receiving the target scene information input by the user and determining the target fill light area of the fill light, the target fill light area between the target scene and the expected shooting range can be accurately determined based on the shooting range information of the target scene, which can improve the accuracy of the target fill light range and further improve the efficiency of fill light debugging.
[0023] In one possible implementation, if the degree of overlap is greater than or equal to a preset degree of overlap threshold, a prompt message indicating that the debugging is successful is displayed.
[0024] It is understood that the debugging device can determine the relationship between the overlap and a preset overlap threshold. If the overlap is greater than or equal to the preset overlap threshold, it means that the fill light's current fill area can meet the lighting area of the shooting range in the shooting scene. Therefore, a prompt message is output in a visual manner to indicate successful debugging. This not only enhances the practicality of fill light debugging, but also improves the efficiency of fill light debugging.
[0025] In one possible implementation, a first image and a second image captured for the same shooting range in a target shooting scene are obtained, including, when the fill light and the shooting device are fixed, controlling the fill light to flash N times at a preset time interval; and controlling the shooting device to obtain a set of first images and second images each time the fill light flashes.
[0026] It's understandable that, when the angle and position of the fill light and camera are fixed, the first and second images can be guaranteed to reference the same source, resulting in a more accurate image of the second image's spot area. By controlling the fill light to flash N times at a preset time interval and capturing the first and second images before or during the flashing of the fill light, it's possible to ensure that the first and second images appear consecutively and in pairs. This, in turn, improves the anti-interference capability and accuracy of the fill light's current fill light area detection.
[0027] In the second aspect, a fill light area detection device for a fill light is provided. In an embodiment of the present application, the fill light area detection device for the fill light can be divided into functional modules according to the method provided in the first aspect. For example, each functional module can be divided corresponding to each function, or two or more functions can be inherited in one processing module. Exemplarily, the embodiment of the present application can divide the fill light area detection device for the fill light into an acquisition module and a detection module according to the function. The description of the possible technical solutions and beneficial effects executed by each of the divided functional modules can refer to the technical solutions provided by the first aspect or its corresponding possible implementation methods, and will not be repeated here.
[0028] In a third aspect, an embodiment of the present application provides a fill light area detection device for a fill light, the detection device comprising a processor and a memory for storing processor executable instructions; the processor is configured to execute instructions so that the detection device executes the above-mentioned fill light area detection device method.
[0029] In a fourth aspect, the present application provides a fill light area detection system for a fill light, comprising: the aforementioned detection device, a camera, and a fill light; the camera and fill light are communicatively connected to the detection device; wherein the detection device is configured to execute the fill light debugging method of the first aspect. The camera is configured to capture N sets of first and second images within the same capture range under a target capture scene. The fill light is configured to provide fill light when the camera captures the second image.
[0030] In a fifth aspect, an embodiment of the present application provides a computer-readable storage medium, in which at least one computer program is stored. The computer program is loaded and executed by a processor to implement the fill light area detection method of the fill light as described above.
[0031] In a sixth aspect, embodiments of the present application provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computing node reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computing node to perform the fill light area detection method for a fill light provided in various optional implementations of the above aspects.
[0032] For the specific description of the second to sixth aspects and their various implementations in the embodiments of the present application, reference can be made to the detailed description in the first aspect and its various implementations; and for the beneficial effects of the second to sixth aspects and their various implementations, reference can be made to the analysis of the beneficial effects in the various implementations of the first aspect, which will not be repeated here.
[0033] These and other aspects of the embodiments of the present application will be more clearly understood in the following description. BRIEF DESCRIPTION OF THE DRAWINGS
[0034] Figure 1 This is a schematic diagram of a camera capture scenario in an intelligent transportation system provided by an embodiment of the present application;
[0035] Figure 2 This is a schematic diagram of a fill light area detection system for a fill light provided in an embodiment of the present application;
[0036] Figure 3 This is a flow chart of a method for detecting a fill light area of a fill light provided in an embodiment of the present application;
[0037] Figure 4 yes Figure 3 A schematic diagram of a method for obtaining a current fill light area of a fill light according to the embodiment shown;
[0038] Figure 5 yes Figure 3 A schematic diagram of a method for determining a target fill light area in a traffic monitoring scenario according to an embodiment of the present invention;
[0039] Figure 6 This is a schematic diagram of a debugging preview image provided by an embodiment of the present application;
[0040] Figure 7 This is a flow chart of a method for debugging a fill light provided in an embodiment of the present application;
[0041] Figure 8 It is a structural schematic diagram of a fill light area detection device of a fill light provided in an embodiment of the present application. DETAILED DESCRIPTION
[0042] The terms "first", "second", "third" and "fourth" in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects rather than to limit a specific order.
[0043] In the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be interpreted as being preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.
[0044] Terminology Introduction:
[0045] Fill lights typically include infrared strobe lights or visible light lamps based on light-emitting diodes (LEDs), xenon lamps, and other technologies. LEDs are solid-state semiconductor devices that convert electrical energy into visible light. They can directly convert electricity into light and are often used to provide fill light for cameras. LEDs can operate in either strobe or constant-on mode, and their power can be flexibly controlled to provide varying fill light intensities. Instantaneously providing high-current, high-intensity fill light is also known as LED flash.
[0046] Xenon lamps, commonly known as gas strobe lamps, are a new type of headlight containing xenon gas, also known as high-intensity discharge (HIDI) gas lamps. They utilize a UV-resistant quartz glass tube filled with various chemical gases. High voltage separates these gases, generating a light source between the two terminals of the power supply, providing stable, high-intensity illumination. They are widely used for fill lighting in photography and surveillance cameras.
[0047] Among them, the infrared flash light emits infrared light that is invisible to the human eye to fill in the shooting range, and the visible light light emits a light spot that is visible to the human eye to fill in the shooting range.
[0048] Taking the intelligent transportation system checkpoint snapshot scenario as an example, the shooting range is usually the lane area, and the target of the shooting is usually the vehicle moving or parked in the lane. When capturing the snapshot, fill lights are usually used to illuminate the vehicle, assisting the camera equipment to clearly capture the vehicle's license plate, color, and driver, providing traffic management personnel with an accurate basis for judging the current vehicle's traffic behavior. Because the installation angle and position of the fill light determine the fill light's fill light area, the installation angle and position of the fill light are particularly important for whether a clear and accurate image can be captured. In shooting scenarios such as intelligent transportation system checkpoint snapshots, the position of the fill light is rarely adjusted after installation. Therefore, when the fill light's fill light area is desired, it is usually achieved by adjusting the installation angle of the fill light.
[0049] Typically, in order to adjust the installation angle of the fill light, it is necessary to detect the current fill light area of the fill light. The current fill light area mentioned in the embodiments of the present application can be understood as the area where the light spot generated by the fill light is formed in the actual shooting scene. For example, when the light spot generated by the fill light falls on the shooting target, the light spot area on the shooting target is the current fill light area of the fill light. It should be understood that the current fill light area of the fill light can be reflected by an image containing the light spot of the fill light. Therefore, the fill light area of the fill light can be the light spot area in the image.
[0050] In the related art, when the fill light is an infrared strobe light, a detection image containing the infrared strobe light is captured and brightness-differentiated to preliminarily determine the fill light area and non-fill light area. Edge detection is then performed on the brightness-differentiated detection image to determine the fill light area. However, this method can only be used to determine the fill light area of an infrared strobe light, which is invisible to the human eye, and is not applicable to fill lights that emit visible light, such as LEDs or xenon lamps.
[0051] In view of this, embodiments of the present application provide a method for detecting the fill light area of a fill light. The method can be performed by a detection device. The detection device can obtain N (N is an integer greater than or equal to 1) sets of first and second images captured within the same shooting range under a target shooting scene. For each set of first and second images, the detection device determines a light spot area, thereby obtaining N light spot areas. The first image is an image captured under the target shooting scene without the fill light, i.e., an image in which the fill light spot does not fall within the shooting range; the second image is an image captured under the target shooting scene with the fill light, e.g., an image in which part or all of the fill light spot falls within the shooting range. The light spot area indicates the light spot area corresponding to the fill light in the second image. The fill light debugging device can determine the current fill light area of the fill light based on the N light spot areas. This method can accurately determine the current fill light area of the fill light, overcome interference from ambient light factors when detecting the current fill light area, and accurately obtain the current fill light area of the fill light even in scenes with strong ambient light. Since the current fill light area of the fill light determined by the method of the present application is relatively accurate, it can better provide a basis for debugging the fill light, making the debugging of the fill light more accurate, thereby improving the debugging efficiency of the fill light.
[0052] First, an exemplary introduction to the application scenarios of the embodiments of the present application is provided. The application scenarios of the embodiments of the present application include, but are not limited to, intelligent transportation system checkpoint snapshot scenarios, for example, fixed-point shooting scenarios in tourist attractions, fixed-point shooting scenarios in public places such as airports and train stations, etc. Among them, the checkpoint refers to an intersection or important road node where a vehicle needs to be captured.
[0053] The detection method provided in the embodiments of this application can be used to guide users in adjusting the installation angle of the fill light, so that the light spot emitted by the fill light can accurately fill in the target, improving the debugging efficiency of the fill light in the application scenario. The following uses the intelligent transportation system checkpoint capture scene as an example to introduce the specific implementation of the embodiment of this application.
[0054] Figure 1 This is a schematic diagram of a camera capture scene in an intelligent transportation system provided by an embodiment of the present application. Figure 1 As shown, taking two lanes as an example, a capture scene at a checkpoint in an intelligent transportation system typically includes a fill light 101, a camera 102, a capture target 103, and a capture trigger line 104. Camera 102 can be an image acquisition device for capturing snapshots, such as various cameras. The capture range of camera 102 can cover multiple lanes. Typically, fill light 101 and camera 102 are mounted on a monitoring pole.
[0055] Generally, each lane is equipped with a fill light 103. Fill light 103 is used to illuminate the target 103 and assist the camera 102 in capturing the target 103's behavior. Fill light 101 can be a general lighting device, specifically an LED lamp, xenon lamp, or other lighting device used for photography fill light.
[0056] The fill light 101 is communicatively connected to the shooting device 102, for example, by a signal line or wireless communication. When the shooting target 103 reaches the snapshot trigger line 104, the fill light 101 is triggered to turn on (flash) to illuminate the shooting target 103. At the same time, the shooting device 102 snapshots the shooting target 103, thereby obtaining an image that can clearly reflect the appearance information of the shooting target 103.
[0057] The embodiment of the present application can be used to guide technicians to debug the installation angle and position of the fill light 101, ensuring that the fill light area of the debugged fill light 101 can fall within the desired fill light area, such as covering the shooting target 103, thereby improving the utilization rate of the fill light 101 and improving the debugging efficiency of the fill light 101.
[0058] Next, the system architecture of the embodiment of the present application is exemplarily introduced.
[0059] The embodiment of the present application can be applied to the fill light area detection system of the fill light, which can accurately determine the current fill light area of the fill light, and guide technicians to debug the installation angle and position of the fill light based on the current fill light area, so that the fill light can cover the shooting target, thereby improving the efficiency of the fill light debugging.
[0060] Figure 2 FIG. 1 is a schematic diagram of a fill light area detection system for a fill light provided in an embodiment of the present application. Figure 2 As shown, the fill light area detection system of the fill light may include a shooting device 102 , a fill light 101 and a detection device 201 .
[0061] The fill light 101 and the shooting device 102 may be connected via communication, specifically via a communication network connection or a signal line connection, and may be controlled by the detection device 201 at the same time.
[0062] In one possible implementation, the detection device 201 may include a system-on-chip (SoC) capable of running an operating system, specifically a system on chip (SOC). The SOC can mimic a computer system and miniaturize an operating system on a chip, including a core processor, a storage unit, peripheral interfaces, and a bus.
[0063] In one possible implementation, the detection device 201 may include a system-on-chip (SOC) and a field-programmable gate array (FPGA). An FPGA is a chip whose internal structure can be modified through programming, also known as a controller. In this implementation, the FPGA can be used to control the on and off of the fill light 101. Using the FPGA to control the fill light 101 can effectively reduce the latency of the detection device 201 and ensure synchronization between the fill light 101 and the camera 102.
[0064] The detection device 201 is used to obtain N groups of first images and second images captured by the shooting device 102 in the target shooting scene with the same shooting range, and determine the light spot area for each group of first and second images, thereby obtaining N light spot areas. The first image is an image captured without a fill light for fill lighting in the target shooting scene, and the second image is an image captured with a fill light for fill lighting in the target shooting scene; N is an integer positive number greater than or equal to 1. The light spot area is used to indicate the light spot area corresponding to the fill light in the second image. The detection device 201 is also used to determine the current fill light area of the fill light based on the N light spot areas. The current fill light area includes the overlapping area of the N light spot areas.
[0065] In one possible implementation, the fill light can be installed on an intelligent pan-tilt platform; wherein the intelligent pan-tilt platform can receive adjustment instructions sent by the detection device, and rotate or move according to the adjustment instructions to adjust the installation angle of the fill light.
[0066] Specifically, the intelligent pan-tilt head and fill light are mounted together on the surveillance pole, with the fill light mounted on the pan-tilt head. The detection equipment and the intelligent pan-tilt head are connected via a signal cable or a communications network. The detection equipment generates adjustment commands and sends them to the intelligent pan-tilt head. Upon receiving these commands, the intelligent pan-tilt head rotates or moves the fill light to adjust its mounting angle. This change in mounting angle allows the fill light's light spot to cover the desired shooting range, enabling the camera to capture clear, accurate images. This enables remote commissioning of the fill light, eliminating the need for technicians to repeatedly visit the pole and improving commissioning efficiency.
[0067] It should be noted that the system architecture and application scenarios described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application, and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Ordinary technicians in this field can know that with the evolution of the system architecture and the emergence of new business scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0068] For ease of understanding, the following is an exemplary introduction to the fill light area detection method of the fill light provided by the present application in conjunction with the accompanying drawings. The fill light area detection method of the fill light is applicable to Figure 2 The system shown.
[0069] Figure 3 The flow chart of a method for detecting the fill light area of a fill light provided by an embodiment of the present application is shown. The method for detecting the fill light area of a fill light can be applied to a fill light detection device, and includes the following steps:
[0070] S101: A detection device obtains N groups of first images and second images captured in a target shooting scene and within a same shooting range; wherein N is an integer greater than or equal to 1.
[0071] The target capture scene may be, for example, a capture scene captured by a checkpoint in an intelligent transportation system, and the capture range may be, for example, a lane area. The first image and the second image may be images captured by cameras provided at the checkpoint. The first image and the second image may include specific capture targets. For example, the first image and the second image may be images captured of vehicles in a lane, with the passing vehicles being the specific capture targets. Furthermore, the first image and the second image may not include specific capture targets. For example, the first image and the second image may be images captured of an idle lane, with no vehicles in the idle lane.
[0072] The first image is an image taken without using a fill light, that is, an image in which the light spot of the fill light does not fall within the shooting range; the second image is an image taken with a fill light, for example, an image in which part or all of the light spot of the fill light falls within the shooting range.
[0073] In one possible implementation, when the installation angle and position of the fill light and the camera are fixed, the detection device can control the fill light to flash N times at a preset time interval. Simultaneously, the detection device can control the camera to capture a set of first and second images captured within the same shooting range in a target shooting scene each time the fill light flashes.
[0074] The fill light flashes once, indicating that the fill light is turned on once and then off. Before and during the fill light flashing, the detection device can control the camera to capture the first and second images. With each flash, the detection device controls the camera to capture the first and second images before and during the fill light flashing. Each set of first and second images is captured continuously by the camera, forming a set of adjacent comparison frames.
[0075] For example, if N is 48 and the preset time interval is 0.5 seconds, and the fill light and camera are installed at a fixed angle and position, the detection device can control the fill light to flash once every 0.5 seconds, for a total of 48 consecutive flashes. Before the fill light flashes, the detection device can control the camera to capture the first image, and then capture the second image while the fill light flashes. In this way, the first and second images captured consecutively form a set of comparison frames. After the fill light flashes 48 times, the detection device will have captured 48 sets of comparison images formed by the first and second images.
[0076] In the above implementation, by capturing the first and second images of the fill light before and during flashing, with the installation angle and position of the fill light and the camera fixed, as a set of comparison frames, it is possible to ensure that the environmental influencing factors (factors other than the influence of the fill light) of the first and second images remain consistent. Specifically, the image angles and positions of the first and second images, as well as the size and position of the fill light's fill light area, are consistent.
[0077] In one possible implementation, when the installation angle and position of the fill light and the camera are fixed, the detection device may pre-acquire a fill light detection image and an ambient light detection image captured within the capture range under the target capture scene. The value of N is determined based on the exposure difference between the fill light detection image and the ambient light detection image. For example, before acquiring N sets of first and second images, the detection device may first acquire the fill light detection image and the ambient light detection image. The exposure difference between the fill light detection image and the ambient light detection image is then determined based on the exposure values of the fill light detection image and the ambient light detection image. If the exposure difference is greater than or equal to a preset difference threshold, N is determined to be a first value; if the exposure difference is less than the preset difference threshold, N is determined to be a second value. The fill light detection image is an image captured using the fill light for fill lighting, i.e., an image in which part or all of the fill light spot falls within the capture range. The ambient light detection image is an image captured without the fill light for fill lighting, i.e., an image in which the fill light spot does not fall within the capture range. The second value is greater than the first value.
[0078] In other words, the detection device determines the value of N by determining the relationship between the exposure difference and a preset difference threshold. If the exposure difference is greater than or equal to the preset difference threshold, N is determined to be a first value; if the exposure difference is less than the preset difference threshold, N is determined to be a second value. The second value is greater than the first value.
[0079] For example, if the exposure value of the fill light detection image is 80 and the exposure value of the ambient light detection image is 75, the detection device can determine, based on the exposure values of the fill light detection image and the ambient light detection image, that the exposure difference between the fill light detection image and the ambient light detection image is 5. If the preset difference threshold is 60, the detection device can determine that the exposure difference between the fill light detection image and the ambient light detection image is less than the preset difference threshold. Therefore, N is a second value, which can be 12, obtained by dividing the preset difference threshold of 60 by the exposure difference of 5. If the exposure value of the fill light detection image is 80 and the exposure value of the ambient light detection image is 20, the detection device can determine, based on the exposure values of the fill light detection image and the ambient light detection image, that the exposure difference between the fill light detection image and the ambient light detection image is 60. If the preset difference threshold is 60, the detection device can determine that the exposure difference between the fill light detection image and the ambient light detection image is equal to the preset difference threshold. Therefore, N is a first value, which can be 1, obtained by dividing the preset difference threshold of 60 by the exposure difference of 60. If the exposure value of the fill light detection image is 80 and the exposure value of the ambient light detection image is 10, the detection device can determine, based on the exposure values of the fill light detection image and the ambient light detection image, that the exposure difference between the fill light detection image and the ambient light detection image is 70. If the preset difference threshold is 60, the detection device can determine that the exposure difference between the fill light detection image and the ambient light detection image is less than the preset difference threshold. Therefore, N is a first value, and N can be 1.
[0080] In the above implementation, the detection device determines the value of N based on the difference in exposure values between the fill light detection image and the ambient light detection image. This allows the device to dynamically determine the value of N based on varying ambient light conditions, thus avoiding overexposure of the fill light's spot area in strong ambient light conditions. This can lead to a small difference in exposure values between the ambient light detection image and the fill light detection image, resulting in an inconspicuous fill light area and affecting the accuracy of detecting the fill light's current fill light area. By presetting a difference threshold and determining the value of N based on the relationship between the exposure difference between the first and second images and the preset difference threshold, the accuracy of detecting the fill light's current fill light area can be improved, further enhancing the efficiency of fill light debugging.
[0081] S102 : For each group of images, determine a light spot area according to the first image and the second image to obtain N light spot areas; the light spot area is used to indicate the light spot area corresponding to the fill light in the second image.
[0082] In an embodiment of the present application, the second image is an image taken using a fill light for fill lighting; therefore, based on the second image and the first image taken without the fill light for fill lighting, the light spot area formed by the fill light in the second image can be determined, and the light spot area can be reflected by the light spot area.
[0083] The light spot area may be at least one of an image of the light spot area, key point coordinates of the light spot area, or other digital expressions of the light spot area.
[0084] In one possible implementation, for each set of first and second images, the detection device performs a double-frame subtraction operation on the first and second images to obtain the light spot area corresponding to the fill light in the second image. In this implementation, the fill light area map is the inter-frame difference image between the first and second images.
[0085] Among them, dual-frame subtraction is an image processing technology that can detect changes or differences in an image sequence. In an embodiment of the present application, dual-frame subtraction is used to detect the spot area of the fill light in the second image. Specifically, a subtraction operation is performed on a set of first and second images, that is, the corresponding pixel values in the first and second images are subtracted. If the difference values of certain pixels in the first and second images are large, it means that these positions have undergone significant changes, and the difference area between the first and second images, that is, the spot area, can be found.
[0086] In another possible implementation, the detection device may process each set of the first image and the second image using a preset image processing model and output a light spot area.
[0087] The image processing model can be a trained model that can obtain the difference between two frames of images and obtain a difference image between the two frames of images. In this way, the detection device can process N sets of first images and second sets of images using the image processing model to obtain N light spot areas.
[0088] The above method of determining the light spot area through a double-frame subtraction operation or an image processing model for each set of first and second images is only an example and does not limit the specific implementation method of determining the light spot area based on the first and second images.
[0089] In a possible implementation, after the detection device acquires N groups of first images and second images, the image parameters of the first image and the second image may be adjusted according to the image parameters of the first image in each group of images.
[0090] If the exposure value of the first image is greater than a preset exposure threshold, the detection device performs exposure adjustment processing on the first and second images according to the preset exposure adjustment value. If the grayscale value of the first image is less than the preset grayscale threshold, the detection device performs gamma correction processing on the first and second images according to the preset gamma value.
[0091] For example, if the exposure value of the first image acquired by the detection device is greater than the preset exposure value, the brightness of the first image will be very bright and will be greatly affected by the environment. At this time, the detection device will simultaneously perform exposure adjustment processing on the first image and the second image according to the preset exposure value, so that the exposure value changes of the first image and the second image are the same, stabilize the exposure of the first image and the second image, and make the brightness changes of the first image and the second image consistent, avoiding the change of the spot area of the fill light in the second image due to the brightness adjustment, resulting in inaccurate spot area. If the grayscale value of the first image acquired by the detection device is greater than the preset grayscale threshold, the contrast of the first image is relatively small. Therefore, the detection device will simultaneously perform gamma correction processing on the first image and the second image according to the preset gamma value, increase the contrast of the first image and the second image, and make the spot area of the fill light in the second image more prominent.
[0092] For example, assume that the preset exposure threshold of the detection device is 80 and the preset grayscale threshold is 50. If the exposure value of the first image detected by the detection device is 120, the detection device will automatically perform exposure adjustment processing on the first image and the second image at the same time according to the preset exposure adjustment value 10. After the automatic exposure adjustment processing, the relationship between the exposure value of the first image and the preset exposure threshold is judged again, and the exposure adjustment processing is automatically performed on the first image and the second image until the exposure value of the first image is less than or equal to the preset exposure threshold. If the grayscale value of the first image detected by the detection device is 100, the detection device will automatically perform gamma correction processing on the first image and the second image according to the preset gamma value 2. After the automatic gamma correction processing, the relationship between the grayscale value of the first image and the preset grayscale threshold is judged again, and the gamma correction processing is automatically performed on the first image and the second image until the exposure value of the first image is less than or equal to the preset grayscale threshold.
[0093] In one possible implementation, when the detection device processes the first and second images, the detection device may process the first and second images based on acquired image parameters of the first and second images and adjustment values for the respective image parameters input by the user. The image parameters include at least an exposure value and a grayscale value.
[0094] In the above implementation method, the image parameters of the first image and the second image are synchronously adjusted according to the image parameters obtained from the first image and the second image, and the adjustment values of the image parameters expected by the user. This can make the light spot area of the fill light in the second image more prominent while ensuring that other variable values of the first image and the second image change synchronously, thereby making the detected light spot area of the fill light in the second image more accurate.
[0095] In one possible implementation, the detection device can perform image processing on at least one light spot area or the current fill light area, including adjusting the exposure value and gamma correction of the grayscale value of the light spot area or the current fill light area, so as to obtain a more prominent and clear current fill light area. Here, there is no specific limitation on the image processing method. The detection device can perform adaptive adjustment based on the adjustment threshold of the pre-equipment, or the relevant technicians can manually input the adjustment value according to the pixel information of the light spot area or the current fill light area to perform adjustment. The method used by the detection device to perform image processing on at least one light spot area or the current fill light area is consistent with the processing method for the first image and the second image, and will not be repeated here.
[0096] It can be seen from this that image processing of at least one of the first image and the second image, the light spot area or the current fill light area, including at least exposure value adjustment and grayscale value adjustment, can make the light spot of the second image more prominent, thereby improving the detection accuracy of the current fill light area.
[0097] S103 : Determine a current fill light area of the fill light according to the N light spot areas, where the current fill light area includes an overlapping area of the N light spot areas.
[0098] In a possible implementation, if the light spot area is a light spot area map, multiple frames of the acquired N light spot area maps are accumulated to determine the current fill light area.
[0099] Multi-frame accumulation is an image processing technology. The detection device can obtain the current fill light area of the fill light by accumulating multiple light spot area images. The current fill light area includes the overlapping area of N light spot areas.
[0100] Figure 4 This is a schematic diagram of a method for obtaining the current fill light area of a fill light provided by an embodiment of the present application. Figure 4 As shown, the detection device can perform a double-frame subtraction operation on a set of continuous first images 401 and second images 402, thereby obtaining a light spot area map 403. For N sets of first images 401 and second images 402, the detection device uses a double-frame subtraction operation and obtains N light spot area maps 403. The detection device can perform a multi-frame accumulation operation on the N light spot area maps 403 to obtain a clear and accurate current fill light area 404.
[0101] As can be seen, by acquiring N sets of first and second images captured within the same shooting range under the target shooting scene, and generating N sets of light spot area maps based on these N sets of first and second images, and then determining the current fill light area of the fill light through multi-frame accumulation based on these N sets of light spot area maps, this method not only prevents interference from ambient light and other factors on the current fill light area of the fill light, but also improves the accuracy of detecting the current fill light area of the fill light. Furthermore, it provides a more intuitive display of the current fill light area of the fill light.
[0102] In some embodiments, the method provided by the embodiments of the present application further includes:
[0103] S104: The detection device displays debugging information based on the current fill light area and the target fill light area, wherein the debugging information is used to instruct adjustment of the installation angle of the fill light.
[0104] In an embodiment of the present application, the detection device can determine whether the fill light needs to be debugged based on the current fill light area and the target fill light area. If debugging is required, the debugging information is output and displayed.
[0105] The current fill light area may be at least one of an image of the front fill light area, key point coordinates of the front fill light area, or other digital expressions of the front fill light area.
[0106] The target fill light area may be at least one of an image of the target fill light area, key point coordinates of the target fill light area, or other digital expressions of the target fill light area.
[0107] In one possible implementation, the detection device can use stereoscopic vision to reconstruct the three-dimensional shape of the target scene and the positional relationships between elements in the target scene based on the acquired information about the target scene, thereby obtaining a three-dimensional model of the target scene. The three-dimensional model of the target scene can be displayed to the user in a visual manner.
[0108] Stereoscopic vision is a technology that restores the three-dimensional information of an object by calculating the disparity of images. It can be used to reconstruct a three-dimensional model of the target scene. First, the camera needs to capture images of the same scene from different angles and register these images to ensure that the various elements of the target scene in the different images are spatially aligned. Then, using information such as the image's grayscale and edges, the positional difference between each pixel in the different images is determined, resulting in the disparity. Finally, based on this disparity information, the three-dimensional shape of the target scene and the positional relationships between the various elements in the target camera scene can be reconstructed to obtain a three-dimensional model of the target scene.
[0109] For example, taking the target shooting scene as a traffic monitoring scene, the detection equipment can obtain images of the same monitored road from different angles, and determine the position information of different elements in the target shooting scene based on the images from different angles. For example, the shapes of elements such as lane lines and trigger lines of the monitored road in the three-dimensional model and their mutual relationships can be restored, thereby obtaining a three-dimensional model of the target shooting scene.
[0110] In one possible implementation, based on the three-dimensional model of the target shooting scene, the detection device may obtain the road information input by the user and display it in the three-dimensional model of the target shooting scene.
[0111] In another possible implementation, road information can be automatically generated by a detection model in the detection device based on an image of the target scene. The detection model can be a pre-trained model that automatically identifies specific elements in an image and obtains information about them. The specific elements can be lane markings and capture trigger lines in the target scene.
[0112] It should be noted that the above-mentioned road information input by the user or automatically generated by the detection model in the detection device based on the image of the target shooting scene is only an example of how the detection device obtains the road information of the target shooting scene. The method of receiving the road information of the detection device is not specifically limited here.
[0113] In one possible implementation, based on a 3D model of the target shooting scene, the detection device can receive information about the target shooting scene input by the user, determine a target fill light area based on the target shooting scene information, and display the target fill light area to the user in a visual manner.
[0114] The information of the target shooting scene includes at least the relative position information between the fill light and the desired shooting range, and may also include the road information of the target scene.
[0115] In other words, the target fill-in light area can be determined by the detection device based on information about the target shooting scene and displayed based on the three-dimensional model of the target shooting scene. The target fill-in light area can be used to indicate the area within the expected shooting range that the shooting device can capture, and can help the shooting device capture a clearer target within the shooting range.
[0116] for example, Figure 5 Schematic diagram of a method for determining a target fill light area in a traffic monitoring scenario provided by an embodiment of the present application. Figure 5As shown, including Figure A and Figure B. In the traffic monitoring scene, the fill light 101 and the shooting device 102 are usually installed on the monitoring pole. After the fill light 101 and the shooting device 102 are fixed, the information of the target shooting scene that the detection device needs to obtain may include the shortest distance L1 between the projection point of the shooting device 102 on the ground and the capture trigger line 104, the height L2 of the shooting target (such as Figure 5 As shown in Figure A), lane width L3 and distance L4 between the fill light 101 and the shooting device 102 (as shown in Figure A Figure 5 The target shooting scene information that the detection device needs to obtain also includes the capture trigger line 104 and the lane line 503.
[0117] Testing equipment according to Figure 5 The shortest distance L1 between the projection point of the shooting device 102 on the ground and the capture trigger line 104 in Figure A and the height L2 of the shooting target 103 can determine the center point of the target shooting area 501; according to the lane width L3, the target shooting area 501 (such as Figure 5 (as shown in Figure B).
[0118] It should be noted that the height of the target 103 can be customized by the user based on the specific application scenario. For example, in a facial recognition scenario at a scenic spot, the target height can be the average height from the ground to a human face; in a logistics monitoring scenario, the target height can be the average height of a large truck; in an airport runway monitoring scenario, the target height can be the average height of an aircraft, etc. By customizing the target height according to the application scenario, the user can ensure the accuracy of the target fill light area and provide more diverse and flexible application scenarios.
[0119] According to the distance L4 between the fill light 101 and the shooting device 102 and the position information, for example, the fill light 101 is on the right side of the shooting device 102, the distance is L4, based on a similar principle, it can be obtained that the center point of the target fill light area 502 is to the right side of the center point of the target shooting area 501 and the distance is L4‵; therefore, the center point of the target fill light area 502 is determined.
[0120] At the same time, according to the focal length information of the lens, the front-back distance L5 between the target fill-in light area 502 and the target shooting area 501 can be determined. Finally, the target fill-in light area 502 can be determined in combination with the lane width L3.
[0121] in, Figure 5 In Figure A, various directions are defined based on a three-dimensional coordinate system. The Z-axis direction is the direction of the monitoring pole, the Y-axis direction is the direction of the lane line 503 and is perpendicular to the Z-axis, and the X-axis is the direction of the capture trigger line 104 and is perpendicular to the Y-axis direction.
[0122] In a possible implementation, the detection device may receive a target fill light area input by a user, where the target fill light area is defined by the user.
[0123] It should be noted that the target fill-light area is determined when the target shooting scene does not include the shooting target (i.e., when there are no vehicles on the lane). This can avoid errors caused by the shooting target in the fill-light area detection, making the display of the target fill-light area clearer and more prominent, and ensuring the accuracy of the target fill-light area. It should be understood that in actual applications, fill-lighting is usually performed for a specific shooting target, such as a vehicle on a lane. Therefore, when determining the target fill-light area in the above implementation, factors related to the shooting target, such as the height L2 of the shooting target, are taken into account. In this way, when the fill light is used to fill light the shooting target, the light spot generated by the fill light can fall on the shooting target within the target shooting area.
[0124] In another possible implementation, the target shooting area can also be determined when the target shooting scene includes a shooting target, such as when there is a vehicle on the lane; in this case, the target shooting area is used to indicate the target fill light area. For example, the center point of the target shooting area can be determined based on the shortest distance between the projection point of the shooting device on the ground and the snapshot trigger line; the target shooting area can be determined based on the lane width. In this case, the target shooting area is determined as the target fill light area. In this implementation, since the target fill light area is determined when there is a shooting target within the shooting range, there is no need to consider factors related to the shooting target, and it can be ensured that when the fill light is used to fill light the shooting target, the light spot generated by the fill light can fall on the shooting target within the target shooting area.
[0125] In another possible implementation, when the target shooting scene includes a shooting target, the detection device may receive a target shooting area input by a user; wherein the target shooting area is used to indicate a target fill light area.
[0126] It should be noted that when determining the target fill light area and detecting the fill light's current fill light area, it is necessary to ensure that all other environmental factors remain constant, except for whether the fill light is flickering. In other words, if the target fill light area is determined without the target being captured in the target shooting scene, then the current fill light area of the fill light must also be detected without the target being captured in the target shooting scene. If the target fill light area is determined while the target being captured in the target shooting scene, then the current fill light area of the fill light must also be detected while the target being captured in the target shooting scene. This ensures that subsequent debugging of the fill light based on the target fill light area and the current fill light area improves debugging accuracy, thereby increasing the efficiency of fill light debugging.
[0127] In one possible implementation, the overlap between the current fill light area and the target fill light area is determined. If the overlap is less than a preset overlap threshold, the detection device may display debugging information based on the position information of the current fill light area and the target fill light area.
[0128] The overlap degree can be used to indicate the size of the overlap area between the current fill light area and the target fill light area relative to the target fill light area. The area size of the current fill light area and the target fill light area can be determined based on at least one of their respective images, key point coordinates, or other digital expressions.
[0129] For example, the overlap ratio can be the ratio of the overlapping area to the target fill light area. If the overlap ratio is less than a preset overlap threshold, it indicates that the current fill light area does not adequately cover the target fill light area, and the fill light position needs to be adjusted. Therefore, the detection device can display adjustment information based on the position information of the current fill light area and the target fill light area.
[0130] In a possible implementation, the debugging information may include at least one of an adjustment strategy for the installation angle of the fill light and / or a debugging preview image.
[0131] The debugging preview image is used to indicate the relative position relationship between the target fill light area and the current fill light area.
[0132] In one possible implementation, the fill light installation angle adjustment strategy can be an adjustment vector. The adjustment vector can be used to indicate the offset vector of the center coordinates of the current fill light area and the target fill light area. A debugging vector can be generated based on the relative positional relationship between the target fill light area and the current fill light area. The adjustment vector can guide relevant personnel to debug the fill light installation angle according to the adjustment vector, so that the overlap between the current fill light area and the target fill light area is greater than or equal to a preset overlap threshold, allowing the fill light to cooperate with the camera to capture a clear image of the target.
[0133] For example, after the detection device obtains the current fill light area and the target fill light area, Figure 6 This is a schematic diagram of a debug preview image provided by an embodiment of the present application. Figure 6 As shown, the detection device can obtain the coordinates of the center of the current fill light area 601 center point A and the center point coordinates of the target fill light area 502 center point B. The detection device can determine the adjustment vector a based on the coordinates of the center of the current fill light area 601 and the center point coordinates of the target fill light area 502.
[0134] In a possible implementation, the adjustment strategy for the installation angle of the fill light may be an adjustment plan; the adjustment plan may be generated based on an adjustment vector, indicating the position and distance for installation and debugging of the fill light.
[0135] For example, based on the adjustment vector, by matching the preset adjustment strategy, it can be displayed that the fill light is adjusted 20 cm to the left and the angle is raised by about 15 degrees, etc., which can provide a reference solution for relevant technicians to debug the fill light, so that the debugging information can be displayed intuitively.
[0136] In a possible implementation, if the degree of overlap is greater than or equal to a preset degree of overlap threshold, a prompt message indicating that the debugging is successful may be displayed.
[0137] That is to say, after the fill light is installed or debugged, the current installation or debugging can be judged by the overlap based on the detection of the current fill light area and the target fill light area. If the preset overlap threshold is met, a prompt message indicating successful debugging will be displayed.
[0138] It can be seen from this that by visually displaying debugging information including adjustment strategies for the installation angle of the fill light and / or at least one type of debugging preview image, relevant technical personnel can be intuitively guided to debug the installation angle of the fill light, thereby improving the efficiency of fill light debugging.
[0139] Figure 7 This is a flow chart of a fill light debugging method provided by an embodiment of the present application. The fill light debugging method can be applied to a fill light area detection system of a fill light, such as Figure 7 As shown. The three-dimensional shape and position of the target shooting scene can be reconstructed and visualized using stereo vision. After the positions of the fill light and the shooting device are fixed, the detection device can receive the information of the target shooting scene input by the user (S701). The information of the target shooting scene at least includes the relative position information between the fill light and the desired shooting range. And the lane line and the shooting trigger line are delineated based on the information of the target shooting scene. The detection device can determine the target fill light area based on the information of the target shooting scene (S702). Among them, the information of the target shooting scene includes the shortest distance between the fill light and the shooting target, the shooting target height, the lane width and the distance L4 between the fill light and the shooting device. First, the detection device can determine the center point of the target shooting area based on the shortest distance between the fill light and the shooting target and the shooting target height. Secondly, the target shooting area can be determined based on the lane width. Finally, based on the distance between the shooting devices 102, the target fill light area can be obtained based on similar principles. At the same time, the target fill light area can be displayed in a visual manner.
[0140] The detection device can acquire N sets of first and second images (S703). The first image is an image captured without a fill light, and the second image is an image captured with a fill light; N is an integer greater than or equal to 1. Before acquiring the first and second images, the detection device can determine the value of N based on the exposure difference between the fill light detection image and the ambient light detection image, and the relationship between the exposure difference and a preset difference threshold. If the exposure difference is greater than or equal to the preset difference threshold, N is determined to be a first value; if the exposure difference is less than the preset difference threshold, N is determined to be a second value. The second value is greater than the first value. Based on the N sets of first and second images, the detection device acquires N light spot regions (S704). For each set of first and second images, a double-frame subtraction operation is performed on the first and second images to obtain the light spot region corresponding to the second image. Thus, N light spot regions can be acquired. Based on the N light spot regions, the current fill light region of the fill light is determined (S705). The detection device can obtain the current fill light area of the fill light by accumulating N light spot areas over multiple frames. The current fill light area of the fill light is displayed visually. An adjustment vector (S706) is determined based on the coordinates of the center of the current fill light area and the coordinates of the center point of the target fill light area. The adjustment vector can be used to indicate the offset angle and distance of the test fill light. Relevant technicians can debug the installation angle of the fill light based on the adjustment vector. An adjustment strategy for the installation angle of the fill light can also be generated based on the adjustment vector.
[0141] The overlap degree is determined based on the current fill light area and the target fill light area (S707). The overlapping area between the current fill light area and the target fill light area can be determined based on the current fill light area and the target fill light area. The overlap degree is determined based on the overlapping area. The overlap degree can be the ratio of the area of the overlapping area to the area of the target fill light area. A determination is made as to whether the overlap degree is less than a preset overlap degree threshold (S708). If the overlap degree is less than the preset overlap degree threshold, debugging information is displayed (S709). The debugging information can include at least one of an adjustment strategy for the fill light installation angle and / or a debugging preview image. Visually displaying the debugging information including at least one of an adjustment strategy for the fill light installation angle and / or a debugging preview image can intuitively guide relevant technical personnel in debugging the fill light installation angle. If the overlap degree is not less than the preset overlap degree threshold, a prompt message indicating successful debugging is displayed (S710).
[0142] In summary, embodiments of the present application provide a method for detecting the fill light area of a fill light. This method can be applied to a detection device or a fill light debugging device. The device can obtain N sets of first and second images captured within the same shooting range under a target shooting scene. For each set of first and second images, the device determines the light spot area, thereby obtaining N light spot areas. The first image is an image captured under the target shooting scene without the fill light, and the second image is an image captured under the target shooting scene with the fill light. N is an integer positive number greater than or equal to 1. The light spot area indicates the light spot area corresponding to the fill light in the second image. The device can determine the current fill light area of the fill light based on the N light spot areas. This method can accurately determine the current fill light area of the fill light. Furthermore, the device determines the degree of overlap between the target fill light area and the current fill light area. If the overlap is less than a preset overlap threshold, the device displays debugging information. This debugging information can provide a better basis for debugging the fill light, making debugging more accurate and improving the efficiency of the debugging process.
[0143] The above mainly introduces the scheme of the embodiment of the present application from the perspective of the method. It can be understood that in order to realize the above functions, the fill light area detection device of the fill light includes at least one of the hardware structure and software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the embodiments of the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the embodiments of the present application.
[0144] In the embodiment of the present application, the fill light area detection device of the fill light can be divided into functional units according to the above-mentioned method example. For example, each functional unit can be divided according to each function, or two or more functions can be integrated into one processing unit. The above-mentioned integrated unit can be implemented in the form of hardware or in the form of software functional units. It should be noted that the division of units in the embodiment of the present application is schematic and is only a logical functional division. In actual implementation, there may be other division methods.
[0145] For example, Figure 8 FIG. 1 is a structural diagram of a fill light area detection device for a fill light provided in an embodiment of the present application. Figure 8 As shown, the fill light area detection device of the fill light can be applied to a detection device. The fill light area detection device 800 of the fill light includes:
[0146] The acquisition module 801 is used to obtain N groups of first images and second images taken for the same shooting range in the target shooting scene; the first images are images taken without using a fill light for fill lighting, and the second images are images taken with a fill light for fill lighting; N is an integer greater than or equal to 1.
[0147] Detection module 802 is configured to determine, for each image group, a light spot region based on the first image and the second image, resulting in N light spot regions. The light spot region indicates the light spot region corresponding to the fill light in the second image. Based on the N light spot regions, a current fill light region of the fill light is determined. The current fill light region includes the overlapping region of the N light spot regions.
[0148] In a possible implementation, the fill light area detection device 800 of the fill light further includes:
[0149] The visualization module is used to generate debugging information according to the current fill light area and the target fill light area; the debugging information is used to be displayed on the display device, and the debugging information is used to indicate the adjustment of the installation angle of the fill light.
[0150] In a possible implementation, the visualization module is further configured to display a prompt message indicating successful debugging if the degree of overlap is greater than or equal to a preset degree of overlap threshold.
[0151] In a possible implementation, the visualization module is also used for debugging strategies for the installation angle of the fill light; and / or debugging preview images; the debugging preview images are used to indicate the relative positional relationship between the target fill light area and the current fill light area.
[0152] In a possible implementation, the visualization module is further used to construct a three-dimensional model corresponding to the target shooting scene based on information of the target shooting scene; the three-dimensional model is used to be displayed on a display device, and the three-dimensional model is used to show the target shooting scene to the user.
[0153] In a possible implementation, the fill light area detection device 800 of the fill light further includes:
[0154] The image processing module is used to perform exposure adjustment processing on the first image and the second image according to a preset exposure adjustment value if the exposure value of the first image is greater than a preset exposure threshold; and to perform gamma correction processing on the first image and the second image according to a preset gamma value if the grayscale value of the first image is greater than the preset grayscale threshold.
[0155] In a possible implementation, the fill light area detection device 800 of the fill light further includes:
[0156] The light control module is used to control the fill light to flash N times according to a preset time interval when the fill light and the shooting device are fixed; and to control the shooting device to obtain a set of first images and second images each time the fill light flashes.
[0157] In a possible implementation, the fill light area detection device 800 of the fill light further includes:
[0158] The input module is used to receive target shooting scene information input by the user, the target shooting scene information at least including the relative position information between the fill light and the expected shooting range; and determine the target fill light area according to the target shooting scene information.
[0159] In a possible implementation, the input module is further used to obtain information of the target shooting scene;
[0160] In one possible implementation, acquisition module 801 is further configured to acquire a fill light detection image and an ambient light detection image captured within a target shooting scene and within a shooting range; the fill light detection image is an image captured using a fill light for fill lighting, and the ambient light detection image is an image captured without a fill light for fill lighting. Based on the exposure values of the fill light detection image and the ambient light detection image, an exposure difference between the fill light detection image and the ambient light detection image is determined. If the exposure difference is greater than or equal to a preset difference threshold, N is determined to be a first value. If the exposure difference is less than the preset difference threshold, N is determined to be a second value; the second value is greater than the first value.
[0161] In one possible implementation, the detection module 802 is also used to determine the degree of overlap based on the respective range information of the current fill light area and the target fill light area. The degree of overlap is used to indicate the size of the overlapping area of the actual fill light area and the target fill light area relative to the target fill light area; if the degree of overlap is less than the preset overlap threshold, debugging information is displayed based on the respective position information of the current fill light area and the target fill light area.
[0162] In a possible implementation, the detection module 802 is further configured to, for each group of images, perform a double-frame subtraction operation on the first image and the second image to obtain a light spot area corresponding to the second image.
[0163] The present invention also provides a computer-readable storage medium having instructions stored therein, which, when executed on a computer, causes the computer to execute Figure 1-Figure 7 The operations of any corresponding embodiment and its various feasible implementation methods.
[0164] The present application also provides a computer program product comprising instructions, which, when executed on a computer, causes the computer to execute Figure 1-Figure 7The operations of any corresponding embodiment and its various feasible implementation methods.
[0165] Those skilled in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.
[0166] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0167] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions, and when the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one network site, computer, server or data center to another network site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line) or wireless (e.g., infrared, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access, or it can be a data storage device such as a server or data center that includes one or more available media integrated. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape, etc.), an optical medium (e.g., a DVD, etc.), or a semiconductor medium (e.g., a solid-state hard disk), etc.
[0168] In the above embodiments, the description of each embodiment has different emphases. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0169] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
Claims
1. A method for detecting the fill light area of a fill light, characterized in that: The method comprises: Acquire N sets of first images and second images captured within the same shooting range under a target shooting scene; the first images are images captured without the fill light, and the second images are images captured with the fill light; N is an integer greater than or equal to 1; For each group of images, a light spot area is determined based on the first image and the second image to obtain N light spot areas; the light spot area is used to indicate the light spot area corresponding to the fill light in the second image; A current fill light area of the fill light is determined according to the N light spot areas, where the current fill light area includes an overlapping area of the N light spot areas.
2. The method according to claim 1, characterized in that The method further comprises: Debugging information is generated according to the current fill light area and the target fill light area; the debugging information is used for displaying on a display device, and the debugging information is used for instructing adjustment of the installation angle of the fill light.
3. The method according to claim 1 or 2, characterized in that The step of determining the light spot area for each group of images according to the first image and the second image to obtain N light spot areas includes: For each group of images, a double-frame subtraction operation is performed on the first image and the second image to obtain a light spot area corresponding to the second image.
4. The method according to any one of claims 1 to 3, characterized in that The method further comprises: Acquire a fill light detection image and an ambient light detection image captured for the shooting range in the target shooting scene; the fill light detection image is an image captured using the fill light for fill light, and the ambient light detection image is an image captured without using the fill light for fill light; determining an exposure difference between the fill light detection image and the ambient light detection image according to the exposure value of the fill light detection image and the exposure value of the ambient light detection image; If the exposure difference is greater than or equal to a preset difference threshold, determining that N is a first value; If the exposure difference is less than a preset difference threshold, N is determined to be a second value; and the second value is greater than the first value.
5. The method according to any one of claims 1 to 4, characterized in that Before determining the light spot area according to the first image and the second image, the method further includes: If the exposure value of the first image is greater than a preset exposure threshold, performing exposure adjustment processing on the first image and the second image according to a preset exposure adjustment value; If the grayscale value of the first image is less than a preset grayscale threshold, gamma correction processing is performed on the first image and the second image according to a preset gamma value.
6. The method according to claim 2, characterized in that The displaying of debugging information according to the current fill light area and the target fill light area includes: determining a degree of overlap according to respective range information of the current fill light area and the target fill light area, the degree of overlap being used to indicate a size of an overlap area between the actual fill light area and the target fill light area relative to the target fill light area; If the overlap is less than a preset overlap threshold, the debugging information is displayed according to the respective position information of the current fill light area and the target fill light area.
7. The method according to claim 2, characterized in that The method further comprises: Acquiring information of the target shooting scene; Based on the information of the target shooting scene, a three-dimensional model corresponding to the target shooting scene is constructed; the three-dimensional model is used to be displayed on a display device, and the three-dimensional model is used to show the target shooting scene to a user.
8. The method according to claim 7, characterized in that The debugging information includes: A debugging strategy for the installation angle of the fill light; and / or, area information, the area information being used to indicate a relative positional relationship between the target fill light area and the current fill light area; The region information is used to be displayed in a three-dimensional model corresponding to the target shooting scene.
9. The method according to any one of claims 1 to 8, characterized in that The method further comprises: Acquiring information of the target shooting scene, where the information of the target shooting scene is at least used to indicate relative position information between the fill light and a desired shooting range; A target fill light area is determined according to information of the target shooting scene.
10. The method according to claim 6, characterized in that The method further comprises: If the degree of overlap is greater than or equal to a preset degree of overlap threshold, a prompt message indicating that the debugging is successful is displayed.
11. The method according to any one of claims 1 to 10, characterized in that The acquiring of the first image and the second image captured in the same shooting range under the target shooting scene includes: When the angles and positions of the fill light and the camera are fixed, controlling the fill light to flash N times according to a preset time interval; The shooting device is controlled to acquire a set of the first image and the second image each time the fill light flashes.
12. A fill light area detection device for a fill light, characterized in that: The detection device includes: a processor and a memory for storing instructions executable by the processor; The processor is configured to execute the instruction, so that the processor performs the fill light area detection method of the fill light according to any one of claims 1 to 11.
13. A fill light area detection system for a fill light, characterized in that: The fill light area detection system of the fill light comprises: the detection device according to claim 12, a shooting device and a fill light; the shooting device and the fill light are communicatively connected with the detection device; Wherein, the detection device is used to perform the method according to any one of claims 1 to 11; The photographing device is used to photograph N groups of the first image and the second image in the same photographing range under a target photographing scene; The fill light is used to provide fill light when the shooting device shoots the second image.