A picture safety monitoring and early warning system for night vision observation equipment

Abstract

The present invention relates to the field of night vision monitoring, and is used to solve the problem that a night vision camera's high-illuminance fill light continuously fills in light, thereby causing energy waste and impacting the environment. The present invention is specifically a picture safety monitoring and early warning system for night vision observation equipment, comprising a camera monitoring unit, an infrared monitoring unit, a regional picture monitoring unit, a low-light control unit, and a picture alarm generation unit. In the present invention, pictures of a visible light camera and an infrared camera are monitored separately to confirm whether positions where pictures change overlap. When changes occur in the two groups of pictures, the fill light is controlled to operate to improve the shooting clarity of the visible light picture, facilitate the capture of facial information in the picture, and improve the safety of picture monitoring. When changes occur in one group of pictures, the fill light is controlled to operate to increase the scene brightness, and the two groups of pictures are overlapped and compared again to confirm whether picture changes occur in the two groups of pictures at the same time, thereby improving the accuracy of picture monitoring.

Description

Technical Field

[0001] The present invention relates to the field of night vision monitoring, and in particular to an image safety monitoring and early warning system for night vision observation equipment. Background Art

[0002] The monitoring system is the physical basis for real-time monitoring of key departments or important places in various industries. Management departments can obtain effective data, image video, digital video monitoring system schematics or sound information through it, and conduct timely monitoring and memory of the process of sudden abnormal events, so as to provide efficient and timely command and height, deploy police force, handle cases, etc. The working modes of monitoring cameras at night generally include black and white night vision and full-color night vision. In black and white night vision mode, the camera turns on the infrared light for fill light; in full-color night vision mode, the camera turns on the fill light for fill light, which can be white light or other visible light fill light;

[0003] At present, the night vision image security monitoring and early warning system in the existing technology still has shortcomings. The existing patent CN101959058A discloses a technical solution in which an LED lamp is used as a camera light source for fill light. The low-power LED lamp is used to continuously fill light for the camera to solve the problem of insufficient camera image clarity. However, in actual use, when the illumination of the LED lamp is insufficient, the effect of the camera capturing a human face is affected. When the illumination of the LED lamp is sufficient, the continuous operation of the LED lamp not only wastes energy, but also affects the environment, thereby affecting people's rest or affecting the ecology of phototactic insects.

[0004] In response to the above technical problems, this application proposes a solution. Summary of the Invention

[0005] In the present invention, the visible light camera and the infrared camera are monitored respectively to obtain whether the two groups of images have changed. After the change occurs, the two groups of images are superimposed to compare whether the positions where the images have changed overlap, thereby improving the accuracy of image change monitoring. When it is confirmed that the image has changed, the fill light is controlled to work, thereby improving the shooting clarity of the visible light image, facilitating the capture of facial information in the image, and improving the safety of image monitoring. At the same time, it avoids the fill light from continuously working at night, saving energy while not affecting the environment due to continuous illumination, solving the problem of energy waste and environmental impact caused by the continuous fill light of the night vision camera with high illumination, and proposes an image safety monitoring and early warning system for night vision observation equipment.

[0006] The purpose of the present invention can be achieved through the following technical solutions:

[0007] A picture safety monitoring and early warning system for night vision observation equipment includes a camera monitoring unit, which is used to collect pictures, obtain low-light pictures and picture brightness, and perform change analysis on the low-light pictures to generate image early warning signals;

[0008] An infrared monitoring unit collects images through an infrared camera, obtains infrared images, performs change analysis on the infrared images, and generates infrared warning signals;

[0009] An area image monitoring unit, which obtains an infrared warning image and an image warning image, compares and analyzes the infrared warning image and the image warning image, and generates an image change alarm or a suspected image alarm signal;

[0010] A low-light control unit, which obtains a picture change alarm or a suspected picture alarm signal through the regional picture monitoring unit and controls the fill light source;

[0011] The picture alarm generating unit obtains the picture change alarm through the regional picture monitoring unit, uploads the picture change alarm and stores the picture.

[0012] As a preferred embodiment of the present invention, the camera monitoring unit collects camera data through a camera callback function, converts the collected camera data into RGB format, and performs algorithm extraction on the RGB format to obtain brightness parameters, which are recorded as picture brightness.

[0013] As a preferred embodiment of the present invention, the process of analyzing the changes in the low-light image by the camera monitoring unit is as follows:

[0014] S1: The camera monitoring unit overlaps two adjacent frames and compares the overlapped pixels. If the color and saturation of the pixels at the same position are the same, they are recorded as static pixels. If any of the color and saturation of the pixels at the same position are different, they are recorded as changing pixels.

[0015] S2: The camera monitoring unit counts all changed pixels and calculates the proportion of changed pixels in all pixels. If the proportion of changed pixels is less than a preset proportion, a no-change signal is generated and the change analysis ends. If the proportion of changed pixels is greater than or equal to the preset proportion, step S3 is performed.

[0016] S3: The camera monitoring unit performs a discrete analysis on the distribution position of the changed pixel points in the picture to obtain the discrete characteristic value of the changed pixel points, and compares the discrete characteristic value with the preset characteristic threshold. If the discrete characteristic value is less than the preset threshold, an image warning signal is generated.

[0017] As a preferred embodiment of the present invention, the process of the infrared monitoring unit performing image change analysis on the infrared image is as follows:

[0018] A1: The infrared monitoring unit treats each frame of the infrared image as a picture and obtains the temperature of the pixels in the picture;

[0019] A2: Continuously monitor the temperature of a pixel at the same location. If the temperature fluctuation of a pixel at the same location exceeds a preset threshold between two consecutive frames, the pixel is recorded as a changing pixel. If the temperature fluctuation of a pixel at the same location does not exceed the preset threshold between two consecutive frames, the pixel is recorded as a stationary pixel.

[0020] A3: The infrared monitoring unit counts the proportion of changed pixels among all pixels. When the proportion of changed pixels is greater than a preset ratio, step A4 is performed. When the proportion of changed pixels is less than or equal to the preset ratio, a still image signal is generated and the change analysis ends.

[0021] A4: The infrared monitoring unit performs a discrete analysis on the distribution of the changing pixels in the image to obtain a discrete eigenvalue. If the discrete eigenvalue is less than a preset threshold, an infrared warning signal is generated.

[0022] As a preferred embodiment of the present invention, the camera monitoring unit sends the picture brightness and image warning signal to the regional picture monitoring unit, and the infrared monitoring unit sends the infrared warning signal to the regional picture monitoring unit.

[0023] As a preferred embodiment of the present invention, the process of discrete analysis performed by the infrared monitoring unit and the video monitoring unit is as follows:

[0024] A set of changing pixels is selected as the starting point, and the shortest path passing through all the changing pixels is found through the path calculation algorithm. The proportion of static pixels passed by the shortest path in the total number of pixels is calculated and recorded as a discrete eigenvalue.

[0025] As a preferred embodiment of the present invention, the regional screen monitoring unit records the screen when the infrared monitoring unit generates an infrared warning signal as an infrared warning screen, and records the screen when the camera monitoring unit generates an image warning signal as an image warning screen. If the positional overlap of the changed pixel points in the infrared warning screen and the image warning screen is greater than or equal to a preset overlap value, a screen change alarm is generated; if the positional overlap of the changed pixel points in the infrared warning screen and the image warning screen is less than the preset overlap value, a screen suspected alarm signal is generated;

[0026] The regional image monitoring unit generates an image suspected alarm signal after acquiring only the infrared warning signal;

[0027] The regional image monitoring unit does not respond when only obtaining the image warning signal.

[0028] As a preferred embodiment of the present invention, after the low-light control unit obtains the picture change alarm, it performs a threshold analysis on the picture brightness. If the picture brightness reaches the set threshold, it does not respond. If the picture brightness does not reach the set threshold, it generates a fill light signal to control the brightness of the fill light source to increase linearly until the obtained picture brightness reaches the set threshold.

[0029] As a preferred embodiment of the present invention, after the low-light control unit obtains the suspected alarm signal of the screen, it performs a threshold analysis on the screen brightness. If the screen brightness reaches the set threshold, the suspected alarm signal of the screen is canceled. If the screen brightness does not reach the set threshold, the brightness of the fill light source is linearly increased so that the screen brightness reaches the set threshold. If a screen change alarm is generated, it is sent to the screen alarm generation unit. If a suspected alarm signal of the screen is still generated, the suspected alarm signal of the screen is canceled.

[0030] Compared with the prior art, the present invention has the following beneficial effects:

[0031] 1. In the present invention, when monitoring the picture, the visible light camera and the infrared camera are monitored separately to monitor whether the current visible light picture and the infrared picture have changed. After the change occurs, the two sets of pictures are superimposed to compare whether the positions where the pictures have changed coincide, thereby improving the accuracy of picture change monitoring.

[0032] 2. In the present invention, when the picture changes, the fill light is controlled by the alarm signal to work, thereby improving the shooting clarity of the visible light picture, facilitating the capture of facial information in the picture, ensuring the clarity of the saved changing picture, and improving the security of picture monitoring. At the same time, it avoids the fill light from working continuously at night, saving energy while not affecting the environment due to continuous lighting.

[0033] 3. In the present invention, when a change occurs in one of the groups of images, the fill light is controlled to work, thereby increasing the scene brightness and improving the shooting clarity of the visible light image. The two groups of images are then overlapped and compared again to confirm whether the two groups of images have changed at the same time, thereby improving the accuracy of image monitoring and reducing the working time of the fill light. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] To facilitate understanding by those skilled in the art, the present invention is further described below with reference to the accompanying drawings.

[0035] Figure 1 is a system block diagram of the present invention;

[0036] Figure 2It is a system flow chart of the present invention. DETAILED DESCRIPTION

[0037] The technical solutions of the present invention will be clearly and completely described below in conjunction with the embodiments. Obviously, the embodiments described are only some embodiments of the present invention, not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of the present invention.

[0038] Example 1:

[0039] See also Figure 1 - Figure 2 As shown, a screen security monitoring and early warning system for night vision observation equipment includes a camera monitoring unit, an infrared monitoring unit, a regional screen monitoring unit, a low-light control unit, and a screen alarm generation unit. The camera monitoring unit collects the screen through the camera and records it as a low-light screen. At the same time, the camera callback function collects the camera data, converts the collected camera data into RGB format, and performs an algorithm to extract the RGB format to obtain brightness parameters, which are recorded as screen brightness.

[0040] The camera monitoring unit analyzes changes in low-light images in the following process:

[0041] S1: The camera monitoring unit breaks down the low-light image frame by frame, recording each frame as a picture. It then overlaps two adjacent frames and compares the overlapped pixels. If the grayscale, color, and saturation of the pixels at the same location are the same, they are recorded as static pixels. If any of the grayscale, color, and saturation of the pixels at the same location are different, they are recorded as changing pixels.

[0042] S2: The camera monitoring unit counts all changed pixels and calculates the proportion of changed pixels in all pixels. If the proportion of changed pixels is less than a preset proportion, a no-change signal is generated and the change analysis ends. If the proportion of changed pixels is greater than or equal to the preset proportion, step S3 is performed.

[0043] S3: The camera monitoring unit performs a discrete analysis on the distribution position of the changed pixel points in the image to obtain a discrete characteristic value of the changed pixel points, and compares the discrete characteristic value with a preset characteristic threshold. If the discrete characteristic value is greater than the preset threshold, a picture discrete signal is generated; if the discrete characteristic value is less than the preset threshold, an image warning signal is generated;

[0044] The camera monitoring unit sends the picture brightness and image warning signal to the regional picture monitoring unit.

[0045] The infrared monitoring unit collects images of the monitored area through an infrared camera and records them as infrared images. The infrared monitoring unit analyzes the image changes of the infrared images. The process is as follows:

[0046] A1: The infrared monitoring unit obtains infrared images and treats each frame of the infrared image as a picture to obtain the temperature of the pixels in the picture;

[0047] A2: Continuously monitor the temperature of a pixel at the same location. If the temperature fluctuation of a pixel at the same location exceeds a preset threshold between two consecutive frames, the pixel is recorded as a changing pixel. If the temperature fluctuation of a pixel at the same location does not exceed the preset threshold between two consecutive frames, the pixel is recorded as a stationary pixel.

[0048] A3: The infrared monitoring unit counts the proportion of changed pixels among all pixels. When the proportion of changed pixels is greater than a preset ratio, step A4 is performed. When the proportion of changed pixels is less than or equal to the preset ratio, a still image signal is generated and the change analysis ends.

[0049] A4: The infrared monitoring unit performs a discrete analysis on the distribution of the changing pixels in the image to obtain a discrete eigenvalue. If the discrete eigenvalue is greater than a preset threshold, a discrete signal is generated. If the discrete eigenvalue is less than the preset threshold, an infrared warning signal is generated.

[0050] The infrared monitoring unit sends the infrared warning signal to the regional picture monitoring unit.

[0051] The process of discrete analysis by the camera monitoring unit and the infrared monitoring unit is as follows:

[0052] A set of changing pixels is selected as the starting point, and the shortest path passing through all the changing pixels is found through the path calculation algorithm. The proportion of static pixels passed by the shortest path in the total number of pixels is calculated and recorded as a discrete eigenvalue.

[0053] Example 2:

[0054] See also Figure 1 - Figure 2 As shown, after the regional screen monitoring unit simultaneously obtains the infrared warning signal and the image warning signal, the infrared monitoring unit obtains the screen when the infrared warning signal is generated, and records it as the infrared warning screen; the camera monitoring unit obtains the screen when the image warning signal is generated, and records it as the image warning screen; and compares the infrared warning screen with the image warning screen. If the positional overlap of the changed pixel points in the infrared warning screen and the image warning screen is greater than or equal to the preset overlap value, a screen change alarm is generated; if the positional overlap of the changed pixel points in the infrared warning screen and the image warning screen is less than the preset overlap value, a screen suspected alarm signal is generated;

[0055] After acquiring only the infrared warning signal, the regional image monitoring unit generates an image suspected alarm signal;

[0056] The regional image monitoring unit does not respond when it only obtains the image warning signal;

[0057] After generating the screen change alarm, the regional screen monitoring unit sends the screen change alarm to the screen alarm unit. The screen alarm unit uploads the screen change alarm through the network, issues an audible and visual alarm through the display device, and saves the infrared warning screen and the image warning screen at the same time.

[0058] Example 3:

[0059] See also Figure 1 - Figure 2 As shown, the regional image monitoring unit sends the image change alarm and image brightness to the low-light control unit, which performs a threshold analysis on the image brightness. If the image brightness reaches the set threshold, it does not react. If the image brightness does not reach the set threshold, it generates a fill light signal to control the fill light source to work and linearly increase the brightness of the fill light source until the acquired image brightness reaches the set threshold. After the image change alarm disappears, the fill light source is controlled to be delayed and turned off.

[0060] The regional picture monitoring unit sends the picture suspected alarm signal and picture brightness to the low-light control unit, which performs a threshold analysis on the picture brightness. If the picture brightness reaches the set threshold, the picture suspected alarm signal is canceled. If the picture brightness does not reach the set threshold, a fill light signal is generated. After linearly increasing the brightness of the fill light source so that the picture brightness reaches the set threshold, if a picture change alarm is generated and sent to the picture alarm generation unit, the low-light control unit controls the fill light source to continue working until the picture change alarm disappears and then delays shutting down. If a picture suspected alarm signal is still generated, the picture suspected alarm signal is canceled.

[0061] The preferred embodiments of the present invention disclosed above are intended only to help illustrate the present invention. These preferred embodiments do not exhaustively describe all details, nor do they limit the present invention to specific embodiments. Obviously, many modifications and variations are possible based on the contents of this specification. These embodiments are selected and described in detail in this specification to better explain the principles and practical applications of the present invention, thereby enabling those skilled in the art to better understand and utilize the present invention. The present invention is limited only by the claims and their full scope and equivalents.

Claims

1. A picture safety monitoring and early warning system for night vision observation equipment, characterized in that: It includes a camera monitoring unit, which is used to collect images, obtain low-light images and image brightness, and perform change analysis on the low-light images to generate image warning signals; An infrared monitoring unit collects images through an infrared camera, obtains infrared images, performs change analysis on the infrared images, and generates infrared warning signals; An area image monitoring unit, which obtains an infrared warning image and an image warning image, compares and analyzes the infrared warning image and the image warning image, and generates an image change alarm or a suspected image alarm signal; A low-light control unit, which obtains a picture change alarm or a suspected picture alarm signal through the regional picture monitoring unit and controls the fill light source; A picture alarm generating unit, which obtains a picture change alarm through the regional picture monitoring unit, uploads the picture change alarm, and stores the picture; The regional screen monitoring unit records the screen when the infrared monitoring unit generates the infrared warning signal as the infrared warning screen, and records the screen when the camera monitoring unit generates the image warning signal as the image warning screen. If the positional overlap of the changed pixel points in the infrared warning screen and the image warning screen is greater than or equal to a preset overlap value, a screen change alarm is generated; if the positional overlap of the changed pixel points in the infrared warning screen and the image warning screen is less than the preset overlap value, a screen suspected alarm signal is generated; The regional image monitoring unit generates an image suspected alarm signal after acquiring only the infrared warning signal; The regional image monitoring unit does not respond when only receiving the image warning signal; After receiving the picture change alarm, the low light control unit performs a threshold analysis on the picture brightness. If the picture brightness reaches the set threshold, no response is made. If the picture brightness does not reach the set threshold, a fill light signal is generated to control the brightness of the fill light source to increase linearly until the obtained picture brightness reaches the set threshold. After the low-light control unit obtains the suspected alarm signal of the screen, it performs a threshold analysis on the screen brightness. If the screen brightness reaches the set threshold, the suspected alarm signal of the screen is cancelled. If the screen brightness does not reach the set threshold, the brightness of the fill light source is linearly increased so that the screen brightness reaches the set threshold. If a screen change alarm is generated, it is sent to the screen alarm generation unit. If a suspected alarm signal of the screen is still generated, the suspected alarm signal of the screen is cancelled.

2. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: The camera monitoring unit collects camera data through a camera callback function, converts the collected camera data into RGB format, and performs algorithm extraction on the RGB format to obtain brightness parameters, which are recorded as picture brightness.

3. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: The process of analyzing the changes in the low-light image by the camera monitoring unit is as follows: S1: The camera monitoring unit overlaps two adjacent frames and compares the overlapped pixels. If the color and saturation of the pixels at the same position are the same, they are recorded as static pixels. If any of the color and saturation of the pixels at the same position are different, they are recorded as changing pixels. S2: The camera monitoring unit counts all changed pixels and calculates the proportion of changed pixels in all pixels. If the proportion of changed pixels is less than a preset proportion, a no-change signal is generated and the change analysis ends. If the proportion of changed pixels is greater than or equal to the preset proportion, step S3 is performed. S3: The camera monitoring unit performs a discrete analysis on the distribution position of the changed pixel points in the picture to obtain the discrete characteristic value of the changed pixel points, and compares the discrete characteristic value with the preset characteristic threshold. If the discrete characteristic value is less than the preset threshold, an image warning signal is generated.

4. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: The process of the infrared monitoring unit performing image change analysis on the infrared image is as follows: A1: The infrared monitoring unit treats each frame of the infrared image as a picture and obtains the temperature of the pixels in the picture; A2: Continuously monitor the temperature of a pixel at the same location. If the temperature fluctuation of a pixel at the same location exceeds a preset threshold between two consecutive frames, the pixel is recorded as a changing pixel. If the temperature fluctuation of a pixel at the same location does not exceed the preset threshold between two consecutive frames, the pixel is recorded as a stationary pixel. A3: The infrared monitoring unit counts the proportion of changed pixels among all pixels. When the proportion of changed pixels is greater than a preset ratio, step A4 is performed. When the proportion of changed pixels is less than or equal to the preset ratio, a still image signal is generated and the change analysis ends. A4: The infrared monitoring unit performs a discrete analysis on the distribution of the changing pixels in the image to obtain a discrete eigenvalue. If the discrete eigenvalue is less than a preset threshold, an infrared warning signal is generated.

5. The image safety monitoring and early warning system for night vision observation equipment according to claim 1, characterized in that: The camera monitoring unit sends the picture brightness and image warning signal to the regional picture monitoring unit, and the infrared monitoring unit sends the infrared warning signal to the regional picture monitoring unit.

6. The image safety monitoring and early warning system for night vision observation equipment according to claim 3 or 4, characterized in that: The process of discrete analysis performed by the infrared monitoring unit or the camera monitoring unit is as follows: A set of changing pixels is selected as the starting point, and the shortest path passing through all the changing pixels is found through the path calculation algorithm. The proportion of static pixels passed by the shortest path in the total number of pixels is calculated and recorded as a discrete eigenvalue.

Images